Jul 15 14:33:36.371537 ip-10-0-140-61 systemd[1]: Starting Kubernetes Kubelet...
Jul 15 14:33:36.766004 ip-10-0-140-61 kubenswrapper[2571]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 14:33:36.766004 ip-10-0-140-61 kubenswrapper[2571]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 15 14:33:36.766004 ip-10-0-140-61 kubenswrapper[2571]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 14:33:36.766004 ip-10-0-140-61 kubenswrapper[2571]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 15 14:33:36.766004 ip-10-0-140-61 kubenswrapper[2571]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 14:33:36.766004 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:36.745528    2571 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 15 14:33:36.766004 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752286    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 14:33:36.766004 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752299    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 14:33:36.766004 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752303    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 14:33:36.766004 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752307    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 14:33:36.766004 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752313    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 14:33:36.766004 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752316    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 14:33:36.766004 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752318    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 14:33:36.766004 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752322    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 14:33:36.778237 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752327    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 14:33:36.778237 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752330    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 14:33:36.778237 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752341    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 14:33:36.778237 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752344    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 14:33:36.778237 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752348    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 14:33:36.778237 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752353    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 14:33:36.778237 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752356    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 14:33:36.778237 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752359    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 14:33:36.778237 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752364    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 14:33:36.778237 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752367    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 14:33:36.778237 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752372    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 14:33:36.778237 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752375    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 14:33:36.778237 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752378    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 14:33:36.778237 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752381    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 14:33:36.778237 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752384    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 14:33:36.778237 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752387    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 14:33:36.778237 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752390    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 14:33:36.778237 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752393    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 14:33:36.778237 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752396    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 14:33:36.779225 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752401    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 14:33:36.779225 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752406    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 14:33:36.779225 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752409    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 14:33:36.779225 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752413    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 14:33:36.779225 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752416    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 14:33:36.779225 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752419    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 14:33:36.779225 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752422    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 14:33:36.779225 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752424    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 14:33:36.779225 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752427    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 14:33:36.779225 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752430    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 14:33:36.779225 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752433    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 14:33:36.779225 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752435    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 14:33:36.779225 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752438    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 14:33:36.779225 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752443    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 14:33:36.779225 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752445    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 14:33:36.779225 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752448    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 14:33:36.779225 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752456    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 14:33:36.779225 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752460    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 14:33:36.779225 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752463    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 14:33:36.779225 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752465    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 14:33:36.780216 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752468    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 14:33:36.780216 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752473    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 14:33:36.780216 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752477    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 14:33:36.780216 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752479    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 14:33:36.780216 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752483    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 14:33:36.780216 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752491    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 14:33:36.780216 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752494    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 14:33:36.780216 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752496    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 14:33:36.780216 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752499    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 14:33:36.780216 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752502    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 14:33:36.780216 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752505    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 14:33:36.780216 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752507    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 14:33:36.780216 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752510    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 14:33:36.780216 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752513    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 14:33:36.780216 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752516    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 14:33:36.780216 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752518    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 14:33:36.780216 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752521    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 14:33:36.780216 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752524    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 14:33:36.780216 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752529    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 14:33:36.780216 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752531    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 14:33:36.781198 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752534    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 14:33:36.781198 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752536    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 14:33:36.781198 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752539    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 14:33:36.781198 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752542    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 14:33:36.781198 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752545    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 14:33:36.781198 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752548    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 14:33:36.781198 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752550    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 14:33:36.781198 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752553    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 14:33:36.781198 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752556    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 14:33:36.781198 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752565    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 14:33:36.781198 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752572    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 14:33:36.781198 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752575    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 14:33:36.781198 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752578    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 14:33:36.781198 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752581    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 14:33:36.781198 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752584    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 14:33:36.781198 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752586    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 14:33:36.781198 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752589    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 14:33:36.781198 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752592    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 14:33:36.781198 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752595    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 14:33:36.782187 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752597    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 14:33:36.782187 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752600    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 14:33:36.782187 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752602    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 14:33:36.782187 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752605    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 14:33:36.782187 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752610    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 14:33:36.782187 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752613    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 14:33:36.782187 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752615    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 14:33:36.782187 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752618    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 14:33:36.782187 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752620    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 14:33:36.782187 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752623    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 14:33:36.782187 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752626    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 14:33:36.782187 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752628    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 14:33:36.782187 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:36.752631    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 14:33:37.728233 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695648    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 14:33:37.728233 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695669    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 14:33:37.728233 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695674    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 14:33:37.728233 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695677    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 14:33:37.728233 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695684    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 14:33:37.728233 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695688    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 14:33:37.728233 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695692    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 14:33:37.728233 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695696    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 14:33:37.728233 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695699    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 14:33:37.728233 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695702    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 14:33:37.728233 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695706    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 14:33:37.728233 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695709    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 14:33:37.728233 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695713    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 14:33:37.728233 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695716    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 14:33:37.728233 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695722    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 14:33:37.728233 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695725    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 14:33:37.728233 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695728    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 14:33:37.728233 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695733    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 14:33:37.729781 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695739    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 14:33:37.729781 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695744    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 14:33:37.729781 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695748    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 14:33:37.729781 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695751    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 14:33:37.729781 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695755    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 14:33:37.729781 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695762    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 14:33:37.729781 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695767    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 14:33:37.729781 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695772    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 14:33:37.729781 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695775    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 14:33:37.729781 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695781    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 14:33:37.729781 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695784    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 14:33:37.729781 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695790    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 14:33:37.729781 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695794    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 14:33:37.729781 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695800    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 14:33:37.729781 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695803    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 14:33:37.729781 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695808    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 14:33:37.729781 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695811    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 14:33:37.729781 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695814    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 14:33:37.729781 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695818    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 14:33:37.730489 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695824    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 14:33:37.730489 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695827    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 14:33:37.730489 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695829    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 14:33:37.730489 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695834    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 14:33:37.730489 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695837    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 14:33:37.730489 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695842    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 14:33:37.730489 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695845    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 14:33:37.730489 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695848    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 14:33:37.730489 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695852    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 14:33:37.730489 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695855    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 14:33:37.730489 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695857    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 14:33:37.730489 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695860    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 14:33:37.730489 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695863    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 14:33:37.730489 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695866    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 14:33:37.730489 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695868    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 14:33:37.730489 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695871    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 14:33:37.730489 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695874    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 14:33:37.730489 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695879    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 14:33:37.730489 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695882    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 14:33:37.730489 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695886    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 14:33:37.731448 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695891    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 14:33:37.731448 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695894    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 14:33:37.731448 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695899    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 14:33:37.731448 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695906    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 14:33:37.731448 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695909    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 14:33:37.731448 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695912    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 14:33:37.731448 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695915    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 14:33:37.731448 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695925    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 14:33:37.731448 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695928    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 14:33:37.731448 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695931    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 14:33:37.731448 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695933    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 14:33:37.731448 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695936    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 14:33:37.731448 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695939    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 14:33:37.731448 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695942    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 14:33:37.731448 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695944    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 14:33:37.731448 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695947    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 14:33:37.731448 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695950    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 14:33:37.731448 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695953    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 14:33:37.731448 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695957    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 14:33:37.731448 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695961    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 14:33:37.732057 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695964    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 14:33:37.732057 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695967    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 14:33:37.732057 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695970    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 14:33:37.732057 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695972    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 14:33:37.732057 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695975    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 14:33:37.732057 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695978    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 14:33:37.732057 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695981    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 14:33:37.732057 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695985    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 14:33:37.732057 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695988    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 14:33:37.732057 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695991    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 14:33:37.732057 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695994    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 14:33:37.732057 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.695997    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 14:33:37.732057 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696000    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 14:33:37.732057 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696002    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 14:33:37.732057 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696005    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 14:33:37.732057 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696008    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 14:33:37.732057 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696011    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 14:33:37.732057 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696014    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 14:33:37.732057 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696016    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 14:33:37.732057 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696019    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 14:33:37.732642 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696023    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 14:33:37.732642 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696026    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 14:33:37.732642 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696504    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 14:33:37.732642 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696511    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 14:33:37.732642 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696514    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 14:33:37.732642 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696516    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 14:33:37.732642 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696519    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 14:33:37.732642 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696522    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 14:33:37.732642 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696527    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 14:33:37.732642 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696531    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 14:33:37.732642 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696535    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 14:33:37.732642 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696538    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 14:33:37.732642 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696541    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 14:33:37.732642 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696544    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 14:33:37.732642 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696548    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 14:33:37.732642 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696550    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 14:33:37.732642 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696553    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 14:33:37.732642 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696556    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 14:33:37.732642 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696559    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 14:33:37.733213 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696562    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 14:33:37.733213 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696565    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 14:33:37.733213 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696567    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 14:33:37.733213 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696570    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 14:33:37.733213 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696573    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 14:33:37.733213 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696575    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 14:33:37.733213 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696578    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 14:33:37.733213 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696581    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 14:33:37.733213 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696583    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 14:33:37.733213 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696586    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 14:33:37.733213 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696589    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 14:33:37.733213 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696592    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 14:33:37.733213 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696594    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 14:33:37.733213 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696598    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 14:33:37.733213 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696601    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 14:33:37.733213 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696603    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 14:33:37.733213 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696606    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 14:33:37.733213 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696609    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 14:33:37.733213 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696611    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 14:33:37.733213 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696614    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 14:33:37.733852 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696617    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 14:33:37.733852 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696620    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 14:33:37.733852 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696623    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 14:33:37.733852 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696626    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 14:33:37.733852 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696629    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 14:33:37.733852 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696631    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 14:33:37.733852 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696634    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 14:33:37.733852 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696637    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 14:33:37.733852 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696640    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 14:33:37.733852 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696642    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 14:33:37.733852 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696645    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 14:33:37.733852 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696648    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 14:33:37.733852 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696650    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 14:33:37.733852 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696653    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 14:33:37.733852 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696656    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 14:33:37.733852 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696659    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 14:33:37.733852 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696662    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 14:33:37.733852 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696664    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 14:33:37.733852 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696667    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 14:33:37.733852 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696669    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 14:33:37.734469 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696672    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 14:33:37.734469 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696675    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 14:33:37.734469 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696677    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 14:33:37.734469 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696680    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 14:33:37.734469 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696683    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 14:33:37.734469 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696685    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 14:33:37.734469 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696688    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 14:33:37.734469 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696691    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 14:33:37.734469 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696694    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 14:33:37.734469 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696697    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 14:33:37.734469 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696700    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 14:33:37.734469 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696702    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 14:33:37.734469 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696705    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 14:33:37.734469 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696708    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 14:33:37.734469 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696710    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 14:33:37.734469 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696713    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 14:33:37.734469 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696715    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 14:33:37.734469 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696718    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 14:33:37.734469 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696721    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 14:33:37.734469 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696724    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 14:33:37.735358 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696727    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 14:33:37.735358 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696732    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 14:33:37.735358 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696735    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 14:33:37.735358 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696737    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 14:33:37.735358 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696740    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 14:33:37.735358 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696742    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 14:33:37.735358 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696745    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 14:33:37.735358 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696748    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 14:33:37.735358 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696750    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 14:33:37.735358 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696755    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 14:33:37.735358 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696759    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 14:33:37.735358 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696762    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 14:33:37.735358 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696765    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 14:33:37.735358 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696769    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 14:33:37.735358 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696773    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 14:33:37.735358 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696776    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 14:33:37.735358 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696779    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 14:33:37.735358 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696782    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 14:33:37.735358 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696785    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 14:33:37.736234 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696789    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 14:33:37.736234 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696792    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 14:33:37.736234 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.696795    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 14:33:37.736234 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.696915    2571 flags.go:64] FLAG: --address="0.0.0.0"
Jul 15 14:33:37.736234 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.696933    2571 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 15 14:33:37.736234 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.696941    2571 flags.go:64] FLAG: --anonymous-auth="true"
Jul 15 14:33:37.736234 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.696946    2571 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 15 14:33:37.736234 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.696951    2571 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 15 14:33:37.736234 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.696955    2571 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 15 14:33:37.736234 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.696959    2571 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 15 14:33:37.736234 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.696965    2571 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 15 14:33:37.736234 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.696968    2571 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 15 14:33:37.736234 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.696972    2571 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 15 14:33:37.736234 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.696975    2571 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 15 14:33:37.736234 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.696979    2571 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 15 14:33:37.736234 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.696982    2571 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 15 14:33:37.736234 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.696985    2571 flags.go:64] FLAG: --cgroup-root=""
Jul 15 14:33:37.736234 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.696989    2571 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 15 14:33:37.736234 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.696992    2571 flags.go:64] FLAG: --client-ca-file=""
Jul 15 14:33:37.736234 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.696995    2571 flags.go:64] FLAG: --cloud-provider="external"
Jul 15 14:33:37.736234 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.696998    2571 flags.go:64] FLAG: --cluster-dns="[]"
Jul 15 14:33:37.736234 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697004    2571 flags.go:64] FLAG: --cluster-domain=""
Jul 15 14:33:37.736234 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697007    2571 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 15 14:33:37.737288 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697011    2571 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 15 14:33:37.737288 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697014    2571 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 15 14:33:37.737288 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697018    2571 flags.go:64] FLAG: --container-log-max-files="5"
Jul 15 14:33:37.737288 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697022    2571 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 15 14:33:37.737288 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697025    2571 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 15 14:33:37.737288 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697029    2571 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 15 14:33:37.737288 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697032    2571 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 15 14:33:37.737288 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697036    2571 flags.go:64] FLAG: --contention-profiling="false"
Jul 15 14:33:37.737288 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697039    2571 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 15 14:33:37.737288 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697043    2571 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 15 14:33:37.737288 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697048    2571 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 15 14:33:37.737288 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697051    2571 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 15 14:33:37.737288 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697056    2571 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 15 14:33:37.737288 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697060    2571 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 15 14:33:37.737288 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697063    2571 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 15 14:33:37.737288 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697066    2571 flags.go:64] FLAG: --enable-load-reader="false"
Jul 15 14:33:37.737288 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697069    2571 flags.go:64] FLAG: --enable-server="true"
Jul 15 14:33:37.737288 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697073    2571 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 15 14:33:37.737288 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697078    2571 flags.go:64] FLAG: --event-burst="100"
Jul 15 14:33:37.737288 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697081    2571 flags.go:64] FLAG: --event-qps="50"
Jul 15 14:33:37.737288 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697084    2571 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 15 14:33:37.737288 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697087    2571 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 15 14:33:37.737288 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697091    2571 flags.go:64] FLAG: --eviction-hard=""
Jul 15 14:33:37.737288 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697095    2571 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 15 14:33:37.738594 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697099    2571 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 15 14:33:37.738594 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697102    2571 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 15 14:33:37.738594 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697105    2571 flags.go:64] FLAG: --eviction-soft=""
Jul 15 14:33:37.738594 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697109    2571 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 15 14:33:37.738594 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697112    2571 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 15 14:33:37.738594 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697115    2571 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 15 14:33:37.738594 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697118    2571 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 15 14:33:37.738594 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697121    2571 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 15 14:33:37.738594 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697124    2571 flags.go:64] FLAG: --fail-swap-on="true"
Jul 15 14:33:37.738594 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697127    2571 flags.go:64] FLAG: --feature-gates=""
Jul 15 14:33:37.738594 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697131    2571 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 15 14:33:37.738594 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697135    2571 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 15 14:33:37.738594 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697138    2571 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 15 14:33:37.738594 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697142    2571 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 15 14:33:37.738594 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697146    2571 flags.go:64] FLAG: --healthz-port="10248"
Jul 15 14:33:37.738594 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697149    2571 flags.go:64] FLAG: --help="false"
Jul 15 14:33:37.738594 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697152    2571 flags.go:64] FLAG: --hostname-override="ip-10-0-140-61.ec2.internal"
Jul 15 14:33:37.738594 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697156    2571 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 15 14:33:37.738594 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697159    2571 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 15 14:33:37.738594 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697163    2571 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 15 14:33:37.738594 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697168    2571 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 15 14:33:37.738594 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697172    2571 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 15 14:33:37.738594 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697175    2571 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 15 14:33:37.738594 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697178    2571 flags.go:64] FLAG: --image-service-endpoint=""
Jul 15 14:33:37.739695 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697181    2571 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 15 14:33:37.739695 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697184    2571 flags.go:64] FLAG: --kube-api-burst="100"
Jul 15 14:33:37.739695 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697188    2571 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 15 14:33:37.739695 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697191    2571 flags.go:64] FLAG: --kube-api-qps="50"
Jul 15 14:33:37.739695 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697194    2571 flags.go:64] FLAG: --kube-reserved=""
Jul 15 14:33:37.739695 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697197    2571 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 15 14:33:37.739695 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697200    2571 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 15 14:33:37.739695 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697204    2571 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 15 14:33:37.739695 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697207    2571 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 15 14:33:37.739695 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697210    2571 flags.go:64] FLAG: --lock-file=""
Jul 15 14:33:37.739695 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697213    2571 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 15 14:33:37.739695 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697216    2571 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 15 14:33:37.739695 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697219    2571 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 15 14:33:37.739695 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697225    2571 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 15 14:33:37.739695 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697229    2571 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 15 14:33:37.739695 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697232    2571 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 15 14:33:37.739695 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697235    2571 flags.go:64] FLAG: --logging-format="text"
Jul 15 14:33:37.739695 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697238    2571 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 15 14:33:37.739695 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697241    2571 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 15 14:33:37.739695 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697244    2571 flags.go:64] FLAG: --manifest-url=""
Jul 15 14:33:37.739695 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697247    2571 flags.go:64] FLAG: --manifest-url-header=""
Jul 15 14:33:37.739695 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697253    2571 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 15 14:33:37.739695 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697256    2571 flags.go:64] FLAG: --max-open-files="1000000"
Jul 15 14:33:37.739695 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697260    2571 flags.go:64] FLAG: --max-pods="110"
Jul 15 14:33:37.739695 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697264    2571 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 15 14:33:37.740902 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697267    2571 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 15 14:33:37.740902 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697270    2571 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 15 14:33:37.740902 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697273    2571 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 15 14:33:37.740902 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697277    2571 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 15 14:33:37.740902 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697281    2571 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 15 14:33:37.740902 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697284    2571 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 15 14:33:37.740902 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697297    2571 flags.go:64] FLAG: --node-status-max-images="50"
Jul 15 14:33:37.740902 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697316    2571 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 15 14:33:37.740902 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697320    2571 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 15 14:33:37.740902 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697323    2571 flags.go:64] FLAG: --pod-cidr=""
Jul 15 14:33:37.740902 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697326    2571 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 15 14:33:37.740902 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697332    2571 flags.go:64] FLAG: --pod-manifest-path=""
Jul 15 14:33:37.740902 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697335    2571 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 15 14:33:37.740902 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697339    2571 flags.go:64] FLAG: --pods-per-core="0"
Jul 15 14:33:37.740902 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697342    2571 flags.go:64] FLAG: --port="10250"
Jul 15 14:33:37.740902 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697348    2571 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 15 14:33:37.740902 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697354    2571 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0696ef6b097d1a794"
Jul 15 14:33:37.740902 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697360    2571 flags.go:64] FLAG: --qos-reserved=""
Jul 15 14:33:37.740902 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697364    2571 flags.go:64] FLAG: --read-only-port="10255"
Jul 15 14:33:37.740902 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697367    2571 flags.go:64] FLAG: --register-node="true"
Jul 15 14:33:37.740902 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697370    2571 flags.go:64] FLAG: --register-with-taints=""
Jul 15 14:33:37.740902 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697374    2571 flags.go:64] FLAG: --registry-burst="10"
Jul 15 14:33:37.740902 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697377    2571 flags.go:64] FLAG: --registry-qps="5"
Jul 15 14:33:37.740902 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697381    2571 flags.go:64] FLAG: --reserved-cpus=""
Jul 15 14:33:37.742797 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697384    2571 flags.go:64] FLAG: --reserved-memory=""
Jul 15 14:33:37.742797 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697388    2571 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 15 14:33:37.742797 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697392    2571 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 15 14:33:37.742797 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697395    2571 flags.go:64] FLAG: --rotate-certificates="false"
Jul 15 14:33:37.742797 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697399    2571 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 15 14:33:37.742797 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697402    2571 flags.go:64] FLAG: --runonce="false"
Jul 15 14:33:37.742797 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697405    2571 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 15 14:33:37.742797 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697409    2571 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 15 14:33:37.742797 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697412    2571 flags.go:64] FLAG: --seccomp-default="false"
Jul 15 14:33:37.742797 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697415    2571 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 15 14:33:37.742797 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697418    2571 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 15 14:33:37.742797 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697421    2571 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 15 14:33:37.742797 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697425    2571 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 15 14:33:37.742797 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697429    2571 flags.go:64] FLAG: --storage-driver-password="root"
Jul 15 14:33:37.742797 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697432    2571 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 15 14:33:37.742797 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697437    2571 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 15 14:33:37.742797 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697440    2571 flags.go:64] FLAG: --storage-driver-user="root"
Jul 15 14:33:37.742797 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697443    2571 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 15 14:33:37.742797 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697446    2571 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 15 14:33:37.742797 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697449    2571 flags.go:64] FLAG: --system-cgroups=""
Jul 15 14:33:37.742797 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697452    2571 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 15 14:33:37.742797 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697458    2571 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 15 14:33:37.742797 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697461    2571 flags.go:64] FLAG: --tls-cert-file=""
Jul 15 14:33:37.742797 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697464    2571 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 15 14:33:37.742797 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697469    2571 flags.go:64] FLAG: --tls-min-version=""
Jul 15 14:33:37.743713 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697472    2571 flags.go:64] FLAG: --tls-private-key-file=""
Jul 15 14:33:37.743713 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697475    2571 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 15 14:33:37.743713 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697479    2571 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 15 14:33:37.743713 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697482    2571 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 15 14:33:37.743713 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697485    2571 flags.go:64] FLAG: --v="2"
Jul 15 14:33:37.743713 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697490    2571 flags.go:64] FLAG: --version="false"
Jul 15 14:33:37.743713 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697494    2571 flags.go:64] FLAG: --vmodule=""
Jul 15 14:33:37.743713 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697498    2571 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 15 14:33:37.743713 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.697502    2571 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 15 14:33:37.743713 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697657    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 14:33:37.743713 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697662    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 14:33:37.743713 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697666    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 14:33:37.743713 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697668    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 14:33:37.743713 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697671    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 14:33:37.743713 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697674    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 14:33:37.743713 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697677    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 14:33:37.743713 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697680    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 14:33:37.743713 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697683    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 14:33:37.743713 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697685    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 14:33:37.743713 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697688    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 14:33:37.743713 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697693    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 14:33:37.743713 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697696    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 14:33:37.744850 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697701    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 14:33:37.744850 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697704    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 14:33:37.744850 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697707    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 14:33:37.744850 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697710    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 14:33:37.744850 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697713    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 14:33:37.744850 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697717    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 14:33:37.744850 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697719    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 14:33:37.744850 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697722    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 14:33:37.744850 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697724    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 14:33:37.744850 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697727    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 14:33:37.744850 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697730    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 14:33:37.744850 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697733    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 14:33:37.744850 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697736    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 14:33:37.744850 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697738    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 14:33:37.744850 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697741    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 14:33:37.744850 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697744    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 14:33:37.744850 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697747    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 14:33:37.744850 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697750    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 14:33:37.744850 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697753    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 14:33:37.744850 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697755    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 14:33:37.745513 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697758    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 14:33:37.745513 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697763    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 14:33:37.745513 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697767    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 14:33:37.745513 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697770    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 14:33:37.745513 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697773    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 14:33:37.745513 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697776    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 14:33:37.745513 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697779    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 14:33:37.745513 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697782    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 14:33:37.745513 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697785    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 14:33:37.745513 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697788    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 14:33:37.745513 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697791    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 14:33:37.745513 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697798    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 14:33:37.745513 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697803    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 14:33:37.745513 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697805    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 14:33:37.745513 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697808    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 14:33:37.745513 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697811    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 14:33:37.745513 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697813    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 14:33:37.745513 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697816    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 14:33:37.745513 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697819    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 14:33:37.746177 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697822    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 14:33:37.746177 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697824    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 14:33:37.746177 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697827    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 14:33:37.746177 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697830    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 14:33:37.746177 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697833    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 14:33:37.746177 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697835    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 14:33:37.746177 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697838    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 14:33:37.746177 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697841    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 14:33:37.746177 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697844    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 14:33:37.746177 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697847    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 14:33:37.746177 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697850    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 14:33:37.746177 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697853    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 14:33:37.746177 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697855    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 14:33:37.746177 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697860    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 14:33:37.746177 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697863    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 14:33:37.746177 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697866    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 14:33:37.746177 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697869    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 14:33:37.746177 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697872    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 14:33:37.746177 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697875    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 14:33:37.746177 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697878    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 14:33:37.746848 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697881    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 14:33:37.746848 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697884    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 14:33:37.746848 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697887    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 14:33:37.746848 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697890    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 14:33:37.746848 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697894    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 14:33:37.746848 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697899    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 14:33:37.746848 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697904    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 14:33:37.746848 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697907    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 14:33:37.746848 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697910    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 14:33:37.746848 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697913    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 14:33:37.746848 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697915    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 14:33:37.746848 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697918    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 14:33:37.746848 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697921    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 14:33:37.746848 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697924    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 14:33:37.746848 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697926    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 14:33:37.746848 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697929    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 14:33:37.746848 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697932    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 14:33:37.746848 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697934    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 14:33:37.746848 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697937    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 14:33:37.747402 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697939    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 14:33:37.747402 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697942    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 14:33:37.747402 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697945    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 14:33:37.747402 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697947    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 14:33:37.747402 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697950    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 14:33:37.747402 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697953    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 14:33:37.747402 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697956    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 14:33:37.747402 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.697958    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 14:33:37.747402 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.698591    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 14:33:37.747402 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.706088    2571 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 15 14:33:37.747402 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.706108    2571 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 15 14:33:37.747402 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.706129    2571 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 15 14:33:37.747402 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.706135    2571 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 15 14:33:37.747402 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706213    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 14:33:37.747846 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706220    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 14:33:37.747846 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706224    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 14:33:37.747846 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706228    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 14:33:37.747846 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706232    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 14:33:37.747846 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706236    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 14:33:37.747846 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706239    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 14:33:37.747846 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706243    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 14:33:37.747846 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706245    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 14:33:37.747846 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706248    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 14:33:37.747846 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706251    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 14:33:37.747846 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706254    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 14:33:37.747846 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706257    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 14:33:37.747846 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706260    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 14:33:37.747846 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706263    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 14:33:37.747846 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706266    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 14:33:37.747846 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706269    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 14:33:37.747846 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706272    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 14:33:37.747846 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706276    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 14:33:37.747846 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706279    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 14:33:37.748453 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706282    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 14:33:37.748453 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706284    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 14:33:37.748453 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706287    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 14:33:37.748453 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706290    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 14:33:37.748453 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706292    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 14:33:37.748453 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706295    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 14:33:37.748453 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706298    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 14:33:37.748453 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706301    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 14:33:37.748453 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706304    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 14:33:37.748453 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706306    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 14:33:37.748453 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706309    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 14:33:37.748453 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706311    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 14:33:37.748453 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706314    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 14:33:37.748453 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706317    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 14:33:37.748453 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706319    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 14:33:37.748453 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706322    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 14:33:37.748453 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706324    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 14:33:37.748453 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706327    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 14:33:37.748453 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706330    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 14:33:37.748453 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706333    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 14:33:37.749035 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706338    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 14:33:37.749035 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706358    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 14:33:37.749035 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706362    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 14:33:37.749035 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706365    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 14:33:37.749035 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706369    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 14:33:37.749035 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706372    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 14:33:37.749035 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706375    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 14:33:37.749035 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706378    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 14:33:37.749035 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706381    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 14:33:37.749035 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706387    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 14:33:37.749035 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706392    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 14:33:37.749035 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706395    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 14:33:37.749035 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706398    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 14:33:37.749035 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706400    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 14:33:37.749035 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706403    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 14:33:37.749035 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706407    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 14:33:37.749035 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706409    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 14:33:37.749035 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706412    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 14:33:37.749035 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706415    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 14:33:37.749035 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706418    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 14:33:37.860161 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706420    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 14:33:37.860161 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706423    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 14:33:37.860161 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706426    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 14:33:37.860161 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706428    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 14:33:37.860161 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706431    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 14:33:37.860161 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706433    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 14:33:37.860161 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706436    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 14:33:37.860161 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706439    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 14:33:37.860161 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706442    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 14:33:37.860161 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706444    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 14:33:37.860161 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706447    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 14:33:37.860161 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706451    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 14:33:37.860161 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706453    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 14:33:37.860161 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706456    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 14:33:37.860161 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706459    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 14:33:37.860161 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706462    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 14:33:37.860161 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706464    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 14:33:37.860161 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706467    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 14:33:37.860161 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706469    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 14:33:37.860161 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706472    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 14:33:37.771525 ip-10-0-140-61 systemd[1]: Started Kubernetes Kubelet.
Jul 15 14:33:37.861822 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706475    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 14:33:37.861822 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706481    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 14:33:37.861822 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706486    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 14:33:37.861822 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706489    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 14:33:37.861822 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706492    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 14:33:37.861822 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706495    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 14:33:37.861822 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706497    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 14:33:37.861822 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706500    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 14:33:37.861822 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706502    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 14:33:37.861822 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706505    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 14:33:37.861822 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706508    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 14:33:37.861822 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706510    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 14:33:37.861822 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706513    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 14:33:37.861822 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706515    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 14:33:37.861822 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706518    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 14:33:37.861822 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706521    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 14:33:37.861822 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706524    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 14:33:37.861822 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706526    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 14:33:37.861822 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706529    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 14:33:37.862634 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.706534    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 14:33:37.862634 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706671    2571 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 14:33:37.862634 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706676    2571 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 14:33:37.862634 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706679    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 14:33:37.862634 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706681    2571 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 14:33:37.862634 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706685    2571 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 14:33:37.862634 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706687    2571 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 14:33:37.862634 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706690    2571 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 14:33:37.862634 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706692    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 14:33:37.862634 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706695    2571 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 14:33:37.862634 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706697    2571 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 14:33:37.862634 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706700    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 14:33:37.862634 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706703    2571 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 14:33:37.862634 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706707    2571 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 14:33:37.864323 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706710    2571 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 14:33:37.864323 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706716    2571 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 14:33:37.864323 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706719    2571 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 14:33:37.864323 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706723    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 14:33:37.864323 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706726    2571 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 14:33:37.864323 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706729    2571 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 14:33:37.864323 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706732    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 14:33:37.864323 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706735    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 14:33:37.864323 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706738    2571 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 14:33:37.864323 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706741    2571 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 14:33:37.864323 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706743    2571 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 14:33:37.864323 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706746    2571 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 14:33:37.864323 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706749    2571 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 14:33:37.864323 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706751    2571 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 14:33:37.864323 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706755    2571 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 14:33:37.864323 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706759    2571 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 14:33:37.864323 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706762    2571 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 14:33:37.864323 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706765    2571 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 14:33:37.864323 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706768    2571 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 14:33:37.864323 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706770    2571 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 14:33:37.865161 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706773    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 14:33:37.865161 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706776    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 14:33:37.865161 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706778    2571 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 14:33:37.865161 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706781    2571 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 14:33:37.865161 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706785    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 14:33:37.865161 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706787    2571 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 14:33:37.865161 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706790    2571 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 14:33:37.865161 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706792    2571 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 14:33:37.865161 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706795    2571 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 14:33:37.865161 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706797    2571 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 14:33:37.865161 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706800    2571 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 14:33:37.865161 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706802    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 14:33:37.865161 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706805    2571 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 14:33:37.865161 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706811    2571 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 14:33:37.865161 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706814    2571 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 14:33:37.865161 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706816    2571 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 14:33:37.865161 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706819    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 14:33:37.865161 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706821    2571 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 14:33:37.865161 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706824    2571 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 14:33:37.865161 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706827    2571 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 14:33:37.865998 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706829    2571 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 14:33:37.865998 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706832    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 14:33:37.865998 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706835    2571 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 14:33:37.865998 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706837    2571 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 14:33:37.865998 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706840    2571 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 14:33:37.865998 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706843    2571 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 14:33:37.865998 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706845    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 14:33:37.865998 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706848    2571 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 14:33:37.865998 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706851    2571 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 14:33:37.865998 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706853    2571 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 14:33:37.865998 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706856    2571 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 14:33:37.865998 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706858    2571 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 14:33:37.865998 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706861    2571 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 14:33:37.865998 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706863    2571 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 14:33:37.865998 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706866    2571 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 14:33:37.865998 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706868    2571 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 14:33:37.865998 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706871    2571 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 14:33:37.865998 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706874    2571 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 14:33:37.865998 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706877    2571 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 14:33:37.865998 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706879    2571 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 14:33:37.867296 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706882    2571 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 14:33:37.867296 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706885    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 14:33:37.867296 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706888    2571 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 14:33:37.867296 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706910    2571 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 14:33:37.867296 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706914    2571 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 14:33:37.867296 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706921    2571 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 14:33:37.867296 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706924    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 14:33:37.867296 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706927    2571 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 14:33:37.867296 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706930    2571 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 14:33:37.867296 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706932    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 14:33:37.867296 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706935    2571 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 14:33:37.867296 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706938    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 14:33:37.867296 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706941    2571 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 14:33:37.867296 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706944    2571 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 14:33:37.867296 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706946    2571 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 14:33:37.867296 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706950    2571 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 14:33:37.867296 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706952    2571 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 14:33:37.867296 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706955    2571 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 14:33:37.867296 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706957    2571 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 14:33:37.868141 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706960    2571 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 14:33:37.868141 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706963    2571 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 14:33:37.868141 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706966    2571 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 14:33:37.868141 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706969    2571 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 14:33:37.868141 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706971    2571 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 14:33:37.868141 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706974    2571 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 14:33:37.868141 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:37.706976    2571 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 14:33:37.868141 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.706981    2571 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 14:33:37.868141 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.707111    2571 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 15 14:33:37.868141 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.709563    2571 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 15 14:33:37.868141 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.711260    2571 server.go:1019] "Starting client certificate rotation"
Jul 15 14:33:37.868141 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.711361    2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 14:33:37.868141 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.711405    2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 14:33:37.868998 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.714098    2571 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 14:33:37.868998 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.715884    2571 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 14:33:37.868998 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.725918    2571 log.go:25] "Validated CRI v1 runtime API"
Jul 15 14:33:37.868998 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.727963    2571 log.go:25] "Validated CRI v1 image API"
Jul 15 14:33:37.868998 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.728855    2571 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 15 14:33:37.868998 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.735164    2571 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 879e390b-54e4-4dbc-bcc8-76d9b8709527:/dev/nvme0n1p3 f8fe31d0-62c1-42c1-862c-06fac55deae5:/dev/nvme0n1p4]
Jul 15 14:33:37.868998 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.735222    2571 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 15 14:33:37.870205 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.743931    2571 manager.go:216] Machine: {Timestamp:2026-07-15 14:33:37.742214476 +0000 UTC m=+1.258032364 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3199345 MemoryCapacity:33164505088 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2ddbb6644ec1e0a87c163d2703fff5 SystemUUID:ec2ddbb6-644e-c1e0-a87c-163d2703fff5 BootID:1a54e36f-7324-4ab8-aad1-6df21f1e682b Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582254592 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ed:b2:7d:30:27 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ed:b2:7d:30:27 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:a2:8c:6a:83:12:8d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164505088 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 15 14:33:37.870205 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.744097    2571 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 15 14:33:37.870205 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.744296    2571 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 15 14:33:37.870205 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.747095    2571 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 15 14:33:37.870205 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.747120    2571 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-61.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 15 14:33:37.870205 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.747804    2571 topology_manager.go:138] "Creating topology manager with none policy"
Jul 15 14:33:37.870205 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.747814    2571 container_manager_linux.go:309] "Creating device plugin manager"
Jul 15 14:33:37.870205 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.747823    2571 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 14:33:37.870205 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.748553    2571 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 14:33:37.870205 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.749792    2571 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 15 14:33:37.870205 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.759290    2571 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 14:33:37.870205 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.759449    2571 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 15 14:33:37.870205 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.759844    2571 kubelet.go:486] "Attempting to sync node with API server"
Jul 15 14:33:37.870205 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.759856    2571 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 15 14:33:37.870205 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.759867    2571 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 15 14:33:37.870205 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.759877    2571 kubelet.go:398] "Adding apiserver pod source"
Jul 15 14:33:37.870205 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.759886    2571 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 15 14:33:37.870205 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.760215    2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 14:33:37.871065 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.760230    2571 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 14:33:37.871065 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.762929    2571 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 15 14:33:37.871065 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.765031    2571 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 15 14:33:37.871065 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.765069    2571 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 15 14:33:37.871065 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.765248    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 15 14:33:37.871065 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.765263    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 15 14:33:37.871065 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.765272    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 15 14:33:37.871065 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.765281    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 15 14:33:37.871065 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.765292    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 15 14:33:37.871065 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.765301    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 15 14:33:37.871065 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.765806    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 15 14:33:37.871065 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.765815    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 15 14:33:37.871065 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.765833    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 15 14:33:37.871065 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.765842    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 15 14:33:37.871065 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.765859    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 15 14:33:37.871065 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.765872    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 15 14:33:37.871065 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.766766    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 15 14:33:37.871065 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.766776    2571 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 15 14:33:37.871065 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.770729    2571 server.go:1268] "Started kubelet"
Jul 15 14:33:37.871065 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.771227    2571 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 15 14:33:37.871065 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.772524    2571 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 15 14:33:37.871065 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.772618    2571 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 15 14:33:37.871065 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.772776    2571 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 14:33:37.871065 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.773715    2571 server.go:310] "Adding debug handlers to kubelet server"
Jul 15 14:33:37.871065 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.773715    2571 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 15 14:33:37.871065 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:37.778292    2571 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 15 14:33:37.871065 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.779457    2571 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 15 14:33:37.871065 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.779472    2571 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 15 14:33:37.871065 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:37.779587    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-61.ec2.internal\" not found"
Jul 15 14:33:37.871065 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.780130    2571 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 15 14:33:37.871065 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.780147    2571 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 15 14:33:37.871065 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.780441    2571 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 15 14:33:37.871065 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.780510    2571 reconstruct.go:97] "Volume reconstruction finished"
Jul 15 14:33:37.871065 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.780539    2571 reconciler.go:29] "Reconciler: start to sync state"
Jul 15 14:33:37.871065 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.781204    2571 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 15 14:33:37.871065 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.781220    2571 factory.go:55] Registering systemd factory
Jul 15 14:33:37.871065 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.781230    2571 factory.go:223] Registration of the systemd container factory successfully
Jul 15 14:33:37.871065 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.781514    2571 factory.go:153] Registering CRI-O factory
Jul 15 14:33:37.871065 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.781529    2571 factory.go:223] Registration of the crio container factory successfully
Jul 15 14:33:37.871065 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.781552    2571 factory.go:103] Registering Raw factory
Jul 15 14:33:37.871065 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.781574    2571 manager.go:1196] Started watching for new ooms in manager
Jul 15 14:33:37.871065 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.781952    2571 manager.go:349] Starting recovery of all containers
Jul 15 14:33:37.871065 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:37.784747    2571 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-61.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 15 14:33:37.871065 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:37.784768    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 15 14:33:37.871065 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:37.784820    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-61.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 15 14:33:37.873212 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.784875    2571 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-61.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 15 14:33:37.873212 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:37.784962    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 15 14:33:37.873212 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:37.784808    2571 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-61.ec2.internal.18c27d2913c148e2  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-61.ec2.internal,UID:ip-10-0-140-61.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-61.ec2.internal,},FirstTimestamp:2026-07-15 14:33:37.770703074 +0000 UTC m=+1.286520939,LastTimestamp:2026-07-15 14:33:37.770703074 +0000 UTC m=+1.286520939,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-61.ec2.internal,}"
Jul 15 14:33:37.873212 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.793000    2571 manager.go:354] Recovery completed
Jul 15 14:33:37.873212 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.797989    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 14:33:37.873212 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.802065    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-61.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 14:33:37.873212 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.802096    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-61.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 14:33:37.873212 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.802109    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-61.ec2.internal" event="NodeHasSufficientPID"
Jul 15 14:33:37.873212 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.803050    2571 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 15 14:33:37.873212 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.803055    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 14:33:37.873212 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.803062    2571 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 15 14:33:37.873212 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.803079    2571 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 14:33:37.873212 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.803885    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-61.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 14:33:37.873212 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.803913    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-61.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 14:33:37.873212 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.803929    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-61.ec2.internal" event="NodeHasSufficientPID"
Jul 15 14:33:37.873212 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.806403    2571 policy_none.go:49] "None policy: Start"
Jul 15 14:33:37.873212 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.806425    2571 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 15 14:33:37.873212 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:37.806443    2571 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 15 14:33:37.873212 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:37.806910    2571 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-61.ec2.internal.18c27d2915a00eb3  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-61.ec2.internal,UID:ip-10-0-140-61.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-61.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-61.ec2.internal,},FirstTimestamp:2026-07-15 14:33:37.802079923 +0000 UTC m=+1.317897790,LastTimestamp:2026-07-15 14:33:37.802079923 +0000 UTC m=+1.317897790,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-61.ec2.internal,}"
Jul 15 14:33:37.882065 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:37.880598    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-61.ec2.internal\" not found"
Jul 15 14:33:37.990001 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:37.981140    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-61.ec2.internal\" not found"
Jul 15 14:33:38.126966 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:38.081804    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-61.ec2.internal\" not found"
Jul 15 14:33:38.257363 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:38.182439    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-61.ec2.internal\" not found"
Jul 15 14:33:38.381043 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:38.283550    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-61.ec2.internal\" not found"
Jul 15 14:33:38.496056 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:38.384070    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-61.ec2.internal\" not found"
Jul 15 14:33:38.496056 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.438526    2571 policy_none.go:47] "Start"
Jul 15 14:33:38.496056 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:38.484834    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-61.ec2.internal\" not found"
Jul 15 14:33:38.574792 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.574760    2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7zj4l"
Jul 15 14:33:38.574792 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.574792    2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-7zj4l"
Jul 15 14:33:38.585623 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:38.585441    2571 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-61.ec2.internal\" not found"
Jul 15 14:33:38.590932 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:38.590910    2571 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-140-61.ec2.internal\" not found" node="ip-10-0-140-61.ec2.internal"
Jul 15 14:33:38.592928 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.592913    2571 manager.go:337] "Starting Device Plugin manager"
Jul 15 14:33:38.593003 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:38.592947    2571 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 15 14:33:38.593003 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.592956    2571 server.go:87] "Starting device plugin registration server"
Jul 15 14:33:38.593243 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.593226    2571 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 15 14:33:38.593366 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.593242    2571 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 15 14:33:38.593699 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.593606    2571 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 15 14:33:38.593776 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.593706    2571 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 15 14:33:38.593776 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.593715    2571 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 15 14:33:38.594171 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:38.594147    2571 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 15 14:33:38.594236 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:38.594211    2571 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-61.ec2.internal\" not found"
Jul 15 14:33:38.693572 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.693528    2571 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 14:33:38.694600 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.694580    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-61.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 14:33:38.694724 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.694618    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-61.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 14:33:38.694724 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.694632    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-61.ec2.internal" event="NodeHasSufficientPID"
Jul 15 14:33:38.694724 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.694667    2571 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-61.ec2.internal"
Jul 15 14:33:38.706636 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.706613    2571 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-61.ec2.internal"
Jul 15 14:33:38.706757 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:38.706640    2571 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-61.ec2.internal\": node \"ip-10-0-140-61.ec2.internal\" not found"
Jul 15 14:33:38.709936 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.709913    2571 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 15 14:33:38.710173 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:38.710084    2571 event.go:368] "Unable to write event (may retry after sleeping)" err="Patch \"https://a058d005d278144e4888c0f2b6a86b67-b51391bb34f85a13.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/default/events/ip-10-0-140-61.ec2.internal.18c27d2915a00eb3\": read tcp 10.0.140.61:38674->54.172.42.53:6443: use of closed network connection" event="&Event{ObjectMeta:{ip-10-0-140-61.ec2.internal.18c27d2915a00eb3  default   5830 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-61.ec2.internal,UID:ip-10-0-140-61.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-61.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-61.ec2.internal,},FirstTimestamp:2026-07-15 14:33:37 +0000 UTC,LastTimestamp:2026-07-15 14:33:38.694600201 +0000 UTC m=+2.210418069,Count:3,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-61.ec2.internal,}"
Jul 15 14:33:38.745435 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.745394    2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 15 14:33:38.746771 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.746746    2571 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 15 14:33:38.746850 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.746790    2571 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 15 14:33:38.746850 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.746814    2571 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 15 14:33:38.746955 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:38.746856    2571 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 15 14:33:38.757050 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.757019    2571 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 14:33:38.757227 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.757210    2571 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 14:33:38.761521 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.761507    2571 apiserver.go:52] "Watching apiserver"
Jul 15 14:33:38.774665 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.774645    2571 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 15 14:33:38.779728 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.779708    2571 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 15 14:33:38.801385 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.801356    2571 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 14:33:38.808177 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.808148    2571 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 14:33:38.825598 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.825566    2571 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-kfsn5"
Jul 15 14:33:38.835702 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.835679    2571 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-kfsn5"
Jul 15 14:33:38.847971 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.847946    2571 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-61.ec2.internal"]
Jul 15 14:33:38.849505 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.849484    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal"
Jul 15 14:33:38.850407 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.850389    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/node-ca-wvfhr","openshift-network-diagnostics/network-check-target-878zd"]
Jul 15 14:33:38.850528 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.850509    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-61.ec2.internal"
Jul 15 14:33:38.851633 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.851613    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wvfhr"
Jul 15 14:33:38.852680 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.852663    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-878zd"
Jul 15 14:33:38.852753 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:38.852724    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-878zd" podUID="109886c7-ff5d-49ac-9bf9-012740e3417f"
Jul 15 14:33:38.853168 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.853151    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/node-resolver-jw9j8"]
Jul 15 14:33:38.854494 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.854474    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 15 14:33:38.854494 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.854486    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 15 14:33:38.854494 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.854501    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-c2x9z\""
Jul 15 14:33:38.854712 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.854655    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 15 14:33:38.856582 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.856565    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jw9j8"
Jul 15 14:33:38.859684 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.859662    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 15 14:33:38.860461 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.860441    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-km7qp\""
Jul 15 14:33:38.860756 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.860627    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-operator/iptables-alerter-8r6d7"]
Jul 15 14:33:38.860841 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.860825    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 15 14:33:38.861973 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.861956    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8r6d7"
Jul 15 14:33:38.866031 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.866015    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 15 14:33:38.866126 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.866110    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 15 14:33:38.866620 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.866607    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xqhdf\""
Jul 15 14:33:38.866857 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.866845    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 15 14:33:38.873233 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.873212    2571 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal"
Jul 15 14:33:38.880887 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.880868    2571 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 15 14:33:38.887731 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.887710    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m5xgj\" (UniqueName: \"kubernetes.io/projected/251749ce-0465-4ac6-b2c6-dfb3ac64981b-kube-api-access-m5xgj\") pod \"iptables-alerter-8r6d7\" (UID: \"251749ce-0465-4ac6-b2c6-dfb3ac64981b\") " pod="openshift-network-operator/iptables-alerter-8r6d7"
Jul 15 14:33:38.887813 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.887740    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4bc0c7a3681d7c042fbc0dd13cac7333-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal\" (UID: \"4bc0c7a3681d7c042fbc0dd13cac7333\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal"
Jul 15 14:33:38.887813 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.887769    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4bc0c7a3681d7c042fbc0dd13cac7333-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal\" (UID: \"4bc0c7a3681d7c042fbc0dd13cac7333\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal"
Jul 15 14:33:38.887813 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.887792    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5c90a46431eae6b3cdd7f5745d0d2187-config\") pod \"kube-apiserver-proxy-ip-10-0-140-61.ec2.internal\" (UID: \"5c90a46431eae6b3cdd7f5745d0d2187\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-61.ec2.internal"
Jul 15 14:33:38.887922 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.887836    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkwlc\" (UniqueName: \"kubernetes.io/projected/55343882-5974-45a9-b3e2-cfff9bec7863-kube-api-access-nkwlc\") pod \"node-ca-wvfhr\" (UID: \"55343882-5974-45a9-b3e2-cfff9bec7863\") " pod="openshift-image-registry/node-ca-wvfhr"
Jul 15 14:33:38.887922 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.887887    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/251749ce-0465-4ac6-b2c6-dfb3ac64981b-host-slash\") pod \"iptables-alerter-8r6d7\" (UID: \"251749ce-0465-4ac6-b2c6-dfb3ac64981b\") " pod="openshift-network-operator/iptables-alerter-8r6d7"
Jul 15 14:33:38.887984 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.887924    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/55343882-5974-45a9-b3e2-cfff9bec7863-host\") pod \"node-ca-wvfhr\" (UID: \"55343882-5974-45a9-b3e2-cfff9bec7863\") " pod="openshift-image-registry/node-ca-wvfhr"
Jul 15 14:33:38.887984 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.887950    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/55343882-5974-45a9-b3e2-cfff9bec7863-serviceca\") pod \"node-ca-wvfhr\" (UID: \"55343882-5974-45a9-b3e2-cfff9bec7863\") " pod="openshift-image-registry/node-ca-wvfhr"
Jul 15 14:33:38.888047 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.887984    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkfs5\" (UniqueName: \"kubernetes.io/projected/109886c7-ff5d-49ac-9bf9-012740e3417f-kube-api-access-vkfs5\") pod \"network-check-target-878zd\" (UID: \"109886c7-ff5d-49ac-9bf9-012740e3417f\") " pod="openshift-network-diagnostics/network-check-target-878zd"
Jul 15 14:33:38.888047 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.888007    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/144a8b5d-13b7-4453-8bd5-963d4c7815c8-hosts-file\") pod \"node-resolver-jw9j8\" (UID: \"144a8b5d-13b7-4453-8bd5-963d4c7815c8\") " pod="openshift-dns/node-resolver-jw9j8"
Jul 15 14:33:38.888047 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.888023    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/144a8b5d-13b7-4453-8bd5-963d4c7815c8-tmp-dir\") pod \"node-resolver-jw9j8\" (UID: \"144a8b5d-13b7-4453-8bd5-963d4c7815c8\") " pod="openshift-dns/node-resolver-jw9j8"
Jul 15 14:33:38.888047 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.888038    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgh7l\" (UniqueName: \"kubernetes.io/projected/144a8b5d-13b7-4453-8bd5-963d4c7815c8-kube-api-access-hgh7l\") pod \"node-resolver-jw9j8\" (UID: \"144a8b5d-13b7-4453-8bd5-963d4c7815c8\") " pod="openshift-dns/node-resolver-jw9j8"
Jul 15 14:33:38.888186 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.888091    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/251749ce-0465-4ac6-b2c6-dfb3ac64981b-iptables-alerter-script\") pod \"iptables-alerter-8r6d7\" (UID: \"251749ce-0465-4ac6-b2c6-dfb3ac64981b\") " pod="openshift-network-operator/iptables-alerter-8r6d7"
Jul 15 14:33:38.889008 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.888996    2571 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-61.ec2.internal"
Jul 15 14:33:38.965712 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.965620    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal"]
Jul 15 14:33:38.965712 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.965683    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-140-61.ec2.internal"]
Jul 15 14:33:38.968157 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.968139    2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 14:33:38.968450 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.968437    2571 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 14:33:38.974367 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.974350    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-42cjp"]
Jul 15 14:33:38.975825 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.975808    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-42cjp"
Jul 15 14:33:38.979980 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.979959    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 15 14:33:38.980188 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.980172    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-mwb7r\""
Jul 15 14:33:38.980258 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.980238    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 15 14:33:38.989148 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.989130    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/251749ce-0465-4ac6-b2c6-dfb3ac64981b-host-slash\") pod \"iptables-alerter-8r6d7\" (UID: \"251749ce-0465-4ac6-b2c6-dfb3ac64981b\") " pod="openshift-network-operator/iptables-alerter-8r6d7"
Jul 15 14:33:38.989201 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.989158    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d1d4ca67-bb3b-4f02-a744-de494982cffa-agent-certs\") pod \"konnectivity-agent-42cjp\" (UID: \"d1d4ca67-bb3b-4f02-a744-de494982cffa\") " pod="kube-system/konnectivity-agent-42cjp"
Jul 15 14:33:38.989201 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.989176    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/55343882-5974-45a9-b3e2-cfff9bec7863-host\") pod \"node-ca-wvfhr\" (UID: \"55343882-5974-45a9-b3e2-cfff9bec7863\") " pod="openshift-image-registry/node-ca-wvfhr"
Jul 15 14:33:38.989201 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.989192    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/55343882-5974-45a9-b3e2-cfff9bec7863-serviceca\") pod \"node-ca-wvfhr\" (UID: \"55343882-5974-45a9-b3e2-cfff9bec7863\") " pod="openshift-image-registry/node-ca-wvfhr"
Jul 15 14:33:38.989415 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.989208    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/144a8b5d-13b7-4453-8bd5-963d4c7815c8-tmp-dir\") pod \"node-resolver-jw9j8\" (UID: \"144a8b5d-13b7-4453-8bd5-963d4c7815c8\") " pod="openshift-dns/node-resolver-jw9j8"
Jul 15 14:33:38.989415 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.989223    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgh7l\" (UniqueName: \"kubernetes.io/projected/144a8b5d-13b7-4453-8bd5-963d4c7815c8-kube-api-access-hgh7l\") pod \"node-resolver-jw9j8\" (UID: \"144a8b5d-13b7-4453-8bd5-963d4c7815c8\") " pod="openshift-dns/node-resolver-jw9j8"
Jul 15 14:33:38.989415 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.989268    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/55343882-5974-45a9-b3e2-cfff9bec7863-host\") pod \"node-ca-wvfhr\" (UID: \"55343882-5974-45a9-b3e2-cfff9bec7863\") " pod="openshift-image-registry/node-ca-wvfhr"
Jul 15 14:33:38.989415 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.989289    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/251749ce-0465-4ac6-b2c6-dfb3ac64981b-host-slash\") pod \"iptables-alerter-8r6d7\" (UID: \"251749ce-0465-4ac6-b2c6-dfb3ac64981b\") " pod="openshift-network-operator/iptables-alerter-8r6d7"
Jul 15 14:33:38.989415 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.989322    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/251749ce-0465-4ac6-b2c6-dfb3ac64981b-iptables-alerter-script\") pod \"iptables-alerter-8r6d7\" (UID: \"251749ce-0465-4ac6-b2c6-dfb3ac64981b\") " pod="openshift-network-operator/iptables-alerter-8r6d7"
Jul 15 14:33:38.989415 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.989347    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m5xgj\" (UniqueName: \"kubernetes.io/projected/251749ce-0465-4ac6-b2c6-dfb3ac64981b-kube-api-access-m5xgj\") pod \"iptables-alerter-8r6d7\" (UID: \"251749ce-0465-4ac6-b2c6-dfb3ac64981b\") " pod="openshift-network-operator/iptables-alerter-8r6d7"
Jul 15 14:33:38.989415 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.989366    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4bc0c7a3681d7c042fbc0dd13cac7333-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal\" (UID: \"4bc0c7a3681d7c042fbc0dd13cac7333\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal"
Jul 15 14:33:38.989415 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.989382    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4bc0c7a3681d7c042fbc0dd13cac7333-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal\" (UID: \"4bc0c7a3681d7c042fbc0dd13cac7333\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal"
Jul 15 14:33:38.989415 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.989405    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkwlc\" (UniqueName: \"kubernetes.io/projected/55343882-5974-45a9-b3e2-cfff9bec7863-kube-api-access-nkwlc\") pod \"node-ca-wvfhr\" (UID: \"55343882-5974-45a9-b3e2-cfff9bec7863\") " pod="openshift-image-registry/node-ca-wvfhr"
Jul 15 14:33:38.989821 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.989432    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkfs5\" (UniqueName: \"kubernetes.io/projected/109886c7-ff5d-49ac-9bf9-012740e3417f-kube-api-access-vkfs5\") pod \"network-check-target-878zd\" (UID: \"109886c7-ff5d-49ac-9bf9-012740e3417f\") " pod="openshift-network-diagnostics/network-check-target-878zd"
Jul 15 14:33:38.989821 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.989450    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/4bc0c7a3681d7c042fbc0dd13cac7333-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal\" (UID: \"4bc0c7a3681d7c042fbc0dd13cac7333\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal"
Jul 15 14:33:38.989821 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.989460    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/144a8b5d-13b7-4453-8bd5-963d4c7815c8-hosts-file\") pod \"node-resolver-jw9j8\" (UID: \"144a8b5d-13b7-4453-8bd5-963d4c7815c8\") " pod="openshift-dns/node-resolver-jw9j8"
Jul 15 14:33:38.989821 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.989497    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d1d4ca67-bb3b-4f02-a744-de494982cffa-konnectivity-ca\") pod \"konnectivity-agent-42cjp\" (UID: \"d1d4ca67-bb3b-4f02-a744-de494982cffa\") " pod="kube-system/konnectivity-agent-42cjp"
Jul 15 14:33:38.989821 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.989527    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5c90a46431eae6b3cdd7f5745d0d2187-config\") pod \"kube-apiserver-proxy-ip-10-0-140-61.ec2.internal\" (UID: \"5c90a46431eae6b3cdd7f5745d0d2187\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-61.ec2.internal"
Jul 15 14:33:38.989821 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.989608    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/5c90a46431eae6b3cdd7f5745d0d2187-config\") pod \"kube-apiserver-proxy-ip-10-0-140-61.ec2.internal\" (UID: \"5c90a46431eae6b3cdd7f5745d0d2187\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-61.ec2.internal"
Jul 15 14:33:38.989821 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.989627    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/144a8b5d-13b7-4453-8bd5-963d4c7815c8-hosts-file\") pod \"node-resolver-jw9j8\" (UID: \"144a8b5d-13b7-4453-8bd5-963d4c7815c8\") " pod="openshift-dns/node-resolver-jw9j8"
Jul 15 14:33:38.989821 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.989628    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4bc0c7a3681d7c042fbc0dd13cac7333-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal\" (UID: \"4bc0c7a3681d7c042fbc0dd13cac7333\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal"
Jul 15 14:33:38.991542 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.991523    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/144a8b5d-13b7-4453-8bd5-963d4c7815c8-tmp-dir\") pod \"node-resolver-jw9j8\" (UID: \"144a8b5d-13b7-4453-8bd5-963d4c7815c8\") " pod="openshift-dns/node-resolver-jw9j8"
Jul 15 14:33:38.991920 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.991898    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/251749ce-0465-4ac6-b2c6-dfb3ac64981b-iptables-alerter-script\") pod \"iptables-alerter-8r6d7\" (UID: \"251749ce-0465-4ac6-b2c6-dfb3ac64981b\") " pod="openshift-network-operator/iptables-alerter-8r6d7"
Jul 15 14:33:38.992471 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:38.992454    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/55343882-5974-45a9-b3e2-cfff9bec7863-serviceca\") pod \"node-ca-wvfhr\" (UID: \"55343882-5974-45a9-b3e2-cfff9bec7863\") " pod="openshift-image-registry/node-ca-wvfhr"
Jul 15 14:33:39.075653 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.075622    2571 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 14:33:39.090667 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.090640    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d1d4ca67-bb3b-4f02-a744-de494982cffa-konnectivity-ca\") pod \"konnectivity-agent-42cjp\" (UID: \"d1d4ca67-bb3b-4f02-a744-de494982cffa\") " pod="kube-system/konnectivity-agent-42cjp"
Jul 15 14:33:39.090667 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.090670    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d1d4ca67-bb3b-4f02-a744-de494982cffa-agent-certs\") pod \"konnectivity-agent-42cjp\" (UID: \"d1d4ca67-bb3b-4f02-a744-de494982cffa\") " pod="kube-system/konnectivity-agent-42cjp"
Jul 15 14:33:39.091000 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.090983    2571 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 15 14:33:39.091767 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.091749    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/d1d4ca67-bb3b-4f02-a744-de494982cffa-konnectivity-ca\") pod \"konnectivity-agent-42cjp\" (UID: \"d1d4ca67-bb3b-4f02-a744-de494982cffa\") " pod="kube-system/konnectivity-agent-42cjp"
Jul 15 14:33:39.094140 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.094124    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/d1d4ca67-bb3b-4f02-a744-de494982cffa-agent-certs\") pod \"konnectivity-agent-42cjp\" (UID: \"d1d4ca67-bb3b-4f02-a744-de494982cffa\") " pod="kube-system/konnectivity-agent-42cjp"
Jul 15 14:33:39.097738 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.097719    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgh7l\" (UniqueName: \"kubernetes.io/projected/144a8b5d-13b7-4453-8bd5-963d4c7815c8-kube-api-access-hgh7l\") pod \"node-resolver-jw9j8\" (UID: \"144a8b5d-13b7-4453-8bd5-963d4c7815c8\") " pod="openshift-dns/node-resolver-jw9j8"
Jul 15 14:33:39.104024 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.104007    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m5xgj\" (UniqueName: \"kubernetes.io/projected/251749ce-0465-4ac6-b2c6-dfb3ac64981b-kube-api-access-m5xgj\") pod \"iptables-alerter-8r6d7\" (UID: \"251749ce-0465-4ac6-b2c6-dfb3ac64981b\") " pod="openshift-network-operator/iptables-alerter-8r6d7"
Jul 15 14:33:39.138789 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.138761    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkwlc\" (UniqueName: \"kubernetes.io/projected/55343882-5974-45a9-b3e2-cfff9bec7863-kube-api-access-nkwlc\") pod \"node-ca-wvfhr\" (UID: \"55343882-5974-45a9-b3e2-cfff9bec7863\") " pod="openshift-image-registry/node-ca-wvfhr"
Jul 15 14:33:39.154236 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.154208    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-j8tt2"]
Jul 15 14:33:39.159210 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.159183    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2"
Jul 15 14:33:39.164664 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.164644    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 15 14:33:39.164845 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.164832    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 15 14:33:39.166074 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.166060    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 15 14:33:39.166126 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.166087    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 15 14:33:39.166444 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.166431    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-k6tnr\""
Jul 15 14:33:39.170040 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.170022    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 15 14:33:39.170150 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.170134    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 15 14:33:39.170286 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.170271    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c4b59"]
Jul 15 14:33:39.171698 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.171684    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c4b59"
Jul 15 14:33:39.177023 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:39.177004    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"kube-root-ca.crt\" is forbidden: User \"system:node:ip-10-0-140-61.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-cluster-csi-drivers\": no relationship found between node 'ip-10-0-140-61.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" type="*v1.ConfigMap"
Jul 15 14:33:39.182118 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:39.182100    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 14:33:39.182189 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:39.182122    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 14:33:39.182189 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:39.182134    2571 projected.go:196] Error preparing data for projected volume kube-api-access-vkfs5 for pod openshift-network-diagnostics/network-check-target-878zd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 14:33:39.182291 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:39.182206    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/109886c7-ff5d-49ac-9bf9-012740e3417f-kube-api-access-vkfs5 podName:109886c7-ff5d-49ac-9bf9-012740e3417f nodeName:}" failed. No retries permitted until 2026-07-15 14:33:39.68218356 +0000 UTC m=+3.198001410 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vkfs5" (UniqueName: "kubernetes.io/projected/109886c7-ff5d-49ac-9bf9-012740e3417f-kube-api-access-vkfs5") pod "network-check-target-878zd" (UID: "109886c7-ff5d-49ac-9bf9-012740e3417f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 14:33:39.182368 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:39.182263    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"aws-ebs-csi-driver-node-metrics-serving-cert\" is forbidden: User \"system:node:ip-10-0-140-61.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-cluster-csi-drivers\": no relationship found between node 'ip-10-0-140-61.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" type="*v1.Secret"
Jul 15 14:33:39.182411 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:39.182392    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.ConfigMap: configmaps \"openshift-service-ca.crt\" is forbidden: User \"system:node:ip-10-0-140-61.ec2.internal\" cannot list resource \"configmaps\" in API group \"\" in the namespace \"openshift-cluster-csi-drivers\": no relationship found between node 'ip-10-0-140-61.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" type="*v1.ConfigMap"
Jul 15 14:33:39.184879 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:39.184856    2571 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"aws-ebs-csi-driver-node-sa-dockercfg-r8c9t\" is forbidden: User \"system:node:ip-10-0-140-61.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-cluster-csi-drivers\": no relationship found between node 'ip-10-0-140-61.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-r8c9t\"" type="*v1.Secret"
Jul 15 14:33:39.190800 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.190774    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3464d623-ebc8-4b3f-8c92-41cc16c406a9-socket-dir\") pod \"aws-ebs-csi-driver-node-c4b59\" (UID: \"3464d623-ebc8-4b3f-8c92-41cc16c406a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c4b59"
Jul 15 14:33:39.190800 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.190799    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3464d623-ebc8-4b3f-8c92-41cc16c406a9-registration-dir\") pod \"aws-ebs-csi-driver-node-c4b59\" (UID: \"3464d623-ebc8-4b3f-8c92-41cc16c406a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c4b59"
Jul 15 14:33:39.190952 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.190816    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12bf26b1-5c4a-4e51-beb3-b17d7e7c4656-host-run-ovn-kubernetes\") pod \"ovnkube-node-j8tt2\" (UID: \"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2"
Jul 15 14:33:39.190952 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.190832    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/12bf26b1-5c4a-4e51-beb3-b17d7e7c4656-host-cni-bin\") pod \"ovnkube-node-j8tt2\" (UID: \"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2"
Jul 15 14:33:39.190952 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.190883    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/12bf26b1-5c4a-4e51-beb3-b17d7e7c4656-run-openvswitch\") pod \"ovnkube-node-j8tt2\" (UID: \"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2"
Jul 15 14:33:39.190952 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.190911    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/12bf26b1-5c4a-4e51-beb3-b17d7e7c4656-env-overrides\") pod \"ovnkube-node-j8tt2\" (UID: \"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2"
Jul 15 14:33:39.190952 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.190938    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/12bf26b1-5c4a-4e51-beb3-b17d7e7c4656-etc-openvswitch\") pod \"ovnkube-node-j8tt2\" (UID: \"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2"
Jul 15 14:33:39.191341 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.190967    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/12bf26b1-5c4a-4e51-beb3-b17d7e7c4656-run-ovn\") pod \"ovnkube-node-j8tt2\" (UID: \"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2"
Jul 15 14:33:39.191341 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.190993    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/12bf26b1-5c4a-4e51-beb3-b17d7e7c4656-ovnkube-script-lib\") pod \"ovnkube-node-j8tt2\" (UID: \"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2"
Jul 15 14:33:39.191341 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.191013    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4lmt\" (UniqueName: \"kubernetes.io/projected/12bf26b1-5c4a-4e51-beb3-b17d7e7c4656-kube-api-access-q4lmt\") pod \"ovnkube-node-j8tt2\" (UID: \"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2"
Jul 15 14:33:39.191341 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.191028    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3464d623-ebc8-4b3f-8c92-41cc16c406a9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-c4b59\" (UID: \"3464d623-ebc8-4b3f-8c92-41cc16c406a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c4b59"
Jul 15 14:33:39.191341 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.191064    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/12bf26b1-5c4a-4e51-beb3-b17d7e7c4656-host-slash\") pod \"ovnkube-node-j8tt2\" (UID: \"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2"
Jul 15 14:33:39.191341 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.191107    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/12bf26b1-5c4a-4e51-beb3-b17d7e7c4656-var-lib-openvswitch\") pod \"ovnkube-node-j8tt2\" (UID: \"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2"
Jul 15 14:33:39.191341 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.191152    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/12bf26b1-5c4a-4e51-beb3-b17d7e7c4656-log-socket\") pod \"ovnkube-node-j8tt2\" (UID: \"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2"
Jul 15 14:33:39.191341 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.191183    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/12bf26b1-5c4a-4e51-beb3-b17d7e7c4656-host-cni-netd\") pod \"ovnkube-node-j8tt2\" (UID: \"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2"
Jul 15 14:33:39.191341 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.191205    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3464d623-ebc8-4b3f-8c92-41cc16c406a9-device-dir\") pod \"aws-ebs-csi-driver-node-c4b59\" (UID: \"3464d623-ebc8-4b3f-8c92-41cc16c406a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c4b59"
Jul 15 14:33:39.191341 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.191229    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3464d623-ebc8-4b3f-8c92-41cc16c406a9-etc-selinux\") pod \"aws-ebs-csi-driver-node-c4b59\" (UID: \"3464d623-ebc8-4b3f-8c92-41cc16c406a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c4b59"
Jul 15 14:33:39.191341 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.191254    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3464d623-ebc8-4b3f-8c92-41cc16c406a9-sys-fs\") pod \"aws-ebs-csi-driver-node-c4b59\" (UID: \"3464d623-ebc8-4b3f-8c92-41cc16c406a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c4b59"
Jul 15 14:33:39.191341 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.191299    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kw59d\" (UniqueName: \"kubernetes.io/projected/3464d623-ebc8-4b3f-8c92-41cc16c406a9-kube-api-access-kw59d\") pod \"aws-ebs-csi-driver-node-c4b59\" (UID: \"3464d623-ebc8-4b3f-8c92-41cc16c406a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c4b59"
Jul 15 14:33:39.191341 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.191329    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/12bf26b1-5c4a-4e51-beb3-b17d7e7c4656-host-kubelet\") pod \"ovnkube-node-j8tt2\" (UID: \"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2"
Jul 15 14:33:39.191966 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.191357    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/12bf26b1-5c4a-4e51-beb3-b17d7e7c4656-host-run-netns\") pod \"ovnkube-node-j8tt2\" (UID: \"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2"
Jul 15 14:33:39.191966 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.191376    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12bf26b1-5c4a-4e51-beb3-b17d7e7c4656-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j8tt2\" (UID: \"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2"
Jul 15 14:33:39.191966 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.191393    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/12bf26b1-5c4a-4e51-beb3-b17d7e7c4656-ovn-node-metrics-cert\") pod \"ovnkube-node-j8tt2\" (UID: \"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2"
Jul 15 14:33:39.191966 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.191407    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/12bf26b1-5c4a-4e51-beb3-b17d7e7c4656-node-log\") pod \"ovnkube-node-j8tt2\" (UID: \"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2"
Jul 15 14:33:39.191966 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.191463    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/12bf26b1-5c4a-4e51-beb3-b17d7e7c4656-systemd-units\") pod \"ovnkube-node-j8tt2\" (UID: \"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2"
Jul 15 14:33:39.191966 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.191488    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/12bf26b1-5c4a-4e51-beb3-b17d7e7c4656-run-systemd\") pod \"ovnkube-node-j8tt2\" (UID: \"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2"
Jul 15 14:33:39.191966 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.191528    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/12bf26b1-5c4a-4e51-beb3-b17d7e7c4656-ovnkube-config\") pod \"ovnkube-node-j8tt2\" (UID: \"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2"
Jul 15 14:33:39.206731 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.206709    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-wvfhr"
Jul 15 14:33:39.220770 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.220707    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-g49wp"]
Jul 15 14:33:39.222160 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.222142    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g49wp"
Jul 15 14:33:39.222259 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:39.222220    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g49wp" podUID="eff6ee84-dee0-429b-9edc-df30874ebd31"
Jul 15 14:33:39.224424 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.224405    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-jw9j8"
Jul 15 14:33:39.225023 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.225005    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-additional-cni-plugins-cs6zp"]
Jul 15 14:33:39.226649 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.226632    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cs6zp"
Jul 15 14:33:39.229140 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.229119    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-8r6d7"
Jul 15 14:33:39.230545 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.230529    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-thpdx\""
Jul 15 14:33:39.230625 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.230590    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 15 14:33:39.231476 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.231462    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 15 14:33:39.234411 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.234395    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 15 14:33:39.236199 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.236063    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 15 14:33:39.236612 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.236593    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 15 14:33:39.270162 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.270137    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-61.ec2.internal"
Jul 15 14:33:39.271875 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.271854    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal"
Jul 15 14:33:39.280877 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.280849    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-5jrhz"]
Jul 15 14:33:39.282365 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.282332    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5jrhz"
Jul 15 14:33:39.292804 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.292782    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2baab41c-7646-411f-acbd-f0eb28f82489-cni-binary-copy\") pod \"multus-5jrhz\" (UID: \"2baab41c-7646-411f-acbd-f0eb28f82489\") " pod="openshift-multus/multus-5jrhz"
Jul 15 14:33:39.292906 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.292807    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2baab41c-7646-411f-acbd-f0eb28f82489-host-run-k8s-cni-cncf-io\") pod \"multus-5jrhz\" (UID: \"2baab41c-7646-411f-acbd-f0eb28f82489\") " pod="openshift-multus/multus-5jrhz"
Jul 15 14:33:39.292906 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.292825    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2baab41c-7646-411f-acbd-f0eb28f82489-hostroot\") pod \"multus-5jrhz\" (UID: \"2baab41c-7646-411f-acbd-f0eb28f82489\") " pod="openshift-multus/multus-5jrhz"
Jul 15 14:33:39.292906 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.292844    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/12bf26b1-5c4a-4e51-beb3-b17d7e7c4656-node-log\") pod \"ovnkube-node-j8tt2\" (UID: \"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2"
Jul 15 14:33:39.292906 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.292862    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/12bf26b1-5c4a-4e51-beb3-b17d7e7c4656-ovnkube-config\") pod \"ovnkube-node-j8tt2\" (UID: \"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2"
Jul 15 14:33:39.292906 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.292886    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9f578de8-ae1f-4aa2-a034-0e029991f7e0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cs6zp\" (UID: \"9f578de8-ae1f-4aa2-a034-0e029991f7e0\") " pod="openshift-multus/multus-additional-cni-plugins-cs6zp"
Jul 15 14:33:39.293143 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.292910    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3464d623-ebc8-4b3f-8c92-41cc16c406a9-socket-dir\") pod \"aws-ebs-csi-driver-node-c4b59\" (UID: \"3464d623-ebc8-4b3f-8c92-41cc16c406a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c4b59"
Jul 15 14:33:39.293143 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.292936    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/12bf26b1-5c4a-4e51-beb3-b17d7e7c4656-node-log\") pod \"ovnkube-node-j8tt2\" (UID: \"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2"
Jul 15 14:33:39.293143 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.292976    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3464d623-ebc8-4b3f-8c92-41cc16c406a9-registration-dir\") pod \"aws-ebs-csi-driver-node-c4b59\" (UID: \"3464d623-ebc8-4b3f-8c92-41cc16c406a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c4b59"
Jul 15 14:33:39.293143 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.293000    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9f578de8-ae1f-4aa2-a034-0e029991f7e0-system-cni-dir\") pod \"multus-additional-cni-plugins-cs6zp\" (UID: \"9f578de8-ae1f-4aa2-a034-0e029991f7e0\") " pod="openshift-multus/multus-additional-cni-plugins-cs6zp"
Jul 15 14:33:39.293143 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.293019    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3464d623-ebc8-4b3f-8c92-41cc16c406a9-registration-dir\") pod \"aws-ebs-csi-driver-node-c4b59\" (UID: \"3464d623-ebc8-4b3f-8c92-41cc16c406a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c4b59"
Jul 15 14:33:39.293143 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.293045    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9f578de8-ae1f-4aa2-a034-0e029991f7e0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cs6zp\" (UID: \"9f578de8-ae1f-4aa2-a034-0e029991f7e0\") " pod="openshift-multus/multus-additional-cni-plugins-cs6zp"
Jul 15 14:33:39.293143 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.293063    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9f578de8-ae1f-4aa2-a034-0e029991f7e0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cs6zp\" (UID: \"9f578de8-ae1f-4aa2-a034-0e029991f7e0\") " pod="openshift-multus/multus-additional-cni-plugins-cs6zp"
Jul 15 14:33:39.293143 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.293068    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3464d623-ebc8-4b3f-8c92-41cc16c406a9-socket-dir\") pod \"aws-ebs-csi-driver-node-c4b59\" (UID: \"3464d623-ebc8-4b3f-8c92-41cc16c406a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c4b59"
Jul 15 14:33:39.293143 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.293085    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5dmfl\" (UniqueName: \"kubernetes.io/projected/2baab41c-7646-411f-acbd-f0eb28f82489-kube-api-access-5dmfl\") pod \"multus-5jrhz\" (UID: \"2baab41c-7646-411f-acbd-f0eb28f82489\") " pod="openshift-multus/multus-5jrhz"
Jul 15 14:33:39.293143 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.293113    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/12bf26b1-5c4a-4e51-beb3-b17d7e7c4656-host-cni-bin\") pod \"ovnkube-node-j8tt2\" (UID: \"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2"
Jul 15 14:33:39.293143 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.293135    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/12bf26b1-5c4a-4e51-beb3-b17d7e7c4656-run-openvswitch\") pod \"ovnkube-node-j8tt2\" (UID: \"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2"
Jul 15 14:33:39.293714 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.293162    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/12bf26b1-5c4a-4e51-beb3-b17d7e7c4656-host-cni-bin\") pod \"ovnkube-node-j8tt2\" (UID: \"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2"
Jul 15 14:33:39.293714 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.293198    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/12bf26b1-5c4a-4e51-beb3-b17d7e7c4656-run-openvswitch\") pod \"ovnkube-node-j8tt2\" (UID: \"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2"
Jul 15 14:33:39.293714 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.293204    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/12bf26b1-5c4a-4e51-beb3-b17d7e7c4656-ovnkube-script-lib\") pod \"ovnkube-node-j8tt2\" (UID: \"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2"
Jul 15 14:33:39.293714 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.293241    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/12bf26b1-5c4a-4e51-beb3-b17d7e7c4656-run-ovn\") pod \"ovnkube-node-j8tt2\" (UID: \"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2"
Jul 15 14:33:39.293714 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.293259    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3464d623-ebc8-4b3f-8c92-41cc16c406a9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-c4b59\" (UID: \"3464d623-ebc8-4b3f-8c92-41cc16c406a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c4b59"
Jul 15 14:33:39.293714 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.293352    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2baab41c-7646-411f-acbd-f0eb28f82489-host-run-netns\") pod \"multus-5jrhz\" (UID: \"2baab41c-7646-411f-acbd-f0eb28f82489\") " pod="openshift-multus/multus-5jrhz"
Jul 15 14:33:39.293714 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.293388    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/12bf26b1-5c4a-4e51-beb3-b17d7e7c4656-ovnkube-config\") pod \"ovnkube-node-j8tt2\" (UID: \"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2"
Jul 15 14:33:39.293714 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.293395    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2baab41c-7646-411f-acbd-f0eb28f82489-host-var-lib-cni-bin\") pod \"multus-5jrhz\" (UID: \"2baab41c-7646-411f-acbd-f0eb28f82489\") " pod="openshift-multus/multus-5jrhz"
Jul 15 14:33:39.293714 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.293442    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3464d623-ebc8-4b3f-8c92-41cc16c406a9-kubelet-dir\") pod \"aws-ebs-csi-driver-node-c4b59\" (UID: \"3464d623-ebc8-4b3f-8c92-41cc16c406a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c4b59"
Jul 15 14:33:39.293714 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.293479    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2baab41c-7646-411f-acbd-f0eb28f82489-cnibin\") pod \"multus-5jrhz\" (UID: \"2baab41c-7646-411f-acbd-f0eb28f82489\") " pod="openshift-multus/multus-5jrhz"
Jul 15 14:33:39.293714 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.293535    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/12bf26b1-5c4a-4e51-beb3-b17d7e7c4656-log-socket\") pod \"ovnkube-node-j8tt2\" (UID: \"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2"
Jul 15 14:33:39.293714 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.293562    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2baab41c-7646-411f-acbd-f0eb28f82489-os-release\") pod \"multus-5jrhz\" (UID: \"2baab41c-7646-411f-acbd-f0eb28f82489\") " pod="openshift-multus/multus-5jrhz"
Jul 15 14:33:39.293714 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.293587    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2baab41c-7646-411f-acbd-f0eb28f82489-multus-conf-dir\") pod \"multus-5jrhz\" (UID: \"2baab41c-7646-411f-acbd-f0eb28f82489\") " pod="openshift-multus/multus-5jrhz"
Jul 15 14:33:39.293714 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.293601    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/12bf26b1-5c4a-4e51-beb3-b17d7e7c4656-log-socket\") pod \"ovnkube-node-j8tt2\" (UID: \"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2"
Jul 15 14:33:39.294333 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.293790    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/12bf26b1-5c4a-4e51-beb3-b17d7e7c4656-ovnkube-script-lib\") pod \"ovnkube-node-j8tt2\" (UID: \"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2"
Jul 15 14:33:39.294333 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.293349    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/12bf26b1-5c4a-4e51-beb3-b17d7e7c4656-run-ovn\") pod \"ovnkube-node-j8tt2\" (UID: \"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2"
Jul 15 14:33:39.294333 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.293996    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-dtmp6\""
Jul 15 14:33:39.294333 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.294045    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/12bf26b1-5c4a-4e51-beb3-b17d7e7c4656-host-run-netns\") pod \"ovnkube-node-j8tt2\" (UID: \"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2"
Jul 15 14:33:39.294333 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.294073    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/12bf26b1-5c4a-4e51-beb3-b17d7e7c4656-ovn-node-metrics-cert\") pod \"ovnkube-node-j8tt2\" (UID: \"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2"
Jul 15 14:33:39.294333 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.294080    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/12bf26b1-5c4a-4e51-beb3-b17d7e7c4656-host-run-netns\") pod \"ovnkube-node-j8tt2\" (UID: \"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2"
Jul 15 14:33:39.294333 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.294099    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9f578de8-ae1f-4aa2-a034-0e029991f7e0-os-release\") pod \"multus-additional-cni-plugins-cs6zp\" (UID: \"9f578de8-ae1f-4aa2-a034-0e029991f7e0\") " pod="openshift-multus/multus-additional-cni-plugins-cs6zp"
Jul 15 14:33:39.294333 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.294124    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/12bf26b1-5c4a-4e51-beb3-b17d7e7c4656-systemd-units\") pod \"ovnkube-node-j8tt2\" (UID: \"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2"
Jul 15 14:33:39.294333 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.294147    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/12bf26b1-5c4a-4e51-beb3-b17d7e7c4656-run-systemd\") pod \"ovnkube-node-j8tt2\" (UID: \"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2"
Jul 15 14:33:39.294333 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.294178    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2baab41c-7646-411f-acbd-f0eb28f82489-multus-socket-dir-parent\") pod \"multus-5jrhz\" (UID: \"2baab41c-7646-411f-acbd-f0eb28f82489\") " pod="openshift-multus/multus-5jrhz"
Jul 15 14:33:39.294333 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.294194    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2baab41c-7646-411f-acbd-f0eb28f82489-multus-daemon-config\") pod \"multus-5jrhz\" (UID: \"2baab41c-7646-411f-acbd-f0eb28f82489\") " pod="openshift-multus/multus-5jrhz"
Jul 15 14:33:39.294333 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.294213    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2baab41c-7646-411f-acbd-f0eb28f82489-multus-cni-dir\") pod \"multus-5jrhz\" (UID: \"2baab41c-7646-411f-acbd-f0eb28f82489\") " pod="openshift-multus/multus-5jrhz"
Jul 15 14:33:39.294333 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.294193    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/12bf26b1-5c4a-4e51-beb3-b17d7e7c4656-systemd-units\") pod \"ovnkube-node-j8tt2\" (UID: \"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2"
Jul 15 14:33:39.294333 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.294216    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 15 14:33:39.294333 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.294248    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eff6ee84-dee0-429b-9edc-df30874ebd31-metrics-certs\") pod \"network-metrics-daemon-g49wp\" (UID: \"eff6ee84-dee0-429b-9edc-df30874ebd31\") " pod="openshift-multus/network-metrics-daemon-g49wp"
Jul 15 14:33:39.294333 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.294264    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/12bf26b1-5c4a-4e51-beb3-b17d7e7c4656-run-systemd\") pod \"ovnkube-node-j8tt2\" (UID: \"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2"
Jul 15 14:33:39.294333 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.294295    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3464d623-ebc8-4b3f-8c92-41cc16c406a9-etc-selinux\") pod \"aws-ebs-csi-driver-node-c4b59\" (UID: \"3464d623-ebc8-4b3f-8c92-41cc16c406a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c4b59"
Jul 15 14:33:39.294333 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.294324    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3464d623-ebc8-4b3f-8c92-41cc16c406a9-sys-fs\") pod \"aws-ebs-csi-driver-node-c4b59\" (UID: \"3464d623-ebc8-4b3f-8c92-41cc16c406a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c4b59"
Jul 15 14:33:39.295053 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.294350    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kw59d\" (UniqueName: \"kubernetes.io/projected/3464d623-ebc8-4b3f-8c92-41cc16c406a9-kube-api-access-kw59d\") pod \"aws-ebs-csi-driver-node-c4b59\" (UID: \"3464d623-ebc8-4b3f-8c92-41cc16c406a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c4b59"
Jul 15 14:33:39.295053 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.294399    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3464d623-ebc8-4b3f-8c92-41cc16c406a9-sys-fs\") pod \"aws-ebs-csi-driver-node-c4b59\" (UID: \"3464d623-ebc8-4b3f-8c92-41cc16c406a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c4b59"
Jul 15 14:33:39.295053 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.294425    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12bf26b1-5c4a-4e51-beb3-b17d7e7c4656-host-run-ovn-kubernetes\") pod \"ovnkube-node-j8tt2\" (UID: \"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2"
Jul 15 14:33:39.295053 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.294451    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3464d623-ebc8-4b3f-8c92-41cc16c406a9-etc-selinux\") pod \"aws-ebs-csi-driver-node-c4b59\" (UID: \"3464d623-ebc8-4b3f-8c92-41cc16c406a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c4b59"
Jul 15 14:33:39.295053 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.294454    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/12bf26b1-5c4a-4e51-beb3-b17d7e7c4656-env-overrides\") pod \"ovnkube-node-j8tt2\" (UID: \"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2"
Jul 15 14:33:39.295053 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.294495    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4lmt\" (UniqueName: \"kubernetes.io/projected/12bf26b1-5c4a-4e51-beb3-b17d7e7c4656-kube-api-access-q4lmt\") pod \"ovnkube-node-j8tt2\" (UID: \"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2"
Jul 15 14:33:39.295053 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.294508    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12bf26b1-5c4a-4e51-beb3-b17d7e7c4656-host-run-ovn-kubernetes\") pod \"ovnkube-node-j8tt2\" (UID: \"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2"
Jul 15 14:33:39.295053 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.294603    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9f578de8-ae1f-4aa2-a034-0e029991f7e0-cni-binary-copy\") pod \"multus-additional-cni-plugins-cs6zp\" (UID: \"9f578de8-ae1f-4aa2-a034-0e029991f7e0\") " pod="openshift-multus/multus-additional-cni-plugins-cs6zp"
Jul 15 14:33:39.295053 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.294636    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/12bf26b1-5c4a-4e51-beb3-b17d7e7c4656-etc-openvswitch\") pod \"ovnkube-node-j8tt2\" (UID: \"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2"
Jul 15 14:33:39.295053 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.294664    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2baab41c-7646-411f-acbd-f0eb28f82489-host-var-lib-kubelet\") pod \"multus-5jrhz\" (UID: \"2baab41c-7646-411f-acbd-f0eb28f82489\") " pod="openshift-multus/multus-5jrhz"
Jul 15 14:33:39.295053 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.294693    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2baab41c-7646-411f-acbd-f0eb28f82489-host-run-multus-certs\") pod \"multus-5jrhz\" (UID: \"2baab41c-7646-411f-acbd-f0eb28f82489\") " pod="openshift-multus/multus-5jrhz"
Jul 15 14:33:39.295053 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.294732    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2baab41c-7646-411f-acbd-f0eb28f82489-etc-kubernetes\") pod \"multus-5jrhz\" (UID: \"2baab41c-7646-411f-acbd-f0eb28f82489\") " pod="openshift-multus/multus-5jrhz"
Jul 15 14:33:39.295053 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.294733    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/12bf26b1-5c4a-4e51-beb3-b17d7e7c4656-etc-openvswitch\") pod \"ovnkube-node-j8tt2\" (UID: \"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2"
Jul 15 14:33:39.295053 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.294774    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/12bf26b1-5c4a-4e51-beb3-b17d7e7c4656-host-slash\") pod \"ovnkube-node-j8tt2\" (UID: \"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2"
Jul 15 14:33:39.295053 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.294817    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/12bf26b1-5c4a-4e51-beb3-b17d7e7c4656-var-lib-openvswitch\") pod \"ovnkube-node-j8tt2\" (UID: \"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2"
Jul 15 14:33:39.295053 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.294849    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9f578de8-ae1f-4aa2-a034-0e029991f7e0-cnibin\") pod \"multus-additional-cni-plugins-cs6zp\" (UID: \"9f578de8-ae1f-4aa2-a034-0e029991f7e0\") " pod="openshift-multus/multus-additional-cni-plugins-cs6zp"
Jul 15 14:33:39.295053 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.294851    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/12bf26b1-5c4a-4e51-beb3-b17d7e7c4656-var-lib-openvswitch\") pod \"ovnkube-node-j8tt2\" (UID: \"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2"
Jul 15 14:33:39.295658 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.294819    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/12bf26b1-5c4a-4e51-beb3-b17d7e7c4656-host-slash\") pod \"ovnkube-node-j8tt2\" (UID: \"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2"
Jul 15 14:33:39.295658 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.294882    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/12bf26b1-5c4a-4e51-beb3-b17d7e7c4656-env-overrides\") pod \"ovnkube-node-j8tt2\" (UID: \"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2"
Jul 15 14:33:39.295658 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.294878    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/12bf26b1-5c4a-4e51-beb3-b17d7e7c4656-host-cni-netd\") pod \"ovnkube-node-j8tt2\" (UID: \"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2"
Jul 15 14:33:39.295658 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.294918    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/12bf26b1-5c4a-4e51-beb3-b17d7e7c4656-host-cni-netd\") pod \"ovnkube-node-j8tt2\" (UID: \"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2"
Jul 15 14:33:39.295658 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.294930    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3464d623-ebc8-4b3f-8c92-41cc16c406a9-device-dir\") pod \"aws-ebs-csi-driver-node-c4b59\" (UID: \"3464d623-ebc8-4b3f-8c92-41cc16c406a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c4b59"
Jul 15 14:33:39.295658 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.294953    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wsmj5\" (UniqueName: \"kubernetes.io/projected/eff6ee84-dee0-429b-9edc-df30874ebd31-kube-api-access-wsmj5\") pod \"network-metrics-daemon-g49wp\" (UID: \"eff6ee84-dee0-429b-9edc-df30874ebd31\") " pod="openshift-multus/network-metrics-daemon-g49wp"
Jul 15 14:33:39.295658 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.294970    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2baab41c-7646-411f-acbd-f0eb28f82489-host-var-lib-cni-multus\") pod \"multus-5jrhz\" (UID: \"2baab41c-7646-411f-acbd-f0eb28f82489\") " pod="openshift-multus/multus-5jrhz"
Jul 15 14:33:39.295658 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.294987    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/12bf26b1-5c4a-4e51-beb3-b17d7e7c4656-host-kubelet\") pod \"ovnkube-node-j8tt2\" (UID: \"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2"
Jul 15 14:33:39.295658 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.295003    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12bf26b1-5c4a-4e51-beb3-b17d7e7c4656-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j8tt2\" (UID: \"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2"
Jul 15 14:33:39.295658 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.295009    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3464d623-ebc8-4b3f-8c92-41cc16c406a9-device-dir\") pod \"aws-ebs-csi-driver-node-c4b59\" (UID: \"3464d623-ebc8-4b3f-8c92-41cc16c406a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c4b59"
Jul 15 14:33:39.295658 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.295020    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zc2q8\" (UniqueName: \"kubernetes.io/projected/9f578de8-ae1f-4aa2-a034-0e029991f7e0-kube-api-access-zc2q8\") pod \"multus-additional-cni-plugins-cs6zp\" (UID: \"9f578de8-ae1f-4aa2-a034-0e029991f7e0\") " pod="openshift-multus/multus-additional-cni-plugins-cs6zp"
Jul 15 14:33:39.295658 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.295036    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2baab41c-7646-411f-acbd-f0eb28f82489-system-cni-dir\") pod \"multus-5jrhz\" (UID: \"2baab41c-7646-411f-acbd-f0eb28f82489\") " pod="openshift-multus/multus-5jrhz"
Jul 15 14:33:39.295658 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.295058    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/12bf26b1-5c4a-4e51-beb3-b17d7e7c4656-host-kubelet\") pod \"ovnkube-node-j8tt2\" (UID: \"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2"
Jul 15 14:33:39.295658 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.295085    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/12bf26b1-5c4a-4e51-beb3-b17d7e7c4656-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j8tt2\" (UID: \"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2"
Jul 15 14:33:39.295658 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.295608    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-42cjp"
Jul 15 14:33:39.296575 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.296559    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/12bf26b1-5c4a-4e51-beb3-b17d7e7c4656-ovn-node-metrics-cert\") pod \"ovnkube-node-j8tt2\" (UID: \"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2"
Jul 15 14:33:39.320855 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.320824    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4lmt\" (UniqueName: \"kubernetes.io/projected/12bf26b1-5c4a-4e51-beb3-b17d7e7c4656-kube-api-access-q4lmt\") pod \"ovnkube-node-j8tt2\" (UID: \"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656\") " pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2"
Jul 15 14:33:39.325378 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.325342    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-node-tuning-operator/tuned-h9tlc"]
Jul 15 14:33:39.327061 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.327047    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-h9tlc"
Jul 15 14:33:39.333811 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.333791    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-7wsxn\""
Jul 15 14:33:39.334089 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.334072    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 15 14:33:39.334142 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.334073    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 15 14:33:39.344632 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.344615    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-7b98l"]
Jul 15 14:33:39.346261 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.346248    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7b98l"
Jul 15 14:33:39.346329 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:39.346314    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7b98l" podUID="4a14d87d-5fd3-40b7-b753-4758b15dd501"
Jul 15 14:33:39.395314 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.395263    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2baab41c-7646-411f-acbd-f0eb28f82489-multus-cni-dir\") pod \"multus-5jrhz\" (UID: \"2baab41c-7646-411f-acbd-f0eb28f82489\") " pod="openshift-multus/multus-5jrhz"
Jul 15 14:33:39.395448 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.395320    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eff6ee84-dee0-429b-9edc-df30874ebd31-metrics-certs\") pod \"network-metrics-daemon-g49wp\" (UID: \"eff6ee84-dee0-429b-9edc-df30874ebd31\") " pod="openshift-multus/network-metrics-daemon-g49wp"
Jul 15 14:33:39.395448 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.395351    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac-etc-modprobe-d\") pod \"tuned-h9tlc\" (UID: \"6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac\") " pod="openshift-cluster-node-tuning-operator/tuned-h9tlc"
Jul 15 14:33:39.395448 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.395380    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9f578de8-ae1f-4aa2-a034-0e029991f7e0-cni-binary-copy\") pod \"multus-additional-cni-plugins-cs6zp\" (UID: \"9f578de8-ae1f-4aa2-a034-0e029991f7e0\") " pod="openshift-multus/multus-additional-cni-plugins-cs6zp"
Jul 15 14:33:39.395448 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.395402    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2baab41c-7646-411f-acbd-f0eb28f82489-host-var-lib-kubelet\") pod \"multus-5jrhz\" (UID: \"2baab41c-7646-411f-acbd-f0eb28f82489\") " pod="openshift-multus/multus-5jrhz"
Jul 15 14:33:39.395448 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.395423    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2baab41c-7646-411f-acbd-f0eb28f82489-host-run-multus-certs\") pod \"multus-5jrhz\" (UID: \"2baab41c-7646-411f-acbd-f0eb28f82489\") " pod="openshift-multus/multus-5jrhz"
Jul 15 14:33:39.395448 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:39.395438    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 14:33:39.395737 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.395482    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2baab41c-7646-411f-acbd-f0eb28f82489-etc-kubernetes\") pod \"multus-5jrhz\" (UID: \"2baab41c-7646-411f-acbd-f0eb28f82489\") " pod="openshift-multus/multus-5jrhz"
Jul 15 14:33:39.395737 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.395444    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/2baab41c-7646-411f-acbd-f0eb28f82489-etc-kubernetes\") pod \"multus-5jrhz\" (UID: \"2baab41c-7646-411f-acbd-f0eb28f82489\") " pod="openshift-multus/multus-5jrhz"
Jul 15 14:33:39.395737 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:39.395518    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eff6ee84-dee0-429b-9edc-df30874ebd31-metrics-certs podName:eff6ee84-dee0-429b-9edc-df30874ebd31 nodeName:}" failed. No retries permitted until 2026-07-15 14:33:39.895496057 +0000 UTC m=+3.411313912 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eff6ee84-dee0-429b-9edc-df30874ebd31-metrics-certs") pod "network-metrics-daemon-g49wp" (UID: "eff6ee84-dee0-429b-9edc-df30874ebd31") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 14:33:39.395737 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.395515    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2baab41c-7646-411f-acbd-f0eb28f82489-host-var-lib-kubelet\") pod \"multus-5jrhz\" (UID: \"2baab41c-7646-411f-acbd-f0eb28f82489\") " pod="openshift-multus/multus-5jrhz"
Jul 15 14:33:39.395737 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.395533    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/2baab41c-7646-411f-acbd-f0eb28f82489-host-run-multus-certs\") pod \"multus-5jrhz\" (UID: \"2baab41c-7646-411f-acbd-f0eb28f82489\") " pod="openshift-multus/multus-5jrhz"
Jul 15 14:33:39.395737 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.395550    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2baab41c-7646-411f-acbd-f0eb28f82489-multus-cni-dir\") pod \"multus-5jrhz\" (UID: \"2baab41c-7646-411f-acbd-f0eb28f82489\") " pod="openshift-multus/multus-5jrhz"
Jul 15 14:33:39.395737 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.395574    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac-etc-sysconfig\") pod \"tuned-h9tlc\" (UID: \"6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac\") " pod="openshift-cluster-node-tuning-operator/tuned-h9tlc"
Jul 15 14:33:39.395737 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.395596    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac-etc-sysctl-d\") pod \"tuned-h9tlc\" (UID: \"6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac\") " pod="openshift-cluster-node-tuning-operator/tuned-h9tlc"
Jul 15 14:33:39.395737 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.395612    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac-etc-sysctl-conf\") pod \"tuned-h9tlc\" (UID: \"6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac\") " pod="openshift-cluster-node-tuning-operator/tuned-h9tlc"
Jul 15 14:33:39.395737 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.395638    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9f578de8-ae1f-4aa2-a034-0e029991f7e0-cnibin\") pod \"multus-additional-cni-plugins-cs6zp\" (UID: \"9f578de8-ae1f-4aa2-a034-0e029991f7e0\") " pod="openshift-multus/multus-additional-cni-plugins-cs6zp"
Jul 15 14:33:39.395737 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.395665    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac-tmp\") pod \"tuned-h9tlc\" (UID: \"6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac\") " pod="openshift-cluster-node-tuning-operator/tuned-h9tlc"
Jul 15 14:33:39.395737 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.395688    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmgxm\" (UniqueName: \"kubernetes.io/projected/6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac-kube-api-access-gmgxm\") pod \"tuned-h9tlc\" (UID: \"6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac\") " pod="openshift-cluster-node-tuning-operator/tuned-h9tlc"
Jul 15 14:33:39.395737 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.395698    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/9f578de8-ae1f-4aa2-a034-0e029991f7e0-cnibin\") pod \"multus-additional-cni-plugins-cs6zp\" (UID: \"9f578de8-ae1f-4aa2-a034-0e029991f7e0\") " pod="openshift-multus/multus-additional-cni-plugins-cs6zp"
Jul 15 14:33:39.395737 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.395721    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wsmj5\" (UniqueName: \"kubernetes.io/projected/eff6ee84-dee0-429b-9edc-df30874ebd31-kube-api-access-wsmj5\") pod \"network-metrics-daemon-g49wp\" (UID: \"eff6ee84-dee0-429b-9edc-df30874ebd31\") " pod="openshift-multus/network-metrics-daemon-g49wp"
Jul 15 14:33:39.396388 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.395758    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2baab41c-7646-411f-acbd-f0eb28f82489-host-var-lib-cni-multus\") pod \"multus-5jrhz\" (UID: \"2baab41c-7646-411f-acbd-f0eb28f82489\") " pod="openshift-multus/multus-5jrhz"
Jul 15 14:33:39.396388 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.395828    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac-etc-systemd\") pod \"tuned-h9tlc\" (UID: \"6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac\") " pod="openshift-cluster-node-tuning-operator/tuned-h9tlc"
Jul 15 14:33:39.396388 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.395842    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/2baab41c-7646-411f-acbd-f0eb28f82489-host-var-lib-cni-multus\") pod \"multus-5jrhz\" (UID: \"2baab41c-7646-411f-acbd-f0eb28f82489\") " pod="openshift-multus/multus-5jrhz"
Jul 15 14:33:39.396388 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.395877    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac-sys\") pod \"tuned-h9tlc\" (UID: \"6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac\") " pod="openshift-cluster-node-tuning-operator/tuned-h9tlc"
Jul 15 14:33:39.396388 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.395893    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac-host\") pod \"tuned-h9tlc\" (UID: \"6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac\") " pod="openshift-cluster-node-tuning-operator/tuned-h9tlc"
Jul 15 14:33:39.396388 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.395919    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4a14d87d-5fd3-40b7-b753-4758b15dd501-dbus\") pod \"global-pull-secret-syncer-7b98l\" (UID: \"4a14d87d-5fd3-40b7-b753-4758b15dd501\") " pod="kube-system/global-pull-secret-syncer-7b98l"
Jul 15 14:33:39.396388 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.395943    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zc2q8\" (UniqueName: \"kubernetes.io/projected/9f578de8-ae1f-4aa2-a034-0e029991f7e0-kube-api-access-zc2q8\") pod \"multus-additional-cni-plugins-cs6zp\" (UID: \"9f578de8-ae1f-4aa2-a034-0e029991f7e0\") " pod="openshift-multus/multus-additional-cni-plugins-cs6zp"
Jul 15 14:33:39.396388 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.395962    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2baab41c-7646-411f-acbd-f0eb28f82489-system-cni-dir\") pod \"multus-5jrhz\" (UID: \"2baab41c-7646-411f-acbd-f0eb28f82489\") " pod="openshift-multus/multus-5jrhz"
Jul 15 14:33:39.396388 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.396007    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/2baab41c-7646-411f-acbd-f0eb28f82489-system-cni-dir\") pod \"multus-5jrhz\" (UID: \"2baab41c-7646-411f-acbd-f0eb28f82489\") " pod="openshift-multus/multus-5jrhz"
Jul 15 14:33:39.396388 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.396059    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2baab41c-7646-411f-acbd-f0eb28f82489-cni-binary-copy\") pod \"multus-5jrhz\" (UID: \"2baab41c-7646-411f-acbd-f0eb28f82489\") " pod="openshift-multus/multus-5jrhz"
Jul 15 14:33:39.396388 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.396063    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/9f578de8-ae1f-4aa2-a034-0e029991f7e0-cni-binary-copy\") pod \"multus-additional-cni-plugins-cs6zp\" (UID: \"9f578de8-ae1f-4aa2-a034-0e029991f7e0\") " pod="openshift-multus/multus-additional-cni-plugins-cs6zp"
Jul 15 14:33:39.396388 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.396079    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2baab41c-7646-411f-acbd-f0eb28f82489-host-run-k8s-cni-cncf-io\") pod \"multus-5jrhz\" (UID: \"2baab41c-7646-411f-acbd-f0eb28f82489\") " pod="openshift-multus/multus-5jrhz"
Jul 15 14:33:39.396388 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.396123    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/2baab41c-7646-411f-acbd-f0eb28f82489-host-run-k8s-cni-cncf-io\") pod \"multus-5jrhz\" (UID: \"2baab41c-7646-411f-acbd-f0eb28f82489\") " pod="openshift-multus/multus-5jrhz"
Jul 15 14:33:39.396388 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.396128    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2baab41c-7646-411f-acbd-f0eb28f82489-hostroot\") pod \"multus-5jrhz\" (UID: \"2baab41c-7646-411f-acbd-f0eb28f82489\") " pod="openshift-multus/multus-5jrhz"
Jul 15 14:33:39.396388 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.396159    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac-run\") pod \"tuned-h9tlc\" (UID: \"6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac\") " pod="openshift-cluster-node-tuning-operator/tuned-h9tlc"
Jul 15 14:33:39.396388 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.396191    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac-lib-modules\") pod \"tuned-h9tlc\" (UID: \"6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac\") " pod="openshift-cluster-node-tuning-operator/tuned-h9tlc"
Jul 15 14:33:39.396388 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.396217    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac-var-lib-kubelet\") pod \"tuned-h9tlc\" (UID: \"6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac\") " pod="openshift-cluster-node-tuning-operator/tuned-h9tlc"
Jul 15 14:33:39.397223 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.396237    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/2baab41c-7646-411f-acbd-f0eb28f82489-hostroot\") pod \"multus-5jrhz\" (UID: \"2baab41c-7646-411f-acbd-f0eb28f82489\") " pod="openshift-multus/multus-5jrhz"
Jul 15 14:33:39.397223 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.396250    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4a14d87d-5fd3-40b7-b753-4758b15dd501-kubelet-config\") pod \"global-pull-secret-syncer-7b98l\" (UID: \"4a14d87d-5fd3-40b7-b753-4758b15dd501\") " pod="kube-system/global-pull-secret-syncer-7b98l"
Jul 15 14:33:39.397223 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.396304    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9f578de8-ae1f-4aa2-a034-0e029991f7e0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cs6zp\" (UID: \"9f578de8-ae1f-4aa2-a034-0e029991f7e0\") " pod="openshift-multus/multus-additional-cni-plugins-cs6zp"
Jul 15 14:33:39.397223 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.396335    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9f578de8-ae1f-4aa2-a034-0e029991f7e0-system-cni-dir\") pod \"multus-additional-cni-plugins-cs6zp\" (UID: \"9f578de8-ae1f-4aa2-a034-0e029991f7e0\") " pod="openshift-multus/multus-additional-cni-plugins-cs6zp"
Jul 15 14:33:39.397223 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.396361    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9f578de8-ae1f-4aa2-a034-0e029991f7e0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cs6zp\" (UID: \"9f578de8-ae1f-4aa2-a034-0e029991f7e0\") " pod="openshift-multus/multus-additional-cni-plugins-cs6zp"
Jul 15 14:33:39.397223 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.396390    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9f578de8-ae1f-4aa2-a034-0e029991f7e0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cs6zp\" (UID: \"9f578de8-ae1f-4aa2-a034-0e029991f7e0\") " pod="openshift-multus/multus-additional-cni-plugins-cs6zp"
Jul 15 14:33:39.397223 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.396399    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/9f578de8-ae1f-4aa2-a034-0e029991f7e0-system-cni-dir\") pod \"multus-additional-cni-plugins-cs6zp\" (UID: \"9f578de8-ae1f-4aa2-a034-0e029991f7e0\") " pod="openshift-multus/multus-additional-cni-plugins-cs6zp"
Jul 15 14:33:39.397223 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.396419    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5dmfl\" (UniqueName: \"kubernetes.io/projected/2baab41c-7646-411f-acbd-f0eb28f82489-kube-api-access-5dmfl\") pod \"multus-5jrhz\" (UID: \"2baab41c-7646-411f-acbd-f0eb28f82489\") " pod="openshift-multus/multus-5jrhz"
Jul 15 14:33:39.397223 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.396454    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2baab41c-7646-411f-acbd-f0eb28f82489-host-run-netns\") pod \"multus-5jrhz\" (UID: \"2baab41c-7646-411f-acbd-f0eb28f82489\") " pod="openshift-multus/multus-5jrhz"
Jul 15 14:33:39.397223 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.396479    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2baab41c-7646-411f-acbd-f0eb28f82489-host-var-lib-cni-bin\") pod \"multus-5jrhz\" (UID: \"2baab41c-7646-411f-acbd-f0eb28f82489\") " pod="openshift-multus/multus-5jrhz"
Jul 15 14:33:39.397223 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.396503    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac-etc-kubernetes\") pod \"tuned-h9tlc\" (UID: \"6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac\") " pod="openshift-cluster-node-tuning-operator/tuned-h9tlc"
Jul 15 14:33:39.397223 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.396543    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2baab41c-7646-411f-acbd-f0eb28f82489-cnibin\") pod \"multus-5jrhz\" (UID: \"2baab41c-7646-411f-acbd-f0eb28f82489\") " pod="openshift-multus/multus-5jrhz"
Jul 15 14:33:39.397223 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.396558    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/9f578de8-ae1f-4aa2-a034-0e029991f7e0-tuning-conf-dir\") pod \"multus-additional-cni-plugins-cs6zp\" (UID: \"9f578de8-ae1f-4aa2-a034-0e029991f7e0\") " pod="openshift-multus/multus-additional-cni-plugins-cs6zp"
Jul 15 14:33:39.397223 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.396570    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2baab41c-7646-411f-acbd-f0eb28f82489-os-release\") pod \"multus-5jrhz\" (UID: \"2baab41c-7646-411f-acbd-f0eb28f82489\") " pod="openshift-multus/multus-5jrhz"
Jul 15 14:33:39.397223 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.396542    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/2baab41c-7646-411f-acbd-f0eb28f82489-host-run-netns\") pod \"multus-5jrhz\" (UID: \"2baab41c-7646-411f-acbd-f0eb28f82489\") " pod="openshift-multus/multus-5jrhz"
Jul 15 14:33:39.397223 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.396544    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/2baab41c-7646-411f-acbd-f0eb28f82489-host-var-lib-cni-bin\") pod \"multus-5jrhz\" (UID: \"2baab41c-7646-411f-acbd-f0eb28f82489\") " pod="openshift-multus/multus-5jrhz"
Jul 15 14:33:39.397223 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.396606    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2baab41c-7646-411f-acbd-f0eb28f82489-multus-conf-dir\") pod \"multus-5jrhz\" (UID: \"2baab41c-7646-411f-acbd-f0eb28f82489\") " pod="openshift-multus/multus-5jrhz"
Jul 15 14:33:39.397764 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.396627    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/2baab41c-7646-411f-acbd-f0eb28f82489-cnibin\") pod \"multus-5jrhz\" (UID: \"2baab41c-7646-411f-acbd-f0eb28f82489\") " pod="openshift-multus/multus-5jrhz"
Jul 15 14:33:39.397764 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.396638    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9f578de8-ae1f-4aa2-a034-0e029991f7e0-os-release\") pod \"multus-additional-cni-plugins-cs6zp\" (UID: \"9f578de8-ae1f-4aa2-a034-0e029991f7e0\") " pod="openshift-multus/multus-additional-cni-plugins-cs6zp"
Jul 15 14:33:39.397764 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.396656    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/2baab41c-7646-411f-acbd-f0eb28f82489-os-release\") pod \"multus-5jrhz\" (UID: \"2baab41c-7646-411f-acbd-f0eb28f82489\") " pod="openshift-multus/multus-5jrhz"
Jul 15 14:33:39.397764 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.396669    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/2baab41c-7646-411f-acbd-f0eb28f82489-cni-binary-copy\") pod \"multus-5jrhz\" (UID: \"2baab41c-7646-411f-acbd-f0eb28f82489\") " pod="openshift-multus/multus-5jrhz"
Jul 15 14:33:39.397764 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.396670    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac-etc-tuned\") pod \"tuned-h9tlc\" (UID: \"6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac\") " pod="openshift-cluster-node-tuning-operator/tuned-h9tlc"
Jul 15 14:33:39.397764 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.396691    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/2baab41c-7646-411f-acbd-f0eb28f82489-multus-conf-dir\") pod \"multus-5jrhz\" (UID: \"2baab41c-7646-411f-acbd-f0eb28f82489\") " pod="openshift-multus/multus-5jrhz"
Jul 15 14:33:39.397764 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.396708    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/9f578de8-ae1f-4aa2-a034-0e029991f7e0-os-release\") pod \"multus-additional-cni-plugins-cs6zp\" (UID: \"9f578de8-ae1f-4aa2-a034-0e029991f7e0\") " pod="openshift-multus/multus-additional-cni-plugins-cs6zp"
Jul 15 14:33:39.397764 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.396718    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2baab41c-7646-411f-acbd-f0eb28f82489-multus-socket-dir-parent\") pod \"multus-5jrhz\" (UID: \"2baab41c-7646-411f-acbd-f0eb28f82489\") " pod="openshift-multus/multus-5jrhz"
Jul 15 14:33:39.397764 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.396745    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2baab41c-7646-411f-acbd-f0eb28f82489-multus-daemon-config\") pod \"multus-5jrhz\" (UID: \"2baab41c-7646-411f-acbd-f0eb28f82489\") " pod="openshift-multus/multus-5jrhz"
Jul 15 14:33:39.397764 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.396760    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/2baab41c-7646-411f-acbd-f0eb28f82489-multus-socket-dir-parent\") pod \"multus-5jrhz\" (UID: \"2baab41c-7646-411f-acbd-f0eb28f82489\") " pod="openshift-multus/multus-5jrhz"
Jul 15 14:33:39.397764 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.396774    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4a14d87d-5fd3-40b7-b753-4758b15dd501-original-pull-secret\") pod \"global-pull-secret-syncer-7b98l\" (UID: \"4a14d87d-5fd3-40b7-b753-4758b15dd501\") " pod="kube-system/global-pull-secret-syncer-7b98l"
Jul 15 14:33:39.397764 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.396804    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/9f578de8-ae1f-4aa2-a034-0e029991f7e0-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-cs6zp\" (UID: \"9f578de8-ae1f-4aa2-a034-0e029991f7e0\") " pod="openshift-multus/multus-additional-cni-plugins-cs6zp"
Jul 15 14:33:39.397764 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.396891    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/9f578de8-ae1f-4aa2-a034-0e029991f7e0-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-cs6zp\" (UID: \"9f578de8-ae1f-4aa2-a034-0e029991f7e0\") " pod="openshift-multus/multus-additional-cni-plugins-cs6zp"
Jul 15 14:33:39.397764 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.397228    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/2baab41c-7646-411f-acbd-f0eb28f82489-multus-daemon-config\") pod \"multus-5jrhz\" (UID: \"2baab41c-7646-411f-acbd-f0eb28f82489\") " pod="openshift-multus/multus-5jrhz"
Jul 15 14:33:39.416551 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.416516    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wsmj5\" (UniqueName: \"kubernetes.io/projected/eff6ee84-dee0-429b-9edc-df30874ebd31-kube-api-access-wsmj5\") pod \"network-metrics-daemon-g49wp\" (UID: \"eff6ee84-dee0-429b-9edc-df30874ebd31\") " pod="openshift-multus/network-metrics-daemon-g49wp"
Jul 15 14:33:39.423527 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.423508    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5dmfl\" (UniqueName: \"kubernetes.io/projected/2baab41c-7646-411f-acbd-f0eb28f82489-kube-api-access-5dmfl\") pod \"multus-5jrhz\" (UID: \"2baab41c-7646-411f-acbd-f0eb28f82489\") " pod="openshift-multus/multus-5jrhz"
Jul 15 14:33:39.431329 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.431301    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zc2q8\" (UniqueName: \"kubernetes.io/projected/9f578de8-ae1f-4aa2-a034-0e029991f7e0-kube-api-access-zc2q8\") pod \"multus-additional-cni-plugins-cs6zp\" (UID: \"9f578de8-ae1f-4aa2-a034-0e029991f7e0\") " pod="openshift-multus/multus-additional-cni-plugins-cs6zp"
Jul 15 14:33:39.489218 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.489126    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2"
Jul 15 14:33:39.497699 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.497673    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4a14d87d-5fd3-40b7-b753-4758b15dd501-dbus\") pod \"global-pull-secret-syncer-7b98l\" (UID: \"4a14d87d-5fd3-40b7-b753-4758b15dd501\") " pod="kube-system/global-pull-secret-syncer-7b98l"
Jul 15 14:33:39.497819 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.497712    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac-run\") pod \"tuned-h9tlc\" (UID: \"6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac\") " pod="openshift-cluster-node-tuning-operator/tuned-h9tlc"
Jul 15 14:33:39.497819 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.497755    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/4a14d87d-5fd3-40b7-b753-4758b15dd501-dbus\") pod \"global-pull-secret-syncer-7b98l\" (UID: \"4a14d87d-5fd3-40b7-b753-4758b15dd501\") " pod="kube-system/global-pull-secret-syncer-7b98l"
Jul 15 14:33:39.497819 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.497757    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac-lib-modules\") pod \"tuned-h9tlc\" (UID: \"6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac\") " pod="openshift-cluster-node-tuning-operator/tuned-h9tlc"
Jul 15 14:33:39.497819 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.497799    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac-var-lib-kubelet\") pod \"tuned-h9tlc\" (UID: \"6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac\") " pod="openshift-cluster-node-tuning-operator/tuned-h9tlc"
Jul 15 14:33:39.498017 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.497822    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4a14d87d-5fd3-40b7-b753-4758b15dd501-kubelet-config\") pod \"global-pull-secret-syncer-7b98l\" (UID: \"4a14d87d-5fd3-40b7-b753-4758b15dd501\") " pod="kube-system/global-pull-secret-syncer-7b98l"
Jul 15 14:33:39.498017 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.497857    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac-run\") pod \"tuned-h9tlc\" (UID: \"6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac\") " pod="openshift-cluster-node-tuning-operator/tuned-h9tlc"
Jul 15 14:33:39.498017 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.497879    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac-var-lib-kubelet\") pod \"tuned-h9tlc\" (UID: \"6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac\") " pod="openshift-cluster-node-tuning-operator/tuned-h9tlc"
Jul 15 14:33:39.498017 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.497865    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac-etc-kubernetes\") pod \"tuned-h9tlc\" (UID: \"6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac\") " pod="openshift-cluster-node-tuning-operator/tuned-h9tlc"
Jul 15 14:33:39.498017 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.497913    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac-lib-modules\") pod \"tuned-h9tlc\" (UID: \"6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac\") " pod="openshift-cluster-node-tuning-operator/tuned-h9tlc"
Jul 15 14:33:39.498017 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.497930    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/4a14d87d-5fd3-40b7-b753-4758b15dd501-kubelet-config\") pod \"global-pull-secret-syncer-7b98l\" (UID: \"4a14d87d-5fd3-40b7-b753-4758b15dd501\") " pod="kube-system/global-pull-secret-syncer-7b98l"
Jul 15 14:33:39.498017 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.497930    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac-etc-kubernetes\") pod \"tuned-h9tlc\" (UID: \"6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac\") " pod="openshift-cluster-node-tuning-operator/tuned-h9tlc"
Jul 15 14:33:39.498017 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.497945    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac-etc-tuned\") pod \"tuned-h9tlc\" (UID: \"6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac\") " pod="openshift-cluster-node-tuning-operator/tuned-h9tlc"
Jul 15 14:33:39.498017 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.497976    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4a14d87d-5fd3-40b7-b753-4758b15dd501-original-pull-secret\") pod \"global-pull-secret-syncer-7b98l\" (UID: \"4a14d87d-5fd3-40b7-b753-4758b15dd501\") " pod="kube-system/global-pull-secret-syncer-7b98l"
Jul 15 14:33:39.498017 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.498018    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac-etc-modprobe-d\") pod \"tuned-h9tlc\" (UID: \"6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac\") " pod="openshift-cluster-node-tuning-operator/tuned-h9tlc"
Jul 15 14:33:39.498379 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:39.498149    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 14:33:39.498379 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:39.498197    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a14d87d-5fd3-40b7-b753-4758b15dd501-original-pull-secret podName:4a14d87d-5fd3-40b7-b753-4758b15dd501 nodeName:}" failed. No retries permitted until 2026-07-15 14:33:39.998182732 +0000 UTC m=+3.514000596 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4a14d87d-5fd3-40b7-b753-4758b15dd501-original-pull-secret") pod "global-pull-secret-syncer-7b98l" (UID: "4a14d87d-5fd3-40b7-b753-4758b15dd501") : object "kube-system"/"original-pull-secret" not registered
Jul 15 14:33:39.498379 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.498192    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac-etc-sysconfig\") pod \"tuned-h9tlc\" (UID: \"6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac\") " pod="openshift-cluster-node-tuning-operator/tuned-h9tlc"
Jul 15 14:33:39.498379 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.498219    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac-etc-sysctl-d\") pod \"tuned-h9tlc\" (UID: \"6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac\") " pod="openshift-cluster-node-tuning-operator/tuned-h9tlc"
Jul 15 14:33:39.498379 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.498236    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac-etc-sysctl-conf\") pod \"tuned-h9tlc\" (UID: \"6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac\") " pod="openshift-cluster-node-tuning-operator/tuned-h9tlc"
Jul 15 14:33:39.498379 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.498239    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac-etc-sysconfig\") pod \"tuned-h9tlc\" (UID: \"6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac\") " pod="openshift-cluster-node-tuning-operator/tuned-h9tlc"
Jul 15 14:33:39.498379 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.498264    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac-tmp\") pod \"tuned-h9tlc\" (UID: \"6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac\") " pod="openshift-cluster-node-tuning-operator/tuned-h9tlc"
Jul 15 14:33:39.498379 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.498285    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac-etc-modprobe-d\") pod \"tuned-h9tlc\" (UID: \"6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac\") " pod="openshift-cluster-node-tuning-operator/tuned-h9tlc"
Jul 15 14:33:39.498379 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.498304    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmgxm\" (UniqueName: \"kubernetes.io/projected/6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac-kube-api-access-gmgxm\") pod \"tuned-h9tlc\" (UID: \"6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac\") " pod="openshift-cluster-node-tuning-operator/tuned-h9tlc"
Jul 15 14:33:39.498379 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.498330    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac-etc-systemd\") pod \"tuned-h9tlc\" (UID: \"6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac\") " pod="openshift-cluster-node-tuning-operator/tuned-h9tlc"
Jul 15 14:33:39.498379 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.498350    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac-sys\") pod \"tuned-h9tlc\" (UID: \"6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac\") " pod="openshift-cluster-node-tuning-operator/tuned-h9tlc"
Jul 15 14:33:39.498379 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.498375    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac-host\") pod \"tuned-h9tlc\" (UID: \"6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac\") " pod="openshift-cluster-node-tuning-operator/tuned-h9tlc"
Jul 15 14:33:39.498788 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.498396    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac-etc-sysctl-d\") pod \"tuned-h9tlc\" (UID: \"6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac\") " pod="openshift-cluster-node-tuning-operator/tuned-h9tlc"
Jul 15 14:33:39.498788 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.498416    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac-etc-sysctl-conf\") pod \"tuned-h9tlc\" (UID: \"6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac\") " pod="openshift-cluster-node-tuning-operator/tuned-h9tlc"
Jul 15 14:33:39.498788 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.498456    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac-sys\") pod \"tuned-h9tlc\" (UID: \"6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac\") " pod="openshift-cluster-node-tuning-operator/tuned-h9tlc"
Jul 15 14:33:39.498788 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.498489    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac-etc-systemd\") pod \"tuned-h9tlc\" (UID: \"6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac\") " pod="openshift-cluster-node-tuning-operator/tuned-h9tlc"
Jul 15 14:33:39.498788 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.498528    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac-host\") pod \"tuned-h9tlc\" (UID: \"6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac\") " pod="openshift-cluster-node-tuning-operator/tuned-h9tlc"
Jul 15 14:33:39.500224 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.500206    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac-etc-tuned\") pod \"tuned-h9tlc\" (UID: \"6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac\") " pod="openshift-cluster-node-tuning-operator/tuned-h9tlc"
Jul 15 14:33:39.500297 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.500267    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac-tmp\") pod \"tuned-h9tlc\" (UID: \"6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac\") " pod="openshift-cluster-node-tuning-operator/tuned-h9tlc"
Jul 15 14:33:39.513891 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.513868    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmgxm\" (UniqueName: \"kubernetes.io/projected/6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac-kube-api-access-gmgxm\") pod \"tuned-h9tlc\" (UID: \"6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac\") " pod="openshift-cluster-node-tuning-operator/tuned-h9tlc"
Jul 15 14:33:39.545601 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.545573    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-cs6zp"
Jul 15 14:33:39.578608 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.578548    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-14 14:28:38 +0000 UTC" deadline="2028-02-09 21:09:02.774519188 +0000 UTC"
Jul 15 14:33:39.578608 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.578605    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13782h35m23.195917035s"
Jul 15 14:33:39.606012 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.605981    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-5jrhz"
Jul 15 14:33:39.642781 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.642746    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-h9tlc"
Jul 15 14:33:39.699697 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.699657    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkfs5\" (UniqueName: \"kubernetes.io/projected/109886c7-ff5d-49ac-9bf9-012740e3417f-kube-api-access-vkfs5\") pod \"network-check-target-878zd\" (UID: \"109886c7-ff5d-49ac-9bf9-012740e3417f\") " pod="openshift-network-diagnostics/network-check-target-878zd"
Jul 15 14:33:39.699926 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:39.699824    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 14:33:39.699926 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:39.699845    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 14:33:39.699926 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:39.699855    2571 projected.go:196] Error preparing data for projected volume kube-api-access-vkfs5 for pod openshift-network-diagnostics/network-check-target-878zd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 14:33:39.699926 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:39.699912    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/109886c7-ff5d-49ac-9bf9-012740e3417f-kube-api-access-vkfs5 podName:109886c7-ff5d-49ac-9bf9-012740e3417f nodeName:}" failed. No retries permitted until 2026-07-15 14:33:40.699897989 +0000 UTC m=+4.215715842 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vkfs5" (UniqueName: "kubernetes.io/projected/109886c7-ff5d-49ac-9bf9-012740e3417f-kube-api-access-vkfs5") pod "network-check-target-878zd" (UID: "109886c7-ff5d-49ac-9bf9-012740e3417f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 14:33:39.838402 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.838342    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 14:28:39 +0000 UTC" deadline="2028-03-30 18:39:38.096841872 +0000 UTC"
Jul 15 14:33:39.838402 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.838398    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14980h5m58.258446727s"
Jul 15 14:33:39.852332 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:39.852246    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod55343882_5974_45a9_b3e2_cfff9bec7863.slice/crio-620f0b350e7f8510831ee0c4fde797bd08a16e1042512df76f746320c6909e65 WatchSource:0}: Error finding container 620f0b350e7f8510831ee0c4fde797bd08a16e1042512df76f746320c6909e65: Status 404 returned error can't find the container with id 620f0b350e7f8510831ee0c4fde797bd08a16e1042512df76f746320c6909e65
Jul 15 14:33:39.852670 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:39.852645    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1d4ca67_bb3b_4f02_a744_de494982cffa.slice/crio-02537cd0493b7f2001d9b9ca2207286cc4ededa3140d4da9de5422e04114cb39 WatchSource:0}: Error finding container 02537cd0493b7f2001d9b9ca2207286cc4ededa3140d4da9de5422e04114cb39: Status 404 returned error can't find the container with id 02537cd0493b7f2001d9b9ca2207286cc4ededa3140d4da9de5422e04114cb39
Jul 15 14:33:39.853491 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:39.853465    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod251749ce_0465_4ac6_b2c6_dfb3ac64981b.slice/crio-01de2b301ed11b425407afa7d8d29c94d8016053fb66fa1a3f36ff18fb0177ad WatchSource:0}: Error finding container 01de2b301ed11b425407afa7d8d29c94d8016053fb66fa1a3f36ff18fb0177ad: Status 404 returned error can't find the container with id 01de2b301ed11b425407afa7d8d29c94d8016053fb66fa1a3f36ff18fb0177ad
Jul 15 14:33:39.854185 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:39.854153    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bc0c7a3681d7c042fbc0dd13cac7333.slice/crio-e9967ba4d290c2b93500dc41a37ab8e1017333c1511e9f277bfd478068aadd29 WatchSource:0}: Error finding container e9967ba4d290c2b93500dc41a37ab8e1017333c1511e9f277bfd478068aadd29: Status 404 returned error can't find the container with id e9967ba4d290c2b93500dc41a37ab8e1017333c1511e9f277bfd478068aadd29
Jul 15 14:33:39.858736 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.858716    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 14:33:39.867574 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:39.867546    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod144a8b5d_13b7_4453_8bd5_963d4c7815c8.slice/crio-8ff44733d43bda222691c95c851bd7f80da2974c2032805aacfb9aa1c01d27e3 WatchSource:0}: Error finding container 8ff44733d43bda222691c95c851bd7f80da2974c2032805aacfb9aa1c01d27e3: Status 404 returned error can't find the container with id 8ff44733d43bda222691c95c851bd7f80da2974c2032805aacfb9aa1c01d27e3
Jul 15 14:33:39.900657 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:39.900616    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eff6ee84-dee0-429b-9edc-df30874ebd31-metrics-certs\") pod \"network-metrics-daemon-g49wp\" (UID: \"eff6ee84-dee0-429b-9edc-df30874ebd31\") " pod="openshift-multus/network-metrics-daemon-g49wp"
Jul 15 14:33:39.900826 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:39.900792    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 14:33:39.900872 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:39.900858    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eff6ee84-dee0-429b-9edc-df30874ebd31-metrics-certs podName:eff6ee84-dee0-429b-9edc-df30874ebd31 nodeName:}" failed. No retries permitted until 2026-07-15 14:33:40.900842535 +0000 UTC m=+4.416660392 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eff6ee84-dee0-429b-9edc-df30874ebd31-metrics-certs") pod "network-metrics-daemon-g49wp" (UID: "eff6ee84-dee0-429b-9edc-df30874ebd31") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 14:33:39.938057 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:39.938032    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f578de8_ae1f_4aa2_a034_0e029991f7e0.slice/crio-c1e60c312fbb9e7c45d48e84f4f4b34ed62cf9d1507058bb0e136d5f956d72fc WatchSource:0}: Error finding container c1e60c312fbb9e7c45d48e84f4f4b34ed62cf9d1507058bb0e136d5f956d72fc: Status 404 returned error can't find the container with id c1e60c312fbb9e7c45d48e84f4f4b34ed62cf9d1507058bb0e136d5f956d72fc
Jul 15 14:33:39.955615 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:39.955588    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c90a46431eae6b3cdd7f5745d0d2187.slice/crio-70744f806dfc83311e4c29a472cc21144c7b76231c86734cf9cbbf478a44c0c7 WatchSource:0}: Error finding container 70744f806dfc83311e4c29a472cc21144c7b76231c86734cf9cbbf478a44c0c7: Status 404 returned error can't find the container with id 70744f806dfc83311e4c29a472cc21144c7b76231c86734cf9cbbf478a44c0c7
Jul 15 14:33:40.001331 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:40.001285    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4a14d87d-5fd3-40b7-b753-4758b15dd501-original-pull-secret\") pod \"global-pull-secret-syncer-7b98l\" (UID: \"4a14d87d-5fd3-40b7-b753-4758b15dd501\") " pod="kube-system/global-pull-secret-syncer-7b98l"
Jul 15 14:33:40.001484 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:40.001465    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 14:33:40.001548 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:40.001538    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a14d87d-5fd3-40b7-b753-4758b15dd501-original-pull-secret podName:4a14d87d-5fd3-40b7-b753-4758b15dd501 nodeName:}" failed. No retries permitted until 2026-07-15 14:33:41.001521456 +0000 UTC m=+4.517339316 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4a14d87d-5fd3-40b7-b753-4758b15dd501-original-pull-secret") pod "global-pull-secret-syncer-7b98l" (UID: "4a14d87d-5fd3-40b7-b753-4758b15dd501") : object "kube-system"/"original-pull-secret" not registered
Jul 15 14:33:40.018243 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:40.018217    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12bf26b1_5c4a_4e51_beb3_b17d7e7c4656.slice/crio-d82284c18c8aba2abcd365146ffd585253aa694c13a2904baf2d8dcc1e091fa9 WatchSource:0}: Error finding container d82284c18c8aba2abcd365146ffd585253aa694c13a2904baf2d8dcc1e091fa9: Status 404 returned error can't find the container with id d82284c18c8aba2abcd365146ffd585253aa694c13a2904baf2d8dcc1e091fa9
Jul 15 14:33:40.045966 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:40.045945    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 15 14:33:40.061299 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:40.061262    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6e6d1e85_cdbe_411f_9f1d_fcd26b2513ac.slice/crio-6c363048b157f20cc6dc356ee90694ce98cadd2399dcf25ce60fc6484368a788 WatchSource:0}: Error finding container 6c363048b157f20cc6dc356ee90694ce98cadd2399dcf25ce60fc6484368a788: Status 404 returned error can't find the container with id 6c363048b157f20cc6dc356ee90694ce98cadd2399dcf25ce60fc6484368a788
Jul 15 14:33:40.144744 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:40.144721    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 15 14:33:40.147194 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:40.147165    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2baab41c_7646_411f_acbd_f0eb28f82489.slice/crio-0923db3d619c00ae843c14a0f70589c923138fe1c213c5913f5f15ded2936875 WatchSource:0}: Error finding container 0923db3d619c00ae843c14a0f70589c923138fe1c213c5913f5f15ded2936875: Status 404 returned error can't find the container with id 0923db3d619c00ae843c14a0f70589c923138fe1c213c5913f5f15ded2936875
Jul 15 14:33:40.307171 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:40.307137    2571 projected.go:291] Couldn't get configMap openshift-cluster-csi-drivers/kube-root-ca.crt: failed to sync configmap cache: timed out waiting for the condition
Jul 15 14:33:40.307171 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:40.307185    2571 projected.go:196] Error preparing data for projected volume kube-api-access-kw59d for pod openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c4b59: failed to sync configmap cache: timed out waiting for the condition
Jul 15 14:33:40.307441 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:40.307251    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3464d623-ebc8-4b3f-8c92-41cc16c406a9-kube-api-access-kw59d podName:3464d623-ebc8-4b3f-8c92-41cc16c406a9 nodeName:}" failed. No retries permitted until 2026-07-15 14:33:40.807233852 +0000 UTC m=+4.323051706 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-kw59d" (UniqueName: "kubernetes.io/projected/3464d623-ebc8-4b3f-8c92-41cc16c406a9-kube-api-access-kw59d") pod "aws-ebs-csi-driver-node-c4b59" (UID: "3464d623-ebc8-4b3f-8c92-41cc16c406a9") : failed to sync configmap cache: timed out waiting for the condition
Jul 15 14:33:40.342193 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:40.342171    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-r8c9t\""
Jul 15 14:33:40.548580 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:40.548499    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 15 14:33:40.558523 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:40.558257    2571 log.go:32] "PullImage from image service failed" err="rpc error: code = Unknown desc = unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image" image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0595b1d6de8e08ddb61ce581075357331193db6206d341c15cf213514ef0f693"
Jul 15 14:33:40.558523 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:40.558415    2571 kuberuntime_manager.go:1459] "Unhandled Error" err="container haproxy start failed in pod kube-apiserver-proxy-ip-10-0-140-61.ec2.internal_kube-system(5c90a46431eae6b3cdd7f5745d0d2187): ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image" logger="UnhandledError"
Jul 15 14:33:40.558523 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:40.558459    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"haproxy\" with ErrImagePull: \"unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image\"" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-61.ec2.internal" podUID="5c90a46431eae6b3cdd7f5745d0d2187"
Jul 15 14:33:40.708101 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:40.707743    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkfs5\" (UniqueName: \"kubernetes.io/projected/109886c7-ff5d-49ac-9bf9-012740e3417f-kube-api-access-vkfs5\") pod \"network-check-target-878zd\" (UID: \"109886c7-ff5d-49ac-9bf9-012740e3417f\") " pod="openshift-network-diagnostics/network-check-target-878zd"
Jul 15 14:33:40.708101 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:40.707944    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 14:33:40.708101 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:40.707965    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 14:33:40.708101 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:40.707994    2571 projected.go:196] Error preparing data for projected volume kube-api-access-vkfs5 for pod openshift-network-diagnostics/network-check-target-878zd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 14:33:40.708101 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:40.708057    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/109886c7-ff5d-49ac-9bf9-012740e3417f-kube-api-access-vkfs5 podName:109886c7-ff5d-49ac-9bf9-012740e3417f nodeName:}" failed. No retries permitted until 2026-07-15 14:33:42.708038708 +0000 UTC m=+6.223856564 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vkfs5" (UniqueName: "kubernetes.io/projected/109886c7-ff5d-49ac-9bf9-012740e3417f-kube-api-access-vkfs5") pod "network-check-target-878zd" (UID: "109886c7-ff5d-49ac-9bf9-012740e3417f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 14:33:40.751143 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:40.750449    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g49wp"
Jul 15 14:33:40.751143 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:40.750607    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g49wp" podUID="eff6ee84-dee0-429b-9edc-df30874ebd31"
Jul 15 14:33:40.751143 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:40.750702    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7b98l"
Jul 15 14:33:40.751143 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:40.750790    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7b98l" podUID="4a14d87d-5fd3-40b7-b753-4758b15dd501"
Jul 15 14:33:40.751143 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:40.750848    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-878zd"
Jul 15 14:33:40.751143 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:40.750914    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-878zd" podUID="109886c7-ff5d-49ac-9bf9-012740e3417f"
Jul 15 14:33:40.759808 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:40.759752    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2" event={"ID":"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656","Type":"ContainerStarted","Data":"d82284c18c8aba2abcd365146ffd585253aa694c13a2904baf2d8dcc1e091fa9"}
Jul 15 14:33:40.763313 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:40.762576    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-61.ec2.internal" event={"ID":"5c90a46431eae6b3cdd7f5745d0d2187","Type":"ContainerStarted","Data":"70744f806dfc83311e4c29a472cc21144c7b76231c86734cf9cbbf478a44c0c7"}
Jul 15 14:33:40.764302 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:40.764168    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"haproxy\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0595b1d6de8e08ddb61ce581075357331193db6206d341c15cf213514ef0f693\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image\"" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-61.ec2.internal" podUID="5c90a46431eae6b3cdd7f5745d0d2187"
Jul 15 14:33:40.774649 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:40.774561    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cs6zp" event={"ID":"9f578de8-ae1f-4aa2-a034-0e029991f7e0","Type":"ContainerStarted","Data":"c1e60c312fbb9e7c45d48e84f4f4b34ed62cf9d1507058bb0e136d5f956d72fc"}
Jul 15 14:33:40.776614 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:40.776589    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jw9j8" event={"ID":"144a8b5d-13b7-4453-8bd5-963d4c7815c8","Type":"ContainerStarted","Data":"8ff44733d43bda222691c95c851bd7f80da2974c2032805aacfb9aa1c01d27e3"}
Jul 15 14:33:40.783785 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:40.783740    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-42cjp" event={"ID":"d1d4ca67-bb3b-4f02-a744-de494982cffa","Type":"ContainerStarted","Data":"02537cd0493b7f2001d9b9ca2207286cc4ededa3140d4da9de5422e04114cb39"}
Jul 15 14:33:40.792243 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:40.792217    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8r6d7" event={"ID":"251749ce-0465-4ac6-b2c6-dfb3ac64981b","Type":"ContainerStarted","Data":"01de2b301ed11b425407afa7d8d29c94d8016053fb66fa1a3f36ff18fb0177ad"}
Jul 15 14:33:40.804557 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:40.804442    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5jrhz" event={"ID":"2baab41c-7646-411f-acbd-f0eb28f82489","Type":"ContainerStarted","Data":"0923db3d619c00ae843c14a0f70589c923138fe1c213c5913f5f15ded2936875"}
Jul 15 14:33:40.808444 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:40.808417    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kw59d\" (UniqueName: \"kubernetes.io/projected/3464d623-ebc8-4b3f-8c92-41cc16c406a9-kube-api-access-kw59d\") pod \"aws-ebs-csi-driver-node-c4b59\" (UID: \"3464d623-ebc8-4b3f-8c92-41cc16c406a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c4b59"
Jul 15 14:33:40.813349 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:40.813321    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-h9tlc" event={"ID":"6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac","Type":"ContainerStarted","Data":"6c363048b157f20cc6dc356ee90694ce98cadd2399dcf25ce60fc6484368a788"}
Jul 15 14:33:40.824080 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:40.824006    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal" event={"ID":"4bc0c7a3681d7c042fbc0dd13cac7333","Type":"ContainerStarted","Data":"e9967ba4d290c2b93500dc41a37ab8e1017333c1511e9f277bfd478068aadd29"}
Jul 15 14:33:40.826476 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:40.826448    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kw59d\" (UniqueName: \"kubernetes.io/projected/3464d623-ebc8-4b3f-8c92-41cc16c406a9-kube-api-access-kw59d\") pod \"aws-ebs-csi-driver-node-c4b59\" (UID: \"3464d623-ebc8-4b3f-8c92-41cc16c406a9\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c4b59"
Jul 15 14:33:40.831726 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:40.831663    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wvfhr" event={"ID":"55343882-5974-45a9-b3e2-cfff9bec7863","Type":"ContainerStarted","Data":"620f0b350e7f8510831ee0c4fde797bd08a16e1042512df76f746320c6909e65"}
Jul 15 14:33:40.839102 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:40.839044    2571 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 14:28:39 +0000 UTC" deadline="2028-02-29 03:31:44.665697074 +0000 UTC"
Jul 15 14:33:40.839102 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:40.839102    2571 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14244h58m3.826598845s"
Jul 15 14:33:40.909779 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:40.909444    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eff6ee84-dee0-429b-9edc-df30874ebd31-metrics-certs\") pod \"network-metrics-daemon-g49wp\" (UID: \"eff6ee84-dee0-429b-9edc-df30874ebd31\") " pod="openshift-multus/network-metrics-daemon-g49wp"
Jul 15 14:33:40.909779 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:40.909641    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 14:33:40.909779 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:40.909716    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eff6ee84-dee0-429b-9edc-df30874ebd31-metrics-certs podName:eff6ee84-dee0-429b-9edc-df30874ebd31 nodeName:}" failed. No retries permitted until 2026-07-15 14:33:42.909695901 +0000 UTC m=+6.425513758 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eff6ee84-dee0-429b-9edc-df30874ebd31-metrics-certs") pod "network-metrics-daemon-g49wp" (UID: "eff6ee84-dee0-429b-9edc-df30874ebd31") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 14:33:40.994034 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:40.993720    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c4b59"
Jul 15 14:33:41.010619 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:41.010334    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4a14d87d-5fd3-40b7-b753-4758b15dd501-original-pull-secret\") pod \"global-pull-secret-syncer-7b98l\" (UID: \"4a14d87d-5fd3-40b7-b753-4758b15dd501\") " pod="kube-system/global-pull-secret-syncer-7b98l"
Jul 15 14:33:41.010619 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:41.010506    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 14:33:41.010619 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:41.010579    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a14d87d-5fd3-40b7-b753-4758b15dd501-original-pull-secret podName:4a14d87d-5fd3-40b7-b753-4758b15dd501 nodeName:}" failed. No retries permitted until 2026-07-15 14:33:43.010559032 +0000 UTC m=+6.526376884 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4a14d87d-5fd3-40b7-b753-4758b15dd501-original-pull-secret") pod "global-pull-secret-syncer-7b98l" (UID: "4a14d87d-5fd3-40b7-b753-4758b15dd501") : object "kube-system"/"original-pull-secret" not registered
Jul 15 14:33:41.015487 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:33:41.015446    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3464d623_ebc8_4b3f_8c92_41cc16c406a9.slice/crio-48021439d005bf66ec0000bac880cd2d0bd912b0f010ca7168cbc644b6e527ed WatchSource:0}: Error finding container 48021439d005bf66ec0000bac880cd2d0bd912b0f010ca7168cbc644b6e527ed: Status 404 returned error can't find the container with id 48021439d005bf66ec0000bac880cd2d0bd912b0f010ca7168cbc644b6e527ed
Jul 15 14:33:41.844382 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:41.843573    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c4b59" event={"ID":"3464d623-ebc8-4b3f-8c92-41cc16c406a9","Type":"ContainerStarted","Data":"48021439d005bf66ec0000bac880cd2d0bd912b0f010ca7168cbc644b6e527ed"}
Jul 15 14:33:41.845088 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:41.844999    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"haproxy\" with ImagePullBackOff: \"Back-off pulling image \\\"quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:0595b1d6de8e08ddb61ce581075357331193db6206d341c15cf213514ef0f693\\\": ErrImagePull: unable to pull image or OCI artifact: pull image err: copying system image from manifest list: parsing image configuration: fetching blob: received unexpected HTTP status: 503 Service Unavailable; artifact err: provided artifact is a container image\"" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-61.ec2.internal" podUID="5c90a46431eae6b3cdd7f5745d0d2187"
Jul 15 14:33:42.727361 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:42.727315    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkfs5\" (UniqueName: \"kubernetes.io/projected/109886c7-ff5d-49ac-9bf9-012740e3417f-kube-api-access-vkfs5\") pod \"network-check-target-878zd\" (UID: \"109886c7-ff5d-49ac-9bf9-012740e3417f\") " pod="openshift-network-diagnostics/network-check-target-878zd"
Jul 15 14:33:42.727866 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:42.727495    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 14:33:42.727866 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:42.727518    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 14:33:42.727866 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:42.727534    2571 projected.go:196] Error preparing data for projected volume kube-api-access-vkfs5 for pod openshift-network-diagnostics/network-check-target-878zd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 14:33:42.727866 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:42.727596    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/109886c7-ff5d-49ac-9bf9-012740e3417f-kube-api-access-vkfs5 podName:109886c7-ff5d-49ac-9bf9-012740e3417f nodeName:}" failed. No retries permitted until 2026-07-15 14:33:46.727576183 +0000 UTC m=+10.243394037 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vkfs5" (UniqueName: "kubernetes.io/projected/109886c7-ff5d-49ac-9bf9-012740e3417f-kube-api-access-vkfs5") pod "network-check-target-878zd" (UID: "109886c7-ff5d-49ac-9bf9-012740e3417f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 14:33:42.750157 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:42.749768    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g49wp"
Jul 15 14:33:42.750157 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:42.749791    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-878zd"
Jul 15 14:33:42.750157 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:42.749917    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g49wp" podUID="eff6ee84-dee0-429b-9edc-df30874ebd31"
Jul 15 14:33:42.750157 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:42.750005    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-878zd" podUID="109886c7-ff5d-49ac-9bf9-012740e3417f"
Jul 15 14:33:42.750157 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:42.750042    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7b98l"
Jul 15 14:33:42.750157 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:42.750113    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7b98l" podUID="4a14d87d-5fd3-40b7-b753-4758b15dd501"
Jul 15 14:33:42.929353 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:42.929069    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eff6ee84-dee0-429b-9edc-df30874ebd31-metrics-certs\") pod \"network-metrics-daemon-g49wp\" (UID: \"eff6ee84-dee0-429b-9edc-df30874ebd31\") " pod="openshift-multus/network-metrics-daemon-g49wp"
Jul 15 14:33:42.929353 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:42.929221    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 14:33:42.929353 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:42.929292    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eff6ee84-dee0-429b-9edc-df30874ebd31-metrics-certs podName:eff6ee84-dee0-429b-9edc-df30874ebd31 nodeName:}" failed. No retries permitted until 2026-07-15 14:33:46.929274415 +0000 UTC m=+10.445092289 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eff6ee84-dee0-429b-9edc-df30874ebd31-metrics-certs") pod "network-metrics-daemon-g49wp" (UID: "eff6ee84-dee0-429b-9edc-df30874ebd31") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 14:33:43.029792 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:43.029537    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4a14d87d-5fd3-40b7-b753-4758b15dd501-original-pull-secret\") pod \"global-pull-secret-syncer-7b98l\" (UID: \"4a14d87d-5fd3-40b7-b753-4758b15dd501\") " pod="kube-system/global-pull-secret-syncer-7b98l"
Jul 15 14:33:43.029792 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:43.029634    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 14:33:43.029792 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:43.029711    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a14d87d-5fd3-40b7-b753-4758b15dd501-original-pull-secret podName:4a14d87d-5fd3-40b7-b753-4758b15dd501 nodeName:}" failed. No retries permitted until 2026-07-15 14:33:47.029691017 +0000 UTC m=+10.545508874 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4a14d87d-5fd3-40b7-b753-4758b15dd501-original-pull-secret") pod "global-pull-secret-syncer-7b98l" (UID: "4a14d87d-5fd3-40b7-b753-4758b15dd501") : object "kube-system"/"original-pull-secret" not registered
Jul 15 14:33:44.747195 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:44.747164    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g49wp"
Jul 15 14:33:44.747696 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:44.747179    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7b98l"
Jul 15 14:33:44.747696 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:44.747351    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-878zd"
Jul 15 14:33:44.747696 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:44.747366    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g49wp" podUID="eff6ee84-dee0-429b-9edc-df30874ebd31"
Jul 15 14:33:44.747696 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:44.747461    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-878zd" podUID="109886c7-ff5d-49ac-9bf9-012740e3417f"
Jul 15 14:33:44.747696 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:44.747537    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7b98l" podUID="4a14d87d-5fd3-40b7-b753-4758b15dd501"
Jul 15 14:33:46.747298 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:46.747241    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g49wp"
Jul 15 14:33:46.747298 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:46.747293    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-878zd"
Jul 15 14:33:46.747298 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:46.747303    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7b98l"
Jul 15 14:33:46.747887 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:46.747423    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g49wp" podUID="eff6ee84-dee0-429b-9edc-df30874ebd31"
Jul 15 14:33:46.747887 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:46.747657    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7b98l" podUID="4a14d87d-5fd3-40b7-b753-4758b15dd501"
Jul 15 14:33:46.747887 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:46.747732    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-878zd" podUID="109886c7-ff5d-49ac-9bf9-012740e3417f"
Jul 15 14:33:46.763673 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:46.763643    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkfs5\" (UniqueName: \"kubernetes.io/projected/109886c7-ff5d-49ac-9bf9-012740e3417f-kube-api-access-vkfs5\") pod \"network-check-target-878zd\" (UID: \"109886c7-ff5d-49ac-9bf9-012740e3417f\") " pod="openshift-network-diagnostics/network-check-target-878zd"
Jul 15 14:33:46.763889 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:46.763870    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 14:33:46.763976 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:46.763895    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 14:33:46.763976 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:46.763908    2571 projected.go:196] Error preparing data for projected volume kube-api-access-vkfs5 for pod openshift-network-diagnostics/network-check-target-878zd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 14:33:46.763976 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:46.763965    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/109886c7-ff5d-49ac-9bf9-012740e3417f-kube-api-access-vkfs5 podName:109886c7-ff5d-49ac-9bf9-012740e3417f nodeName:}" failed. No retries permitted until 2026-07-15 14:33:54.763946964 +0000 UTC m=+18.279764844 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vkfs5" (UniqueName: "kubernetes.io/projected/109886c7-ff5d-49ac-9bf9-012740e3417f-kube-api-access-vkfs5") pod "network-check-target-878zd" (UID: "109886c7-ff5d-49ac-9bf9-012740e3417f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 14:33:46.965264 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:46.964947    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eff6ee84-dee0-429b-9edc-df30874ebd31-metrics-certs\") pod \"network-metrics-daemon-g49wp\" (UID: \"eff6ee84-dee0-429b-9edc-df30874ebd31\") " pod="openshift-multus/network-metrics-daemon-g49wp"
Jul 15 14:33:46.965264 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:46.965192    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 14:33:46.965264 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:46.965269    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eff6ee84-dee0-429b-9edc-df30874ebd31-metrics-certs podName:eff6ee84-dee0-429b-9edc-df30874ebd31 nodeName:}" failed. No retries permitted until 2026-07-15 14:33:54.965250402 +0000 UTC m=+18.481068261 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eff6ee84-dee0-429b-9edc-df30874ebd31-metrics-certs") pod "network-metrics-daemon-g49wp" (UID: "eff6ee84-dee0-429b-9edc-df30874ebd31") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 14:33:47.065762 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:47.065668    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4a14d87d-5fd3-40b7-b753-4758b15dd501-original-pull-secret\") pod \"global-pull-secret-syncer-7b98l\" (UID: \"4a14d87d-5fd3-40b7-b753-4758b15dd501\") " pod="kube-system/global-pull-secret-syncer-7b98l"
Jul 15 14:33:47.065940 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:47.065830    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 14:33:47.065940 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:47.065898    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a14d87d-5fd3-40b7-b753-4758b15dd501-original-pull-secret podName:4a14d87d-5fd3-40b7-b753-4758b15dd501 nodeName:}" failed. No retries permitted until 2026-07-15 14:33:55.06588387 +0000 UTC m=+18.581701725 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4a14d87d-5fd3-40b7-b753-4758b15dd501-original-pull-secret") pod "global-pull-secret-syncer-7b98l" (UID: "4a14d87d-5fd3-40b7-b753-4758b15dd501") : object "kube-system"/"original-pull-secret" not registered
Jul 15 14:33:48.748218 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:48.748186    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-878zd"
Jul 15 14:33:48.748636 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:48.748313    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-878zd" podUID="109886c7-ff5d-49ac-9bf9-012740e3417f"
Jul 15 14:33:48.748636 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:48.748429    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7b98l"
Jul 15 14:33:48.748636 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:48.748534    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7b98l" podUID="4a14d87d-5fd3-40b7-b753-4758b15dd501"
Jul 15 14:33:48.748636 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:48.748591    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g49wp"
Jul 15 14:33:48.750323 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:48.750290    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g49wp" podUID="eff6ee84-dee0-429b-9edc-df30874ebd31"
Jul 15 14:33:50.747963 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:50.747927    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-878zd"
Jul 15 14:33:50.748421 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:50.747927    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g49wp"
Jul 15 14:33:50.748421 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:50.748078    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-878zd" podUID="109886c7-ff5d-49ac-9bf9-012740e3417f"
Jul 15 14:33:50.748421 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:50.748129    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7b98l"
Jul 15 14:33:50.748421 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:50.748233    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g49wp" podUID="eff6ee84-dee0-429b-9edc-df30874ebd31"
Jul 15 14:33:50.748656 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:50.748493    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7b98l" podUID="4a14d87d-5fd3-40b7-b753-4758b15dd501"
Jul 15 14:33:52.747949 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:52.747912    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g49wp"
Jul 15 14:33:52.747949 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:52.747925    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-878zd"
Jul 15 14:33:52.748466 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:52.747922    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7b98l"
Jul 15 14:33:52.748466 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:52.748184    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g49wp" podUID="eff6ee84-dee0-429b-9edc-df30874ebd31"
Jul 15 14:33:52.748466 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:52.748322    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-878zd" podUID="109886c7-ff5d-49ac-9bf9-012740e3417f"
Jul 15 14:33:52.748466 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:52.748418    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7b98l" podUID="4a14d87d-5fd3-40b7-b753-4758b15dd501"
Jul 15 14:33:54.747886 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:54.747839    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-878zd"
Jul 15 14:33:54.748359 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:54.747839    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g49wp"
Jul 15 14:33:54.748359 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:54.747967    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-878zd" podUID="109886c7-ff5d-49ac-9bf9-012740e3417f"
Jul 15 14:33:54.748359 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:54.748097    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7b98l"
Jul 15 14:33:54.748359 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:54.748095    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g49wp" podUID="eff6ee84-dee0-429b-9edc-df30874ebd31"
Jul 15 14:33:54.748359 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:54.748197    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7b98l" podUID="4a14d87d-5fd3-40b7-b753-4758b15dd501"
Jul 15 14:33:54.827625 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:54.827578    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkfs5\" (UniqueName: \"kubernetes.io/projected/109886c7-ff5d-49ac-9bf9-012740e3417f-kube-api-access-vkfs5\") pod \"network-check-target-878zd\" (UID: \"109886c7-ff5d-49ac-9bf9-012740e3417f\") " pod="openshift-network-diagnostics/network-check-target-878zd"
Jul 15 14:33:54.827775 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:54.827756    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 14:33:54.827775 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:54.827776    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 14:33:54.827870 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:54.827786    2571 projected.go:196] Error preparing data for projected volume kube-api-access-vkfs5 for pod openshift-network-diagnostics/network-check-target-878zd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 14:33:54.827870 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:54.827842    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/109886c7-ff5d-49ac-9bf9-012740e3417f-kube-api-access-vkfs5 podName:109886c7-ff5d-49ac-9bf9-012740e3417f nodeName:}" failed. No retries permitted until 2026-07-15 14:34:10.827828334 +0000 UTC m=+34.343646200 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vkfs5" (UniqueName: "kubernetes.io/projected/109886c7-ff5d-49ac-9bf9-012740e3417f-kube-api-access-vkfs5") pod "network-check-target-878zd" (UID: "109886c7-ff5d-49ac-9bf9-012740e3417f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 14:33:55.030232 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:55.030144    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eff6ee84-dee0-429b-9edc-df30874ebd31-metrics-certs\") pod \"network-metrics-daemon-g49wp\" (UID: \"eff6ee84-dee0-429b-9edc-df30874ebd31\") " pod="openshift-multus/network-metrics-daemon-g49wp"
Jul 15 14:33:55.030436 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:55.030417    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 14:33:55.030501 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:55.030482    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eff6ee84-dee0-429b-9edc-df30874ebd31-metrics-certs podName:eff6ee84-dee0-429b-9edc-df30874ebd31 nodeName:}" failed. No retries permitted until 2026-07-15 14:34:11.030468784 +0000 UTC m=+34.546286634 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eff6ee84-dee0-429b-9edc-df30874ebd31-metrics-certs") pod "network-metrics-daemon-g49wp" (UID: "eff6ee84-dee0-429b-9edc-df30874ebd31") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 14:33:55.131412 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:55.131371    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4a14d87d-5fd3-40b7-b753-4758b15dd501-original-pull-secret\") pod \"global-pull-secret-syncer-7b98l\" (UID: \"4a14d87d-5fd3-40b7-b753-4758b15dd501\") " pod="kube-system/global-pull-secret-syncer-7b98l"
Jul 15 14:33:55.131600 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:55.131493    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 14:33:55.131600 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:55.131575    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a14d87d-5fd3-40b7-b753-4758b15dd501-original-pull-secret podName:4a14d87d-5fd3-40b7-b753-4758b15dd501 nodeName:}" failed. No retries permitted until 2026-07-15 14:34:11.131553751 +0000 UTC m=+34.647371611 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4a14d87d-5fd3-40b7-b753-4758b15dd501-original-pull-secret") pod "global-pull-secret-syncer-7b98l" (UID: "4a14d87d-5fd3-40b7-b753-4758b15dd501") : object "kube-system"/"original-pull-secret" not registered
Jul 15 14:33:56.747620 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:56.747407    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7b98l"
Jul 15 14:33:56.748116 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:56.747429    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g49wp"
Jul 15 14:33:56.748116 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:56.747712    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7b98l" podUID="4a14d87d-5fd3-40b7-b753-4758b15dd501"
Jul 15 14:33:56.748116 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:56.747442    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-878zd"
Jul 15 14:33:56.748116 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:56.747775    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g49wp" podUID="eff6ee84-dee0-429b-9edc-df30874ebd31"
Jul 15 14:33:56.748116 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:56.747877    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-878zd" podUID="109886c7-ff5d-49ac-9bf9-012740e3417f"
Jul 15 14:33:58.747697 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:58.747663    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g49wp"
Jul 15 14:33:58.748118 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:58.747750    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g49wp" podUID="eff6ee84-dee0-429b-9edc-df30874ebd31"
Jul 15 14:33:58.748118 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:58.747768    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-878zd"
Jul 15 14:33:58.748118 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:58.747821    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7b98l"
Jul 15 14:33:58.748118 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:58.747901    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7b98l" podUID="4a14d87d-5fd3-40b7-b753-4758b15dd501"
Jul 15 14:33:58.748118 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:33:58.747969    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-878zd" podUID="109886c7-ff5d-49ac-9bf9-012740e3417f"
Jul 15 14:33:59.880469 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:59.880022    2571 generic.go:356] "Generic (PLEG): container finished" podID="9f578de8-ae1f-4aa2-a034-0e029991f7e0" containerID="65c4523ab06f9a2231a5c0759c39f129149d8d448b699ad78a367784f817dc0a" exitCode=0
Jul 15 14:33:59.881235 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:59.880118    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cs6zp" event={"ID":"9f578de8-ae1f-4aa2-a034-0e029991f7e0","Type":"ContainerDied","Data":"65c4523ab06f9a2231a5c0759c39f129149d8d448b699ad78a367784f817dc0a"}
Jul 15 14:33:59.882217 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:59.882184    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-jw9j8" event={"ID":"144a8b5d-13b7-4453-8bd5-963d4c7815c8","Type":"ContainerStarted","Data":"3122ac66a8e191f79c0b2954dbb9fffd4c840657cfe1e751094ecfd446167e9d"}
Jul 15 14:33:59.883788 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:59.883744    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-42cjp" event={"ID":"d1d4ca67-bb3b-4f02-a744-de494982cffa","Type":"ContainerStarted","Data":"3d8ecbaf590b07e60a8b4140fb1b3eb31522c819d0b0d14199025ceeef7f39c4"}
Jul 15 14:33:59.885305 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:59.885260    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c4b59" event={"ID":"3464d623-ebc8-4b3f-8c92-41cc16c406a9","Type":"ContainerStarted","Data":"b5ad4aba287ab8647dc0b6ed52ff3353cbabad3435b1ce7e6cad608a50240233"}
Jul 15 14:33:59.887361 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:59.887341    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-5jrhz" event={"ID":"2baab41c-7646-411f-acbd-f0eb28f82489","Type":"ContainerStarted","Data":"95719b544aa80ec27ac085155daa93917b137ba548adfab307783f8c8c8f1f8e"}
Jul 15 14:33:59.888918 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:59.888887    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-h9tlc" event={"ID":"6e6d1e85-cdbe-411f-9f1d-fcd26b2513ac","Type":"ContainerStarted","Data":"9090a0213ea287523869df51ddd6010ce10586ad140506d229576908b5ae1b7d"}
Jul 15 14:33:59.890448 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:59.890425    2571 generic.go:356] "Generic (PLEG): container finished" podID="4bc0c7a3681d7c042fbc0dd13cac7333" containerID="e256f3e962b7f6a67f8277331ff9799f000416121828b8a4975d118f0d942164" exitCode=0
Jul 15 14:33:59.890536 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:59.890496    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal" event={"ID":"4bc0c7a3681d7c042fbc0dd13cac7333","Type":"ContainerDied","Data":"e256f3e962b7f6a67f8277331ff9799f000416121828b8a4975d118f0d942164"}
Jul 15 14:33:59.892141 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:59.892102    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-wvfhr" event={"ID":"55343882-5974-45a9-b3e2-cfff9bec7863","Type":"ContainerStarted","Data":"86714fcebe774ee6711346d64892e55a077202c72418f7b0ea4d1698640c666f"}
Jul 15 14:33:59.894869 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:59.894851    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8tt2_12bf26b1-5c4a-4e51-beb3-b17d7e7c4656/ovn-acl-logging/0.log"
Jul 15 14:33:59.895222 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:59.895200    2571 generic.go:356] "Generic (PLEG): container finished" podID="12bf26b1-5c4a-4e51-beb3-b17d7e7c4656" containerID="5962cf0a0f147f009e527fa7f4c41dd0fef46255c1d31589b33f8097d59565ba" exitCode=1
Jul 15 14:33:59.895308 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:59.895232    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2" event={"ID":"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656","Type":"ContainerStarted","Data":"aaf2aebdc8eb35bd90e27c42a3cc5ee1364ed59084154b72ae5a0568580f6dcb"}
Jul 15 14:33:59.895362 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:59.895308    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2" event={"ID":"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656","Type":"ContainerStarted","Data":"ec70c1d9c05b3c93468dfe4f0cc9b50acf99646e10d89b80a72e7e3f5e72fa28"}
Jul 15 14:33:59.895362 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:59.895341    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2" event={"ID":"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656","Type":"ContainerStarted","Data":"43cc82d0131748a551b026ab0ff34d47bea2d720a4e41102e907d9ed07a858df"}
Jul 15 14:33:59.895452 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:59.895375    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2" event={"ID":"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656","Type":"ContainerDied","Data":"5962cf0a0f147f009e527fa7f4c41dd0fef46255c1d31589b33f8097d59565ba"}
Jul 15 14:33:59.895452 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:59.895415    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2" event={"ID":"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656","Type":"ContainerStarted","Data":"5a5adffc20f8bd005a128789939e79999088068b468783b1216a5a9778f883d5"}
Jul 15 14:33:59.929968 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:59.929915    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-5jrhz" podStartSLOduration=2.126729318 podStartE2EDuration="20.929895567s" totalImagesPullingTime="18.803166249s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 14:33:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:33:59.929518359 +0000 UTC m=+23.445336230" watchObservedRunningTime="2026-07-15 14:33:59.929895567 +0000 UTC m=+23.445713437"
Jul 15 14:33:59.949664 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:33:59.949613    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-h9tlc" podStartSLOduration=2.095093196 podStartE2EDuration="20.949599225s" totalImagesPullingTime="18.854506029s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 14:33:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:33:59.94908446 +0000 UTC m=+23.464902331" watchObservedRunningTime="2026-07-15 14:33:59.949599225 +0000 UTC m=+23.465417094"
Jul 15 14:34:00.004514 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:00.004462    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-jw9j8" podStartSLOduration=1.957923365 podStartE2EDuration="21.004442501s" totalImagesPullingTime="19.046519136s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 14:33:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:34:00.004180415 +0000 UTC m=+23.519998288" watchObservedRunningTime="2026-07-15 14:34:00.004442501 +0000 UTC m=+23.520260372"
Jul 15 14:34:00.004861 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:00.004828    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-wvfhr" podStartSLOduration=9.970910583 podStartE2EDuration="21.00481851s" totalImagesPullingTime="11.033907927s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 14:33:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:33:59.985155279 +0000 UTC m=+23.500973150" watchObservedRunningTime="2026-07-15 14:34:00.00481851 +0000 UTC m=+23.520636438"
Jul 15 14:34:00.747386 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:00.747315    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g49wp"
Jul 15 14:34:00.747386 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:00.747379    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-878zd"
Jul 15 14:34:00.747609 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:00.747315    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7b98l"
Jul 15 14:34:00.747609 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:00.747472    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g49wp" podUID="eff6ee84-dee0-429b-9edc-df30874ebd31"
Jul 15 14:34:00.747609 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:00.747551    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-878zd" podUID="109886c7-ff5d-49ac-9bf9-012740e3417f"
Jul 15 14:34:00.747758 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:00.747634    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7b98l" podUID="4a14d87d-5fd3-40b7-b753-4758b15dd501"
Jul 15 14:34:00.900378 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:00.900353    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8tt2_12bf26b1-5c4a-4e51-beb3-b17d7e7c4656/ovn-acl-logging/0.log"
Jul 15 14:34:00.900853 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:00.900821    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2" event={"ID":"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656","Type":"ContainerStarted","Data":"606fa281fca8d5f652e970e33a43a945794e80c86eb9b8d19454e268c0a64898"}
Jul 15 14:34:00.902288 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:00.902249    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-8r6d7" event={"ID":"251749ce-0465-4ac6-b2c6-dfb3ac64981b","Type":"ContainerStarted","Data":"c5e4c64e7f69ba068b2d1c6d8b753a8b262bcab9edc81cc48f7f6b308fb6afe1"}
Jul 15 14:34:00.904165 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:00.904141    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal" event={"ID":"4bc0c7a3681d7c042fbc0dd13cac7333","Type":"ContainerStarted","Data":"9767a1a0bc5182843a554d9e828ee37250ba01bbbdaeff7d7b6e65c7d599b199"}
Jul 15 14:34:00.922749 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:00.922701    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-42cjp" podStartSLOduration=2.8636703199999998 podStartE2EDuration="21.922682003s" totalImagesPullingTime="19.059011683s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:33:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:34:00.026190186 +0000 UTC m=+23.542008057" watchObservedRunningTime="2026-07-15 14:34:00.922682003 +0000 UTC m=+24.438499874"
Jul 15 14:34:00.923146 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:00.923115    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-8r6d7" podStartSLOduration=2.8657476649999998 podStartE2EDuration="21.923106145s" totalImagesPullingTime="19.05735848s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 14:33:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:34:00.922575543 +0000 UTC m=+24.438393415" watchObservedRunningTime="2026-07-15 14:34:00.923106145 +0000 UTC m=+24.438924016"
Jul 15 14:34:00.939477 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:00.939443    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-61.ec2.internal" podStartSLOduration=21.939430579 podStartE2EDuration="21.939430579s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 14:33:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:34:00.93937922 +0000 UTC m=+24.455197082" watchObservedRunningTime="2026-07-15 14:34:00.939430579 +0000 UTC m=+24.455248450"
Jul 15 14:34:01.150794 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:01.150638    2571 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 15 14:34:01.608092 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:01.607993    2571 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-15T14:34:01.150656825Z","UUID":"7ff81c48-9f6b-4853-bf94-7afd28dbc370","Handler":null,"Name":"","Endpoint":""}
Jul 15 14:34:01.609527 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:01.609505    2571 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 15 14:34:01.609655 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:01.609549    2571 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 15 14:34:01.907923 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:01.907849    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-61.ec2.internal" event={"ID":"5c90a46431eae6b3cdd7f5745d0d2187","Type":"ContainerStarted","Data":"69fe0b65a757cf1a1a00973ae3d6dd308253aa26bceb1c35b03ca0f413a96c1f"}
Jul 15 14:34:01.909843 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:01.909817    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c4b59" event={"ID":"3464d623-ebc8-4b3f-8c92-41cc16c406a9","Type":"ContainerStarted","Data":"fe091dae7840fb15210449cdf2b5390a554d6bdde6870e9201881bfd431d8bca"}
Jul 15 14:34:01.925349 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:01.925288    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-61.ec2.internal" podStartSLOduration=22.925248733 podStartE2EDuration="22.925248733s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 14:33:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:34:01.924564577 +0000 UTC m=+25.440382447" watchObservedRunningTime="2026-07-15 14:34:01.925248733 +0000 UTC m=+25.441066606"
Jul 15 14:34:02.747087 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:02.747056    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7b98l"
Jul 15 14:34:02.747250 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:02.747092    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-878zd"
Jul 15 14:34:02.747250 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:02.747057    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g49wp"
Jul 15 14:34:02.747250 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:02.747212    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7b98l" podUID="4a14d87d-5fd3-40b7-b753-4758b15dd501"
Jul 15 14:34:02.747436 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:02.747316    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g49wp" podUID="eff6ee84-dee0-429b-9edc-df30874ebd31"
Jul 15 14:34:02.747436 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:02.747396    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-878zd" podUID="109886c7-ff5d-49ac-9bf9-012740e3417f"
Jul 15 14:34:02.915328 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:02.915248    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8tt2_12bf26b1-5c4a-4e51-beb3-b17d7e7c4656/ovn-acl-logging/0.log"
Jul 15 14:34:02.915815 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:02.915789    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2" event={"ID":"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656","Type":"ContainerStarted","Data":"46eaaaf65c81a920d540eef042467dc6690b8fe6384c81a6f3112e99705f0c9f"}
Jul 15 14:34:03.229742 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:03.229438    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-42cjp"
Jul 15 14:34:03.230054 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:03.230023    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-42cjp"
Jul 15 14:34:04.748063 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:04.748041    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7b98l"
Jul 15 14:34:04.748634 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:04.748087    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-878zd"
Jul 15 14:34:04.748634 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:04.748043    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g49wp"
Jul 15 14:34:04.748634 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:04.748176    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7b98l" podUID="4a14d87d-5fd3-40b7-b753-4758b15dd501"
Jul 15 14:34:04.748634 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:04.748298    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g49wp" podUID="eff6ee84-dee0-429b-9edc-df30874ebd31"
Jul 15 14:34:04.748634 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:04.748377    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-878zd" podUID="109886c7-ff5d-49ac-9bf9-012740e3417f"
Jul 15 14:34:04.924415 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:04.924148    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8tt2_12bf26b1-5c4a-4e51-beb3-b17d7e7c4656/ovn-acl-logging/0.log"
Jul 15 14:34:04.924935 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:04.924559    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2" event={"ID":"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656","Type":"ContainerStarted","Data":"f7e4c520dd3ebbf2143830faa3709f3d2962843d5c5094c1f3a14922e86f0ff6"}
Jul 15 14:34:04.924935 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:04.924825    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2"
Jul 15 14:34:04.925220 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:04.925041    2571 scope.go:117] "RemoveContainer" containerID="5962cf0a0f147f009e527fa7f4c41dd0fef46255c1d31589b33f8097d59565ba"
Jul 15 14:34:04.927297 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:04.926915    2571 generic.go:356] "Generic (PLEG): container finished" podID="9f578de8-ae1f-4aa2-a034-0e029991f7e0" containerID="0ece968bd3786e0bf95cab1fe51beec75eda9c775395e1ea9c071433b7f57086" exitCode=0
Jul 15 14:34:04.927297 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:04.926998    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cs6zp" event={"ID":"9f578de8-ae1f-4aa2-a034-0e029991f7e0","Type":"ContainerDied","Data":"0ece968bd3786e0bf95cab1fe51beec75eda9c775395e1ea9c071433b7f57086"}
Jul 15 14:34:04.929961 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:04.929868    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c4b59" event={"ID":"3464d623-ebc8-4b3f-8c92-41cc16c406a9","Type":"ContainerStarted","Data":"dd656700a2b25827cbb2750903cab83d1ae169d48ef16a934332aa8027d4f0f4"}
Jul 15 14:34:04.941899 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:04.941878    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2"
Jul 15 14:34:05.056829 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:05.056638    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-c4b59" podStartSLOduration=3.157816759 podStartE2EDuration="26.0566212s" totalImagesPullingTime="22.898804441s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 14:33:39 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:34:05.010412616 +0000 UTC m=+28.526230487" watchObservedRunningTime="2026-07-15 14:34:05.0566212 +0000 UTC m=+28.572439141"
Jul 15 14:34:05.935545 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:05.935521    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8tt2_12bf26b1-5c4a-4e51-beb3-b17d7e7c4656/ovn-acl-logging/0.log"
Jul 15 14:34:05.936303 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:05.935939    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2" event={"ID":"12bf26b1-5c4a-4e51-beb3-b17d7e7c4656","Type":"ContainerStarted","Data":"a8b8b2e3cd83ffd46b9702018330fc5ac98edc78f06d09e5011a873a81d51e32"}
Jul 15 14:34:05.936431 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:05.936412    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2"
Jul 15 14:34:05.936508 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:05.936469    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2"
Jul 15 14:34:05.950792 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:05.950767    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2"
Jul 15 14:34:05.973674 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:05.973636    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2" podStartSLOduration=7.851769301 podStartE2EDuration="26.973624526s" totalImagesPullingTime="19.121855225s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 14:33:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:34:05.970571906 +0000 UTC m=+29.486389759" watchObservedRunningTime="2026-07-15 14:34:05.973624526 +0000 UTC m=+29.489442396"
Jul 15 14:34:06.747261 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:06.747231    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g49wp"
Jul 15 14:34:06.747461 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:06.747300    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-878zd"
Jul 15 14:34:06.747461 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:06.747392    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g49wp" podUID="eff6ee84-dee0-429b-9edc-df30874ebd31"
Jul 15 14:34:06.747461 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:06.747423    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-878zd" podUID="109886c7-ff5d-49ac-9bf9-012740e3417f"
Jul 15 14:34:06.747619 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:06.747482    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7b98l"
Jul 15 14:34:06.747619 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:06.747577    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7b98l" podUID="4a14d87d-5fd3-40b7-b753-4758b15dd501"
Jul 15 14:34:06.939886 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:06.939852    2571 generic.go:356] "Generic (PLEG): container finished" podID="9f578de8-ae1f-4aa2-a034-0e029991f7e0" containerID="912e28e9198ded646c7e5a5c31665b0bad3c4b471841c29fe67d7f6605e4ef0f" exitCode=0
Jul 15 14:34:06.940297 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:06.939947    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cs6zp" event={"ID":"9f578de8-ae1f-4aa2-a034-0e029991f7e0","Type":"ContainerDied","Data":"912e28e9198ded646c7e5a5c31665b0bad3c4b471841c29fe67d7f6605e4ef0f"}
Jul 15 14:34:07.658426 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:07.658395    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7b98l"]
Jul 15 14:34:07.658591 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:07.658565    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7b98l"
Jul 15 14:34:07.658712 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:07.658689    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7b98l" podUID="4a14d87d-5fd3-40b7-b753-4758b15dd501"
Jul 15 14:34:07.663006 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:07.662647    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-878zd"]
Jul 15 14:34:07.663006 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:07.662750    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-878zd"
Jul 15 14:34:07.663006 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:07.662837    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-878zd" podUID="109886c7-ff5d-49ac-9bf9-012740e3417f"
Jul 15 14:34:07.663432 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:07.663412    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-g49wp"]
Jul 15 14:34:07.663526 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:07.663513    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g49wp"
Jul 15 14:34:07.663635 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:07.663618    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g49wp" podUID="eff6ee84-dee0-429b-9edc-df30874ebd31"
Jul 15 14:34:08.751260 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:08.751088    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-42cjp"
Jul 15 14:34:08.751800 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:08.751315    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-42cjp"
Jul 15 14:34:08.947206 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:08.947179    2571 generic.go:356] "Generic (PLEG): container finished" podID="9f578de8-ae1f-4aa2-a034-0e029991f7e0" containerID="e20c8bedca78bebab058fb608669cb55e1d8bdfd6d6d4e555b7e1a3d5b323bdc" exitCode=0
Jul 15 14:34:08.947339 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:08.947227    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cs6zp" event={"ID":"9f578de8-ae1f-4aa2-a034-0e029991f7e0","Type":"ContainerDied","Data":"e20c8bedca78bebab058fb608669cb55e1d8bdfd6d6d4e555b7e1a3d5b323bdc"}
Jul 15 14:34:09.747510 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:09.747481    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7b98l"
Jul 15 14:34:09.747669 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:09.747482    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-878zd"
Jul 15 14:34:09.747669 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:09.747587    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7b98l" podUID="4a14d87d-5fd3-40b7-b753-4758b15dd501"
Jul 15 14:34:09.747669 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:09.747481    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g49wp"
Jul 15 14:34:09.747778 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:09.747651    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-878zd" podUID="109886c7-ff5d-49ac-9bf9-012740e3417f"
Jul 15 14:34:09.747778 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:09.747737    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g49wp" podUID="eff6ee84-dee0-429b-9edc-df30874ebd31"
Jul 15 14:34:10.847384 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:10.847350    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkfs5\" (UniqueName: \"kubernetes.io/projected/109886c7-ff5d-49ac-9bf9-012740e3417f-kube-api-access-vkfs5\") pod \"network-check-target-878zd\" (UID: \"109886c7-ff5d-49ac-9bf9-012740e3417f\") " pod="openshift-network-diagnostics/network-check-target-878zd"
Jul 15 14:34:10.847853 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:10.847555    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 14:34:10.847853 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:10.847585    2571 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 14:34:10.847853 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:10.847597    2571 projected.go:196] Error preparing data for projected volume kube-api-access-vkfs5 for pod openshift-network-diagnostics/network-check-target-878zd: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 14:34:10.847853 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:10.847657    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/109886c7-ff5d-49ac-9bf9-012740e3417f-kube-api-access-vkfs5 podName:109886c7-ff5d-49ac-9bf9-012740e3417f nodeName:}" failed. No retries permitted until 2026-07-15 14:34:42.84764055 +0000 UTC m=+66.363458410 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vkfs5" (UniqueName: "kubernetes.io/projected/109886c7-ff5d-49ac-9bf9-012740e3417f-kube-api-access-vkfs5") pod "network-check-target-878zd" (UID: "109886c7-ff5d-49ac-9bf9-012740e3417f") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 14:34:11.049106 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.049068    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eff6ee84-dee0-429b-9edc-df30874ebd31-metrics-certs\") pod \"network-metrics-daemon-g49wp\" (UID: \"eff6ee84-dee0-429b-9edc-df30874ebd31\") " pod="openshift-multus/network-metrics-daemon-g49wp"
Jul 15 14:34:11.049294 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:11.049238    2571 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 14:34:11.049352 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:11.049325    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/eff6ee84-dee0-429b-9edc-df30874ebd31-metrics-certs podName:eff6ee84-dee0-429b-9edc-df30874ebd31 nodeName:}" failed. No retries permitted until 2026-07-15 14:34:43.049303746 +0000 UTC m=+66.565121600 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/eff6ee84-dee0-429b-9edc-df30874ebd31-metrics-certs") pod "network-metrics-daemon-g49wp" (UID: "eff6ee84-dee0-429b-9edc-df30874ebd31") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 14:34:11.149882 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.149795    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4a14d87d-5fd3-40b7-b753-4758b15dd501-original-pull-secret\") pod \"global-pull-secret-syncer-7b98l\" (UID: \"4a14d87d-5fd3-40b7-b753-4758b15dd501\") " pod="kube-system/global-pull-secret-syncer-7b98l"
Jul 15 14:34:11.150037 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:11.149985    2571 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 14:34:11.150107 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:11.150041    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a14d87d-5fd3-40b7-b753-4758b15dd501-original-pull-secret podName:4a14d87d-5fd3-40b7-b753-4758b15dd501 nodeName:}" failed. No retries permitted until 2026-07-15 14:34:43.150028118 +0000 UTC m=+66.665845968 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/4a14d87d-5fd3-40b7-b753-4758b15dd501-original-pull-secret") pod "global-pull-secret-syncer-7b98l" (UID: "4a14d87d-5fd3-40b7-b753-4758b15dd501") : object "kube-system"/"original-pull-secret" not registered
Jul 15 14:34:11.747674 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.747635    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g49wp"
Jul 15 14:34:11.747674 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.747662    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7b98l"
Jul 15 14:34:11.747902 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.747665    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-878zd"
Jul 15 14:34:11.747902 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:11.747758    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-g49wp" podUID="eff6ee84-dee0-429b-9edc-df30874ebd31"
Jul 15 14:34:11.747902 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:11.747854    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7b98l" podUID="4a14d87d-5fd3-40b7-b753-4758b15dd501"
Jul 15 14:34:11.748074 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:11.747907    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-878zd" podUID="109886c7-ff5d-49ac-9bf9-012740e3417f"
Jul 15 14:34:11.787749 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.787712    2571 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-61.ec2.internal" event="NodeReady"
Jul 15 14:34:11.787916 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.787864    2571 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 15 14:34:11.840208 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.840140    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7cccfb4ff6-mkrws"]
Jul 15 14:34:11.841777 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.841762    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cccfb4ff6-mkrws"
Jul 15 14:34:11.844431 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.844402    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 15 14:34:11.844981 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.844962    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 15 14:34:11.844981 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.844975    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 15 14:34:11.845127 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.845065    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-l2mcw\""
Jul 15 14:34:11.851872 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.851856    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 15 14:34:11.858740 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.858719    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-zmmq4"]
Jul 15 14:34:11.861369 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.860559    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-cz5pq"]
Jul 15 14:34:11.861973 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.861953    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-45c2z"]
Jul 15 14:34:11.862457 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.862436    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zmmq4"
Jul 15 14:34:11.862536 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.862436    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-cz5pq"
Jul 15 14:34:11.864264 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.863976    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-42mdh"]
Jul 15 14:34:11.864264 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.864123    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-45c2z"
Jul 15 14:34:11.865803 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.865785    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\""
Jul 15 14:34:11.865907 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.865822    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-fkbdh"]
Jul 15 14:34:11.866056 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.866034    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-42mdh"
Jul 15 14:34:11.867172 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.866975    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 15 14:34:11.867172 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.867047    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 15 14:34:11.867172 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.867078    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\""
Jul 15 14:34:11.867172 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.867087    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 15 14:34:11.867172 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.867115    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-w66fn\""
Jul 15 14:34:11.867483 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.867345    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-l6d6c\""
Jul 15 14:34:11.867483 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.867345    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 15 14:34:11.867483 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.867460    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 15 14:34:11.867618 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.867594    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-q6pxk\""
Jul 15 14:34:11.867618 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.867605    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fkhv2"]
Jul 15 14:34:11.867709 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.867665    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-fkbdh"
Jul 15 14:34:11.868234 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.868202    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 15 14:34:11.869433 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.869414    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\""
Jul 15 14:34:11.869591 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.869574    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-pwgtd\""
Jul 15 14:34:11.869670 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.869598    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\""
Jul 15 14:34:11.869670 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.869580    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\""
Jul 15 14:34:11.869768 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.869677    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-6b5f9c7788-p9ls6"]
Jul 15 14:34:11.869832 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.869811    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fkhv2"
Jul 15 14:34:11.870380 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.869917    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\""
Jul 15 14:34:11.872104 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.872085    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7cccfb4ff6-mkrws"]
Jul 15 14:34:11.872214 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.872161    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6b5f9c7788-p9ls6"
Jul 15 14:34:11.876803 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.876771    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\""
Jul 15 14:34:11.880501 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.880465    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\""
Jul 15 14:34:11.880501 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.880481    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 15 14:34:11.881897 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.880976    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 15 14:34:11.881897 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.881149    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 15 14:34:11.881897 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.881207    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-wzqmw\""
Jul 15 14:34:11.881897 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.881294    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-cz5pq"]
Jul 15 14:34:11.881897 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.881325    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 15 14:34:11.881897 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.881441    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 15 14:34:11.881897 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.881516    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-zwc48\""
Jul 15 14:34:11.881897 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.881597    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\""
Jul 15 14:34:11.881897 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.881619    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 15 14:34:11.881897 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.881705    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 15 14:34:11.881897 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.881210    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-9nsqs\""
Jul 15 14:34:11.881897 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.881786    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 15 14:34:11.882781 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.882763    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 15 14:34:11.882894 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.882864    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 15 14:34:11.882999 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.882768    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 15 14:34:11.883508 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.883476    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zmmq4"]
Jul 15 14:34:11.884065 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.884046    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\""
Jul 15 14:34:11.884728 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.884711    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-45c2z"]
Jul 15 14:34:11.885655 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.885630    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-42mdh"]
Jul 15 14:34:11.886461 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.886419    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-69tjk"]
Jul 15 14:34:11.888941 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.888913    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-69tjk"
Jul 15 14:34:11.889378 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.889019    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6b5f9c7788-p9ls6"]
Jul 15 14:34:11.898360 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.898346    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\""
Jul 15 14:34:11.906045 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.905997    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\""
Jul 15 14:34:11.906640 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.906623    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\""
Jul 15 14:34:11.910862 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.910342    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\""
Jul 15 14:34:11.910862 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.910604    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-tqxkl\""
Jul 15 14:34:11.912071 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.912014    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-fkbdh"]
Jul 15 14:34:11.912935 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.912918    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-69tjk"]
Jul 15 14:34:11.913725 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.913687    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fkhv2"]
Jul 15 14:34:11.916831 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.916484    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-dd6cg"]
Jul 15 14:34:11.918385 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.918367    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-dd6cg"
Jul 15 14:34:11.919804 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.919787    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-4rjgr"]
Jul 15 14:34:11.921629 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.921610    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-t56m5"]
Jul 15 14:34:11.921740 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.921725    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-4rjgr"
Jul 15 14:34:11.923181 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.923166    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-npl5n"]
Jul 15 14:34:11.923326 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.923310    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-t56m5"
Jul 15 14:34:11.924819 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.924797    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-npl5n"
Jul 15 14:34:11.933098 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.933081    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\""
Jul 15 14:34:11.933374 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.933352    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\""
Jul 15 14:34:11.933452 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.933359    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-w9gc5\""
Jul 15 14:34:11.933632 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.933617    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\""
Jul 15 14:34:11.939741 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.939723    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 14:34:11.939865 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.939740    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\""
Jul 15 14:34:11.939865 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.939740    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-vzkxr\""
Jul 15 14:34:11.939992 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.939979    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 14:34:11.944648 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.944630    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-dd6cg"]
Jul 15 14:34:11.945476 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.945459    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-4rjgr"]
Jul 15 14:34:11.945641 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.945624    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 15 14:34:11.945824 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.945810    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 15 14:34:11.947516 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.946207    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 15 14:34:11.947516 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.946231    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 15 14:34:11.947516 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.946538    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-j8nlk\""
Jul 15 14:34:11.947516 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.946748    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-npl5n"]
Jul 15 14:34:11.947516 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.947058    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 15 14:34:11.947516 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.947330    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-twbkk\""
Jul 15 14:34:11.948174 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.947620    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-t56m5"]
Jul 15 14:34:11.958487 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.958465    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxqzq\" (UniqueName: \"kubernetes.io/projected/48d450ff-8575-4187-b279-ed927e9fb854-kube-api-access-sxqzq\") pod \"insights-operator-68d9dd94cf-45c2z\" (UID: \"48d450ff-8575-4187-b279-ed927e9fb854\") " pod="openshift-insights/insights-operator-68d9dd94cf-45c2z"
Jul 15 14:34:11.958614 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.958500    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c632d732-9454-4773-bfae-ae68b1f0ac4d-bound-sa-token\") pod \"image-registry-7cccfb4ff6-mkrws\" (UID: \"c632d732-9454-4773-bfae-ae68b1f0ac4d\") " pod="openshift-image-registry/image-registry-7cccfb4ff6-mkrws"
Jul 15 14:34:11.958614 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.958524    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e8dade3b-1035-4ff4-911d-7ca98ce14401-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-fkbdh\" (UID: \"e8dade3b-1035-4ff4-911d-7ca98ce14401\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-fkbdh"
Jul 15 14:34:11.958830 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.958604    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c632d732-9454-4773-bfae-ae68b1f0ac4d-image-registry-private-configuration\") pod \"image-registry-7cccfb4ff6-mkrws\" (UID: \"c632d732-9454-4773-bfae-ae68b1f0ac4d\") " pod="openshift-image-registry/image-registry-7cccfb4ff6-mkrws"
Jul 15 14:34:11.958830 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.958637    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0de0f3ad-e228-4c27-9b2c-de1a5844dcdb-config\") pod \"console-operator-7866497494-42mdh\" (UID: \"0de0f3ad-e228-4c27-9b2c-de1a5844dcdb\") " pod="openshift-console-operator/console-operator-7866497494-42mdh"
Jul 15 14:34:11.958830 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.958677    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lmrhj\" (UniqueName: \"kubernetes.io/projected/4b0ac431-4ca5-45b0-9779-26461b04b319-kube-api-access-lmrhj\") pod \"router-default-6b5f9c7788-p9ls6\" (UID: \"4b0ac431-4ca5-45b0-9779-26461b04b319\") " pod="openshift-ingress/router-default-6b5f9c7788-p9ls6"
Jul 15 14:34:11.958830 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.958699    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd114550-c5d0-471c-83fb-b5203fcea02c-tmp-dir\") pod \"dns-default-zmmq4\" (UID: \"cd114550-c5d0-471c-83fb-b5203fcea02c\") " pod="openshift-dns/dns-default-zmmq4"
Jul 15 14:34:11.958830 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.958735    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c632d732-9454-4773-bfae-ae68b1f0ac4d-registry-certificates\") pod \"image-registry-7cccfb4ff6-mkrws\" (UID: \"c632d732-9454-4773-bfae-ae68b1f0ac4d\") " pod="openshift-image-registry/image-registry-7cccfb4ff6-mkrws"
Jul 15 14:34:11.958830 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.958755    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/48d450ff-8575-4187-b279-ed927e9fb854-tmp\") pod \"insights-operator-68d9dd94cf-45c2z\" (UID: \"48d450ff-8575-4187-b279-ed927e9fb854\") " pod="openshift-insights/insights-operator-68d9dd94cf-45c2z"
Jul 15 14:34:11.958830 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.958776    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-827lt\" (UniqueName: \"kubernetes.io/projected/247f8c50-953c-457c-b2f5-02830e0c499d-kube-api-access-827lt\") pod \"cluster-monitoring-operator-5f7f494dd4-fkhv2\" (UID: \"247f8c50-953c-457c-b2f5-02830e0c499d\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fkhv2"
Jul 15 14:34:11.958830 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.958800    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b0ac431-4ca5-45b0-9779-26461b04b319-metrics-certs\") pod \"router-default-6b5f9c7788-p9ls6\" (UID: \"4b0ac431-4ca5-45b0-9779-26461b04b319\") " pod="openshift-ingress/router-default-6b5f9c7788-p9ls6"
Jul 15 14:34:11.958830 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.958822    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c632d732-9454-4773-bfae-ae68b1f0ac4d-installation-pull-secrets\") pod \"image-registry-7cccfb4ff6-mkrws\" (UID: \"c632d732-9454-4773-bfae-ae68b1f0ac4d\") " pod="openshift-image-registry/image-registry-7cccfb4ff6-mkrws"
Jul 15 14:34:11.959181 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.958842    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/247f8c50-953c-457c-b2f5-02830e0c499d-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-fkhv2\" (UID: \"247f8c50-953c-457c-b2f5-02830e0c499d\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fkhv2"
Jul 15 14:34:11.959181 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.958866    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpvh6\" (UniqueName: \"kubernetes.io/projected/b50812cf-7948-4c73-b6da-728813c52302-kube-api-access-hpvh6\") pod \"volume-data-source-validator-78495597f6-cz5pq\" (UID: \"b50812cf-7948-4c73-b6da-728813c52302\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-cz5pq"
Jul 15 14:34:11.959181 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.958914    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cd114550-c5d0-471c-83fb-b5203fcea02c-config-volume\") pod \"dns-default-zmmq4\" (UID: \"cd114550-c5d0-471c-83fb-b5203fcea02c\") " pod="openshift-dns/dns-default-zmmq4"
Jul 15 14:34:11.959181 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.958938    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c632d732-9454-4773-bfae-ae68b1f0ac4d-trusted-ca\") pod \"image-registry-7cccfb4ff6-mkrws\" (UID: \"c632d732-9454-4773-bfae-ae68b1f0ac4d\") " pod="openshift-image-registry/image-registry-7cccfb4ff6-mkrws"
Jul 15 14:34:11.959181 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.958960    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnfbb\" (UniqueName: \"kubernetes.io/projected/c632d732-9454-4773-bfae-ae68b1f0ac4d-kube-api-access-fnfbb\") pod \"image-registry-7cccfb4ff6-mkrws\" (UID: \"c632d732-9454-4773-bfae-ae68b1f0ac4d\") " pod="openshift-image-registry/image-registry-7cccfb4ff6-mkrws"
Jul 15 14:34:11.959181 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.958979    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/48d450ff-8575-4187-b279-ed927e9fb854-snapshots\") pod \"insights-operator-68d9dd94cf-45c2z\" (UID: \"48d450ff-8575-4187-b279-ed927e9fb854\") " pod="openshift-insights/insights-operator-68d9dd94cf-45c2z"
Jul 15 14:34:11.959181 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.959002    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fjw4d\" (UniqueName: \"kubernetes.io/projected/e8dade3b-1035-4ff4-911d-7ca98ce14401-kube-api-access-fjw4d\") pod \"cluster-samples-operator-65db858894-fkbdh\" (UID: \"e8dade3b-1035-4ff4-911d-7ca98ce14401\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-fkbdh"
Jul 15 14:34:11.959181 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.959037    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c632d732-9454-4773-bfae-ae68b1f0ac4d-ca-trust-extracted\") pod \"image-registry-7cccfb4ff6-mkrws\" (UID: \"c632d732-9454-4773-bfae-ae68b1f0ac4d\") " pod="openshift-image-registry/image-registry-7cccfb4ff6-mkrws"
Jul 15 14:34:11.959181 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.959062    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4b0ac431-4ca5-45b0-9779-26461b04b319-stats-auth\") pod \"router-default-6b5f9c7788-p9ls6\" (UID: \"4b0ac431-4ca5-45b0-9779-26461b04b319\") " pod="openshift-ingress/router-default-6b5f9c7788-p9ls6"
Jul 15 14:34:11.959181 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.959085    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c632d732-9454-4773-bfae-ae68b1f0ac4d-registry-tls\") pod \"image-registry-7cccfb4ff6-mkrws\" (UID: \"c632d732-9454-4773-bfae-ae68b1f0ac4d\") " pod="openshift-image-registry/image-registry-7cccfb4ff6-mkrws"
Jul 15 14:34:11.959181 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.959142    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48d450ff-8575-4187-b279-ed927e9fb854-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-45c2z\" (UID: \"48d450ff-8575-4187-b279-ed927e9fb854\") " pod="openshift-insights/insights-operator-68d9dd94cf-45c2z"
Jul 15 14:34:11.959181 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.959169    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/48d450ff-8575-4187-b279-ed927e9fb854-serving-cert\") pod \"insights-operator-68d9dd94cf-45c2z\" (UID: \"48d450ff-8575-4187-b279-ed927e9fb854\") " pod="openshift-insights/insights-operator-68d9dd94cf-45c2z"
Jul 15 14:34:11.959658 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.959190    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0de0f3ad-e228-4c27-9b2c-de1a5844dcdb-serving-cert\") pod \"console-operator-7866497494-42mdh\" (UID: \"0de0f3ad-e228-4c27-9b2c-de1a5844dcdb\") " pod="openshift-console-operator/console-operator-7866497494-42mdh"
Jul 15 14:34:11.959658 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.959213    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/247f8c50-953c-457c-b2f5-02830e0c499d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-fkhv2\" (UID: \"247f8c50-953c-457c-b2f5-02830e0c499d\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fkhv2"
Jul 15 14:34:11.959658 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.959243    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dc6sv\" (UniqueName: \"kubernetes.io/projected/cd114550-c5d0-471c-83fb-b5203fcea02c-kube-api-access-dc6sv\") pod \"dns-default-zmmq4\" (UID: \"cd114550-c5d0-471c-83fb-b5203fcea02c\") " pod="openshift-dns/dns-default-zmmq4"
Jul 15 14:34:11.959658 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.959286    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48d450ff-8575-4187-b279-ed927e9fb854-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-45c2z\" (UID: \"48d450ff-8575-4187-b279-ed927e9fb854\") " pod="openshift-insights/insights-operator-68d9dd94cf-45c2z"
Jul 15 14:34:11.959658 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.959306    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b0ac431-4ca5-45b0-9779-26461b04b319-service-ca-bundle\") pod \"router-default-6b5f9c7788-p9ls6\" (UID: \"4b0ac431-4ca5-45b0-9779-26461b04b319\") " pod="openshift-ingress/router-default-6b5f9c7788-p9ls6"
Jul 15 14:34:11.959658 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.959389    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v474c\" (UniqueName: \"kubernetes.io/projected/0de0f3ad-e228-4c27-9b2c-de1a5844dcdb-kube-api-access-v474c\") pod \"console-operator-7866497494-42mdh\" (UID: \"0de0f3ad-e228-4c27-9b2c-de1a5844dcdb\") " pod="openshift-console-operator/console-operator-7866497494-42mdh"
Jul 15 14:34:11.959658 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.959446    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd114550-c5d0-471c-83fb-b5203fcea02c-metrics-tls\") pod \"dns-default-zmmq4\" (UID: \"cd114550-c5d0-471c-83fb-b5203fcea02c\") " pod="openshift-dns/dns-default-zmmq4"
Jul 15 14:34:11.959658 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.959499    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0de0f3ad-e228-4c27-9b2c-de1a5844dcdb-trusted-ca\") pod \"console-operator-7866497494-42mdh\" (UID: \"0de0f3ad-e228-4c27-9b2c-de1a5844dcdb\") " pod="openshift-console-operator/console-operator-7866497494-42mdh"
Jul 15 14:34:11.959658 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:11.959523    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4b0ac431-4ca5-45b0-9779-26461b04b319-default-certificate\") pod \"router-default-6b5f9c7788-p9ls6\" (UID: \"4b0ac431-4ca5-45b0-9779-26461b04b319\") " pod="openshift-ingress/router-default-6b5f9c7788-p9ls6"
Jul 15 14:34:12.060263 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.060228    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c632d732-9454-4773-bfae-ae68b1f0ac4d-registry-certificates\") pod \"image-registry-7cccfb4ff6-mkrws\" (UID: \"c632d732-9454-4773-bfae-ae68b1f0ac4d\") " pod="openshift-image-registry/image-registry-7cccfb4ff6-mkrws"
Jul 15 14:34:12.060263 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.060265    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/48d450ff-8575-4187-b279-ed927e9fb854-tmp\") pod \"insights-operator-68d9dd94cf-45c2z\" (UID: \"48d450ff-8575-4187-b279-ed927e9fb854\") " pod="openshift-insights/insights-operator-68d9dd94cf-45c2z"
Jul 15 14:34:12.060520 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.060324    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-827lt\" (UniqueName: \"kubernetes.io/projected/247f8c50-953c-457c-b2f5-02830e0c499d-kube-api-access-827lt\") pod \"cluster-monitoring-operator-5f7f494dd4-fkhv2\" (UID: \"247f8c50-953c-457c-b2f5-02830e0c499d\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fkhv2"
Jul 15 14:34:12.060520 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.060349    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b0ac431-4ca5-45b0-9779-26461b04b319-metrics-certs\") pod \"router-default-6b5f9c7788-p9ls6\" (UID: \"4b0ac431-4ca5-45b0-9779-26461b04b319\") " pod="openshift-ingress/router-default-6b5f9c7788-p9ls6"
Jul 15 14:34:12.060520 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.060366    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c632d732-9454-4773-bfae-ae68b1f0ac4d-installation-pull-secrets\") pod \"image-registry-7cccfb4ff6-mkrws\" (UID: \"c632d732-9454-4773-bfae-ae68b1f0ac4d\") " pod="openshift-image-registry/image-registry-7cccfb4ff6-mkrws"
Jul 15 14:34:12.060520 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.060383    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/247f8c50-953c-457c-b2f5-02830e0c499d-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-fkhv2\" (UID: \"247f8c50-953c-457c-b2f5-02830e0c499d\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fkhv2"
Jul 15 14:34:12.060520 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:12.060464    2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 14:34:12.060751 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.060520    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpvh6\" (UniqueName: \"kubernetes.io/projected/b50812cf-7948-4c73-b6da-728813c52302-kube-api-access-hpvh6\") pod \"volume-data-source-validator-78495597f6-cz5pq\" (UID: \"b50812cf-7948-4c73-b6da-728813c52302\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-cz5pq"
Jul 15 14:34:12.060751 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.060570    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrfb5\" (UniqueName: \"kubernetes.io/projected/7ea4c3c6-6010-4578-bd63-02311a41af04-kube-api-access-zrfb5\") pod \"kube-storage-version-migrator-operator-799cb7f958-69tjk\" (UID: \"7ea4c3c6-6010-4578-bd63-02311a41af04\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-69tjk"
Jul 15 14:34:12.060751 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.060620    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7ea4c3c6-6010-4578-bd63-02311a41af04-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-69tjk\" (UID: \"7ea4c3c6-6010-4578-bd63-02311a41af04\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-69tjk"
Jul 15 14:34:12.060751 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:12.060646    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b0ac431-4ca5-45b0-9779-26461b04b319-metrics-certs podName:4b0ac431-4ca5-45b0-9779-26461b04b319 nodeName:}" failed. No retries permitted until 2026-07-15 14:34:12.560625902 +0000 UTC m=+36.076443759 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4b0ac431-4ca5-45b0-9779-26461b04b319-metrics-certs") pod "router-default-6b5f9c7788-p9ls6" (UID: "4b0ac431-4ca5-45b0-9779-26461b04b319") : secret "router-metrics-certs-default" not found
Jul 15 14:34:12.060751 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.060685    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cd114550-c5d0-471c-83fb-b5203fcea02c-config-volume\") pod \"dns-default-zmmq4\" (UID: \"cd114550-c5d0-471c-83fb-b5203fcea02c\") " pod="openshift-dns/dns-default-zmmq4"
Jul 15 14:34:12.060751 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.060710    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c632d732-9454-4773-bfae-ae68b1f0ac4d-trusted-ca\") pod \"image-registry-7cccfb4ff6-mkrws\" (UID: \"c632d732-9454-4773-bfae-ae68b1f0ac4d\") " pod="openshift-image-registry/image-registry-7cccfb4ff6-mkrws"
Jul 15 14:34:12.060751 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.060739    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/48d450ff-8575-4187-b279-ed927e9fb854-tmp\") pod \"insights-operator-68d9dd94cf-45c2z\" (UID: \"48d450ff-8575-4187-b279-ed927e9fb854\") " pod="openshift-insights/insights-operator-68d9dd94cf-45c2z"
Jul 15 14:34:12.061079 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.060737    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7ea4c3c6-6010-4578-bd63-02311a41af04-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-69tjk\" (UID: \"7ea4c3c6-6010-4578-bd63-02311a41af04\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-69tjk"
Jul 15 14:34:12.061079 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.060795    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnfbb\" (UniqueName: \"kubernetes.io/projected/c632d732-9454-4773-bfae-ae68b1f0ac4d-kube-api-access-fnfbb\") pod \"image-registry-7cccfb4ff6-mkrws\" (UID: \"c632d732-9454-4773-bfae-ae68b1f0ac4d\") " pod="openshift-image-registry/image-registry-7cccfb4ff6-mkrws"
Jul 15 14:34:12.061079 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.060819    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/48d450ff-8575-4187-b279-ed927e9fb854-snapshots\") pod \"insights-operator-68d9dd94cf-45c2z\" (UID: \"48d450ff-8575-4187-b279-ed927e9fb854\") " pod="openshift-insights/insights-operator-68d9dd94cf-45c2z"
Jul 15 14:34:12.061079 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.060843    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fjw4d\" (UniqueName: \"kubernetes.io/projected/e8dade3b-1035-4ff4-911d-7ca98ce14401-kube-api-access-fjw4d\") pod \"cluster-samples-operator-65db858894-fkbdh\" (UID: \"e8dade3b-1035-4ff4-911d-7ca98ce14401\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-fkbdh"
Jul 15 14:34:12.061079 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.060866    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6d24461e-70ad-4e8d-8647-5277bed5a202-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-npl5n\" (UID: \"6d24461e-70ad-4e8d-8647-5277bed5a202\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-npl5n"
Jul 15 14:34:12.061079 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.060912    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c632d732-9454-4773-bfae-ae68b1f0ac4d-ca-trust-extracted\") pod \"image-registry-7cccfb4ff6-mkrws\" (UID: \"c632d732-9454-4773-bfae-ae68b1f0ac4d\") " pod="openshift-image-registry/image-registry-7cccfb4ff6-mkrws"
Jul 15 14:34:12.061079 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.060940    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4b0ac431-4ca5-45b0-9779-26461b04b319-stats-auth\") pod \"router-default-6b5f9c7788-p9ls6\" (UID: \"4b0ac431-4ca5-45b0-9779-26461b04b319\") " pod="openshift-ingress/router-default-6b5f9c7788-p9ls6"
Jul 15 14:34:12.061079 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.060946    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c632d732-9454-4773-bfae-ae68b1f0ac4d-registry-certificates\") pod \"image-registry-7cccfb4ff6-mkrws\" (UID: \"c632d732-9454-4773-bfae-ae68b1f0ac4d\") " pod="openshift-image-registry/image-registry-7cccfb4ff6-mkrws"
Jul 15 14:34:12.061079 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.060963    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c632d732-9454-4773-bfae-ae68b1f0ac4d-registry-tls\") pod \"image-registry-7cccfb4ff6-mkrws\" (UID: \"c632d732-9454-4773-bfae-ae68b1f0ac4d\") " pod="openshift-image-registry/image-registry-7cccfb4ff6-mkrws"
Jul 15 14:34:12.061079 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.061006    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48d450ff-8575-4187-b279-ed927e9fb854-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-45c2z\" (UID: \"48d450ff-8575-4187-b279-ed927e9fb854\") " pod="openshift-insights/insights-operator-68d9dd94cf-45c2z"
Jul 15 14:34:12.061079 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:12.061030    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 14:34:12.061079 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:12.061043    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cccfb4ff6-mkrws: secret "image-registry-tls" not found
Jul 15 14:34:12.061079 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.061044    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/48d450ff-8575-4187-b279-ed927e9fb854-serving-cert\") pod \"insights-operator-68d9dd94cf-45c2z\" (UID: \"48d450ff-8575-4187-b279-ed927e9fb854\") " pod="openshift-insights/insights-operator-68d9dd94cf-45c2z"
Jul 15 14:34:12.061079 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:12.061084    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c632d732-9454-4773-bfae-ae68b1f0ac4d-registry-tls podName:c632d732-9454-4773-bfae-ae68b1f0ac4d nodeName:}" failed. No retries permitted until 2026-07-15 14:34:12.561068853 +0000 UTC m=+36.076886732 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c632d732-9454-4773-bfae-ae68b1f0ac4d-registry-tls") pod "image-registry-7cccfb4ff6-mkrws" (UID: "c632d732-9454-4773-bfae-ae68b1f0ac4d") : secret "image-registry-tls" not found
Jul 15 14:34:12.061818 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.061101    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0de0f3ad-e228-4c27-9b2c-de1a5844dcdb-serving-cert\") pod \"console-operator-7866497494-42mdh\" (UID: \"0de0f3ad-e228-4c27-9b2c-de1a5844dcdb\") " pod="openshift-console-operator/console-operator-7866497494-42mdh"
Jul 15 14:34:12.061818 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.061123    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/247f8c50-953c-457c-b2f5-02830e0c499d-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-fkhv2\" (UID: \"247f8c50-953c-457c-b2f5-02830e0c499d\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fkhv2"
Jul 15 14:34:12.061818 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.061128    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-skchq\" (UniqueName: \"kubernetes.io/projected/95abed3c-7259-4ef3-990b-eb51bd185c59-kube-api-access-skchq\") pod \"service-ca-operator-7695fc6c8c-dd6cg\" (UID: \"95abed3c-7259-4ef3-990b-eb51bd185c59\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-dd6cg"
Jul 15 14:34:12.061818 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.061184    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/247f8c50-953c-457c-b2f5-02830e0c499d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-fkhv2\" (UID: \"247f8c50-953c-457c-b2f5-02830e0c499d\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fkhv2"
Jul 15 14:34:12.061818 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.061233    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dc6sv\" (UniqueName: \"kubernetes.io/projected/cd114550-c5d0-471c-83fb-b5203fcea02c-kube-api-access-dc6sv\") pod \"dns-default-zmmq4\" (UID: \"cd114550-c5d0-471c-83fb-b5203fcea02c\") " pod="openshift-dns/dns-default-zmmq4"
Jul 15 14:34:12.061818 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.061297    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5943ec96-deb6-4e14-9d96-d5f71e12d6d5-cert\") pod \"ingress-canary-t56m5\" (UID: \"5943ec96-deb6-4e14-9d96-d5f71e12d6d5\") " pod="openshift-ingress-canary/ingress-canary-t56m5"
Jul 15 14:34:12.061818 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.061307    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/cd114550-c5d0-471c-83fb-b5203fcea02c-config-volume\") pod \"dns-default-zmmq4\" (UID: \"cd114550-c5d0-471c-83fb-b5203fcea02c\") " pod="openshift-dns/dns-default-zmmq4"
Jul 15 14:34:12.061818 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.061326    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kgck\" (UniqueName: \"kubernetes.io/projected/5943ec96-deb6-4e14-9d96-d5f71e12d6d5-kube-api-access-2kgck\") pod \"ingress-canary-t56m5\" (UID: \"5943ec96-deb6-4e14-9d96-d5f71e12d6d5\") " pod="openshift-ingress-canary/ingress-canary-t56m5"
Jul 15 14:34:12.061818 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.061351    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w2m8x\" (UniqueName: \"kubernetes.io/projected/f7d825f1-c2e0-40b2-92f4-04699e417a8a-kube-api-access-w2m8x\") pod \"network-check-source-869dcfcdcd-4rjgr\" (UID: \"f7d825f1-c2e0-40b2-92f4-04699e417a8a\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-4rjgr"
Jul 15 14:34:12.061818 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.061383    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48d450ff-8575-4187-b279-ed927e9fb854-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-45c2z\" (UID: \"48d450ff-8575-4187-b279-ed927e9fb854\") " pod="openshift-insights/insights-operator-68d9dd94cf-45c2z"
Jul 15 14:34:12.061818 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.061406    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b0ac431-4ca5-45b0-9779-26461b04b319-service-ca-bundle\") pod \"router-default-6b5f9c7788-p9ls6\" (UID: \"4b0ac431-4ca5-45b0-9779-26461b04b319\") " pod="openshift-ingress/router-default-6b5f9c7788-p9ls6"
Jul 15 14:34:12.061818 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.061434    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/95abed3c-7259-4ef3-990b-eb51bd185c59-serving-cert\") pod \"service-ca-operator-7695fc6c8c-dd6cg\" (UID: \"95abed3c-7259-4ef3-990b-eb51bd185c59\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-dd6cg"
Jul 15 14:34:12.061818 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.061460    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v474c\" (UniqueName: \"kubernetes.io/projected/0de0f3ad-e228-4c27-9b2c-de1a5844dcdb-kube-api-access-v474c\") pod \"console-operator-7866497494-42mdh\" (UID: \"0de0f3ad-e228-4c27-9b2c-de1a5844dcdb\") " pod="openshift-console-operator/console-operator-7866497494-42mdh"
Jul 15 14:34:12.061818 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:12.061467    2571 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 14:34:12.061818 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.061485    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd114550-c5d0-471c-83fb-b5203fcea02c-metrics-tls\") pod \"dns-default-zmmq4\" (UID: \"cd114550-c5d0-471c-83fb-b5203fcea02c\") " pod="openshift-dns/dns-default-zmmq4"
Jul 15 14:34:12.061818 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:12.061514    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/247f8c50-953c-457c-b2f5-02830e0c499d-cluster-monitoring-operator-tls podName:247f8c50-953c-457c-b2f5-02830e0c499d nodeName:}" failed. No retries permitted until 2026-07-15 14:34:12.56149905 +0000 UTC m=+36.077316904 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/247f8c50-953c-457c-b2f5-02830e0c499d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-fkhv2" (UID: "247f8c50-953c-457c-b2f5-02830e0c499d") : secret "cluster-monitoring-operator-tls" not found
Jul 15 14:34:12.062581 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.061546    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0de0f3ad-e228-4c27-9b2c-de1a5844dcdb-trusted-ca\") pod \"console-operator-7866497494-42mdh\" (UID: \"0de0f3ad-e228-4c27-9b2c-de1a5844dcdb\") " pod="openshift-console-operator/console-operator-7866497494-42mdh"
Jul 15 14:34:12.062581 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:12.061563    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 14:34:12.062581 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.061572    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4b0ac431-4ca5-45b0-9779-26461b04b319-default-certificate\") pod \"router-default-6b5f9c7788-p9ls6\" (UID: \"4b0ac431-4ca5-45b0-9779-26461b04b319\") " pod="openshift-ingress/router-default-6b5f9c7788-p9ls6"
Jul 15 14:34:12.062581 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:12.061614    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd114550-c5d0-471c-83fb-b5203fcea02c-metrics-tls podName:cd114550-c5d0-471c-83fb-b5203fcea02c nodeName:}" failed. No retries permitted until 2026-07-15 14:34:12.561600005 +0000 UTC m=+36.077417854 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cd114550-c5d0-471c-83fb-b5203fcea02c-metrics-tls") pod "dns-default-zmmq4" (UID: "cd114550-c5d0-471c-83fb-b5203fcea02c") : secret "dns-default-metrics-tls" not found
Jul 15 14:34:12.062581 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.061634    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxqzq\" (UniqueName: \"kubernetes.io/projected/48d450ff-8575-4187-b279-ed927e9fb854-kube-api-access-sxqzq\") pod \"insights-operator-68d9dd94cf-45c2z\" (UID: \"48d450ff-8575-4187-b279-ed927e9fb854\") " pod="openshift-insights/insights-operator-68d9dd94cf-45c2z"
Jul 15 14:34:12.062581 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.061631    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48d450ff-8575-4187-b279-ed927e9fb854-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-45c2z\" (UID: \"48d450ff-8575-4187-b279-ed927e9fb854\") " pod="openshift-insights/insights-operator-68d9dd94cf-45c2z"
Jul 15 14:34:12.062581 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.061673    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c632d732-9454-4773-bfae-ae68b1f0ac4d-trusted-ca\") pod \"image-registry-7cccfb4ff6-mkrws\" (UID: \"c632d732-9454-4773-bfae-ae68b1f0ac4d\") " pod="openshift-image-registry/image-registry-7cccfb4ff6-mkrws"
Jul 15 14:34:12.062581 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.061661    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6d24461e-70ad-4e8d-8647-5277bed5a202-nginx-conf\") pod \"networking-console-plugin-6cf856758c-npl5n\" (UID: \"6d24461e-70ad-4e8d-8647-5277bed5a202\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-npl5n"
Jul 15 14:34:12.062581 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.061829    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c632d732-9454-4773-bfae-ae68b1f0ac4d-bound-sa-token\") pod \"image-registry-7cccfb4ff6-mkrws\" (UID: \"c632d732-9454-4773-bfae-ae68b1f0ac4d\") " pod="openshift-image-registry/image-registry-7cccfb4ff6-mkrws"
Jul 15 14:34:12.062581 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.061865    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e8dade3b-1035-4ff4-911d-7ca98ce14401-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-fkbdh\" (UID: \"e8dade3b-1035-4ff4-911d-7ca98ce14401\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-fkbdh"
Jul 15 14:34:12.062581 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.061895    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c632d732-9454-4773-bfae-ae68b1f0ac4d-image-registry-private-configuration\") pod \"image-registry-7cccfb4ff6-mkrws\" (UID: \"c632d732-9454-4773-bfae-ae68b1f0ac4d\") " pod="openshift-image-registry/image-registry-7cccfb4ff6-mkrws"
Jul 15 14:34:12.062581 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.061920    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0de0f3ad-e228-4c27-9b2c-de1a5844dcdb-config\") pod \"console-operator-7866497494-42mdh\" (UID: \"0de0f3ad-e228-4c27-9b2c-de1a5844dcdb\") " pod="openshift-console-operator/console-operator-7866497494-42mdh"
Jul 15 14:34:12.062581 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.061941    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/48d450ff-8575-4187-b279-ed927e9fb854-snapshots\") pod \"insights-operator-68d9dd94cf-45c2z\" (UID: \"48d450ff-8575-4187-b279-ed927e9fb854\") " pod="openshift-insights/insights-operator-68d9dd94cf-45c2z"
Jul 15 14:34:12.062581 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.061943    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c632d732-9454-4773-bfae-ae68b1f0ac4d-ca-trust-extracted\") pod \"image-registry-7cccfb4ff6-mkrws\" (UID: \"c632d732-9454-4773-bfae-ae68b1f0ac4d\") " pod="openshift-image-registry/image-registry-7cccfb4ff6-mkrws"
Jul 15 14:34:12.062581 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:12.062027    2571 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 15 14:34:12.062581 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:12.062070    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8dade3b-1035-4ff4-911d-7ca98ce14401-samples-operator-tls podName:e8dade3b-1035-4ff4-911d-7ca98ce14401 nodeName:}" failed. No retries permitted until 2026-07-15 14:34:12.562056774 +0000 UTC m=+36.077874825 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e8dade3b-1035-4ff4-911d-7ca98ce14401-samples-operator-tls") pod "cluster-samples-operator-65db858894-fkbdh" (UID: "e8dade3b-1035-4ff4-911d-7ca98ce14401") : secret "samples-operator-tls" not found
Jul 15 14:34:12.063357 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:12.062408    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4b0ac431-4ca5-45b0-9779-26461b04b319-service-ca-bundle podName:4b0ac431-4ca5-45b0-9779-26461b04b319 nodeName:}" failed. No retries permitted until 2026-07-15 14:34:12.562375857 +0000 UTC m=+36.078193728 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4b0ac431-4ca5-45b0-9779-26461b04b319-service-ca-bundle") pod "router-default-6b5f9c7788-p9ls6" (UID: "4b0ac431-4ca5-45b0-9779-26461b04b319") : configmap references non-existent config key: service-ca.crt
Jul 15 14:34:12.063357 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.062508    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/48d450ff-8575-4187-b279-ed927e9fb854-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-45c2z\" (UID: \"48d450ff-8575-4187-b279-ed927e9fb854\") " pod="openshift-insights/insights-operator-68d9dd94cf-45c2z"
Jul 15 14:34:12.063357 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.063023    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/0de0f3ad-e228-4c27-9b2c-de1a5844dcdb-config\") pod \"console-operator-7866497494-42mdh\" (UID: \"0de0f3ad-e228-4c27-9b2c-de1a5844dcdb\") " pod="openshift-console-operator/console-operator-7866497494-42mdh"
Jul 15 14:34:12.063357 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.063093    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lmrhj\" (UniqueName: \"kubernetes.io/projected/4b0ac431-4ca5-45b0-9779-26461b04b319-kube-api-access-lmrhj\") pod \"router-default-6b5f9c7788-p9ls6\" (UID: \"4b0ac431-4ca5-45b0-9779-26461b04b319\") " pod="openshift-ingress/router-default-6b5f9c7788-p9ls6"
Jul 15 14:34:12.063357 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.063142    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd114550-c5d0-471c-83fb-b5203fcea02c-tmp-dir\") pod \"dns-default-zmmq4\" (UID: \"cd114550-c5d0-471c-83fb-b5203fcea02c\") " pod="openshift-dns/dns-default-zmmq4"
Jul 15 14:34:12.063357 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.063173    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/95abed3c-7259-4ef3-990b-eb51bd185c59-config\") pod \"service-ca-operator-7695fc6c8c-dd6cg\" (UID: \"95abed3c-7259-4ef3-990b-eb51bd185c59\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-dd6cg"
Jul 15 14:34:12.063602 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.063488    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/0de0f3ad-e228-4c27-9b2c-de1a5844dcdb-trusted-ca\") pod \"console-operator-7866497494-42mdh\" (UID: \"0de0f3ad-e228-4c27-9b2c-de1a5844dcdb\") " pod="openshift-console-operator/console-operator-7866497494-42mdh"
Jul 15 14:34:12.063992 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.063719    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/cd114550-c5d0-471c-83fb-b5203fcea02c-tmp-dir\") pod \"dns-default-zmmq4\" (UID: \"cd114550-c5d0-471c-83fb-b5203fcea02c\") " pod="openshift-dns/dns-default-zmmq4"
Jul 15 14:34:12.066349 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.066307    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/48d450ff-8575-4187-b279-ed927e9fb854-serving-cert\") pod \"insights-operator-68d9dd94cf-45c2z\" (UID: \"48d450ff-8575-4187-b279-ed927e9fb854\") " pod="openshift-insights/insights-operator-68d9dd94cf-45c2z"
Jul 15 14:34:12.066460 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.066352    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c632d732-9454-4773-bfae-ae68b1f0ac4d-image-registry-private-configuration\") pod \"image-registry-7cccfb4ff6-mkrws\" (UID: \"c632d732-9454-4773-bfae-ae68b1f0ac4d\") " pod="openshift-image-registry/image-registry-7cccfb4ff6-mkrws"
Jul 15 14:34:12.066460 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.066417    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/4b0ac431-4ca5-45b0-9779-26461b04b319-default-certificate\") pod \"router-default-6b5f9c7788-p9ls6\" (UID: \"4b0ac431-4ca5-45b0-9779-26461b04b319\") " pod="openshift-ingress/router-default-6b5f9c7788-p9ls6"
Jul 15 14:34:12.066615 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.066597    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/4b0ac431-4ca5-45b0-9779-26461b04b319-stats-auth\") pod \"router-default-6b5f9c7788-p9ls6\" (UID: \"4b0ac431-4ca5-45b0-9779-26461b04b319\") " pod="openshift-ingress/router-default-6b5f9c7788-p9ls6"
Jul 15 14:34:12.066872 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.066852    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/0de0f3ad-e228-4c27-9b2c-de1a5844dcdb-serving-cert\") pod \"console-operator-7866497494-42mdh\" (UID: \"0de0f3ad-e228-4c27-9b2c-de1a5844dcdb\") " pod="openshift-console-operator/console-operator-7866497494-42mdh"
Jul 15 14:34:12.067026 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.067008    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c632d732-9454-4773-bfae-ae68b1f0ac4d-installation-pull-secrets\") pod \"image-registry-7cccfb4ff6-mkrws\" (UID: \"c632d732-9454-4773-bfae-ae68b1f0ac4d\") " pod="openshift-image-registry/image-registry-7cccfb4ff6-mkrws"
Jul 15 14:34:12.072146 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.072116    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-827lt\" (UniqueName: \"kubernetes.io/projected/247f8c50-953c-457c-b2f5-02830e0c499d-kube-api-access-827lt\") pod \"cluster-monitoring-operator-5f7f494dd4-fkhv2\" (UID: \"247f8c50-953c-457c-b2f5-02830e0c499d\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fkhv2"
Jul 15 14:34:12.074174 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.074150    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpvh6\" (UniqueName: \"kubernetes.io/projected/b50812cf-7948-4c73-b6da-728813c52302-kube-api-access-hpvh6\") pod \"volume-data-source-validator-78495597f6-cz5pq\" (UID: \"b50812cf-7948-4c73-b6da-728813c52302\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-cz5pq"
Jul 15 14:34:12.074937 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.074912    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dc6sv\" (UniqueName: \"kubernetes.io/projected/cd114550-c5d0-471c-83fb-b5203fcea02c-kube-api-access-dc6sv\") pod \"dns-default-zmmq4\" (UID: \"cd114550-c5d0-471c-83fb-b5203fcea02c\") " pod="openshift-dns/dns-default-zmmq4"
Jul 15 14:34:12.075607 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.075554    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c632d732-9454-4773-bfae-ae68b1f0ac4d-bound-sa-token\") pod \"image-registry-7cccfb4ff6-mkrws\" (UID: \"c632d732-9454-4773-bfae-ae68b1f0ac4d\") " pod="openshift-image-registry/image-registry-7cccfb4ff6-mkrws"
Jul 15 14:34:12.076106 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.076066    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v474c\" (UniqueName: \"kubernetes.io/projected/0de0f3ad-e228-4c27-9b2c-de1a5844dcdb-kube-api-access-v474c\") pod \"console-operator-7866497494-42mdh\" (UID: \"0de0f3ad-e228-4c27-9b2c-de1a5844dcdb\") " pod="openshift-console-operator/console-operator-7866497494-42mdh"
Jul 15 14:34:12.076319 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.076291    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnfbb\" (UniqueName: \"kubernetes.io/projected/c632d732-9454-4773-bfae-ae68b1f0ac4d-kube-api-access-fnfbb\") pod \"image-registry-7cccfb4ff6-mkrws\" (UID: \"c632d732-9454-4773-bfae-ae68b1f0ac4d\") " pod="openshift-image-registry/image-registry-7cccfb4ff6-mkrws"
Jul 15 14:34:12.077832 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.077792    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxqzq\" (UniqueName: \"kubernetes.io/projected/48d450ff-8575-4187-b279-ed927e9fb854-kube-api-access-sxqzq\") pod \"insights-operator-68d9dd94cf-45c2z\" (UID: \"48d450ff-8575-4187-b279-ed927e9fb854\") " pod="openshift-insights/insights-operator-68d9dd94cf-45c2z"
Jul 15 14:34:12.078628 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.078604    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lmrhj\" (UniqueName: \"kubernetes.io/projected/4b0ac431-4ca5-45b0-9779-26461b04b319-kube-api-access-lmrhj\") pod \"router-default-6b5f9c7788-p9ls6\" (UID: \"4b0ac431-4ca5-45b0-9779-26461b04b319\") " pod="openshift-ingress/router-default-6b5f9c7788-p9ls6"
Jul 15 14:34:12.079732 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.079697    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fjw4d\" (UniqueName: \"kubernetes.io/projected/e8dade3b-1035-4ff4-911d-7ca98ce14401-kube-api-access-fjw4d\") pod \"cluster-samples-operator-65db858894-fkbdh\" (UID: \"e8dade3b-1035-4ff4-911d-7ca98ce14401\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-fkbdh"
Jul 15 14:34:12.100499 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.100431    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:12.164645 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.164612    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7ea4c3c6-6010-4578-bd63-02311a41af04-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-69tjk\" (UID: \"7ea4c3c6-6010-4578-bd63-02311a41af04\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-69tjk"
Jul 15 14:34:12.164784 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.164654    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6d24461e-70ad-4e8d-8647-5277bed5a202-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-npl5n\" (UID: \"6d24461e-70ad-4e8d-8647-5277bed5a202\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-npl5n"
Jul 15 14:34:12.164784 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.164709    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-skchq\" (UniqueName: \"kubernetes.io/projected/95abed3c-7259-4ef3-990b-eb51bd185c59-kube-api-access-skchq\") pod \"service-ca-operator-7695fc6c8c-dd6cg\" (UID: \"95abed3c-7259-4ef3-990b-eb51bd185c59\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-dd6cg"
Jul 15 14:34:12.164908 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:12.164817    2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 15 14:34:12.164908 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.164852    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5943ec96-deb6-4e14-9d96-d5f71e12d6d5-cert\") pod \"ingress-canary-t56m5\" (UID: \"5943ec96-deb6-4e14-9d96-d5f71e12d6d5\") " pod="openshift-ingress-canary/ingress-canary-t56m5"
Jul 15 14:34:12.164908 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.164881    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kgck\" (UniqueName: \"kubernetes.io/projected/5943ec96-deb6-4e14-9d96-d5f71e12d6d5-kube-api-access-2kgck\") pod \"ingress-canary-t56m5\" (UID: \"5943ec96-deb6-4e14-9d96-d5f71e12d6d5\") " pod="openshift-ingress-canary/ingress-canary-t56m5"
Jul 15 14:34:12.164908 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:12.164896    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d24461e-70ad-4e8d-8647-5277bed5a202-networking-console-plugin-cert podName:6d24461e-70ad-4e8d-8647-5277bed5a202 nodeName:}" failed. No retries permitted until 2026-07-15 14:34:12.664875211 +0000 UTC m=+36.180693065 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6d24461e-70ad-4e8d-8647-5277bed5a202-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-npl5n" (UID: "6d24461e-70ad-4e8d-8647-5277bed5a202") : secret "networking-console-plugin-cert" not found
Jul 15 14:34:12.165104 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.164930    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w2m8x\" (UniqueName: \"kubernetes.io/projected/f7d825f1-c2e0-40b2-92f4-04699e417a8a-kube-api-access-w2m8x\") pod \"network-check-source-869dcfcdcd-4rjgr\" (UID: \"f7d825f1-c2e0-40b2-92f4-04699e417a8a\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-4rjgr"
Jul 15 14:34:12.165104 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.164981    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/95abed3c-7259-4ef3-990b-eb51bd185c59-serving-cert\") pod \"service-ca-operator-7695fc6c8c-dd6cg\" (UID: \"95abed3c-7259-4ef3-990b-eb51bd185c59\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-dd6cg"
Jul 15 14:34:12.165104 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.165042    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6d24461e-70ad-4e8d-8647-5277bed5a202-nginx-conf\") pod \"networking-console-plugin-6cf856758c-npl5n\" (UID: \"6d24461e-70ad-4e8d-8647-5277bed5a202\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-npl5n"
Jul 15 14:34:12.165247 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.165208    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/95abed3c-7259-4ef3-990b-eb51bd185c59-config\") pod \"service-ca-operator-7695fc6c8c-dd6cg\" (UID: \"95abed3c-7259-4ef3-990b-eb51bd185c59\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-dd6cg"
Jul 15 14:34:12.165336 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.165309    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrfb5\" (UniqueName: \"kubernetes.io/projected/7ea4c3c6-6010-4578-bd63-02311a41af04-kube-api-access-zrfb5\") pod \"kube-storage-version-migrator-operator-799cb7f958-69tjk\" (UID: \"7ea4c3c6-6010-4578-bd63-02311a41af04\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-69tjk"
Jul 15 14:34:12.165391 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.165350    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7ea4c3c6-6010-4578-bd63-02311a41af04-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-69tjk\" (UID: \"7ea4c3c6-6010-4578-bd63-02311a41af04\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-69tjk"
Jul 15 14:34:12.165798 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.165752    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/6d24461e-70ad-4e8d-8647-5277bed5a202-nginx-conf\") pod \"networking-console-plugin-6cf856758c-npl5n\" (UID: \"6d24461e-70ad-4e8d-8647-5277bed5a202\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-npl5n"
Jul 15 14:34:12.165946 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.165919    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/95abed3c-7259-4ef3-990b-eb51bd185c59-config\") pod \"service-ca-operator-7695fc6c8c-dd6cg\" (UID: \"95abed3c-7259-4ef3-990b-eb51bd185c59\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-dd6cg"
Jul 15 14:34:12.166005 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.165939    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/7ea4c3c6-6010-4578-bd63-02311a41af04-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-69tjk\" (UID: \"7ea4c3c6-6010-4578-bd63-02311a41af04\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-69tjk"
Jul 15 14:34:12.167447 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.167404    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/95abed3c-7259-4ef3-990b-eb51bd185c59-serving-cert\") pod \"service-ca-operator-7695fc6c8c-dd6cg\" (UID: \"95abed3c-7259-4ef3-990b-eb51bd185c59\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-dd6cg"
Jul 15 14:34:12.167546 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.167512    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/7ea4c3c6-6010-4578-bd63-02311a41af04-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-69tjk\" (UID: \"7ea4c3c6-6010-4578-bd63-02311a41af04\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-69tjk"
Jul 15 14:34:12.167626 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.167606    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5943ec96-deb6-4e14-9d96-d5f71e12d6d5-cert\") pod \"ingress-canary-t56m5\" (UID: \"5943ec96-deb6-4e14-9d96-d5f71e12d6d5\") " pod="openshift-ingress-canary/ingress-canary-t56m5"
Jul 15 14:34:12.178591 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.178563    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w2m8x\" (UniqueName: \"kubernetes.io/projected/f7d825f1-c2e0-40b2-92f4-04699e417a8a-kube-api-access-w2m8x\") pod \"network-check-source-869dcfcdcd-4rjgr\" (UID: \"f7d825f1-c2e0-40b2-92f4-04699e417a8a\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-4rjgr"
Jul 15 14:34:12.179114 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.179090    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kgck\" (UniqueName: \"kubernetes.io/projected/5943ec96-deb6-4e14-9d96-d5f71e12d6d5-kube-api-access-2kgck\") pod \"ingress-canary-t56m5\" (UID: \"5943ec96-deb6-4e14-9d96-d5f71e12d6d5\") " pod="openshift-ingress-canary/ingress-canary-t56m5"
Jul 15 14:34:12.179114 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.179112    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-skchq\" (UniqueName: \"kubernetes.io/projected/95abed3c-7259-4ef3-990b-eb51bd185c59-kube-api-access-skchq\") pod \"service-ca-operator-7695fc6c8c-dd6cg\" (UID: \"95abed3c-7259-4ef3-990b-eb51bd185c59\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-dd6cg"
Jul 15 14:34:12.179381 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.179366    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrfb5\" (UniqueName: \"kubernetes.io/projected/7ea4c3c6-6010-4578-bd63-02311a41af04-kube-api-access-zrfb5\") pod \"kube-storage-version-migrator-operator-799cb7f958-69tjk\" (UID: \"7ea4c3c6-6010-4578-bd63-02311a41af04\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-69tjk"
Jul 15 14:34:12.185853 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.185836    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-cz5pq"
Jul 15 14:34:12.194985 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.194957    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-45c2z"
Jul 15 14:34:12.199543 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.199501    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-42mdh"
Jul 15 14:34:12.226001 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.225957    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-69tjk"
Jul 15 14:34:12.232067 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.231876    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-dd6cg"
Jul 15 14:34:12.237220 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.237195    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-4rjgr"
Jul 15 14:34:12.243488 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.243246    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-t56m5"
Jul 15 14:34:12.281741 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.281457    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:12.369345 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.369235    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:12.436475 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.436405    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:12.450816 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.450787    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-45c2z"]
Jul 15 14:34:12.456442 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:34:12.456404    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod48d450ff_8575_4187_b279_ed927e9fb854.slice/crio-75446c5a91e65e681720ea32bbfebe8538685a097c6ac1a698a4c56ffe746208 WatchSource:0}: Error finding container 75446c5a91e65e681720ea32bbfebe8538685a097c6ac1a698a4c56ffe746208: Status 404 returned error can't find the container with id 75446c5a91e65e681720ea32bbfebe8538685a097c6ac1a698a4c56ffe746208
Jul 15 14:34:12.471233 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.471210    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-42mdh"]
Jul 15 14:34:12.472687 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.472481    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-cz5pq"]
Jul 15 14:34:12.476615 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:34:12.476583    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0de0f3ad_e228_4c27_9b2c_de1a5844dcdb.slice/crio-151a98d658e3b0d7279db16e4f7974fcb37ce47c74c12ea6c67e0a56e19783ac WatchSource:0}: Error finding container 151a98d658e3b0d7279db16e4f7974fcb37ce47c74c12ea6c67e0a56e19783ac: Status 404 returned error can't find the container with id 151a98d658e3b0d7279db16e4f7974fcb37ce47c74c12ea6c67e0a56e19783ac
Jul 15 14:34:12.477413 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:34:12.477230    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb50812cf_7948_4c73_b6da_728813c52302.slice/crio-908554bc5d04b95e8b1b93aaaa93e7c68fa1215d011be643dce827a2dd29f37e WatchSource:0}: Error finding container 908554bc5d04b95e8b1b93aaaa93e7c68fa1215d011be643dce827a2dd29f37e: Status 404 returned error can't find the container with id 908554bc5d04b95e8b1b93aaaa93e7c68fa1215d011be643dce827a2dd29f37e
Jul 15 14:34:12.479984 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.479803    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-69tjk"]
Jul 15 14:34:12.482474 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:34:12.482322    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ea4c3c6_6010_4578_bd63_02311a41af04.slice/crio-cce1f75cd5c036c401e65175d41868d07ba5f75be92002e04bdf2fcd96cdab06 WatchSource:0}: Error finding container cce1f75cd5c036c401e65175d41868d07ba5f75be92002e04bdf2fcd96cdab06: Status 404 returned error can't find the container with id cce1f75cd5c036c401e65175d41868d07ba5f75be92002e04bdf2fcd96cdab06
Jul 15 14:34:12.484495 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.484451    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-4rjgr"]
Jul 15 14:34:12.487510 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:34:12.487489    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7d825f1_c2e0_40b2_92f4_04699e417a8a.slice/crio-52ad9b7f2e8928b12408c4ac511e0397ebde460ae227729297f1d6df32b14374 WatchSource:0}: Error finding container 52ad9b7f2e8928b12408c4ac511e0397ebde460ae227729297f1d6df32b14374: Status 404 returned error can't find the container with id 52ad9b7f2e8928b12408c4ac511e0397ebde460ae227729297f1d6df32b14374
Jul 15 14:34:12.492821 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.492780    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-dd6cg"]
Jul 15 14:34:12.495609 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:34:12.495569    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95abed3c_7259_4ef3_990b_eb51bd185c59.slice/crio-954f217d0cc3da8217fd7432ccfd842c3c8c8434c7c96cb21909880ba687fc36 WatchSource:0}: Error finding container 954f217d0cc3da8217fd7432ccfd842c3c8c8434c7c96cb21909880ba687fc36: Status 404 returned error can't find the container with id 954f217d0cc3da8217fd7432ccfd842c3c8c8434c7c96cb21909880ba687fc36
Jul 15 14:34:12.518708 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.518680    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:12.524742 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.524724    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-t56m5"]
Jul 15 14:34:12.526965 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:34:12.526944    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5943ec96_deb6_4e14_9d96_d5f71e12d6d5.slice/crio-020ac058b8b4252e59fd1ea61b97b0757acd64cdfc36a5658edbe1d35522ad08 WatchSource:0}: Error finding container 020ac058b8b4252e59fd1ea61b97b0757acd64cdfc36a5658edbe1d35522ad08: Status 404 returned error can't find the container with id 020ac058b8b4252e59fd1ea61b97b0757acd64cdfc36a5658edbe1d35522ad08
Jul 15 14:34:12.567824 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.567800    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b0ac431-4ca5-45b0-9779-26461b04b319-metrics-certs\") pod \"router-default-6b5f9c7788-p9ls6\" (UID: \"4b0ac431-4ca5-45b0-9779-26461b04b319\") " pod="openshift-ingress/router-default-6b5f9c7788-p9ls6"
Jul 15 14:34:12.567962 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.567866    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c632d732-9454-4773-bfae-ae68b1f0ac4d-registry-tls\") pod \"image-registry-7cccfb4ff6-mkrws\" (UID: \"c632d732-9454-4773-bfae-ae68b1f0ac4d\") " pod="openshift-image-registry/image-registry-7cccfb4ff6-mkrws"
Jul 15 14:34:12.567962 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.567899    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/247f8c50-953c-457c-b2f5-02830e0c499d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-fkhv2\" (UID: \"247f8c50-953c-457c-b2f5-02830e0c499d\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fkhv2"
Jul 15 14:34:12.567962 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:12.567948    2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 14:34:12.567962 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.567952    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b0ac431-4ca5-45b0-9779-26461b04b319-service-ca-bundle\") pod \"router-default-6b5f9c7788-p9ls6\" (UID: \"4b0ac431-4ca5-45b0-9779-26461b04b319\") " pod="openshift-ingress/router-default-6b5f9c7788-p9ls6"
Jul 15 14:34:12.568157 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.567980    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd114550-c5d0-471c-83fb-b5203fcea02c-metrics-tls\") pod \"dns-default-zmmq4\" (UID: \"cd114550-c5d0-471c-83fb-b5203fcea02c\") " pod="openshift-dns/dns-default-zmmq4"
Jul 15 14:34:12.568157 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:12.568005    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b0ac431-4ca5-45b0-9779-26461b04b319-metrics-certs podName:4b0ac431-4ca5-45b0-9779-26461b04b319 nodeName:}" failed. No retries permitted until 2026-07-15 14:34:13.567985084 +0000 UTC m=+37.083802951 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4b0ac431-4ca5-45b0-9779-26461b04b319-metrics-certs") pod "router-default-6b5f9c7788-p9ls6" (UID: "4b0ac431-4ca5-45b0-9779-26461b04b319") : secret "router-metrics-certs-default" not found
Jul 15 14:34:12.568157 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:12.568023    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 14:34:12.568157 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:12.568037    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 14:34:12.568157 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:12.568041    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cccfb4ff6-mkrws: secret "image-registry-tls" not found
Jul 15 14:34:12.568157 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:12.568050    2571 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 14:34:12.568157 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.568049    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e8dade3b-1035-4ff4-911d-7ca98ce14401-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-fkbdh\" (UID: \"e8dade3b-1035-4ff4-911d-7ca98ce14401\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-fkbdh"
Jul 15 14:34:12.568157 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:12.568090    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c632d732-9454-4773-bfae-ae68b1f0ac4d-registry-tls podName:c632d732-9454-4773-bfae-ae68b1f0ac4d nodeName:}" failed. No retries permitted until 2026-07-15 14:34:13.568073875 +0000 UTC m=+37.083891725 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c632d732-9454-4773-bfae-ae68b1f0ac4d-registry-tls") pod "image-registry-7cccfb4ff6-mkrws" (UID: "c632d732-9454-4773-bfae-ae68b1f0ac4d") : secret "image-registry-tls" not found
Jul 15 14:34:12.568157 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:12.568103    2571 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 15 14:34:12.568157 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:12.568113    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/247f8c50-953c-457c-b2f5-02830e0c499d-cluster-monitoring-operator-tls podName:247f8c50-953c-457c-b2f5-02830e0c499d nodeName:}" failed. No retries permitted until 2026-07-15 14:34:13.568104358 +0000 UTC m=+37.083922207 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/247f8c50-953c-457c-b2f5-02830e0c499d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-fkhv2" (UID: "247f8c50-953c-457c-b2f5-02830e0c499d") : secret "cluster-monitoring-operator-tls" not found
Jul 15 14:34:12.568157 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:12.568130    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd114550-c5d0-471c-83fb-b5203fcea02c-metrics-tls podName:cd114550-c5d0-471c-83fb-b5203fcea02c nodeName:}" failed. No retries permitted until 2026-07-15 14:34:13.568122159 +0000 UTC m=+37.083940008 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cd114550-c5d0-471c-83fb-b5203fcea02c-metrics-tls") pod "dns-default-zmmq4" (UID: "cd114550-c5d0-471c-83fb-b5203fcea02c") : secret "dns-default-metrics-tls" not found
Jul 15 14:34:12.568157 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:12.568152    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4b0ac431-4ca5-45b0-9779-26461b04b319-service-ca-bundle podName:4b0ac431-4ca5-45b0-9779-26461b04b319 nodeName:}" failed. No retries permitted until 2026-07-15 14:34:13.568144825 +0000 UTC m=+37.083962677 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4b0ac431-4ca5-45b0-9779-26461b04b319-service-ca-bundle") pod "router-default-6b5f9c7788-p9ls6" (UID: "4b0ac431-4ca5-45b0-9779-26461b04b319") : configmap references non-existent config key: service-ca.crt
Jul 15 14:34:12.568650 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:12.568178    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8dade3b-1035-4ff4-911d-7ca98ce14401-samples-operator-tls podName:e8dade3b-1035-4ff4-911d-7ca98ce14401 nodeName:}" failed. No retries permitted until 2026-07-15 14:34:13.568168873 +0000 UTC m=+37.083986727 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e8dade3b-1035-4ff4-911d-7ca98ce14401-samples-operator-tls") pod "cluster-samples-operator-65db858894-fkbdh" (UID: "e8dade3b-1035-4ff4-911d-7ca98ce14401") : secret "samples-operator-tls" not found
Jul 15 14:34:12.644083 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.644002    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:12.669559 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.669530    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6d24461e-70ad-4e8d-8647-5277bed5a202-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-npl5n\" (UID: \"6d24461e-70ad-4e8d-8647-5277bed5a202\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-npl5n"
Jul 15 14:34:12.669717 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:12.669647    2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 15 14:34:12.669717 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:12.669714    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d24461e-70ad-4e8d-8647-5277bed5a202-networking-console-plugin-cert podName:6d24461e-70ad-4e8d-8647-5277bed5a202 nodeName:}" failed. No retries permitted until 2026-07-15 14:34:13.669694142 +0000 UTC m=+37.185511994 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6d24461e-70ad-4e8d-8647-5277bed5a202-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-npl5n" (UID: "6d24461e-70ad-4e8d-8647-5277bed5a202") : secret "networking-console-plugin-cert" not found
Jul 15 14:34:12.724104 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.724071    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:12.824342 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.824307    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:12.962662 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.962587    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-45c2z" event={"ID":"48d450ff-8575-4187-b279-ed927e9fb854","Type":"ContainerStarted","Data":"75446c5a91e65e681720ea32bbfebe8538685a097c6ac1a698a4c56ffe746208"}
Jul 15 14:34:12.963964 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.963937    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-t56m5" event={"ID":"5943ec96-deb6-4e14-9d96-d5f71e12d6d5","Type":"ContainerStarted","Data":"020ac058b8b4252e59fd1ea61b97b0757acd64cdfc36a5658edbe1d35522ad08"}
Jul 15 14:34:12.965222 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.965175    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-69tjk" event={"ID":"7ea4c3c6-6010-4578-bd63-02311a41af04","Type":"ContainerStarted","Data":"cce1f75cd5c036c401e65175d41868d07ba5f75be92002e04bdf2fcd96cdab06"}
Jul 15 14:34:12.967554 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.967492    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-42mdh" event={"ID":"0de0f3ad-e228-4c27-9b2c-de1a5844dcdb","Type":"ContainerStarted","Data":"151a98d658e3b0d7279db16e4f7974fcb37ce47c74c12ea6c67e0a56e19783ac"}
Jul 15 14:34:12.969469 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.969141    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-cz5pq" event={"ID":"b50812cf-7948-4c73-b6da-728813c52302","Type":"ContainerStarted","Data":"908554bc5d04b95e8b1b93aaaa93e7c68fa1215d011be643dce827a2dd29f37e"}
Jul 15 14:34:12.970827 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.970779    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-4rjgr" event={"ID":"f7d825f1-c2e0-40b2-92f4-04699e417a8a","Type":"ContainerStarted","Data":"52ad9b7f2e8928b12408c4ac511e0397ebde460ae227729297f1d6df32b14374"}
Jul 15 14:34:12.972837 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:12.972796    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-dd6cg" event={"ID":"95abed3c-7259-4ef3-990b-eb51bd185c59","Type":"ContainerStarted","Data":"954f217d0cc3da8217fd7432ccfd842c3c8c8434c7c96cb21909880ba687fc36"}
Jul 15 14:34:13.308326 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:13.308226    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:13.578659 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:13.577835    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c632d732-9454-4773-bfae-ae68b1f0ac4d-registry-tls\") pod \"image-registry-7cccfb4ff6-mkrws\" (UID: \"c632d732-9454-4773-bfae-ae68b1f0ac4d\") " pod="openshift-image-registry/image-registry-7cccfb4ff6-mkrws"
Jul 15 14:34:13.578659 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:13.577892    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/247f8c50-953c-457c-b2f5-02830e0c499d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-fkhv2\" (UID: \"247f8c50-953c-457c-b2f5-02830e0c499d\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fkhv2"
Jul 15 14:34:13.578659 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:13.577948    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b0ac431-4ca5-45b0-9779-26461b04b319-service-ca-bundle\") pod \"router-default-6b5f9c7788-p9ls6\" (UID: \"4b0ac431-4ca5-45b0-9779-26461b04b319\") " pod="openshift-ingress/router-default-6b5f9c7788-p9ls6"
Jul 15 14:34:13.578659 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:13.577979    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd114550-c5d0-471c-83fb-b5203fcea02c-metrics-tls\") pod \"dns-default-zmmq4\" (UID: \"cd114550-c5d0-471c-83fb-b5203fcea02c\") " pod="openshift-dns/dns-default-zmmq4"
Jul 15 14:34:13.578659 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:13.578018    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e8dade3b-1035-4ff4-911d-7ca98ce14401-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-fkbdh\" (UID: \"e8dade3b-1035-4ff4-911d-7ca98ce14401\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-fkbdh"
Jul 15 14:34:13.578659 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:13.578074    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b0ac431-4ca5-45b0-9779-26461b04b319-metrics-certs\") pod \"router-default-6b5f9c7788-p9ls6\" (UID: \"4b0ac431-4ca5-45b0-9779-26461b04b319\") " pod="openshift-ingress/router-default-6b5f9c7788-p9ls6"
Jul 15 14:34:13.578659 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:13.578236    2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 14:34:13.578659 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:13.578312    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b0ac431-4ca5-45b0-9779-26461b04b319-metrics-certs podName:4b0ac431-4ca5-45b0-9779-26461b04b319 nodeName:}" failed. No retries permitted until 2026-07-15 14:34:15.578294039 +0000 UTC m=+39.094111933 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4b0ac431-4ca5-45b0-9779-26461b04b319-metrics-certs") pod "router-default-6b5f9c7788-p9ls6" (UID: "4b0ac431-4ca5-45b0-9779-26461b04b319") : secret "router-metrics-certs-default" not found
Jul 15 14:34:13.579215 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:13.578682    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4b0ac431-4ca5-45b0-9779-26461b04b319-service-ca-bundle podName:4b0ac431-4ca5-45b0-9779-26461b04b319 nodeName:}" failed. No retries permitted until 2026-07-15 14:34:15.578665935 +0000 UTC m=+39.094483804 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4b0ac431-4ca5-45b0-9779-26461b04b319-service-ca-bundle") pod "router-default-6b5f9c7788-p9ls6" (UID: "4b0ac431-4ca5-45b0-9779-26461b04b319") : configmap references non-existent config key: service-ca.crt
Jul 15 14:34:13.579215 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:13.578688    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 14:34:13.579215 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:13.578722    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd114550-c5d0-471c-83fb-b5203fcea02c-metrics-tls podName:cd114550-c5d0-471c-83fb-b5203fcea02c nodeName:}" failed. No retries permitted until 2026-07-15 14:34:15.578712579 +0000 UTC m=+39.094530432 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cd114550-c5d0-471c-83fb-b5203fcea02c-metrics-tls") pod "dns-default-zmmq4" (UID: "cd114550-c5d0-471c-83fb-b5203fcea02c") : secret "dns-default-metrics-tls" not found
Jul 15 14:34:13.579215 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:13.578734    2571 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 15 14:34:13.579215 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:13.578765    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8dade3b-1035-4ff4-911d-7ca98ce14401-samples-operator-tls podName:e8dade3b-1035-4ff4-911d-7ca98ce14401 nodeName:}" failed. No retries permitted until 2026-07-15 14:34:15.578755964 +0000 UTC m=+39.094573820 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e8dade3b-1035-4ff4-911d-7ca98ce14401-samples-operator-tls") pod "cluster-samples-operator-65db858894-fkbdh" (UID: "e8dade3b-1035-4ff4-911d-7ca98ce14401") : secret "samples-operator-tls" not found
Jul 15 14:34:13.579215 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:13.578783    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 14:34:13.579215 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:13.578794    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cccfb4ff6-mkrws: secret "image-registry-tls" not found
Jul 15 14:34:13.579215 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:13.578816    2571 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 14:34:13.579215 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:13.578822    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c632d732-9454-4773-bfae-ae68b1f0ac4d-registry-tls podName:c632d732-9454-4773-bfae-ae68b1f0ac4d nodeName:}" failed. No retries permitted until 2026-07-15 14:34:15.578812338 +0000 UTC m=+39.094630192 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c632d732-9454-4773-bfae-ae68b1f0ac4d-registry-tls") pod "image-registry-7cccfb4ff6-mkrws" (UID: "c632d732-9454-4773-bfae-ae68b1f0ac4d") : secret "image-registry-tls" not found
Jul 15 14:34:13.579215 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:13.578846    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/247f8c50-953c-457c-b2f5-02830e0c499d-cluster-monitoring-operator-tls podName:247f8c50-953c-457c-b2f5-02830e0c499d nodeName:}" failed. No retries permitted until 2026-07-15 14:34:15.578836815 +0000 UTC m=+39.094654668 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/247f8c50-953c-457c-b2f5-02830e0c499d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-fkhv2" (UID: "247f8c50-953c-457c-b2f5-02830e0c499d") : secret "cluster-monitoring-operator-tls" not found
Jul 15 14:34:13.679377 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:13.679332    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6d24461e-70ad-4e8d-8647-5277bed5a202-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-npl5n\" (UID: \"6d24461e-70ad-4e8d-8647-5277bed5a202\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-npl5n"
Jul 15 14:34:13.679527 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:13.679474    2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 15 14:34:13.679565 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:13.679536    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d24461e-70ad-4e8d-8647-5277bed5a202-networking-console-plugin-cert podName:6d24461e-70ad-4e8d-8647-5277bed5a202 nodeName:}" failed. No retries permitted until 2026-07-15 14:34:15.679517832 +0000 UTC m=+39.195335686 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6d24461e-70ad-4e8d-8647-5277bed5a202-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-npl5n" (UID: "6d24461e-70ad-4e8d-8647-5277bed5a202") : secret "networking-console-plugin-cert" not found
Jul 15 14:34:13.747966 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:13.747932    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-878zd"
Jul 15 14:34:13.748139 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:13.747938    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g49wp"
Jul 15 14:34:13.748139 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:13.748105    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7b98l"
Jul 15 14:34:13.753558 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:13.753536    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 14:34:13.754730 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:13.754706    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 14:34:13.754828 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:13.754812    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tz86z\""
Jul 15 14:34:13.755028 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:13.755010    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-m26tp\""
Jul 15 14:34:14.565546 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:14.565472    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:14.640570 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:14.640523    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:15.599038 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:15.598997    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c632d732-9454-4773-bfae-ae68b1f0ac4d-registry-tls\") pod \"image-registry-7cccfb4ff6-mkrws\" (UID: \"c632d732-9454-4773-bfae-ae68b1f0ac4d\") " pod="openshift-image-registry/image-registry-7cccfb4ff6-mkrws"
Jul 15 14:34:15.599507 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:15.599060    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/247f8c50-953c-457c-b2f5-02830e0c499d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-fkhv2\" (UID: \"247f8c50-953c-457c-b2f5-02830e0c499d\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fkhv2"
Jul 15 14:34:15.599507 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:15.599120    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b0ac431-4ca5-45b0-9779-26461b04b319-service-ca-bundle\") pod \"router-default-6b5f9c7788-p9ls6\" (UID: \"4b0ac431-4ca5-45b0-9779-26461b04b319\") " pod="openshift-ingress/router-default-6b5f9c7788-p9ls6"
Jul 15 14:34:15.599507 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:15.599152    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd114550-c5d0-471c-83fb-b5203fcea02c-metrics-tls\") pod \"dns-default-zmmq4\" (UID: \"cd114550-c5d0-471c-83fb-b5203fcea02c\") " pod="openshift-dns/dns-default-zmmq4"
Jul 15 14:34:15.599507 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:15.599191    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e8dade3b-1035-4ff4-911d-7ca98ce14401-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-fkbdh\" (UID: \"e8dade3b-1035-4ff4-911d-7ca98ce14401\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-fkbdh"
Jul 15 14:34:15.599507 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:15.599246    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b0ac431-4ca5-45b0-9779-26461b04b319-metrics-certs\") pod \"router-default-6b5f9c7788-p9ls6\" (UID: \"4b0ac431-4ca5-45b0-9779-26461b04b319\") " pod="openshift-ingress/router-default-6b5f9c7788-p9ls6"
Jul 15 14:34:15.599507 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:15.599414    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4b0ac431-4ca5-45b0-9779-26461b04b319-service-ca-bundle podName:4b0ac431-4ca5-45b0-9779-26461b04b319 nodeName:}" failed. No retries permitted until 2026-07-15 14:34:19.599393154 +0000 UTC m=+43.115211007 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4b0ac431-4ca5-45b0-9779-26461b04b319-service-ca-bundle") pod "router-default-6b5f9c7788-p9ls6" (UID: "4b0ac431-4ca5-45b0-9779-26461b04b319") : configmap references non-existent config key: service-ca.crt
Jul 15 14:34:15.599886 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:15.599867    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 14:34:15.599941 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:15.599888    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cccfb4ff6-mkrws: secret "image-registry-tls" not found
Jul 15 14:34:15.599941 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:15.599935    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c632d732-9454-4773-bfae-ae68b1f0ac4d-registry-tls podName:c632d732-9454-4773-bfae-ae68b1f0ac4d nodeName:}" failed. No retries permitted until 2026-07-15 14:34:19.59991843 +0000 UTC m=+43.115736295 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c632d732-9454-4773-bfae-ae68b1f0ac4d-registry-tls") pod "image-registry-7cccfb4ff6-mkrws" (UID: "c632d732-9454-4773-bfae-ae68b1f0ac4d") : secret "image-registry-tls" not found
Jul 15 14:34:15.600096 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:15.599998    2571 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 14:34:15.600096 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:15.600034    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/247f8c50-953c-457c-b2f5-02830e0c499d-cluster-monitoring-operator-tls podName:247f8c50-953c-457c-b2f5-02830e0c499d nodeName:}" failed. No retries permitted until 2026-07-15 14:34:19.600023583 +0000 UTC m=+43.115841434 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/247f8c50-953c-457c-b2f5-02830e0c499d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-fkhv2" (UID: "247f8c50-953c-457c-b2f5-02830e0c499d") : secret "cluster-monitoring-operator-tls" not found
Jul 15 14:34:15.600096 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:15.600092    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 14:34:15.600240 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:15.600121    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd114550-c5d0-471c-83fb-b5203fcea02c-metrics-tls podName:cd114550-c5d0-471c-83fb-b5203fcea02c nodeName:}" failed. No retries permitted until 2026-07-15 14:34:19.600110473 +0000 UTC m=+43.115928324 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cd114550-c5d0-471c-83fb-b5203fcea02c-metrics-tls") pod "dns-default-zmmq4" (UID: "cd114550-c5d0-471c-83fb-b5203fcea02c") : secret "dns-default-metrics-tls" not found
Jul 15 14:34:15.600240 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:15.600175    2571 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 15 14:34:15.600240 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:15.600204    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8dade3b-1035-4ff4-911d-7ca98ce14401-samples-operator-tls podName:e8dade3b-1035-4ff4-911d-7ca98ce14401 nodeName:}" failed. No retries permitted until 2026-07-15 14:34:19.6001947 +0000 UTC m=+43.116012555 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e8dade3b-1035-4ff4-911d-7ca98ce14401-samples-operator-tls") pod "cluster-samples-operator-65db858894-fkbdh" (UID: "e8dade3b-1035-4ff4-911d-7ca98ce14401") : secret "samples-operator-tls" not found
Jul 15 14:34:15.600407 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:15.600369    2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 14:34:15.600452 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:15.600413    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b0ac431-4ca5-45b0-9779-26461b04b319-metrics-certs podName:4b0ac431-4ca5-45b0-9779-26461b04b319 nodeName:}" failed. No retries permitted until 2026-07-15 14:34:19.60039952 +0000 UTC m=+43.116217371 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4b0ac431-4ca5-45b0-9779-26461b04b319-metrics-certs") pod "router-default-6b5f9c7788-p9ls6" (UID: "4b0ac431-4ca5-45b0-9779-26461b04b319") : secret "router-metrics-certs-default" not found
Jul 15 14:34:15.702416 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:15.701672    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6d24461e-70ad-4e8d-8647-5277bed5a202-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-npl5n\" (UID: \"6d24461e-70ad-4e8d-8647-5277bed5a202\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-npl5n"
Jul 15 14:34:15.702416 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:15.701941    2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 15 14:34:15.702416 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:15.702005    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d24461e-70ad-4e8d-8647-5277bed5a202-networking-console-plugin-cert podName:6d24461e-70ad-4e8d-8647-5277bed5a202 nodeName:}" failed. No retries permitted until 2026-07-15 14:34:19.701986932 +0000 UTC m=+43.217804788 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6d24461e-70ad-4e8d-8647-5277bed5a202-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-npl5n" (UID: "6d24461e-70ad-4e8d-8647-5277bed5a202") : secret "networking-console-plugin-cert" not found
Jul 15 14:34:15.940514 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:15.940432    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:16.040178 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:16.040141    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:17.729816 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:17.729786    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:18.432742 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:18.432706    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:18.499941 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:18.499906    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:19.131832 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:19.131796    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:19.235717 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:19.235680    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:19.638093 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:19.638057    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b0ac431-4ca5-45b0-9779-26461b04b319-metrics-certs\") pod \"router-default-6b5f9c7788-p9ls6\" (UID: \"4b0ac431-4ca5-45b0-9779-26461b04b319\") " pod="openshift-ingress/router-default-6b5f9c7788-p9ls6"
Jul 15 14:34:19.638252 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:19.638142    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c632d732-9454-4773-bfae-ae68b1f0ac4d-registry-tls\") pod \"image-registry-7cccfb4ff6-mkrws\" (UID: \"c632d732-9454-4773-bfae-ae68b1f0ac4d\") " pod="openshift-image-registry/image-registry-7cccfb4ff6-mkrws"
Jul 15 14:34:19.638252 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:19.638175    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/247f8c50-953c-457c-b2f5-02830e0c499d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-fkhv2\" (UID: \"247f8c50-953c-457c-b2f5-02830e0c499d\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fkhv2"
Jul 15 14:34:19.638252 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:19.638205    2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 14:34:19.638252 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:19.638226    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b0ac431-4ca5-45b0-9779-26461b04b319-service-ca-bundle\") pod \"router-default-6b5f9c7788-p9ls6\" (UID: \"4b0ac431-4ca5-45b0-9779-26461b04b319\") " pod="openshift-ingress/router-default-6b5f9c7788-p9ls6"
Jul 15 14:34:19.638469 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:19.638306    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b0ac431-4ca5-45b0-9779-26461b04b319-metrics-certs podName:4b0ac431-4ca5-45b0-9779-26461b04b319 nodeName:}" failed. No retries permitted until 2026-07-15 14:34:27.638284741 +0000 UTC m=+51.154102613 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4b0ac431-4ca5-45b0-9779-26461b04b319-metrics-certs") pod "router-default-6b5f9c7788-p9ls6" (UID: "4b0ac431-4ca5-45b0-9779-26461b04b319") : secret "router-metrics-certs-default" not found
Jul 15 14:34:19.638469 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:19.638322    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 14:34:19.638469 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:19.638342    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cccfb4ff6-mkrws: secret "image-registry-tls" not found
Jul 15 14:34:19.638469 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:19.638358    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4b0ac431-4ca5-45b0-9779-26461b04b319-service-ca-bundle podName:4b0ac431-4ca5-45b0-9779-26461b04b319 nodeName:}" failed. No retries permitted until 2026-07-15 14:34:27.638342966 +0000 UTC m=+51.154160832 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4b0ac431-4ca5-45b0-9779-26461b04b319-service-ca-bundle") pod "router-default-6b5f9c7788-p9ls6" (UID: "4b0ac431-4ca5-45b0-9779-26461b04b319") : configmap references non-existent config key: service-ca.crt
Jul 15 14:34:19.638469 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:19.638373    2571 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 14:34:19.638469 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:19.638397    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c632d732-9454-4773-bfae-ae68b1f0ac4d-registry-tls podName:c632d732-9454-4773-bfae-ae68b1f0ac4d nodeName:}" failed. No retries permitted until 2026-07-15 14:34:27.638382862 +0000 UTC m=+51.154200730 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c632d732-9454-4773-bfae-ae68b1f0ac4d-registry-tls") pod "image-registry-7cccfb4ff6-mkrws" (UID: "c632d732-9454-4773-bfae-ae68b1f0ac4d") : secret "image-registry-tls" not found
Jul 15 14:34:19.638469 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:19.638417    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd114550-c5d0-471c-83fb-b5203fcea02c-metrics-tls\") pod \"dns-default-zmmq4\" (UID: \"cd114550-c5d0-471c-83fb-b5203fcea02c\") " pod="openshift-dns/dns-default-zmmq4"
Jul 15 14:34:19.638469 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:19.638429    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/247f8c50-953c-457c-b2f5-02830e0c499d-cluster-monitoring-operator-tls podName:247f8c50-953c-457c-b2f5-02830e0c499d nodeName:}" failed. No retries permitted until 2026-07-15 14:34:27.638415184 +0000 UTC m=+51.154233038 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/247f8c50-953c-457c-b2f5-02830e0c499d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-fkhv2" (UID: "247f8c50-953c-457c-b2f5-02830e0c499d") : secret "cluster-monitoring-operator-tls" not found
Jul 15 14:34:19.638469 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:19.638471    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 14:34:19.638921 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:19.638484    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e8dade3b-1035-4ff4-911d-7ca98ce14401-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-fkbdh\" (UID: \"e8dade3b-1035-4ff4-911d-7ca98ce14401\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-fkbdh"
Jul 15 14:34:19.638921 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:19.638498    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd114550-c5d0-471c-83fb-b5203fcea02c-metrics-tls podName:cd114550-c5d0-471c-83fb-b5203fcea02c nodeName:}" failed. No retries permitted until 2026-07-15 14:34:27.638491221 +0000 UTC m=+51.154309070 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cd114550-c5d0-471c-83fb-b5203fcea02c-metrics-tls") pod "dns-default-zmmq4" (UID: "cd114550-c5d0-471c-83fb-b5203fcea02c") : secret "dns-default-metrics-tls" not found
Jul 15 14:34:19.638921 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:19.638539    2571 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 15 14:34:19.638921 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:19.638584    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8dade3b-1035-4ff4-911d-7ca98ce14401-samples-operator-tls podName:e8dade3b-1035-4ff4-911d-7ca98ce14401 nodeName:}" failed. No retries permitted until 2026-07-15 14:34:27.638573522 +0000 UTC m=+51.154391374 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e8dade3b-1035-4ff4-911d-7ca98ce14401-samples-operator-tls") pod "cluster-samples-operator-65db858894-fkbdh" (UID: "e8dade3b-1035-4ff4-911d-7ca98ce14401") : secret "samples-operator-tls" not found
Jul 15 14:34:19.739359 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:19.739321    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6d24461e-70ad-4e8d-8647-5277bed5a202-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-npl5n\" (UID: \"6d24461e-70ad-4e8d-8647-5277bed5a202\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-npl5n"
Jul 15 14:34:19.739540 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:19.739488    2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 15 14:34:19.739598 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:19.739559    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d24461e-70ad-4e8d-8647-5277bed5a202-networking-console-plugin-cert podName:6d24461e-70ad-4e8d-8647-5277bed5a202 nodeName:}" failed. No retries permitted until 2026-07-15 14:34:27.739544821 +0000 UTC m=+51.255362670 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6d24461e-70ad-4e8d-8647-5277bed5a202-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-npl5n" (UID: "6d24461e-70ad-4e8d-8647-5277bed5a202") : secret "networking-console-plugin-cert" not found
Jul 15 14:34:21.002251 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:21.001989    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-t56m5" event={"ID":"5943ec96-deb6-4e14-9d96-d5f71e12d6d5","Type":"ContainerStarted","Data":"489c211fc013b2c30dfa579d2346652bb4af9e24262ce90bd045ff6cf7a43fe5"}
Jul 15 14:34:21.004346 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:21.003964    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-69tjk" event={"ID":"7ea4c3c6-6010-4578-bd63-02311a41af04","Type":"ContainerStarted","Data":"2545c1a504c0595115beb493c1ab87d0f05efdde35cbd0cd29c82a49370a67dd"}
Jul 15 14:34:21.006355 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:21.006333    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-42mdh_0de0f3ad-e228-4c27-9b2c-de1a5844dcdb/console-operator/0.log"
Jul 15 14:34:21.006464 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:21.006369    2571 generic.go:356] "Generic (PLEG): container finished" podID="0de0f3ad-e228-4c27-9b2c-de1a5844dcdb" containerID="00457bb42c9fa67323982c40b59113441fd69d8877bef35b71051ad459ab50b9" exitCode=255
Jul 15 14:34:21.006652 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:21.006603    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-42mdh" event={"ID":"0de0f3ad-e228-4c27-9b2c-de1a5844dcdb","Type":"ContainerDied","Data":"00457bb42c9fa67323982c40b59113441fd69d8877bef35b71051ad459ab50b9"}
Jul 15 14:34:21.006725 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:21.006680    2571 scope.go:117] "RemoveContainer" containerID="00457bb42c9fa67323982c40b59113441fd69d8877bef35b71051ad459ab50b9"
Jul 15 14:34:21.010420 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:21.010398    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-cz5pq" event={"ID":"b50812cf-7948-4c73-b6da-728813c52302","Type":"ContainerStarted","Data":"b4f3a82def9a8aea535c4acfac37c66d8155253d77f891027e7edd6436ce34c7"}
Jul 15 14:34:21.012324 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:21.012306    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-4rjgr" event={"ID":"f7d825f1-c2e0-40b2-92f4-04699e417a8a","Type":"ContainerStarted","Data":"c4a842b5b5e8ca78a3b15a9909f8c7e7375402f4633138e240dc60c7d3e8824c"}
Jul 15 14:34:21.014021 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:21.013998    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-dd6cg" event={"ID":"95abed3c-7259-4ef3-990b-eb51bd185c59","Type":"ContainerStarted","Data":"cb5a94bb4f3d2b2801d4377b591a807e30588a9f9e2f594b2576a55fa9f9bdba"}
Jul 15 14:34:21.016487 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:21.016465    2571 generic.go:356] "Generic (PLEG): container finished" podID="9f578de8-ae1f-4aa2-a034-0e029991f7e0" containerID="bc25bbd4c08440e2cd18119ec3e3c91525aa5533e7a3eb008e031253db4d57ac" exitCode=0
Jul 15 14:34:21.016586 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:21.016545    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cs6zp" event={"ID":"9f578de8-ae1f-4aa2-a034-0e029991f7e0","Type":"ContainerDied","Data":"bc25bbd4c08440e2cd18119ec3e3c91525aa5533e7a3eb008e031253db4d57ac"}
Jul 15 14:34:21.018834 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:21.018813    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-45c2z" event={"ID":"48d450ff-8575-4187-b279-ed927e9fb854","Type":"ContainerStarted","Data":"6ce4a4ab39ab75be2a87d62ec048c54795acee920303d8fc18bf5f361aedf97e"}
Jul 15 14:34:21.040292 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:21.036980    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-t56m5" podStartSLOduration=1.99941965 podStartE2EDuration="10.036942185s" totalImagesPullingTime="8.037522535s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:34:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:34:21.026607226 +0000 UTC m=+44.542425097" watchObservedRunningTime="2026-07-15 14:34:21.036942185 +0000 UTC m=+44.552760059"
Jul 15 14:34:21.093426 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:21.092285    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-45c2z" podStartSLOduration=29.016142934 podStartE2EDuration="37.092250308s" totalImagesPullingTime="8.076107374s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:33:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:34:21.058559323 +0000 UTC m=+44.574377196" watchObservedRunningTime="2026-07-15 14:34:21.092250308 +0000 UTC m=+44.608068182"
Jul 15 14:34:21.115556 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:21.115036    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-69tjk" podStartSLOduration=29.036218223 podStartE2EDuration="37.115016284s" totalImagesPullingTime="8.078798061s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:33:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:34:21.113988988 +0000 UTC m=+44.629806861" watchObservedRunningTime="2026-07-15 14:34:21.115016284 +0000 UTC m=+44.630834157"
Jul 15 14:34:21.136307 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:21.136231    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-dd6cg" podStartSLOduration=29.061529912 podStartE2EDuration="37.136209099s" totalImagesPullingTime="8.074679187s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:33:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:34:21.133907642 +0000 UTC m=+44.649725526" watchObservedRunningTime="2026-07-15 14:34:21.136209099 +0000 UTC m=+44.652026971"
Jul 15 14:34:21.224648 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:21.224182    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-4rjgr" podStartSLOduration=29.147090071 podStartE2EDuration="37.224162539s" totalImagesPullingTime="8.077072468s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:33:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:34:21.223607348 +0000 UTC m=+44.739425220" watchObservedRunningTime="2026-07-15 14:34:21.224162539 +0000 UTC m=+44.739980410"
Jul 15 14:34:21.224930 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:21.224897    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-cz5pq" podStartSLOduration=29.14087736 podStartE2EDuration="37.224886456s" totalImagesPullingTime="8.084009096s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:33:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:34:21.19460359 +0000 UTC m=+44.710421462" watchObservedRunningTime="2026-07-15 14:34:21.224886456 +0000 UTC m=+44.740704334"
Jul 15 14:34:21.323179 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:21.323150    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:21.779489 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:21.779458    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-rbdmg"]
Jul 15 14:34:21.800796 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:21.800767    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rbdmg"
Jul 15 14:34:21.803006 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:21.802930    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rbdmg"]
Jul 15 14:34:21.805176 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:21.804772    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 15 14:34:21.805176 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:21.805149    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 15 14:34:21.806351 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:21.805866    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-5q8j8\""
Jul 15 14:34:21.811003 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:21.810980    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:21.861014 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:21.860987    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ebcd9b8b-583f-482c-8fc2-534201772275-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rbdmg\" (UID: \"ebcd9b8b-583f-482c-8fc2-534201772275\") " pod="openshift-insights/insights-runtime-extractor-rbdmg"
Jul 15 14:34:21.861162 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:21.861043    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ebcd9b8b-583f-482c-8fc2-534201772275-crio-socket\") pod \"insights-runtime-extractor-rbdmg\" (UID: \"ebcd9b8b-583f-482c-8fc2-534201772275\") " pod="openshift-insights/insights-runtime-extractor-rbdmg"
Jul 15 14:34:21.861162 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:21.861099    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ebcd9b8b-583f-482c-8fc2-534201772275-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rbdmg\" (UID: \"ebcd9b8b-583f-482c-8fc2-534201772275\") " pod="openshift-insights/insights-runtime-extractor-rbdmg"
Jul 15 14:34:21.861162 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:21.861158    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2sg8\" (UniqueName: \"kubernetes.io/projected/ebcd9b8b-583f-482c-8fc2-534201772275-kube-api-access-z2sg8\") pod \"insights-runtime-extractor-rbdmg\" (UID: \"ebcd9b8b-583f-482c-8fc2-534201772275\") " pod="openshift-insights/insights-runtime-extractor-rbdmg"
Jul 15 14:34:21.861309 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:21.861241    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ebcd9b8b-583f-482c-8fc2-534201772275-data-volume\") pod \"insights-runtime-extractor-rbdmg\" (UID: \"ebcd9b8b-583f-482c-8fc2-534201772275\") " pod="openshift-insights/insights-runtime-extractor-rbdmg"
Jul 15 14:34:21.882951 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:21.882894    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:21.962356 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:21.962317    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2sg8\" (UniqueName: \"kubernetes.io/projected/ebcd9b8b-583f-482c-8fc2-534201772275-kube-api-access-z2sg8\") pod \"insights-runtime-extractor-rbdmg\" (UID: \"ebcd9b8b-583f-482c-8fc2-534201772275\") " pod="openshift-insights/insights-runtime-extractor-rbdmg"
Jul 15 14:34:21.962513 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:21.962423    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ebcd9b8b-583f-482c-8fc2-534201772275-data-volume\") pod \"insights-runtime-extractor-rbdmg\" (UID: \"ebcd9b8b-583f-482c-8fc2-534201772275\") " pod="openshift-insights/insights-runtime-extractor-rbdmg"
Jul 15 14:34:21.962513 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:21.962490    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ebcd9b8b-583f-482c-8fc2-534201772275-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rbdmg\" (UID: \"ebcd9b8b-583f-482c-8fc2-534201772275\") " pod="openshift-insights/insights-runtime-extractor-rbdmg"
Jul 15 14:34:21.962631 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:21.962553    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ebcd9b8b-583f-482c-8fc2-534201772275-crio-socket\") pod \"insights-runtime-extractor-rbdmg\" (UID: \"ebcd9b8b-583f-482c-8fc2-534201772275\") " pod="openshift-insights/insights-runtime-extractor-rbdmg"
Jul 15 14:34:21.962631 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:21.962598    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ebcd9b8b-583f-482c-8fc2-534201772275-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rbdmg\" (UID: \"ebcd9b8b-583f-482c-8fc2-534201772275\") " pod="openshift-insights/insights-runtime-extractor-rbdmg"
Jul 15 14:34:21.962731 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:21.962722    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 14:34:21.962790 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:21.962780    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebcd9b8b-583f-482c-8fc2-534201772275-insights-runtime-extractor-tls podName:ebcd9b8b-583f-482c-8fc2-534201772275 nodeName:}" failed. No retries permitted until 2026-07-15 14:34:22.462761921 +0000 UTC m=+45.978579777 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ebcd9b8b-583f-482c-8fc2-534201772275-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rbdmg" (UID: "ebcd9b8b-583f-482c-8fc2-534201772275") : secret "insights-runtime-extractor-tls" not found
Jul 15 14:34:21.963045 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:21.963006    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 14:34:21.963175 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:21.963070    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ebcd9b8b-583f-482c-8fc2-534201772275-kube-rbac-proxy-cm podName:ebcd9b8b-583f-482c-8fc2-534201772275 nodeName:}" failed. No retries permitted until 2026-07-15 14:34:22.463052227 +0000 UTC m=+45.978870118 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ebcd9b8b-583f-482c-8fc2-534201772275-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rbdmg" (UID: "ebcd9b8b-583f-482c-8fc2-534201772275") : configmap "kube-rbac-proxy" not found
Jul 15 14:34:21.963175 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:21.963131    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/ebcd9b8b-583f-482c-8fc2-534201772275-crio-socket\") pod \"insights-runtime-extractor-rbdmg\" (UID: \"ebcd9b8b-583f-482c-8fc2-534201772275\") " pod="openshift-insights/insights-runtime-extractor-rbdmg"
Jul 15 14:34:21.963338 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:21.963321    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/ebcd9b8b-583f-482c-8fc2-534201772275-data-volume\") pod \"insights-runtime-extractor-rbdmg\" (UID: \"ebcd9b8b-583f-482c-8fc2-534201772275\") " pod="openshift-insights/insights-runtime-extractor-rbdmg"
Jul 15 14:34:21.980580 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:21.980558    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2sg8\" (UniqueName: \"kubernetes.io/projected/ebcd9b8b-583f-482c-8fc2-534201772275-kube-api-access-z2sg8\") pod \"insights-runtime-extractor-rbdmg\" (UID: \"ebcd9b8b-583f-482c-8fc2-534201772275\") " pod="openshift-insights/insights-runtime-extractor-rbdmg"
Jul 15 14:34:22.024818 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:22.024786    2571 generic.go:356] "Generic (PLEG): container finished" podID="9f578de8-ae1f-4aa2-a034-0e029991f7e0" containerID="aacb9f281faa0433c04849b0bc25ec75c991cd5aaa976f317aaa157e45d47000" exitCode=0
Jul 15 14:34:22.025220 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:22.024864    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cs6zp" event={"ID":"9f578de8-ae1f-4aa2-a034-0e029991f7e0","Type":"ContainerDied","Data":"aacb9f281faa0433c04849b0bc25ec75c991cd5aaa976f317aaa157e45d47000"}
Jul 15 14:34:22.026426 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:22.026404    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-42mdh_0de0f3ad-e228-4c27-9b2c-de1a5844dcdb/console-operator/1.log"
Jul 15 14:34:22.027114 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:22.026884    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-42mdh_0de0f3ad-e228-4c27-9b2c-de1a5844dcdb/console-operator/0.log"
Jul 15 14:34:22.027114 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:22.026919    2571 generic.go:356] "Generic (PLEG): container finished" podID="0de0f3ad-e228-4c27-9b2c-de1a5844dcdb" containerID="195c004666f6a02d0b880cd7d8f16b3855a7bd0ff31fdce1c620421a53e47f4a" exitCode=255
Jul 15 14:34:22.027114 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:22.027015    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-42mdh" event={"ID":"0de0f3ad-e228-4c27-9b2c-de1a5844dcdb","Type":"ContainerDied","Data":"195c004666f6a02d0b880cd7d8f16b3855a7bd0ff31fdce1c620421a53e47f4a"}
Jul 15 14:34:22.027114 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:22.027060    2571 scope.go:117] "RemoveContainer" containerID="00457bb42c9fa67323982c40b59113441fd69d8877bef35b71051ad459ab50b9"
Jul 15 14:34:22.027305 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:22.027226    2571 scope.go:117] "RemoveContainer" containerID="195c004666f6a02d0b880cd7d8f16b3855a7bd0ff31fdce1c620421a53e47f4a"
Jul 15 14:34:22.027428 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:22.027406    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-42mdh_openshift-console-operator(0de0f3ad-e228-4c27-9b2c-de1a5844dcdb)\"" pod="openshift-console-operator/console-operator-7866497494-42mdh" podUID="0de0f3ad-e228-4c27-9b2c-de1a5844dcdb"
Jul 15 14:34:22.061348 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:22.061169    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:22.128604 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:22.128576    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:22.200546 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:22.200521    2571 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-42mdh"
Jul 15 14:34:22.200652 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:22.200603    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-42mdh"
Jul 15 14:34:22.467689 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:22.467604    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ebcd9b8b-583f-482c-8fc2-534201772275-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rbdmg\" (UID: \"ebcd9b8b-583f-482c-8fc2-534201772275\") " pod="openshift-insights/insights-runtime-extractor-rbdmg"
Jul 15 14:34:22.467835 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:22.467766    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 14:34:22.467835 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:22.467782    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ebcd9b8b-583f-482c-8fc2-534201772275-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rbdmg\" (UID: \"ebcd9b8b-583f-482c-8fc2-534201772275\") " pod="openshift-insights/insights-runtime-extractor-rbdmg"
Jul 15 14:34:22.467835 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:22.467833    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebcd9b8b-583f-482c-8fc2-534201772275-insights-runtime-extractor-tls podName:ebcd9b8b-583f-482c-8fc2-534201772275 nodeName:}" failed. No retries permitted until 2026-07-15 14:34:23.467813106 +0000 UTC m=+46.983630975 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ebcd9b8b-583f-482c-8fc2-534201772275-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rbdmg" (UID: "ebcd9b8b-583f-482c-8fc2-534201772275") : secret "insights-runtime-extractor-tls" not found
Jul 15 14:34:22.467943 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:22.467846    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 14:34:22.467943 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:22.467879    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ebcd9b8b-583f-482c-8fc2-534201772275-kube-rbac-proxy-cm podName:ebcd9b8b-583f-482c-8fc2-534201772275 nodeName:}" failed. No retries permitted until 2026-07-15 14:34:23.467868922 +0000 UTC m=+46.983686771 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ebcd9b8b-583f-482c-8fc2-534201772275-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rbdmg" (UID: "ebcd9b8b-583f-482c-8fc2-534201772275") : configmap "kube-rbac-proxy" not found
Jul 15 14:34:22.866498 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:22.866466    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:22.965415 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:22.965387    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:23.034642 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:23.034612    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-cs6zp" event={"ID":"9f578de8-ae1f-4aa2-a034-0e029991f7e0","Type":"ContainerStarted","Data":"9f45cd8fc23f8802ab728c982c1f4fdc03605679190f936ad6910244fb91236b"}
Jul 15 14:34:23.036029 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:23.036012    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-42mdh_0de0f3ad-e228-4c27-9b2c-de1a5844dcdb/console-operator/1.log"
Jul 15 14:34:23.036303 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:23.036291    2571 scope.go:117] "RemoveContainer" containerID="195c004666f6a02d0b880cd7d8f16b3855a7bd0ff31fdce1c620421a53e47f4a"
Jul 15 14:34:23.036450 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:23.036433    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-42mdh_openshift-console-operator(0de0f3ad-e228-4c27-9b2c-de1a5844dcdb)\"" pod="openshift-console-operator/console-operator-7866497494-42mdh" podUID="0de0f3ad-e228-4c27-9b2c-de1a5844dcdb"
Jul 15 14:34:23.040316 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:23.040293    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-lz7p6"]
Jul 15 14:34:23.062435 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:23.062415    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-lz7p6"]
Jul 15 14:34:23.062521 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:23.062485    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-lz7p6"
Jul 15 14:34:23.065249 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:23.065233    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 15 14:34:23.065376 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:23.065360    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 15 14:34:23.065452 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:23.065439    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-q4n8c\""
Jul 15 14:34:23.073381 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:23.073342    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-cs6zp" podStartSLOduration=6.03095136 podStartE2EDuration="44.073326511s" totalImagesPullingTime="38.042375151s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 14:33:39 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:34:23.068849132 +0000 UTC m=+46.584667002" watchObservedRunningTime="2026-07-15 14:34:23.073326511 +0000 UTC m=+46.589144380"
Jul 15 14:34:23.105496 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:23.105471    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:23.170509 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:23.170454    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jw9j8_144a8b5d-13b7-4453-8bd5-963d4c7815c8/dns-node-resolver/0.log"
Jul 15 14:34:23.173805 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:23.173782    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75lx9\" (UniqueName: \"kubernetes.io/projected/22e7cfb1-87e4-4936-bd2a-c0d127b6d3d7-kube-api-access-75lx9\") pod \"migrator-7f59b54f6c-lz7p6\" (UID: \"22e7cfb1-87e4-4936-bd2a-c0d127b6d3d7\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-lz7p6"
Jul 15 14:34:23.207790 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:23.207760    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:23.274643 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:23.274612    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75lx9\" (UniqueName: \"kubernetes.io/projected/22e7cfb1-87e4-4936-bd2a-c0d127b6d3d7-kube-api-access-75lx9\") pod \"migrator-7f59b54f6c-lz7p6\" (UID: \"22e7cfb1-87e4-4936-bd2a-c0d127b6d3d7\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-lz7p6"
Jul 15 14:34:23.292637 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:23.292616    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75lx9\" (UniqueName: \"kubernetes.io/projected/22e7cfb1-87e4-4936-bd2a-c0d127b6d3d7-kube-api-access-75lx9\") pod \"migrator-7f59b54f6c-lz7p6\" (UID: \"22e7cfb1-87e4-4936-bd2a-c0d127b6d3d7\") " pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-lz7p6"
Jul 15 14:34:23.298373 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:23.298347    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:23.359487 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:23.359458    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:23.371713 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:23.371693    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-lz7p6"
Jul 15 14:34:23.476148 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:23.476120    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ebcd9b8b-583f-482c-8fc2-534201772275-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rbdmg\" (UID: \"ebcd9b8b-583f-482c-8fc2-534201772275\") " pod="openshift-insights/insights-runtime-extractor-rbdmg"
Jul 15 14:34:23.476299 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:23.476199    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ebcd9b8b-583f-482c-8fc2-534201772275-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rbdmg\" (UID: \"ebcd9b8b-583f-482c-8fc2-534201772275\") " pod="openshift-insights/insights-runtime-extractor-rbdmg"
Jul 15 14:34:23.476299 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:23.476248    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 14:34:23.476377 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:23.476335    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ebcd9b8b-583f-482c-8fc2-534201772275-kube-rbac-proxy-cm podName:ebcd9b8b-583f-482c-8fc2-534201772275 nodeName:}" failed. No retries permitted until 2026-07-15 14:34:25.476317015 +0000 UTC m=+48.992134868 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ebcd9b8b-583f-482c-8fc2-534201772275-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rbdmg" (UID: "ebcd9b8b-583f-482c-8fc2-534201772275") : configmap "kube-rbac-proxy" not found
Jul 15 14:34:23.476377 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:23.476355    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 14:34:23.476471 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:23.476403    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebcd9b8b-583f-482c-8fc2-534201772275-insights-runtime-extractor-tls podName:ebcd9b8b-583f-482c-8fc2-534201772275 nodeName:}" failed. No retries permitted until 2026-07-15 14:34:25.476388268 +0000 UTC m=+48.992206128 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ebcd9b8b-583f-482c-8fc2-534201772275-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rbdmg" (UID: "ebcd9b8b-583f-482c-8fc2-534201772275") : secret "insights-runtime-extractor-tls" not found
Jul 15 14:34:23.533484 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:23.533453    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7f59b54f6c-lz7p6"]
Jul 15 14:34:23.536444 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:34:23.536410    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22e7cfb1_87e4_4936_bd2a_c0d127b6d3d7.slice/crio-cd06225c3827d8ebf08719607641aefa3a21677fe08927d485efca2746a841ce WatchSource:0}: Error finding container cd06225c3827d8ebf08719607641aefa3a21677fe08927d485efca2746a841ce: Status 404 returned error can't find the container with id cd06225c3827d8ebf08719607641aefa3a21677fe08927d485efca2746a841ce
Jul 15 14:34:23.601799 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:23.601763    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:23.681826 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:23.681791    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:24.043822 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:24.043788    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-lz7p6" event={"ID":"22e7cfb1-87e4-4936-bd2a-c0d127b6d3d7","Type":"ContainerStarted","Data":"cd06225c3827d8ebf08719607641aefa3a21677fe08927d485efca2746a841ce"}
Jul 15 14:34:24.044262 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:24.044246    2571 scope.go:117] "RemoveContainer" containerID="195c004666f6a02d0b880cd7d8f16b3855a7bd0ff31fdce1c620421a53e47f4a"
Jul 15 14:34:24.044415 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:24.044397    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-42mdh_openshift-console-operator(0de0f3ad-e228-4c27-9b2c-de1a5844dcdb)\"" pod="openshift-console-operator/console-operator-7866497494-42mdh" podUID="0de0f3ad-e228-4c27-9b2c-de1a5844dcdb"
Jul 15 14:34:24.162698 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:24.162675    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wvfhr_55343882-5974-45a9-b3e2-cfff9bec7863/node-ca/0.log"
Jul 15 14:34:24.399932 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:24.399897    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:24.495764 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:24.495732    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:24.555519 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:24.555495    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-t56m5_5943ec96-deb6-4e14-9d96-d5f71e12d6d5/serve-healthcheck-canary/0.log"
Jul 15 14:34:25.402153 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:25.402125    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:25.496260 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:25.496230    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ebcd9b8b-583f-482c-8fc2-534201772275-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rbdmg\" (UID: \"ebcd9b8b-583f-482c-8fc2-534201772275\") " pod="openshift-insights/insights-runtime-extractor-rbdmg"
Jul 15 14:34:25.496389 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:25.496373    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 14:34:25.496435 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:25.496413    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 14:34:25.496435 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:25.496424    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebcd9b8b-583f-482c-8fc2-534201772275-insights-runtime-extractor-tls podName:ebcd9b8b-583f-482c-8fc2-534201772275 nodeName:}" failed. No retries permitted until 2026-07-15 14:34:29.496410984 +0000 UTC m=+53.012228833 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ebcd9b8b-583f-482c-8fc2-534201772275-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rbdmg" (UID: "ebcd9b8b-583f-482c-8fc2-534201772275") : secret "insights-runtime-extractor-tls" not found
Jul 15 14:34:25.496513 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:25.496373    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ebcd9b8b-583f-482c-8fc2-534201772275-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rbdmg\" (UID: \"ebcd9b8b-583f-482c-8fc2-534201772275\") " pod="openshift-insights/insights-runtime-extractor-rbdmg"
Jul 15 14:34:25.496513 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:25.496474    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ebcd9b8b-583f-482c-8fc2-534201772275-kube-rbac-proxy-cm podName:ebcd9b8b-583f-482c-8fc2-534201772275 nodeName:}" failed. No retries permitted until 2026-07-15 14:34:29.496444613 +0000 UTC m=+53.012262480 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ebcd9b8b-583f-482c-8fc2-534201772275-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rbdmg" (UID: "ebcd9b8b-583f-482c-8fc2-534201772275") : configmap "kube-rbac-proxy" not found
Jul 15 14:34:25.682260 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:25.682224    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:26.053067 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:26.052989    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-lz7p6" event={"ID":"22e7cfb1-87e4-4936-bd2a-c0d127b6d3d7","Type":"ContainerStarted","Data":"2b2b8e8d22b629d0de8f28af2779c255aaf8085e249c1224331a5aa594a9cc0d"}
Jul 15 14:34:26.053067 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:26.053040    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-lz7p6" event={"ID":"22e7cfb1-87e4-4936-bd2a-c0d127b6d3d7","Type":"ContainerStarted","Data":"5f60778b49cd472b0d74dbfd799e988ca405bc9b436cda21f9518be56db0e60b"}
Jul 15 14:34:26.074918 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:26.074876    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7f59b54f6c-lz7p6" podStartSLOduration=1.360094594 podStartE2EDuration="3.074862129s" totalImagesPullingTime="1.714767535s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:34:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:34:26.073072948 +0000 UTC m=+49.588890818" watchObservedRunningTime="2026-07-15 14:34:26.074862129 +0000 UTC m=+49.590679998"
Jul 15 14:34:26.187961 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:26.187936    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:26.284716 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:26.284690    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:27.165464 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:27.165435    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:27.716673 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:27.716640    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd114550-c5d0-471c-83fb-b5203fcea02c-metrics-tls\") pod \"dns-default-zmmq4\" (UID: \"cd114550-c5d0-471c-83fb-b5203fcea02c\") " pod="openshift-dns/dns-default-zmmq4"
Jul 15 14:34:27.716825 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:27.716680    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e8dade3b-1035-4ff4-911d-7ca98ce14401-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-fkbdh\" (UID: \"e8dade3b-1035-4ff4-911d-7ca98ce14401\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-fkbdh"
Jul 15 14:34:27.716825 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:27.716736    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b0ac431-4ca5-45b0-9779-26461b04b319-metrics-certs\") pod \"router-default-6b5f9c7788-p9ls6\" (UID: \"4b0ac431-4ca5-45b0-9779-26461b04b319\") " pod="openshift-ingress/router-default-6b5f9c7788-p9ls6"
Jul 15 14:34:27.716825 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:27.716798    2571 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 15 14:34:27.716825 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:27.716807    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c632d732-9454-4773-bfae-ae68b1f0ac4d-registry-tls\") pod \"image-registry-7cccfb4ff6-mkrws\" (UID: \"c632d732-9454-4773-bfae-ae68b1f0ac4d\") " pod="openshift-image-registry/image-registry-7cccfb4ff6-mkrws"
Jul 15 14:34:27.716985 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:27.716838    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/247f8c50-953c-457c-b2f5-02830e0c499d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-fkhv2\" (UID: \"247f8c50-953c-457c-b2f5-02830e0c499d\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fkhv2"
Jul 15 14:34:27.716985 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:27.716853    2571 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found
Jul 15 14:34:27.716985 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:27.716855    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd114550-c5d0-471c-83fb-b5203fcea02c-metrics-tls podName:cd114550-c5d0-471c-83fb-b5203fcea02c nodeName:}" failed. No retries permitted until 2026-07-15 14:34:43.716838493 +0000 UTC m=+67.232656365 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/cd114550-c5d0-471c-83fb-b5203fcea02c-metrics-tls") pod "dns-default-zmmq4" (UID: "cd114550-c5d0-471c-83fb-b5203fcea02c") : secret "dns-default-metrics-tls" not found
Jul 15 14:34:27.716985 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:27.716932    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e8dade3b-1035-4ff4-911d-7ca98ce14401-samples-operator-tls podName:e8dade3b-1035-4ff4-911d-7ca98ce14401 nodeName:}" failed. No retries permitted until 2026-07-15 14:34:43.716919898 +0000 UTC m=+67.232737747 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/e8dade3b-1035-4ff4-911d-7ca98ce14401-samples-operator-tls") pod "cluster-samples-operator-65db858894-fkbdh" (UID: "e8dade3b-1035-4ff4-911d-7ca98ce14401") : secret "samples-operator-tls" not found
Jul 15 14:34:27.716985 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:27.716933    2571 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 15 14:34:27.716985 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:27.716946    2571 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 15 14:34:27.716985 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:27.716958    2571 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7cccfb4ff6-mkrws: secret "image-registry-tls" not found
Jul 15 14:34:27.716985 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:27.716983    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4b0ac431-4ca5-45b0-9779-26461b04b319-metrics-certs podName:4b0ac431-4ca5-45b0-9779-26461b04b319 nodeName:}" failed. No retries permitted until 2026-07-15 14:34:43.716967591 +0000 UTC m=+67.232785440 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/4b0ac431-4ca5-45b0-9779-26461b04b319-metrics-certs") pod "router-default-6b5f9c7788-p9ls6" (UID: "4b0ac431-4ca5-45b0-9779-26461b04b319") : secret "router-metrics-certs-default" not found
Jul 15 14:34:27.717301 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:27.717002    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/c632d732-9454-4773-bfae-ae68b1f0ac4d-registry-tls podName:c632d732-9454-4773-bfae-ae68b1f0ac4d nodeName:}" failed. No retries permitted until 2026-07-15 14:34:43.716996015 +0000 UTC m=+67.232813864 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/c632d732-9454-4773-bfae-ae68b1f0ac4d-registry-tls") pod "image-registry-7cccfb4ff6-mkrws" (UID: "c632d732-9454-4773-bfae-ae68b1f0ac4d") : secret "image-registry-tls" not found
Jul 15 14:34:27.717301 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:27.717027    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b0ac431-4ca5-45b0-9779-26461b04b319-service-ca-bundle\") pod \"router-default-6b5f9c7788-p9ls6\" (UID: \"4b0ac431-4ca5-45b0-9779-26461b04b319\") " pod="openshift-ingress/router-default-6b5f9c7788-p9ls6"
Jul 15 14:34:27.717301 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:27.717039    2571 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 15 14:34:27.717301 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:27.717100    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/247f8c50-953c-457c-b2f5-02830e0c499d-cluster-monitoring-operator-tls podName:247f8c50-953c-457c-b2f5-02830e0c499d nodeName:}" failed. No retries permitted until 2026-07-15 14:34:43.717085009 +0000 UTC m=+67.232902877 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/247f8c50-953c-457c-b2f5-02830e0c499d-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-fkhv2" (UID: "247f8c50-953c-457c-b2f5-02830e0c499d") : secret "cluster-monitoring-operator-tls" not found
Jul 15 14:34:27.717301 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:27.717143    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/4b0ac431-4ca5-45b0-9779-26461b04b319-service-ca-bundle podName:4b0ac431-4ca5-45b0-9779-26461b04b319 nodeName:}" failed. No retries permitted until 2026-07-15 14:34:43.717135996 +0000 UTC m=+67.232953845 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/4b0ac431-4ca5-45b0-9779-26461b04b319-service-ca-bundle") pod "router-default-6b5f9c7788-p9ls6" (UID: "4b0ac431-4ca5-45b0-9779-26461b04b319") : configmap references non-existent config key: service-ca.crt
Jul 15 14:34:27.817913 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:27.817888    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6d24461e-70ad-4e8d-8647-5277bed5a202-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-npl5n\" (UID: \"6d24461e-70ad-4e8d-8647-5277bed5a202\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-npl5n"
Jul 15 14:34:27.818064 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:27.818040    2571 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found
Jul 15 14:34:27.818150 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:27.818137    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6d24461e-70ad-4e8d-8647-5277bed5a202-networking-console-plugin-cert podName:6d24461e-70ad-4e8d-8647-5277bed5a202 nodeName:}" failed. No retries permitted until 2026-07-15 14:34:43.818121834 +0000 UTC m=+67.333939696 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/6d24461e-70ad-4e8d-8647-5277bed5a202-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-npl5n" (UID: "6d24461e-70ad-4e8d-8647-5277bed5a202") : secret "networking-console-plugin-cert" not found
Jul 15 14:34:28.117948 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:28.117916    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:28.223197 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:28.223162    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:29.391367 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:29.391327    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:29.534022 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:29.533985    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ebcd9b8b-583f-482c-8fc2-534201772275-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rbdmg\" (UID: \"ebcd9b8b-583f-482c-8fc2-534201772275\") " pod="openshift-insights/insights-runtime-extractor-rbdmg"
Jul 15 14:34:29.534194 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:29.534081    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ebcd9b8b-583f-482c-8fc2-534201772275-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rbdmg\" (UID: \"ebcd9b8b-583f-482c-8fc2-534201772275\") " pod="openshift-insights/insights-runtime-extractor-rbdmg"
Jul 15 14:34:29.534194 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:29.534107    2571 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 14:34:29.534194 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:29.534166    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/ebcd9b8b-583f-482c-8fc2-534201772275-kube-rbac-proxy-cm podName:ebcd9b8b-583f-482c-8fc2-534201772275 nodeName:}" failed. No retries permitted until 2026-07-15 14:34:37.534148758 +0000 UTC m=+61.049966626 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/ebcd9b8b-583f-482c-8fc2-534201772275-kube-rbac-proxy-cm") pod "insights-runtime-extractor-rbdmg" (UID: "ebcd9b8b-583f-482c-8fc2-534201772275") : configmap "kube-rbac-proxy" not found
Jul 15 14:34:29.534399 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:29.534230    2571 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 14:34:29.534399 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:34:29.534317    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ebcd9b8b-583f-482c-8fc2-534201772275-insights-runtime-extractor-tls podName:ebcd9b8b-583f-482c-8fc2-534201772275 nodeName:}" failed. No retries permitted until 2026-07-15 14:34:37.5343035 +0000 UTC m=+61.050121353 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/ebcd9b8b-583f-482c-8fc2-534201772275-insights-runtime-extractor-tls") pod "insights-runtime-extractor-rbdmg" (UID: "ebcd9b8b-583f-482c-8fc2-534201772275") : secret "insights-runtime-extractor-tls" not found
Jul 15 14:34:30.607479 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:30.607443    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:30.702409 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:30.702369    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:31.444691 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:31.444662    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:31.598774 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:31.598746    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:31.711634 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:31.711553    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:31.808955 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:31.808918    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:31.912709 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:31.912679    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:32.350777 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:32.350750    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:32.969453 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:32.969423    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:33.350618 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:33.350580    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:33.743091 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:33.743012    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:33.930386 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:33.930350    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:34.122195 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:34.122162    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:34.210997 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:34.210970    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:35.690280 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:35.690227    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:35.749655 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:35.749628    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:36.154752 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:36.154719    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:36.246878 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:36.246848    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:37.122667 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:37.122635    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:37.332727 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:37.332682    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:37.536205 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:37.536116    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:37.612167 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:37.612133    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ebcd9b8b-583f-482c-8fc2-534201772275-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rbdmg\" (UID: \"ebcd9b8b-583f-482c-8fc2-534201772275\") " pod="openshift-insights/insights-runtime-extractor-rbdmg"
Jul 15 14:34:37.612362 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:37.612201    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ebcd9b8b-583f-482c-8fc2-534201772275-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rbdmg\" (UID: \"ebcd9b8b-583f-482c-8fc2-534201772275\") " pod="openshift-insights/insights-runtime-extractor-rbdmg"
Jul 15 14:34:37.612728 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:37.612700    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/ebcd9b8b-583f-482c-8fc2-534201772275-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-rbdmg\" (UID: \"ebcd9b8b-583f-482c-8fc2-534201772275\") " pod="openshift-insights/insights-runtime-extractor-rbdmg"
Jul 15 14:34:37.614434 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:37.614416    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/ebcd9b8b-583f-482c-8fc2-534201772275-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-rbdmg\" (UID: \"ebcd9b8b-583f-482c-8fc2-534201772275\") " pod="openshift-insights/insights-runtime-extractor-rbdmg"
Jul 15 14:34:37.714321 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:37.714286    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-rbdmg"
Jul 15 14:34:37.721764 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:37.721738    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:37.844184 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:37.844067    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-rbdmg"]
Jul 15 14:34:37.846568 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:34:37.846536    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebcd9b8b_583f_482c_8fc2_534201772275.slice/crio-c00fc930894d0fe7726398744949120aea03f6236209bf619ab223e53d473140 WatchSource:0}: Error finding container c00fc930894d0fe7726398744949120aea03f6236209bf619ab223e53d473140: Status 404 returned error can't find the container with id c00fc930894d0fe7726398744949120aea03f6236209bf619ab223e53d473140
Jul 15 14:34:37.927061 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:37.927027    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:37.951962 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:37.951938    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j8tt2"
Jul 15 14:34:38.100167 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:38.100140    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rbdmg" event={"ID":"ebcd9b8b-583f-482c-8fc2-534201772275","Type":"ContainerStarted","Data":"c00fc930894d0fe7726398744949120aea03f6236209bf619ab223e53d473140"}
Jul 15 14:34:38.335177 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:38.335143    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:38.748785 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:38.748750    2571 scope.go:117] "RemoveContainer" containerID="195c004666f6a02d0b880cd7d8f16b3855a7bd0ff31fdce1c620421a53e47f4a"
Jul 15 14:34:38.928094 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:38.928030    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:39.107246 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:39.107137    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-42mdh_0de0f3ad-e228-4c27-9b2c-de1a5844dcdb/console-operator/1.log"
Jul 15 14:34:39.107246 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:39.107222    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-42mdh" event={"ID":"0de0f3ad-e228-4c27-9b2c-de1a5844dcdb","Type":"ContainerStarted","Data":"095ca0ccd13bea6c3f8bb70256b533ca1aa28dc5700aa774fb4b58c3f8e3f9b8"}
Jul 15 14:34:39.107935 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:39.107870    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-42mdh"
Jul 15 14:34:39.132951 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:39.132184    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-42mdh" podStartSLOduration=47.070154718 podStartE2EDuration="55.132165107s" totalImagesPullingTime="8.062010389s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:33:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:34:39.129561306 +0000 UTC m=+62.645379177" watchObservedRunningTime="2026-07-15 14:34:39.132165107 +0000 UTC m=+62.647982980"
Jul 15 14:34:39.284975 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:39.284883    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-42mdh"
Jul 15 14:34:39.492959 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:39.492886    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:39.588780 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:39.588746    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:39.689730 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:39.689694    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:40.021616 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:40.021587    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:40.080783 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:40.080745    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:40.146122 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:40.146082    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:40.203701 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:40.203665    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:40.333381 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:40.333346    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:40.557254 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:40.557222    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:40.695518 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:40.695431    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:40.998604 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:40.998503    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:41.067975 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:41.067943    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:41.129188 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:41.129161    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:41.331911 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:41.331877    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:41.406757 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:41.406724    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:41.723142 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:41.723070    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:41.996093 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:41.996005    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:42.338019 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:42.337991    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:42.438220 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:42.438185    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:42.542836 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:42.542802    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:42.858886 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:42.858844    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkfs5\" (UniqueName: \"kubernetes.io/projected/109886c7-ff5d-49ac-9bf9-012740e3417f-kube-api-access-vkfs5\") pod \"network-check-target-878zd\" (UID: \"109886c7-ff5d-49ac-9bf9-012740e3417f\") " pod="openshift-network-diagnostics/network-check-target-878zd"
Jul 15 14:34:42.861581 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:42.861555    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkfs5\" (UniqueName: \"kubernetes.io/projected/109886c7-ff5d-49ac-9bf9-012740e3417f-kube-api-access-vkfs5\") pod \"network-check-target-878zd\" (UID: \"109886c7-ff5d-49ac-9bf9-012740e3417f\") " pod="openshift-network-diagnostics/network-check-target-878zd"
Jul 15 14:34:42.866007 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:42.865986    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-m26tp\""
Jul 15 14:34:42.873639 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:42.873614    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-878zd"
Jul 15 14:34:43.059927 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:43.059898    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eff6ee84-dee0-429b-9edc-df30874ebd31-metrics-certs\") pod \"network-metrics-daemon-g49wp\" (UID: \"eff6ee84-dee0-429b-9edc-df30874ebd31\") " pod="openshift-multus/network-metrics-daemon-g49wp"
Jul 15 14:34:43.063072 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:43.063051    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 14:34:43.072427 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:43.072400    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/eff6ee84-dee0-429b-9edc-df30874ebd31-metrics-certs\") pod \"network-metrics-daemon-g49wp\" (UID: \"eff6ee84-dee0-429b-9edc-df30874ebd31\") " pod="openshift-multus/network-metrics-daemon-g49wp"
Jul 15 14:34:43.160897 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:43.160864    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4a14d87d-5fd3-40b7-b753-4758b15dd501-original-pull-secret\") pod \"global-pull-secret-syncer-7b98l\" (UID: \"4a14d87d-5fd3-40b7-b753-4758b15dd501\") " pod="kube-system/global-pull-secret-syncer-7b98l"
Jul 15 14:34:43.164153 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:43.164133    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 14:34:43.173435 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:43.173417    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/4a14d87d-5fd3-40b7-b753-4758b15dd501-original-pull-secret\") pod \"global-pull-secret-syncer-7b98l\" (UID: \"4a14d87d-5fd3-40b7-b753-4758b15dd501\") " pod="kube-system/global-pull-secret-syncer-7b98l"
Jul 15 14:34:43.178124 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:43.178081    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tz86z\""
Jul 15 14:34:43.181350 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:43.181335    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7b98l"
Jul 15 14:34:43.183281 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:43.183246    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-g49wp"
Jul 15 14:34:43.184645 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:43.184618    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-878zd"]
Jul 15 14:34:43.189048 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:34:43.189018    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod109886c7_ff5d_49ac_9bf9_012740e3417f.slice/crio-48253029bc14ef372493062f8afaa1aa18adef579f9a1c5fe5df4177321d5414 WatchSource:0}: Error finding container 48253029bc14ef372493062f8afaa1aa18adef579f9a1c5fe5df4177321d5414: Status 404 returned error can't find the container with id 48253029bc14ef372493062f8afaa1aa18adef579f9a1c5fe5df4177321d5414
Jul 15 14:34:43.321660 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:43.321637    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-g49wp"]
Jul 15 14:34:43.323345 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:34:43.323312    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podeff6ee84_dee0_429b_9edc_df30874ebd31.slice/crio-232f330e371e7f1d1d2f95d93a544bff8e949dad257e70c1a92d00e988b3b6d5 WatchSource:0}: Error finding container 232f330e371e7f1d1d2f95d93a544bff8e949dad257e70c1a92d00e988b3b6d5: Status 404 returned error can't find the container with id 232f330e371e7f1d1d2f95d93a544bff8e949dad257e70c1a92d00e988b3b6d5
Jul 15 14:34:43.341229 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:43.341205    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7b98l"]
Jul 15 14:34:43.343771 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:34:43.343753    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a14d87d_5fd3_40b7_b753_4758b15dd501.slice/crio-d2c785a53853f1358b17efe58d198948841d846d9420adbf34a7fdc62ae7c36e WatchSource:0}: Error finding container d2c785a53853f1358b17efe58d198948841d846d9420adbf34a7fdc62ae7c36e: Status 404 returned error can't find the container with id d2c785a53853f1358b17efe58d198948841d846d9420adbf34a7fdc62ae7c36e
Jul 15 14:34:43.765745 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:43.765641    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b0ac431-4ca5-45b0-9779-26461b04b319-metrics-certs\") pod \"router-default-6b5f9c7788-p9ls6\" (UID: \"4b0ac431-4ca5-45b0-9779-26461b04b319\") " pod="openshift-ingress/router-default-6b5f9c7788-p9ls6"
Jul 15 14:34:43.765930 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:43.765814    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c632d732-9454-4773-bfae-ae68b1f0ac4d-registry-tls\") pod \"image-registry-7cccfb4ff6-mkrws\" (UID: \"c632d732-9454-4773-bfae-ae68b1f0ac4d\") " pod="openshift-image-registry/image-registry-7cccfb4ff6-mkrws"
Jul 15 14:34:43.765930 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:43.765855    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/247f8c50-953c-457c-b2f5-02830e0c499d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-fkhv2\" (UID: \"247f8c50-953c-457c-b2f5-02830e0c499d\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fkhv2"
Jul 15 14:34:43.765930 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:43.765893    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b0ac431-4ca5-45b0-9779-26461b04b319-service-ca-bundle\") pod \"router-default-6b5f9c7788-p9ls6\" (UID: \"4b0ac431-4ca5-45b0-9779-26461b04b319\") " pod="openshift-ingress/router-default-6b5f9c7788-p9ls6"
Jul 15 14:34:43.765930 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:43.765920    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd114550-c5d0-471c-83fb-b5203fcea02c-metrics-tls\") pod \"dns-default-zmmq4\" (UID: \"cd114550-c5d0-471c-83fb-b5203fcea02c\") " pod="openshift-dns/dns-default-zmmq4"
Jul 15 14:34:43.766126 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:43.765958    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e8dade3b-1035-4ff4-911d-7ca98ce14401-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-fkbdh\" (UID: \"e8dade3b-1035-4ff4-911d-7ca98ce14401\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-fkbdh"
Jul 15 14:34:43.767113 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:43.767037    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4b0ac431-4ca5-45b0-9779-26461b04b319-service-ca-bundle\") pod \"router-default-6b5f9c7788-p9ls6\" (UID: \"4b0ac431-4ca5-45b0-9779-26461b04b319\") " pod="openshift-ingress/router-default-6b5f9c7788-p9ls6"
Jul 15 14:34:43.769870 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:43.769826    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/4b0ac431-4ca5-45b0-9779-26461b04b319-metrics-certs\") pod \"router-default-6b5f9c7788-p9ls6\" (UID: \"4b0ac431-4ca5-45b0-9779-26461b04b319\") " pod="openshift-ingress/router-default-6b5f9c7788-p9ls6"
Jul 15 14:34:43.770323 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:43.770299    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/e8dade3b-1035-4ff4-911d-7ca98ce14401-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-fkbdh\" (UID: \"e8dade3b-1035-4ff4-911d-7ca98ce14401\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-fkbdh"
Jul 15 14:34:43.770414 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:43.770352    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/cd114550-c5d0-471c-83fb-b5203fcea02c-metrics-tls\") pod \"dns-default-zmmq4\" (UID: \"cd114550-c5d0-471c-83fb-b5203fcea02c\") " pod="openshift-dns/dns-default-zmmq4"
Jul 15 14:34:43.770990 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:43.770956    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c632d732-9454-4773-bfae-ae68b1f0ac4d-registry-tls\") pod \"image-registry-7cccfb4ff6-mkrws\" (UID: \"c632d732-9454-4773-bfae-ae68b1f0ac4d\") " pod="openshift-image-registry/image-registry-7cccfb4ff6-mkrws"
Jul 15 14:34:43.772373 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:43.772351    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/247f8c50-953c-457c-b2f5-02830e0c499d-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-fkhv2\" (UID: \"247f8c50-953c-457c-b2f5-02830e0c499d\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fkhv2"
Jul 15 14:34:43.866804 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:43.866665    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6d24461e-70ad-4e8d-8647-5277bed5a202-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-npl5n\" (UID: \"6d24461e-70ad-4e8d-8647-5277bed5a202\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-npl5n"
Jul 15 14:34:43.872023 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:43.871969    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/6d24461e-70ad-4e8d-8647-5277bed5a202-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-npl5n\" (UID: \"6d24461e-70ad-4e8d-8647-5277bed5a202\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-npl5n"
Jul 15 14:34:43.955154 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:43.955120    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-l2mcw\""
Jul 15 14:34:43.962791 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:43.962766    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cccfb4ff6-mkrws"
Jul 15 14:34:43.978210 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:43.978174    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-w66fn\""
Jul 15 14:34:43.985604 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:43.985582    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-zmmq4"
Jul 15 14:34:44.010262 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:44.010034    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-zwc48\""
Jul 15 14:34:44.015527 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:44.015228    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-fkbdh"
Jul 15 14:34:44.015669 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:44.015553    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-9nsqs\""
Jul 15 14:34:44.023761 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:44.023438    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fkhv2"
Jul 15 14:34:44.024995 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:44.024825    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-wzqmw\""
Jul 15 14:34:44.031402 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:44.031380    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-6b5f9c7788-p9ls6"
Jul 15 14:34:44.056300 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:44.055546    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-twbkk\""
Jul 15 14:34:44.062565 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:44.062376    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-npl5n"
Jul 15 14:34:44.141648 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:44.141455    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rbdmg" event={"ID":"ebcd9b8b-583f-482c-8fc2-534201772275","Type":"ContainerStarted","Data":"1ed2b7720e51528163f7ab73199896f0df6ef31bd42dbf38c12e22539b1bb953"}
Jul 15 14:34:44.162677 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:44.162020    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-878zd" event={"ID":"109886c7-ff5d-49ac-9bf9-012740e3417f","Type":"ContainerStarted","Data":"694553493cefab962f0872978588d13922f828006ba2b185bb104458ea61b376"}
Jul 15 14:34:44.162677 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:44.162075    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-878zd" event={"ID":"109886c7-ff5d-49ac-9bf9-012740e3417f","Type":"ContainerStarted","Data":"48253029bc14ef372493062f8afaa1aa18adef579f9a1c5fe5df4177321d5414"}
Jul 15 14:34:44.162677 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:44.162130    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-878zd"
Jul 15 14:34:44.173184 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:44.171261    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7b98l" event={"ID":"4a14d87d-5fd3-40b7-b753-4758b15dd501","Type":"ContainerStarted","Data":"d2c785a53853f1358b17efe58d198948841d846d9420adbf34a7fdc62ae7c36e"}
Jul 15 14:34:44.174977 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:44.174943    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g49wp" event={"ID":"eff6ee84-dee0-429b-9edc-df30874ebd31","Type":"ContainerStarted","Data":"232f330e371e7f1d1d2f95d93a544bff8e949dad257e70c1a92d00e988b3b6d5"}
Jul 15 14:34:44.190038 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:44.188508    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7cccfb4ff6-mkrws"]
Jul 15 14:34:44.247542 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:44.247475    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-878zd" podStartSLOduration=65.247450982 podStartE2EDuration="1m5.247450982s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:33:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:34:44.196667266 +0000 UTC m=+67.712485137" watchObservedRunningTime="2026-07-15 14:34:44.247450982 +0000 UTC m=+67.763268849"
Jul 15 14:34:44.249257 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:44.248235    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-zmmq4"]
Jul 15 14:34:44.299474 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:44.299431    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fkhv2"]
Jul 15 14:34:44.303134 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:34:44.303081    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod247f8c50_953c_457c_b2f5_02830e0c499d.slice/crio-e85dd15616359bb6e81cf4d45a7de5b2699ae1892fa2b90990a5a5daefd784a6 WatchSource:0}: Error finding container e85dd15616359bb6e81cf4d45a7de5b2699ae1892fa2b90990a5a5daefd784a6: Status 404 returned error can't find the container with id e85dd15616359bb6e81cf4d45a7de5b2699ae1892fa2b90990a5a5daefd784a6
Jul 15 14:34:44.308249 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:44.307862    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-fkbdh"]
Jul 15 14:34:44.344973 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:44.344938    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-npl5n"]
Jul 15 14:34:44.370008 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:44.369224    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-6b5f9c7788-p9ls6"]
Jul 15 14:34:44.672493 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:34:44.671486    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b0ac431_4ca5_45b0_9779_26461b04b319.slice/crio-89db95d1678883c43831fecf777755e6199d54681b3906fd15930a52eeb6f02a WatchSource:0}: Error finding container 89db95d1678883c43831fecf777755e6199d54681b3906fd15930a52eeb6f02a: Status 404 returned error can't find the container with id 89db95d1678883c43831fecf777755e6199d54681b3906fd15930a52eeb6f02a
Jul 15 14:34:44.682029 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:34:44.681997    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d24461e_70ad_4e8d_8647_5277bed5a202.slice/crio-e04c5465e71fabcc1108dbcd5ef1effceb4f4bd92f699ef7acb56b1c70c97245 WatchSource:0}: Error finding container e04c5465e71fabcc1108dbcd5ef1effceb4f4bd92f699ef7acb56b1c70c97245: Status 404 returned error can't find the container with id e04c5465e71fabcc1108dbcd5ef1effceb4f4bd92f699ef7acb56b1c70c97245
Jul 15 14:34:45.191486 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:45.191397    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-npl5n" event={"ID":"6d24461e-70ad-4e8d-8647-5277bed5a202","Type":"ContainerStarted","Data":"e04c5465e71fabcc1108dbcd5ef1effceb4f4bd92f699ef7acb56b1c70c97245"}
Jul 15 14:34:45.193405 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:45.193373    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6b5f9c7788-p9ls6" event={"ID":"4b0ac431-4ca5-45b0-9779-26461b04b319","Type":"ContainerStarted","Data":"8e2145e6e4ff61deb1d2e0545392c54035764048904e094912d822902cd14d6d"}
Jul 15 14:34:45.193545 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:45.193427    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-6b5f9c7788-p9ls6" event={"ID":"4b0ac431-4ca5-45b0-9779-26461b04b319","Type":"ContainerStarted","Data":"89db95d1678883c43831fecf777755e6199d54681b3906fd15930a52eeb6f02a"}
Jul 15 14:34:45.195111 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:45.195078    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-fkbdh" event={"ID":"e8dade3b-1035-4ff4-911d-7ca98ce14401","Type":"ContainerStarted","Data":"e1c9a7f364677b4332f277d910a193a350a7dbce843d9ccee589b54ff6608fc8"}
Jul 15 14:34:45.196417 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:45.196352    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zmmq4" event={"ID":"cd114550-c5d0-471c-83fb-b5203fcea02c","Type":"ContainerStarted","Data":"e31b3ca2d1c24ed681351299d9e1d65430da3e32923b66f5f42d34075c107a1b"}
Jul 15 14:34:45.198884 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:45.198848    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g49wp" event={"ID":"eff6ee84-dee0-429b-9edc-df30874ebd31","Type":"ContainerStarted","Data":"c096556651d3d9d5037782f4e757beb33540b3f48c58e186b60af694a86530f1"}
Jul 15 14:34:45.199004 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:45.198899    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-g49wp" event={"ID":"eff6ee84-dee0-429b-9edc-df30874ebd31","Type":"ContainerStarted","Data":"bb4488a6a9d27e05b31510578b8f0bf0ce6eb1a9ac54201fa80b03095fdedb57"}
Jul 15 14:34:45.201167 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:45.201139    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fkhv2" event={"ID":"247f8c50-953c-457c-b2f5-02830e0c499d","Type":"ContainerStarted","Data":"e85dd15616359bb6e81cf4d45a7de5b2699ae1892fa2b90990a5a5daefd784a6"}
Jul 15 14:34:45.204234 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:45.204109    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7cccfb4ff6-mkrws" event={"ID":"c632d732-9454-4773-bfae-ae68b1f0ac4d","Type":"ContainerStarted","Data":"fdaaa5d1ad5ec76d7d5a9272cb26e61dd9bf86cee84b1db5ee9e44bbe8d8ed96"}
Jul 15 14:34:45.204234 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:45.204179    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7cccfb4ff6-mkrws"
Jul 15 14:34:45.204234 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:45.204201    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7cccfb4ff6-mkrws" event={"ID":"c632d732-9454-4773-bfae-ae68b1f0ac4d","Type":"ContainerStarted","Data":"af58000dba87fdbbfa840651b3dd0e3b1a14d34ebeb849a73b3f4dbc2f48b5c8"}
Jul 15 14:34:45.223749 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:45.223693    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-6b5f9c7788-p9ls6" podStartSLOduration=61.223675747 podStartE2EDuration="1m1.223675747s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:33:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:34:45.223204542 +0000 UTC m=+68.739022413" watchObservedRunningTime="2026-07-15 14:34:45.223675747 +0000 UTC m=+68.739493619"
Jul 15 14:34:45.244052 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:45.244006    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-g49wp" podStartSLOduration=64.867350367 podStartE2EDuration="1m6.243988656s" totalImagesPullingTime="1.376638289s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:33:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:34:45.242233581 +0000 UTC m=+68.758051449" watchObservedRunningTime="2026-07-15 14:34:45.243988656 +0000 UTC m=+68.759806527"
Jul 15 14:34:45.270231 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:45.269827    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7cccfb4ff6-mkrws" podStartSLOduration=66.269803482 podStartE2EDuration="1m6.269803482s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:33:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:34:45.268978544 +0000 UTC m=+68.784796416" watchObservedRunningTime="2026-07-15 14:34:45.269803482 +0000 UTC m=+68.785621354"
Jul 15 14:34:46.032467 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:46.032409    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-6b5f9c7788-p9ls6"
Jul 15 14:34:46.035336 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:46.035310    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-6b5f9c7788-p9ls6"
Jul 15 14:34:46.209834 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:46.209700    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-6b5f9c7788-p9ls6"
Jul 15 14:34:46.211411 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:46.211384    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-6b5f9c7788-p9ls6"
Jul 15 14:34:49.136986 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:49.136909    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:49.260790 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:49.260761    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:49.366175 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:49.366140    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:49.468035 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:49.467953    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:49.668069 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:49.668038    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:49.824963 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:49.824930    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:49.954974 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:49.954927    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:50.227808 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:50.227732    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:50.308063 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:50.308014    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:51.527763 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:51.527682    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:51.595954 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:51.595912    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:51.661480 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:51.661456    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:52.100211 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:52.100173    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:52.234199 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:52.234091    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-npl5n" event={"ID":"6d24461e-70ad-4e8d-8647-5277bed5a202","Type":"ContainerStarted","Data":"c85b18e659896e79f27802a0e42150440b3d23abe6214366f4ffb50b7b78f80a"}
Jul 15 14:34:52.236048 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:52.236021    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-fkbdh" event={"ID":"e8dade3b-1035-4ff4-911d-7ca98ce14401","Type":"ContainerStarted","Data":"32b224d239b690227b9b87b0f687dfa33a28377b6ad4b16675fe5a5e33b3eb08"}
Jul 15 14:34:52.236175 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:52.236069    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-fkbdh" event={"ID":"e8dade3b-1035-4ff4-911d-7ca98ce14401","Type":"ContainerStarted","Data":"85e4258cbeabe917cfd0fc5c53dd602908ff5762cffff34e269b77a4fa8bb842"}
Jul 15 14:34:52.237615 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:52.237594    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zmmq4" event={"ID":"cd114550-c5d0-471c-83fb-b5203fcea02c","Type":"ContainerStarted","Data":"ff50c04d3421a607726c2d01203d22c7c93020c70e83ebf8c4f02605d9bc6232"}
Jul 15 14:34:52.239802 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:52.239777    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rbdmg" event={"ID":"ebcd9b8b-583f-482c-8fc2-534201772275","Type":"ContainerStarted","Data":"f7b54a398e3b8699b8bc32a21b5d645bf8ff38352b2cfce0d813caac7a8d22b6"}
Jul 15 14:34:52.241223 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:52.241199    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fkhv2" event={"ID":"247f8c50-953c-457c-b2f5-02830e0c499d","Type":"ContainerStarted","Data":"9251b5621b8249572acd17bd14cda891df37d3acd401ad6bfcc6163081dd48b5"}
Jul 15 14:34:52.242918 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:52.242894    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7b98l" event={"ID":"4a14d87d-5fd3-40b7-b753-4758b15dd501","Type":"ContainerStarted","Data":"dd7d337dbdf3d3379e8c036f52772c42e6208e5c1e027a135a0285f1132f078e"}
Jul 15 14:34:52.268896 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:52.268856    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-npl5n" podStartSLOduration=42.152982417 podStartE2EDuration="48.268841158s" totalImagesPullingTime="6.115858741s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:34:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:34:52.267435074 +0000 UTC m=+75.783252946" watchObservedRunningTime="2026-07-15 14:34:52.268841158 +0000 UTC m=+75.784659028"
Jul 15 14:34:52.295405 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:52.295184    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-fkbdh" podStartSLOduration=62.204031463 podStartE2EDuration="1m8.295168303s" totalImagesPullingTime="6.09113684s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:33:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:34:52.294574656 +0000 UTC m=+75.810392529" watchObservedRunningTime="2026-07-15 14:34:52.295168303 +0000 UTC m=+75.810986175"
Jul 15 14:34:52.343324 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:52.343237    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-7b98l" podStartSLOduration=65.032227349 podStartE2EDuration="1m13.343220283s" totalImagesPullingTime="8.310992934s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 14:33:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:34:52.342482549 +0000 UTC m=+75.858300413" watchObservedRunningTime="2026-07-15 14:34:52.343220283 +0000 UTC m=+75.859038155"
Jul 15 14:34:52.382249 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:52.382217    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:52.442564 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:52.442514    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-fkhv2" podStartSLOduration=61.941009368 podStartE2EDuration="1m8.442496608s" totalImagesPullingTime="6.50148724s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:33:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:34:52.442197533 +0000 UTC m=+75.958015396" watchObservedRunningTime="2026-07-15 14:34:52.442496608 +0000 UTC m=+75.958314478"
Jul 15 14:34:52.512635 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:52.512598    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:52.817378 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:52.817339    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:52.887005 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:52.886956    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:53.249062 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:53.248967    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-zmmq4" event={"ID":"cd114550-c5d0-471c-83fb-b5203fcea02c","Type":"ContainerStarted","Data":"30b7a0b1949cd1ff43a76c64876d272acb1a7d3441c4b23d3e47bcee6d410d8c"}
Jul 15 14:34:53.249220 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:53.249173    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-zmmq4"
Jul 15 14:34:53.277224 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:53.277178    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-zmmq4" podStartSLOduration=34.512688335 podStartE2EDuration="42.277163233s" totalImagesPullingTime="7.764474898s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:34:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:34:53.276192114 +0000 UTC m=+76.792009985" watchObservedRunningTime="2026-07-15 14:34:53.277163233 +0000 UTC m=+76.792981104"
Jul 15 14:34:54.004363 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:54.004324    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:54.076451 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:54.076419    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:55.971789 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:55.971762    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:56.111481 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:56.111451    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:56.234706 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:56.234635    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:56.326728 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:56.326695    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:57.268201 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:57.268165    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-rbdmg" event={"ID":"ebcd9b8b-583f-482c-8fc2-534201772275","Type":"ContainerStarted","Data":"93b2d44270fef9edb8cde9cbcf692138d1db5dcd798fe004d771df8b8e01c185"}
Jul 15 14:34:57.295132 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:57.295078    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-rbdmg" podStartSLOduration=18.096538179 podStartE2EDuration="36.295061753s" totalImagesPullingTime="18.198523574s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 14:34:21 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:34:57.293206067 +0000 UTC m=+80.809023938" watchObservedRunningTime="2026-07-15 14:34:57.295061753 +0000 UTC m=+80.810879624"
Jul 15 14:34:58.494879 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:58.494845    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:58.611293 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:58.611241    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:58.709793 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:58.709756    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:59.547852 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:59.547820    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:59.649307 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:59.649253    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:59.667372 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:59.667336    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-nwxjr"]
Jul 15 14:34:59.669555 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:59.669537    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-nwxjr"
Jul 15 14:34:59.676017 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:59.675999    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 15 14:34:59.677127 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:59.677109    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 15 14:34:59.677201 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:59.677144    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 15 14:34:59.677201 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:59.677169    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-fckpc\""
Jul 15 14:34:59.687314 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:59.687292    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-nwxjr"]
Jul 15 14:34:59.695853 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:59.695826    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f87ee709-cbaa-4a04-b7cc-7d01381a9b73-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-nwxjr\" (UID: \"f87ee709-cbaa-4a04-b7cc-7d01381a9b73\") " pod="openshift-monitoring/prometheus-operator-64785b6675-nwxjr"
Jul 15 14:34:59.695941 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:59.695893    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f87ee709-cbaa-4a04-b7cc-7d01381a9b73-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-nwxjr\" (UID: \"f87ee709-cbaa-4a04-b7cc-7d01381a9b73\") " pod="openshift-monitoring/prometheus-operator-64785b6675-nwxjr"
Jul 15 14:34:59.695990 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:59.695936    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f87ee709-cbaa-4a04-b7cc-7d01381a9b73-metrics-client-ca\") pod \"prometheus-operator-64785b6675-nwxjr\" (UID: \"f87ee709-cbaa-4a04-b7cc-7d01381a9b73\") " pod="openshift-monitoring/prometheus-operator-64785b6675-nwxjr"
Jul 15 14:34:59.696031 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:59.696021    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chczx\" (UniqueName: \"kubernetes.io/projected/f87ee709-cbaa-4a04-b7cc-7d01381a9b73-kube-api-access-chczx\") pod \"prometheus-operator-64785b6675-nwxjr\" (UID: \"f87ee709-cbaa-4a04-b7cc-7d01381a9b73\") " pod="openshift-monitoring/prometheus-operator-64785b6675-nwxjr"
Jul 15 14:34:59.741321 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:59.741287    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:59.797008 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:59.796981    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f87ee709-cbaa-4a04-b7cc-7d01381a9b73-metrics-client-ca\") pod \"prometheus-operator-64785b6675-nwxjr\" (UID: \"f87ee709-cbaa-4a04-b7cc-7d01381a9b73\") " pod="openshift-monitoring/prometheus-operator-64785b6675-nwxjr"
Jul 15 14:34:59.797171 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:59.797033    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chczx\" (UniqueName: \"kubernetes.io/projected/f87ee709-cbaa-4a04-b7cc-7d01381a9b73-kube-api-access-chczx\") pod \"prometheus-operator-64785b6675-nwxjr\" (UID: \"f87ee709-cbaa-4a04-b7cc-7d01381a9b73\") " pod="openshift-monitoring/prometheus-operator-64785b6675-nwxjr"
Jul 15 14:34:59.797171 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:59.797057    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f87ee709-cbaa-4a04-b7cc-7d01381a9b73-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-nwxjr\" (UID: \"f87ee709-cbaa-4a04-b7cc-7d01381a9b73\") " pod="openshift-monitoring/prometheus-operator-64785b6675-nwxjr"
Jul 15 14:34:59.797171 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:59.797106    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f87ee709-cbaa-4a04-b7cc-7d01381a9b73-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-nwxjr\" (UID: \"f87ee709-cbaa-4a04-b7cc-7d01381a9b73\") " pod="openshift-monitoring/prometheus-operator-64785b6675-nwxjr"
Jul 15 14:34:59.797735 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:59.797708    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/f87ee709-cbaa-4a04-b7cc-7d01381a9b73-metrics-client-ca\") pod \"prometheus-operator-64785b6675-nwxjr\" (UID: \"f87ee709-cbaa-4a04-b7cc-7d01381a9b73\") " pod="openshift-monitoring/prometheus-operator-64785b6675-nwxjr"
Jul 15 14:34:59.799606 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:59.799552    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/f87ee709-cbaa-4a04-b7cc-7d01381a9b73-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-nwxjr\" (UID: \"f87ee709-cbaa-4a04-b7cc-7d01381a9b73\") " pod="openshift-monitoring/prometheus-operator-64785b6675-nwxjr"
Jul 15 14:34:59.799606 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:59.799566    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/f87ee709-cbaa-4a04-b7cc-7d01381a9b73-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-nwxjr\" (UID: \"f87ee709-cbaa-4a04-b7cc-7d01381a9b73\") " pod="openshift-monitoring/prometheus-operator-64785b6675-nwxjr"
Jul 15 14:34:59.807931 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:59.807907    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chczx\" (UniqueName: \"kubernetes.io/projected/f87ee709-cbaa-4a04-b7cc-7d01381a9b73-kube-api-access-chczx\") pod \"prometheus-operator-64785b6675-nwxjr\" (UID: \"f87ee709-cbaa-4a04-b7cc-7d01381a9b73\") " pod="openshift-monitoring/prometheus-operator-64785b6675-nwxjr"
Jul 15 14:34:59.810945 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:59.810926    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:59.890203 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:59.890176    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:34:59.978523 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:34:59.978489    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-nwxjr"
Jul 15 14:35:00.061417 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:00.061390    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:35:00.113746 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:00.113716    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-nwxjr"]
Jul 15 14:35:00.117017 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:35:00.116989    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf87ee709_cbaa_4a04_b7cc_7d01381a9b73.slice/crio-214399d36837b2e8272c1ddec35f2fa67997a894873b8191936f6e5b4a338f47 WatchSource:0}: Error finding container 214399d36837b2e8272c1ddec35f2fa67997a894873b8191936f6e5b4a338f47: Status 404 returned error can't find the container with id 214399d36837b2e8272c1ddec35f2fa67997a894873b8191936f6e5b4a338f47
Jul 15 14:35:00.279689 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:00.279653    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-nwxjr" event={"ID":"f87ee709-cbaa-4a04-b7cc-7d01381a9b73","Type":"ContainerStarted","Data":"214399d36837b2e8272c1ddec35f2fa67997a894873b8191936f6e5b4a338f47"}
Jul 15 14:35:01.409547 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:01.409517    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:35:01.501579 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:01.501545    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:35:02.570121 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:02.570094    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:35:02.684837 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:02.684809    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:35:03.255615 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:03.255541    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-zmmq4"
Jul 15 14:35:03.290725 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:03.290695    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:35:03.297746 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:03.297718    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-nwxjr" event={"ID":"f87ee709-cbaa-4a04-b7cc-7d01381a9b73","Type":"ContainerStarted","Data":"d07cb456a3d1e9a7deb57726ba75d6e8f556b207d7931dedffd84525c91d773c"}
Jul 15 14:35:03.297866 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:03.297772    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-nwxjr" event={"ID":"f87ee709-cbaa-4a04-b7cc-7d01381a9b73","Type":"ContainerStarted","Data":"891dd78db700e29839dca53b63163fb179c0f75ecea7b10278ede4de844397c8"}
Jul 15 14:35:03.323380 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:03.323307    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-nwxjr" podStartSLOduration=1.492131937 podStartE2EDuration="4.323287659s" totalImagesPullingTime="2.831155722s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:34:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:35:03.321294071 +0000 UTC m=+86.837111942" watchObservedRunningTime="2026-07-15 14:35:03.323287659 +0000 UTC m=+86.839105522"
Jul 15 14:35:04.820396 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:04.820367    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:35:05.142178 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:05.142091    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-bjqrt"]
Jul 15 14:35:05.144613 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:05.144591    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bjqrt"
Jul 15 14:35:05.148737 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:05.148716    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 15 14:35:05.149033 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:05.149016    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 15 14:35:05.149084 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:05.149028    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 15 14:35:05.151590 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:05.151572    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-cdwhh\""
Jul 15 14:35:05.228887 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:05.228852    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:35:05.231952 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:05.231931    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/63c44b95-aa50-4c76-b4d4-4de11e252661-node-exporter-wtmp\") pod \"node-exporter-bjqrt\" (UID: \"63c44b95-aa50-4c76-b4d4-4de11e252661\") " pod="openshift-monitoring/node-exporter-bjqrt"
Jul 15 14:35:05.232052 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:05.231965    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/63c44b95-aa50-4c76-b4d4-4de11e252661-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bjqrt\" (UID: \"63c44b95-aa50-4c76-b4d4-4de11e252661\") " pod="openshift-monitoring/node-exporter-bjqrt"
Jul 15 14:35:05.232052 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:05.231983    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/63c44b95-aa50-4c76-b4d4-4de11e252661-node-exporter-accelerators-collector-config\") pod \"node-exporter-bjqrt\" (UID: \"63c44b95-aa50-4c76-b4d4-4de11e252661\") " pod="openshift-monitoring/node-exporter-bjqrt"
Jul 15 14:35:05.232052 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:05.232000    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/63c44b95-aa50-4c76-b4d4-4de11e252661-root\") pod \"node-exporter-bjqrt\" (UID: \"63c44b95-aa50-4c76-b4d4-4de11e252661\") " pod="openshift-monitoring/node-exporter-bjqrt"
Jul 15 14:35:05.232052 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:05.232015    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63c44b95-aa50-4c76-b4d4-4de11e252661-metrics-client-ca\") pod \"node-exporter-bjqrt\" (UID: \"63c44b95-aa50-4c76-b4d4-4de11e252661\") " pod="openshift-monitoring/node-exporter-bjqrt"
Jul 15 14:35:05.232052 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:05.232033    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zjrmk\" (UniqueName: \"kubernetes.io/projected/63c44b95-aa50-4c76-b4d4-4de11e252661-kube-api-access-zjrmk\") pod \"node-exporter-bjqrt\" (UID: \"63c44b95-aa50-4c76-b4d4-4de11e252661\") " pod="openshift-monitoring/node-exporter-bjqrt"
Jul 15 14:35:05.232243 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:05.232097    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/63c44b95-aa50-4c76-b4d4-4de11e252661-node-exporter-textfile\") pod \"node-exporter-bjqrt\" (UID: \"63c44b95-aa50-4c76-b4d4-4de11e252661\") " pod="openshift-monitoring/node-exporter-bjqrt"
Jul 15 14:35:05.232243 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:05.232148    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/63c44b95-aa50-4c76-b4d4-4de11e252661-node-exporter-tls\") pod \"node-exporter-bjqrt\" (UID: \"63c44b95-aa50-4c76-b4d4-4de11e252661\") " pod="openshift-monitoring/node-exporter-bjqrt"
Jul 15 14:35:05.232243 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:05.232183    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/63c44b95-aa50-4c76-b4d4-4de11e252661-sys\") pod \"node-exporter-bjqrt\" (UID: \"63c44b95-aa50-4c76-b4d4-4de11e252661\") " pod="openshift-monitoring/node-exporter-bjqrt"
Jul 15 14:35:05.333392 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:05.333355    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/63c44b95-aa50-4c76-b4d4-4de11e252661-node-exporter-textfile\") pod \"node-exporter-bjqrt\" (UID: \"63c44b95-aa50-4c76-b4d4-4de11e252661\") " pod="openshift-monitoring/node-exporter-bjqrt"
Jul 15 14:35:05.333558 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:05.333412    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/63c44b95-aa50-4c76-b4d4-4de11e252661-node-exporter-tls\") pod \"node-exporter-bjqrt\" (UID: \"63c44b95-aa50-4c76-b4d4-4de11e252661\") " pod="openshift-monitoring/node-exporter-bjqrt"
Jul 15 14:35:05.333558 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:05.333453    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/63c44b95-aa50-4c76-b4d4-4de11e252661-sys\") pod \"node-exporter-bjqrt\" (UID: \"63c44b95-aa50-4c76-b4d4-4de11e252661\") " pod="openshift-monitoring/node-exporter-bjqrt"
Jul 15 14:35:05.333558 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:05.333499    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/63c44b95-aa50-4c76-b4d4-4de11e252661-node-exporter-wtmp\") pod \"node-exporter-bjqrt\" (UID: \"63c44b95-aa50-4c76-b4d4-4de11e252661\") " pod="openshift-monitoring/node-exporter-bjqrt"
Jul 15 14:35:05.333558 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:05.333523    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/63c44b95-aa50-4c76-b4d4-4de11e252661-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bjqrt\" (UID: \"63c44b95-aa50-4c76-b4d4-4de11e252661\") " pod="openshift-monitoring/node-exporter-bjqrt"
Jul 15 14:35:05.333558 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:05.333545    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/63c44b95-aa50-4c76-b4d4-4de11e252661-node-exporter-accelerators-collector-config\") pod \"node-exporter-bjqrt\" (UID: \"63c44b95-aa50-4c76-b4d4-4de11e252661\") " pod="openshift-monitoring/node-exporter-bjqrt"
Jul 15 14:35:05.333795 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:05.333567    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/63c44b95-aa50-4c76-b4d4-4de11e252661-root\") pod \"node-exporter-bjqrt\" (UID: \"63c44b95-aa50-4c76-b4d4-4de11e252661\") " pod="openshift-monitoring/node-exporter-bjqrt"
Jul 15 14:35:05.333795 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:05.333565    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/63c44b95-aa50-4c76-b4d4-4de11e252661-sys\") pod \"node-exporter-bjqrt\" (UID: \"63c44b95-aa50-4c76-b4d4-4de11e252661\") " pod="openshift-monitoring/node-exporter-bjqrt"
Jul 15 14:35:05.333795 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:05.333591    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63c44b95-aa50-4c76-b4d4-4de11e252661-metrics-client-ca\") pod \"node-exporter-bjqrt\" (UID: \"63c44b95-aa50-4c76-b4d4-4de11e252661\") " pod="openshift-monitoring/node-exporter-bjqrt"
Jul 15 14:35:05.333795 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:05.333615    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zjrmk\" (UniqueName: \"kubernetes.io/projected/63c44b95-aa50-4c76-b4d4-4de11e252661-kube-api-access-zjrmk\") pod \"node-exporter-bjqrt\" (UID: \"63c44b95-aa50-4c76-b4d4-4de11e252661\") " pod="openshift-monitoring/node-exporter-bjqrt"
Jul 15 14:35:05.333795 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:05.333630    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/63c44b95-aa50-4c76-b4d4-4de11e252661-root\") pod \"node-exporter-bjqrt\" (UID: \"63c44b95-aa50-4c76-b4d4-4de11e252661\") " pod="openshift-monitoring/node-exporter-bjqrt"
Jul 15 14:35:05.333795 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:05.333774    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/63c44b95-aa50-4c76-b4d4-4de11e252661-node-exporter-textfile\") pod \"node-exporter-bjqrt\" (UID: \"63c44b95-aa50-4c76-b4d4-4de11e252661\") " pod="openshift-monitoring/node-exporter-bjqrt"
Jul 15 14:35:05.334165 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:05.334135    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/63c44b95-aa50-4c76-b4d4-4de11e252661-node-exporter-wtmp\") pod \"node-exporter-bjqrt\" (UID: \"63c44b95-aa50-4c76-b4d4-4de11e252661\") " pod="openshift-monitoring/node-exporter-bjqrt"
Jul 15 14:35:05.334313 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:05.334185    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/63c44b95-aa50-4c76-b4d4-4de11e252661-node-exporter-accelerators-collector-config\") pod \"node-exporter-bjqrt\" (UID: \"63c44b95-aa50-4c76-b4d4-4de11e252661\") " pod="openshift-monitoring/node-exporter-bjqrt"
Jul 15 14:35:05.334313 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:05.334202    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/63c44b95-aa50-4c76-b4d4-4de11e252661-metrics-client-ca\") pod \"node-exporter-bjqrt\" (UID: \"63c44b95-aa50-4c76-b4d4-4de11e252661\") " pod="openshift-monitoring/node-exporter-bjqrt"
Jul 15 14:35:05.335846 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:05.335826    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/63c44b95-aa50-4c76-b4d4-4de11e252661-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-bjqrt\" (UID: \"63c44b95-aa50-4c76-b4d4-4de11e252661\") " pod="openshift-monitoring/node-exporter-bjqrt"
Jul 15 14:35:05.335920 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:05.335827    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/63c44b95-aa50-4c76-b4d4-4de11e252661-node-exporter-tls\") pod \"node-exporter-bjqrt\" (UID: \"63c44b95-aa50-4c76-b4d4-4de11e252661\") " pod="openshift-monitoring/node-exporter-bjqrt"
Jul 15 14:35:05.348868 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:05.348840    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zjrmk\" (UniqueName: \"kubernetes.io/projected/63c44b95-aa50-4c76-b4d4-4de11e252661-kube-api-access-zjrmk\") pod \"node-exporter-bjqrt\" (UID: \"63c44b95-aa50-4c76-b4d4-4de11e252661\") " pod="openshift-monitoring/node-exporter-bjqrt"
Jul 15 14:35:05.453358 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:05.453284    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-bjqrt"
Jul 15 14:35:05.455897 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:05.455756    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:35:05.463236 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:35:05.463213    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod63c44b95_aa50_4c76_b4d4_4de11e252661.slice/crio-305d732916cb3a2059691e7383922ea3b305fa7e72a213f58f46b4c1351d52fe WatchSource:0}: Error finding container 305d732916cb3a2059691e7383922ea3b305fa7e72a213f58f46b4c1351d52fe: Status 404 returned error can't find the container with id 305d732916cb3a2059691e7383922ea3b305fa7e72a213f58f46b4c1351d52fe
Jul 15 14:35:05.599359 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:05.599333    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:35:05.841181 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:05.841153    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:35:05.946220 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:05.946182    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:35:06.088484 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:06.088440    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:35:06.215511 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:06.215430    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7cccfb4ff6-mkrws"
Jul 15 14:35:06.312072 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:06.311986    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bjqrt" event={"ID":"63c44b95-aa50-4c76-b4d4-4de11e252661","Type":"ContainerStarted","Data":"305d732916cb3a2059691e7383922ea3b305fa7e72a213f58f46b4c1351d52fe"}
Jul 15 14:35:07.132525 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:07.132489    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:35:07.233000 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:07.232965    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:35:07.317355 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:07.317318    2571 generic.go:356] "Generic (PLEG): container finished" podID="63c44b95-aa50-4c76-b4d4-4de11e252661" containerID="e03ed11178f4b7311ac33ec943dbb78cba679df5a30ab6bfab2dc28873a4251d" exitCode=0
Jul 15 14:35:07.317484 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:07.317392    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bjqrt" event={"ID":"63c44b95-aa50-4c76-b4d4-4de11e252661","Type":"ContainerDied","Data":"e03ed11178f4b7311ac33ec943dbb78cba679df5a30ab6bfab2dc28873a4251d"}
Jul 15 14:35:08.162062 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:08.162029    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:35:08.230573 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:08.230518    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:35:08.322998 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:08.322966    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bjqrt" event={"ID":"63c44b95-aa50-4c76-b4d4-4de11e252661","Type":"ContainerStarted","Data":"90575e5066d50d6974b97de1f7523a461c410d8e8d95cc6e2e4752b10fe167e1"}
Jul 15 14:35:08.323172 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:08.323048    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-bjqrt" event={"ID":"63c44b95-aa50-4c76-b4d4-4de11e252661","Type":"ContainerStarted","Data":"46ce754cd0f491bc6ec5e34a1792f29ba1c3e1a6dbdaacb8ce51b95365f755fc"}
Jul 15 14:35:08.420482 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:08.420368    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-bjqrt" podStartSLOduration=2.183572701 podStartE2EDuration="3.420348227s" totalImagesPullingTime="1.174580696s" totalInitContainerRuntime="62.19483ms" isStatefulPod=true podCreationTimestamp="2026-07-15 14:35:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:35:08.418114165 +0000 UTC m=+91.933932036" watchObservedRunningTime="2026-07-15 14:35:08.420348227 +0000 UTC m=+91.936166096"
Jul 15 14:35:08.452540 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:08.452450    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:35:08.549983 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:08.549913    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:35:09.828678 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:09.828632    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:35:09.900624 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:09.900592    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:35:10.253082 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:10.252951    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:35:11.504640 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.504537    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:35:11.549190 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.549157    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 14:35:11.552341 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.552317    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:35:11.556044 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.556021    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 15 14:35:11.556200 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.556181    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3kfqjb44gcfvc\""
Jul 15 14:35:11.556294 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.556080    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 15 14:35:11.556793 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.556774    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 15 14:35:11.556793 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.556784    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 15 14:35:11.557068 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.557051    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 15 14:35:11.557330 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.557311    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 15 14:35:11.559392 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.559373    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 15 14:35:11.559480 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.559399    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 15 14:35:11.566601 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.566565    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 15 14:35:11.566736 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.566720    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 15 14:35:11.566953 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.566925    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 15 14:35:11.566953 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.566949    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-cl5jt\""
Jul 15 14:35:11.567064 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.566972    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 15 14:35:11.567064 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.566937    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 15 14:35:11.583256 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.583230    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w4cqt\" (UniqueName: \"kubernetes.io/projected/c368aa90-1525-412e-aadc-5b22c89fba2e-kube-api-access-w4cqt\") pod \"prometheus-k8s-0\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:35:11.583361 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.583263    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c368aa90-1525-412e-aadc-5b22c89fba2e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:35:11.583361 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.583311    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c368aa90-1525-412e-aadc-5b22c89fba2e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:35:11.583361 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.583329    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c368aa90-1525-412e-aadc-5b22c89fba2e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:35:11.583361 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.583345    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c368aa90-1525-412e-aadc-5b22c89fba2e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:35:11.583484 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.583361    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c368aa90-1525-412e-aadc-5b22c89fba2e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:35:11.583484 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.583424    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c368aa90-1525-412e-aadc-5b22c89fba2e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:35:11.583484 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.583442    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c368aa90-1525-412e-aadc-5b22c89fba2e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:35:11.583484 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.583465    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c368aa90-1525-412e-aadc-5b22c89fba2e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:35:11.583598 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.583487    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c368aa90-1525-412e-aadc-5b22c89fba2e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:35:11.583598 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.583504    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c368aa90-1525-412e-aadc-5b22c89fba2e-config-out\") pod \"prometheus-k8s-0\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:35:11.583598 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.583519    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c368aa90-1525-412e-aadc-5b22c89fba2e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:35:11.583598 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.583547    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c368aa90-1525-412e-aadc-5b22c89fba2e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:35:11.583598 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.583585    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c368aa90-1525-412e-aadc-5b22c89fba2e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:35:11.583734 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.583601    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c368aa90-1525-412e-aadc-5b22c89fba2e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:35:11.583734 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.583661    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c368aa90-1525-412e-aadc-5b22c89fba2e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:35:11.583734 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.583689    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c368aa90-1525-412e-aadc-5b22c89fba2e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:35:11.583734 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.583712    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c368aa90-1525-412e-aadc-5b22c89fba2e-config\") pod \"prometheus-k8s-0\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:35:11.583847 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.583737    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c368aa90-1525-412e-aadc-5b22c89fba2e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:35:11.583847 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.583757    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c368aa90-1525-412e-aadc-5b22c89fba2e-web-config\") pod \"prometheus-k8s-0\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:35:11.590507 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.590486    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7cccfb4ff6-mkrws"]
Jul 15 14:35:11.591801 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.591780    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 15 14:35:11.592087 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.592062    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 14:35:11.600814 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.600785    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 15 14:35:11.605204 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.605038    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:35:11.685077 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.685046    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w4cqt\" (UniqueName: \"kubernetes.io/projected/c368aa90-1525-412e-aadc-5b22c89fba2e-kube-api-access-w4cqt\") pod \"prometheus-k8s-0\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:35:11.685077 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.685082    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c368aa90-1525-412e-aadc-5b22c89fba2e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:35:11.685347 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.685099    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c368aa90-1525-412e-aadc-5b22c89fba2e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:35:11.685347 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.685185    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c368aa90-1525-412e-aadc-5b22c89fba2e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:35:11.685347 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.685211    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c368aa90-1525-412e-aadc-5b22c89fba2e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:35:11.685480 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.685374    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c368aa90-1525-412e-aadc-5b22c89fba2e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:35:11.685480 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.685417    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c368aa90-1525-412e-aadc-5b22c89fba2e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:35:11.685480 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.685444    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c368aa90-1525-412e-aadc-5b22c89fba2e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:35:11.685480 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.685466    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c368aa90-1525-412e-aadc-5b22c89fba2e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:35:11.685671 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.685609    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c368aa90-1525-412e-aadc-5b22c89fba2e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:35:11.685671 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.685647    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c368aa90-1525-412e-aadc-5b22c89fba2e-config-out\") pod \"prometheus-k8s-0\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:35:11.685775 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.685678    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c368aa90-1525-412e-aadc-5b22c89fba2e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:35:11.685775 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.685707    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c368aa90-1525-412e-aadc-5b22c89fba2e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:35:11.685775 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.685735    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c368aa90-1525-412e-aadc-5b22c89fba2e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:35:11.685775 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.685752    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c368aa90-1525-412e-aadc-5b22c89fba2e-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:35:11.685775 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.685761    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c368aa90-1525-412e-aadc-5b22c89fba2e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:35:11.686006 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.685841    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c368aa90-1525-412e-aadc-5b22c89fba2e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:35:11.686006 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.685874    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c368aa90-1525-412e-aadc-5b22c89fba2e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:35:11.686006 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.685910    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c368aa90-1525-412e-aadc-5b22c89fba2e-config\") pod \"prometheus-k8s-0\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:35:11.686006 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.685951    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c368aa90-1525-412e-aadc-5b22c89fba2e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:35:11.686006 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.685985    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c368aa90-1525-412e-aadc-5b22c89fba2e-web-config\") pod \"prometheus-k8s-0\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:35:11.686288 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.686247    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c368aa90-1525-412e-aadc-5b22c89fba2e-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:35:11.686392 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.686371    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c368aa90-1525-412e-aadc-5b22c89fba2e-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:35:11.686508 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.686461    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c368aa90-1525-412e-aadc-5b22c89fba2e-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:35:11.686826 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.686800    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c368aa90-1525-412e-aadc-5b22c89fba2e-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:35:11.688468 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.688439    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c368aa90-1525-412e-aadc-5b22c89fba2e-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:35:11.689045 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.689022    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c368aa90-1525-412e-aadc-5b22c89fba2e-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:35:11.689817 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.689713    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c368aa90-1525-412e-aadc-5b22c89fba2e-web-config\") pod \"prometheus-k8s-0\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:35:11.690466 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.689951    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c368aa90-1525-412e-aadc-5b22c89fba2e-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:35:11.690466 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.690361    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c368aa90-1525-412e-aadc-5b22c89fba2e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:35:11.690466 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.690425    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c368aa90-1525-412e-aadc-5b22c89fba2e-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:35:11.690898 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.690851    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c368aa90-1525-412e-aadc-5b22c89fba2e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:35:11.691041 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.690994    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c368aa90-1525-412e-aadc-5b22c89fba2e-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:35:11.691557 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.691517    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c368aa90-1525-412e-aadc-5b22c89fba2e-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:35:11.691720 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.691697    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c368aa90-1525-412e-aadc-5b22c89fba2e-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:35:11.691838 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.691815    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/c368aa90-1525-412e-aadc-5b22c89fba2e-config\") pod \"prometheus-k8s-0\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:35:11.691998 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.691977    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c368aa90-1525-412e-aadc-5b22c89fba2e-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:35:11.692036 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.692000    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c368aa90-1525-412e-aadc-5b22c89fba2e-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:35:11.692541 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.692520    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c368aa90-1525-412e-aadc-5b22c89fba2e-config-out\") pod \"prometheus-k8s-0\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:35:11.697516 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.697484    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w4cqt\" (UniqueName: \"kubernetes.io/projected/c368aa90-1525-412e-aadc-5b22c89fba2e-kube-api-access-w4cqt\") pod \"prometheus-k8s-0\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:35:11.771200 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.771114    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:35:11.838493 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.838464    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:35:11.863139 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:11.863110    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:35:12.008952 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:12.008926    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 14:35:12.011051 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:35:12.011012    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc368aa90_1525_412e_aadc_5b22c89fba2e.slice/crio-83a2cbd71db3fa49019bfc735fd0658ae321bed073290d1d81a79e85c6e1f0f0 WatchSource:0}: Error finding container 83a2cbd71db3fa49019bfc735fd0658ae321bed073290d1d81a79e85c6e1f0f0: Status 404 returned error can't find the container with id 83a2cbd71db3fa49019bfc735fd0658ae321bed073290d1d81a79e85c6e1f0f0
Jul 15 14:35:12.204340 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:12.204306    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:35:12.342246 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:12.342197    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c368aa90-1525-412e-aadc-5b22c89fba2e","Type":"ContainerStarted","Data":"83a2cbd71db3fa49019bfc735fd0658ae321bed073290d1d81a79e85c6e1f0f0"}
Jul 15 14:35:13.350492 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:13.350445    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c368aa90-1525-412e-aadc-5b22c89fba2e","Type":"ContainerStarted","Data":"7c3d63d8023cc83a149c97bae5a89a5e12db4da27d3a5dd87a9c00e1d6652747"}
Jul 15 14:35:14.356084 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:14.355844    2571 generic.go:356] "Generic (PLEG): container finished" podID="c368aa90-1525-412e-aadc-5b22c89fba2e" containerID="7c3d63d8023cc83a149c97bae5a89a5e12db4da27d3a5dd87a9c00e1d6652747" exitCode=0
Jul 15 14:35:14.356084 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:14.355896    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c368aa90-1525-412e-aadc-5b22c89fba2e","Type":"ContainerDied","Data":"7c3d63d8023cc83a149c97bae5a89a5e12db4da27d3a5dd87a9c00e1d6652747"}
Jul 15 14:35:14.635920 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:14.635830    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:35:14.709020 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:14.708981    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:35:15.121209 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:15.121175    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:35:15.190535 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:15.190502    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:35:15.206440 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:15.206409    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-878zd"
Jul 15 14:35:16.183039 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:16.183004    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:35:16.245459 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:16.245427    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:35:19.145445 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:19.145416    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:35:19.245921 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:19.245891    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:35:19.379041 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:19.379011    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c368aa90-1525-412e-aadc-5b22c89fba2e","Type":"ContainerStarted","Data":"0c687b067459dd59a6709a4794227569d3b45415e8a59f703df1bb92baf46b94"}
Jul 15 14:35:20.386351 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:20.386308    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c368aa90-1525-412e-aadc-5b22c89fba2e","Type":"ContainerStarted","Data":"c570f56bddcae9243b46a4114f206745134e00f7acbbceb1636ea1f2d9209db4"}
Jul 15 14:35:20.541471 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:20.541433    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:35:20.645232 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:20.645151    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:35:21.880822 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:21.880792    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:35:21.980322 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:21.980291    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:35:22.080134 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:22.080111    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:35:22.398382 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:22.398349    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c368aa90-1525-412e-aadc-5b22c89fba2e","Type":"ContainerStarted","Data":"d6c75003442eb7cedac9b7360c016e883168f6df2e42495f5d0a5bb1d4c3dceb"}
Jul 15 14:35:22.398597 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:22.398416    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c368aa90-1525-412e-aadc-5b22c89fba2e","Type":"ContainerStarted","Data":"4e91c2db974a94f165b27c986a9de8c19fed2992c4c427c8c78cc46f007ec193"}
Jul 15 14:35:22.398597 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:22.398444    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c368aa90-1525-412e-aadc-5b22c89fba2e","Type":"ContainerStarted","Data":"c2dae48e4ddc3857b01b78d3f58ffcbe06486dedf0529a44a97fd27b8f9a4595"}
Jul 15 14:35:22.398597 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:22.398467    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c368aa90-1525-412e-aadc-5b22c89fba2e","Type":"ContainerStarted","Data":"46700f688f7aa7f05cadaaceffb2e91cb2c975460c591f538ded3d977f989e12"}
Jul 15 14:35:22.442791 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:22.442712    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=3.040066751 podStartE2EDuration="11.44263709s" totalImagesPullingTime="8.3803431s" totalInitContainerRuntime="22.227239ms" isStatefulPod=false podCreationTimestamp="2026-07-15 14:35:11 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:35:22.438969083 +0000 UTC m=+105.954786956" watchObservedRunningTime="2026-07-15 14:35:22.44263709 +0000 UTC m=+105.958454975"
Jul 15 14:35:24.284659 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:24.284622    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:35:24.381399 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:24.381364    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:35:26.863587 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:26.863557    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:35:27.417799 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:27.417765    2571 generic.go:356] "Generic (PLEG): container finished" podID="95abed3c-7259-4ef3-990b-eb51bd185c59" containerID="cb5a94bb4f3d2b2801d4377b591a807e30588a9f9e2f594b2576a55fa9f9bdba" exitCode=0
Jul 15 14:35:27.417968 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:27.417839    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-dd6cg" event={"ID":"95abed3c-7259-4ef3-990b-eb51bd185c59","Type":"ContainerDied","Data":"cb5a94bb4f3d2b2801d4377b591a807e30588a9f9e2f594b2576a55fa9f9bdba"}
Jul 15 14:35:27.418198 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:27.418184    2571 scope.go:117] "RemoveContainer" containerID="cb5a94bb4f3d2b2801d4377b591a807e30588a9f9e2f594b2576a55fa9f9bdba"
Jul 15 14:35:28.424517 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:28.424480    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-dd6cg" event={"ID":"95abed3c-7259-4ef3-990b-eb51bd185c59","Type":"ContainerStarted","Data":"dbf853476f9c36fd31fc37dd998f80a90f3f5c09d43a40271758f436f11bb19f"}
Jul 15 14:35:31.438674 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:31.438634    2571 generic.go:356] "Generic (PLEG): container finished" podID="48d450ff-8575-4187-b279-ed927e9fb854" containerID="6ce4a4ab39ab75be2a87d62ec048c54795acee920303d8fc18bf5f361aedf97e" exitCode=0
Jul 15 14:35:31.439132 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:31.438673    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-45c2z" event={"ID":"48d450ff-8575-4187-b279-ed927e9fb854","Type":"ContainerDied","Data":"6ce4a4ab39ab75be2a87d62ec048c54795acee920303d8fc18bf5f361aedf97e"}
Jul 15 14:35:31.439132 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:31.439048    2571 scope.go:117] "RemoveContainer" containerID="6ce4a4ab39ab75be2a87d62ec048c54795acee920303d8fc18bf5f361aedf97e"
Jul 15 14:35:32.447285 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:32.447246    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-45c2z" event={"ID":"48d450ff-8575-4187-b279-ed927e9fb854","Type":"ContainerStarted","Data":"3173e16d7a66121f4e2371570eb1995d156618b64130face33df15fa820273ba"}
Jul 15 14:35:36.463887 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:36.463856    2571 generic.go:356] "Generic (PLEG): container finished" podID="7ea4c3c6-6010-4578-bd63-02311a41af04" containerID="2545c1a504c0595115beb493c1ab87d0f05efdde35cbd0cd29c82a49370a67dd" exitCode=0
Jul 15 14:35:36.464234 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:36.463930    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-69tjk" event={"ID":"7ea4c3c6-6010-4578-bd63-02311a41af04","Type":"ContainerDied","Data":"2545c1a504c0595115beb493c1ab87d0f05efdde35cbd0cd29c82a49370a67dd"}
Jul 15 14:35:36.464324 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:36.464246    2571 scope.go:117] "RemoveContainer" containerID="2545c1a504c0595115beb493c1ab87d0f05efdde35cbd0cd29c82a49370a67dd"
Jul 15 14:35:36.611055 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:36.610999    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7cccfb4ff6-mkrws" podUID="c632d732-9454-4773-bfae-ae68b1f0ac4d" containerName="registry" containerID="cri-o://fdaaa5d1ad5ec76d7d5a9272cb26e61dd9bf86cee84b1db5ee9e44bbe8d8ed96" gracePeriod=30
Jul 15 14:35:36.856940 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:36.856910    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cccfb4ff6-mkrws"
Jul 15 14:35:37.011788 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:37.011698    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c632d732-9454-4773-bfae-ae68b1f0ac4d-trusted-ca\") pod \"c632d732-9454-4773-bfae-ae68b1f0ac4d\" (UID: \"c632d732-9454-4773-bfae-ae68b1f0ac4d\") "
Jul 15 14:35:37.011788 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:37.011744    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c632d732-9454-4773-bfae-ae68b1f0ac4d-image-registry-private-configuration\") pod \"c632d732-9454-4773-bfae-ae68b1f0ac4d\" (UID: \"c632d732-9454-4773-bfae-ae68b1f0ac4d\") "
Jul 15 14:35:37.011788 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:37.011770    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c632d732-9454-4773-bfae-ae68b1f0ac4d-registry-certificates\") pod \"c632d732-9454-4773-bfae-ae68b1f0ac4d\" (UID: \"c632d732-9454-4773-bfae-ae68b1f0ac4d\") "
Jul 15 14:35:37.011788 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:37.011788    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c632d732-9454-4773-bfae-ae68b1f0ac4d-bound-sa-token\") pod \"c632d732-9454-4773-bfae-ae68b1f0ac4d\" (UID: \"c632d732-9454-4773-bfae-ae68b1f0ac4d\") "
Jul 15 14:35:37.012100 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:37.011884    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c632d732-9454-4773-bfae-ae68b1f0ac4d-registry-tls\") pod \"c632d732-9454-4773-bfae-ae68b1f0ac4d\" (UID: \"c632d732-9454-4773-bfae-ae68b1f0ac4d\") "
Jul 15 14:35:37.012100 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:37.011933    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c632d732-9454-4773-bfae-ae68b1f0ac4d-installation-pull-secrets\") pod \"c632d732-9454-4773-bfae-ae68b1f0ac4d\" (UID: \"c632d732-9454-4773-bfae-ae68b1f0ac4d\") "
Jul 15 14:35:37.012100 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:37.012015    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fnfbb\" (UniqueName: \"kubernetes.io/projected/c632d732-9454-4773-bfae-ae68b1f0ac4d-kube-api-access-fnfbb\") pod \"c632d732-9454-4773-bfae-ae68b1f0ac4d\" (UID: \"c632d732-9454-4773-bfae-ae68b1f0ac4d\") "
Jul 15 14:35:37.012100 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:37.012063    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c632d732-9454-4773-bfae-ae68b1f0ac4d-ca-trust-extracted\") pod \"c632d732-9454-4773-bfae-ae68b1f0ac4d\" (UID: \"c632d732-9454-4773-bfae-ae68b1f0ac4d\") "
Jul 15 14:35:37.012314 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:37.012108    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c632d732-9454-4773-bfae-ae68b1f0ac4d-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "c632d732-9454-4773-bfae-ae68b1f0ac4d" (UID: "c632d732-9454-4773-bfae-ae68b1f0ac4d"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 14:35:37.012373 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:37.012355    2571 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/c632d732-9454-4773-bfae-ae68b1f0ac4d-registry-certificates\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 14:35:37.012456 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:37.012437    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c632d732-9454-4773-bfae-ae68b1f0ac4d-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "c632d732-9454-4773-bfae-ae68b1f0ac4d" (UID: "c632d732-9454-4773-bfae-ae68b1f0ac4d"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 14:35:37.014567 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:37.014526    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c632d732-9454-4773-bfae-ae68b1f0ac4d-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "c632d732-9454-4773-bfae-ae68b1f0ac4d" (UID: "c632d732-9454-4773-bfae-ae68b1f0ac4d"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 14:35:37.014733 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:37.014578    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c632d732-9454-4773-bfae-ae68b1f0ac4d-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "c632d732-9454-4773-bfae-ae68b1f0ac4d" (UID: "c632d732-9454-4773-bfae-ae68b1f0ac4d"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 14:35:37.014733 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:37.014652    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c632d732-9454-4773-bfae-ae68b1f0ac4d-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "c632d732-9454-4773-bfae-ae68b1f0ac4d" (UID: "c632d732-9454-4773-bfae-ae68b1f0ac4d"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 14:35:37.014852 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:37.014784    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c632d732-9454-4773-bfae-ae68b1f0ac4d-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "c632d732-9454-4773-bfae-ae68b1f0ac4d" (UID: "c632d732-9454-4773-bfae-ae68b1f0ac4d"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 14:35:37.014959 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:37.014927    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c632d732-9454-4773-bfae-ae68b1f0ac4d-kube-api-access-fnfbb" (OuterVolumeSpecName: "kube-api-access-fnfbb") pod "c632d732-9454-4773-bfae-ae68b1f0ac4d" (UID: "c632d732-9454-4773-bfae-ae68b1f0ac4d"). InnerVolumeSpecName "kube-api-access-fnfbb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 14:35:37.020397 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:37.020375    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c632d732-9454-4773-bfae-ae68b1f0ac4d-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "c632d732-9454-4773-bfae-ae68b1f0ac4d" (UID: "c632d732-9454-4773-bfae-ae68b1f0ac4d"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 14:35:37.113416 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:37.113380    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fnfbb\" (UniqueName: \"kubernetes.io/projected/c632d732-9454-4773-bfae-ae68b1f0ac4d-kube-api-access-fnfbb\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 14:35:37.113416 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:37.113408    2571 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/c632d732-9454-4773-bfae-ae68b1f0ac4d-ca-trust-extracted\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 14:35:37.113416 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:37.113419    2571 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/c632d732-9454-4773-bfae-ae68b1f0ac4d-trusted-ca\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 14:35:37.113623 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:37.113429    2571 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/c632d732-9454-4773-bfae-ae68b1f0ac4d-image-registry-private-configuration\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 14:35:37.113623 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:37.113438    2571 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/c632d732-9454-4773-bfae-ae68b1f0ac4d-bound-sa-token\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 14:35:37.113623 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:37.113446    2571 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/c632d732-9454-4773-bfae-ae68b1f0ac4d-registry-tls\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 14:35:37.113623 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:37.113453    2571 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/c632d732-9454-4773-bfae-ae68b1f0ac4d-installation-pull-secrets\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 14:35:37.470334 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:37.470297    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-69tjk" event={"ID":"7ea4c3c6-6010-4578-bd63-02311a41af04","Type":"ContainerStarted","Data":"8f55b790a1b619078588041f4e807f09f9558e542a2b55fec52aac7f1405af99"}
Jul 15 14:35:37.471574 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:37.471553    2571 generic.go:356] "Generic (PLEG): container finished" podID="c632d732-9454-4773-bfae-ae68b1f0ac4d" containerID="fdaaa5d1ad5ec76d7d5a9272cb26e61dd9bf86cee84b1db5ee9e44bbe8d8ed96" exitCode=0
Jul 15 14:35:37.471702 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:37.471601    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7cccfb4ff6-mkrws"
Jul 15 14:35:37.471702 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:37.471602    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7cccfb4ff6-mkrws" event={"ID":"c632d732-9454-4773-bfae-ae68b1f0ac4d","Type":"ContainerDied","Data":"fdaaa5d1ad5ec76d7d5a9272cb26e61dd9bf86cee84b1db5ee9e44bbe8d8ed96"}
Jul 15 14:35:37.471802 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:37.471722    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7cccfb4ff6-mkrws" event={"ID":"c632d732-9454-4773-bfae-ae68b1f0ac4d","Type":"ContainerDied","Data":"af58000dba87fdbbfa840651b3dd0e3b1a14d34ebeb849a73b3f4dbc2f48b5c8"}
Jul 15 14:35:37.471802 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:37.471749    2571 scope.go:117] "RemoveContainer" containerID="fdaaa5d1ad5ec76d7d5a9272cb26e61dd9bf86cee84b1db5ee9e44bbe8d8ed96"
Jul 15 14:35:37.480535 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:37.480519    2571 scope.go:117] "RemoveContainer" containerID="fdaaa5d1ad5ec76d7d5a9272cb26e61dd9bf86cee84b1db5ee9e44bbe8d8ed96"
Jul 15 14:35:37.480755 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:35:37.480736    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fdaaa5d1ad5ec76d7d5a9272cb26e61dd9bf86cee84b1db5ee9e44bbe8d8ed96\": container with ID starting with fdaaa5d1ad5ec76d7d5a9272cb26e61dd9bf86cee84b1db5ee9e44bbe8d8ed96 not found: ID does not exist" containerID="fdaaa5d1ad5ec76d7d5a9272cb26e61dd9bf86cee84b1db5ee9e44bbe8d8ed96"
Jul 15 14:35:37.480823 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:37.480765    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdaaa5d1ad5ec76d7d5a9272cb26e61dd9bf86cee84b1db5ee9e44bbe8d8ed96"} err="failed to get container status \"fdaaa5d1ad5ec76d7d5a9272cb26e61dd9bf86cee84b1db5ee9e44bbe8d8ed96\": rpc error: code = NotFound desc = could not find container \"fdaaa5d1ad5ec76d7d5a9272cb26e61dd9bf86cee84b1db5ee9e44bbe8d8ed96\": container with ID starting with fdaaa5d1ad5ec76d7d5a9272cb26e61dd9bf86cee84b1db5ee9e44bbe8d8ed96 not found: ID does not exist"
Jul 15 14:35:37.511466 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:37.511442    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7cccfb4ff6-mkrws"]
Jul 15 14:35:37.522298 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:37.522262    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7cccfb4ff6-mkrws"]
Jul 15 14:35:38.753072 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:38.753036    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c632d732-9454-4773-bfae-ae68b1f0ac4d" path="/var/lib/kubelet/pods/c632d732-9454-4773-bfae-ae68b1f0ac4d/volumes"
Jul 15 14:35:45.610112 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:45.610078    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:35:45.678710 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:35:45.678682    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:36:11.863317 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:11.863287    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:36:11.878572 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:11.878541    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:36:12.619450 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:12.619422    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:36:19.313715 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:19.313678    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:36:24.622098 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:24.622065    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:36:25.414021 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:25.413960    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:36:30.098260 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.098177    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 14:36:30.099122 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.099090    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c368aa90-1525-412e-aadc-5b22c89fba2e" containerName="prometheus" containerID="cri-o://0c687b067459dd59a6709a4794227569d3b45415e8a59f703df1bb92baf46b94" gracePeriod=600
Jul 15 14:36:30.099373 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.099340    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c368aa90-1525-412e-aadc-5b22c89fba2e" containerName="thanos-sidecar" containerID="cri-o://46700f688f7aa7f05cadaaceffb2e91cb2c975460c591f538ded3d977f989e12" gracePeriod=600
Jul 15 14:36:30.099458 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.099374    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c368aa90-1525-412e-aadc-5b22c89fba2e" containerName="kube-rbac-proxy" containerID="cri-o://4e91c2db974a94f165b27c986a9de8c19fed2992c4c427c8c78cc46f007ec193" gracePeriod=600
Jul 15 14:36:30.099519 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.099479    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c368aa90-1525-412e-aadc-5b22c89fba2e" containerName="kube-rbac-proxy-web" containerID="cri-o://c2dae48e4ddc3857b01b78d3f58ffcbe06486dedf0529a44a97fd27b8f9a4595" gracePeriod=600
Jul 15 14:36:30.099519 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.099473    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c368aa90-1525-412e-aadc-5b22c89fba2e" containerName="kube-rbac-proxy-thanos" containerID="cri-o://d6c75003442eb7cedac9b7360c016e883168f6df2e42495f5d0a5bb1d4c3dceb" gracePeriod=600
Jul 15 14:36:30.099619 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.099500    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="c368aa90-1525-412e-aadc-5b22c89fba2e" containerName="config-reloader" containerID="cri-o://c570f56bddcae9243b46a4114f206745134e00f7acbbceb1636ea1f2d9209db4" gracePeriod=600
Jul 15 14:36:30.347460 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.347434    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:36:30.415899 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.414332    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c368aa90-1525-412e-aadc-5b22c89fba2e-prometheus-k8s-rulefiles-0\") pod \"c368aa90-1525-412e-aadc-5b22c89fba2e\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") "
Jul 15 14:36:30.415899 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.414393    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c368aa90-1525-412e-aadc-5b22c89fba2e-config-out\") pod \"c368aa90-1525-412e-aadc-5b22c89fba2e\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") "
Jul 15 14:36:30.415899 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.414422    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c368aa90-1525-412e-aadc-5b22c89fba2e-configmap-kubelet-serving-ca-bundle\") pod \"c368aa90-1525-412e-aadc-5b22c89fba2e\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") "
Jul 15 14:36:30.415899 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.414481    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w4cqt\" (UniqueName: \"kubernetes.io/projected/c368aa90-1525-412e-aadc-5b22c89fba2e-kube-api-access-w4cqt\") pod \"c368aa90-1525-412e-aadc-5b22c89fba2e\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") "
Jul 15 14:36:30.415899 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.414525    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c368aa90-1525-412e-aadc-5b22c89fba2e-configmap-serving-certs-ca-bundle\") pod \"c368aa90-1525-412e-aadc-5b22c89fba2e\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") "
Jul 15 14:36:30.415899 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.414552    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c368aa90-1525-412e-aadc-5b22c89fba2e-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"c368aa90-1525-412e-aadc-5b22c89fba2e\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") "
Jul 15 14:36:30.415899 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.414596    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c368aa90-1525-412e-aadc-5b22c89fba2e-prometheus-k8s-rulefiles-2\") pod \"c368aa90-1525-412e-aadc-5b22c89fba2e\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") "
Jul 15 14:36:30.415899 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.414625    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c368aa90-1525-412e-aadc-5b22c89fba2e-secret-prometheus-k8s-tls\") pod \"c368aa90-1525-412e-aadc-5b22c89fba2e\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") "
Jul 15 14:36:30.415899 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.414645    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c368aa90-1525-412e-aadc-5b22c89fba2e-configmap-metrics-client-ca\") pod \"c368aa90-1525-412e-aadc-5b22c89fba2e\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") "
Jul 15 14:36:30.415899 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.415413    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c368aa90-1525-412e-aadc-5b22c89fba2e-secret-kube-rbac-proxy\") pod \"c368aa90-1525-412e-aadc-5b22c89fba2e\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") "
Jul 15 14:36:30.415899 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.415620    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c368aa90-1525-412e-aadc-5b22c89fba2e-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "c368aa90-1525-412e-aadc-5b22c89fba2e" (UID: "c368aa90-1525-412e-aadc-5b22c89fba2e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 14:36:30.415899 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.415657    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c368aa90-1525-412e-aadc-5b22c89fba2e-prometheus-k8s-rulefiles-1\") pod \"c368aa90-1525-412e-aadc-5b22c89fba2e\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") "
Jul 15 14:36:30.415899 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.415690    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/c368aa90-1525-412e-aadc-5b22c89fba2e-config\") pod \"c368aa90-1525-412e-aadc-5b22c89fba2e\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") "
Jul 15 14:36:30.415899 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.415833    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c368aa90-1525-412e-aadc-5b22c89fba2e-prometheus-trusted-ca-bundle\") pod \"c368aa90-1525-412e-aadc-5b22c89fba2e\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") "
Jul 15 14:36:30.416694 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.415964    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c368aa90-1525-412e-aadc-5b22c89fba2e-secret-grpc-tls\") pod \"c368aa90-1525-412e-aadc-5b22c89fba2e\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") "
Jul 15 14:36:30.416694 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.415991    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c368aa90-1525-412e-aadc-5b22c89fba2e-tls-assets\") pod \"c368aa90-1525-412e-aadc-5b22c89fba2e\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") "
Jul 15 14:36:30.416694 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.416053    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c368aa90-1525-412e-aadc-5b22c89fba2e-web-config\") pod \"c368aa90-1525-412e-aadc-5b22c89fba2e\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") "
Jul 15 14:36:30.416694 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.416084    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c368aa90-1525-412e-aadc-5b22c89fba2e-prometheus-k8s-db\") pod \"c368aa90-1525-412e-aadc-5b22c89fba2e\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") "
Jul 15 14:36:30.416694 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.416491    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c368aa90-1525-412e-aadc-5b22c89fba2e-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "c368aa90-1525-412e-aadc-5b22c89fba2e" (UID: "c368aa90-1525-412e-aadc-5b22c89fba2e"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 14:36:30.416991 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.416883    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c368aa90-1525-412e-aadc-5b22c89fba2e-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "c368aa90-1525-412e-aadc-5b22c89fba2e" (UID: "c368aa90-1525-412e-aadc-5b22c89fba2e"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 14:36:30.417058 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.416984    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c368aa90-1525-412e-aadc-5b22c89fba2e-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "c368aa90-1525-412e-aadc-5b22c89fba2e" (UID: "c368aa90-1525-412e-aadc-5b22c89fba2e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 14:36:30.417536 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.417279    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c368aa90-1525-412e-aadc-5b22c89fba2e-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "c368aa90-1525-412e-aadc-5b22c89fba2e" (UID: "c368aa90-1525-412e-aadc-5b22c89fba2e"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 14:36:30.417649 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.417588    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c368aa90-1525-412e-aadc-5b22c89fba2e-secret-metrics-client-certs\") pod \"c368aa90-1525-412e-aadc-5b22c89fba2e\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") "
Jul 15 14:36:30.417649 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.417614    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c368aa90-1525-412e-aadc-5b22c89fba2e-thanos-prometheus-http-client-file\") pod \"c368aa90-1525-412e-aadc-5b22c89fba2e\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") "
Jul 15 14:36:30.417789 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.417658    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c368aa90-1525-412e-aadc-5b22c89fba2e-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"c368aa90-1525-412e-aadc-5b22c89fba2e\" (UID: \"c368aa90-1525-412e-aadc-5b22c89fba2e\") "
Jul 15 14:36:30.418164 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.417953    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c368aa90-1525-412e-aadc-5b22c89fba2e-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "c368aa90-1525-412e-aadc-5b22c89fba2e" (UID: "c368aa90-1525-412e-aadc-5b22c89fba2e"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 14:36:30.418968 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.418588    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c368aa90-1525-412e-aadc-5b22c89fba2e-config-out" (OuterVolumeSpecName: "config-out") pod "c368aa90-1525-412e-aadc-5b22c89fba2e" (UID: "c368aa90-1525-412e-aadc-5b22c89fba2e"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 14:36:30.419077 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.418976    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c368aa90-1525-412e-aadc-5b22c89fba2e-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "c368aa90-1525-412e-aadc-5b22c89fba2e" (UID: "c368aa90-1525-412e-aadc-5b22c89fba2e"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 14:36:30.419077 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.419045    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c368aa90-1525-412e-aadc-5b22c89fba2e-kube-api-access-w4cqt" (OuterVolumeSpecName: "kube-api-access-w4cqt") pod "c368aa90-1525-412e-aadc-5b22c89fba2e" (UID: "c368aa90-1525-412e-aadc-5b22c89fba2e"). InnerVolumeSpecName "kube-api-access-w4cqt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 14:36:30.419262 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.419240    2571 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/c368aa90-1525-412e-aadc-5b22c89fba2e-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 14:36:30.419353 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.419282    2571 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/c368aa90-1525-412e-aadc-5b22c89fba2e-configmap-metrics-client-ca\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 14:36:30.419353 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.419297    2571 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/c368aa90-1525-412e-aadc-5b22c89fba2e-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 14:36:30.419353 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.419310    2571 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c368aa90-1525-412e-aadc-5b22c89fba2e-prometheus-trusted-ca-bundle\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 14:36:30.419353 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.419323    2571 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/c368aa90-1525-412e-aadc-5b22c89fba2e-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 14:36:30.419353 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.419335    2571 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/c368aa90-1525-412e-aadc-5b22c89fba2e-config-out\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 14:36:30.419353 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.419347    2571 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c368aa90-1525-412e-aadc-5b22c89fba2e-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 14:36:30.419677 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.419360    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w4cqt\" (UniqueName: \"kubernetes.io/projected/c368aa90-1525-412e-aadc-5b22c89fba2e-kube-api-access-w4cqt\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 14:36:30.419677 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.419373    2571 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c368aa90-1525-412e-aadc-5b22c89fba2e-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 14:36:30.419677 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.419602    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c368aa90-1525-412e-aadc-5b22c89fba2e-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "c368aa90-1525-412e-aadc-5b22c89fba2e" (UID: "c368aa90-1525-412e-aadc-5b22c89fba2e"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 14:36:30.419953 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.419918    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c368aa90-1525-412e-aadc-5b22c89fba2e-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "c368aa90-1525-412e-aadc-5b22c89fba2e" (UID: "c368aa90-1525-412e-aadc-5b22c89fba2e"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 14:36:30.420445 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.420408    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c368aa90-1525-412e-aadc-5b22c89fba2e-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "c368aa90-1525-412e-aadc-5b22c89fba2e" (UID: "c368aa90-1525-412e-aadc-5b22c89fba2e"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 14:36:30.420916 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.420882    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c368aa90-1525-412e-aadc-5b22c89fba2e-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "c368aa90-1525-412e-aadc-5b22c89fba2e" (UID: "c368aa90-1525-412e-aadc-5b22c89fba2e"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 14:36:30.421529 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.421494    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c368aa90-1525-412e-aadc-5b22c89fba2e-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "c368aa90-1525-412e-aadc-5b22c89fba2e" (UID: "c368aa90-1525-412e-aadc-5b22c89fba2e"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 14:36:30.421808 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.421768    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c368aa90-1525-412e-aadc-5b22c89fba2e-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "c368aa90-1525-412e-aadc-5b22c89fba2e" (UID: "c368aa90-1525-412e-aadc-5b22c89fba2e"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 14:36:30.421808 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.421798    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c368aa90-1525-412e-aadc-5b22c89fba2e-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "c368aa90-1525-412e-aadc-5b22c89fba2e" (UID: "c368aa90-1525-412e-aadc-5b22c89fba2e"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 14:36:30.421921 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.421874    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c368aa90-1525-412e-aadc-5b22c89fba2e-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "c368aa90-1525-412e-aadc-5b22c89fba2e" (UID: "c368aa90-1525-412e-aadc-5b22c89fba2e"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 14:36:30.422540 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.422510    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c368aa90-1525-412e-aadc-5b22c89fba2e-config" (OuterVolumeSpecName: "config") pod "c368aa90-1525-412e-aadc-5b22c89fba2e" (UID: "c368aa90-1525-412e-aadc-5b22c89fba2e"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 14:36:30.425070 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.425035    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c368aa90-1525-412e-aadc-5b22c89fba2e-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "c368aa90-1525-412e-aadc-5b22c89fba2e" (UID: "c368aa90-1525-412e-aadc-5b22c89fba2e"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 14:36:30.434400 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.434376    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c368aa90-1525-412e-aadc-5b22c89fba2e-web-config" (OuterVolumeSpecName: "web-config") pod "c368aa90-1525-412e-aadc-5b22c89fba2e" (UID: "c368aa90-1525-412e-aadc-5b22c89fba2e"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 14:36:30.520525 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.520494    2571 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/c368aa90-1525-412e-aadc-5b22c89fba2e-config\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 14:36:30.520525 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.520519    2571 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/c368aa90-1525-412e-aadc-5b22c89fba2e-secret-grpc-tls\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 14:36:30.520525 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.520530    2571 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/c368aa90-1525-412e-aadc-5b22c89fba2e-tls-assets\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 14:36:30.520748 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.520538    2571 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/c368aa90-1525-412e-aadc-5b22c89fba2e-web-config\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 14:36:30.520748 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.520546    2571 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/c368aa90-1525-412e-aadc-5b22c89fba2e-prometheus-k8s-db\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 14:36:30.520748 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.520554    2571 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/c368aa90-1525-412e-aadc-5b22c89fba2e-secret-metrics-client-certs\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 14:36:30.520748 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.520564    2571 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/c368aa90-1525-412e-aadc-5b22c89fba2e-thanos-prometheus-http-client-file\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 14:36:30.520748 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.520573    2571 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/c368aa90-1525-412e-aadc-5b22c89fba2e-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 14:36:30.520748 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.520582    2571 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/c368aa90-1525-412e-aadc-5b22c89fba2e-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 14:36:30.520748 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.520590    2571 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/c368aa90-1525-412e-aadc-5b22c89fba2e-secret-prometheus-k8s-tls\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 14:36:30.520748 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.520598    2571 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/c368aa90-1525-412e-aadc-5b22c89fba2e-secret-kube-rbac-proxy\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 14:36:30.675158 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.675072    2571 generic.go:356] "Generic (PLEG): container finished" podID="c368aa90-1525-412e-aadc-5b22c89fba2e" containerID="d6c75003442eb7cedac9b7360c016e883168f6df2e42495f5d0a5bb1d4c3dceb" exitCode=0
Jul 15 14:36:30.675158 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.675104    2571 generic.go:356] "Generic (PLEG): container finished" podID="c368aa90-1525-412e-aadc-5b22c89fba2e" containerID="4e91c2db974a94f165b27c986a9de8c19fed2992c4c427c8c78cc46f007ec193" exitCode=0
Jul 15 14:36:30.675158 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.675115    2571 generic.go:356] "Generic (PLEG): container finished" podID="c368aa90-1525-412e-aadc-5b22c89fba2e" containerID="c2dae48e4ddc3857b01b78d3f58ffcbe06486dedf0529a44a97fd27b8f9a4595" exitCode=0
Jul 15 14:36:30.675158 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.675124    2571 generic.go:356] "Generic (PLEG): container finished" podID="c368aa90-1525-412e-aadc-5b22c89fba2e" containerID="46700f688f7aa7f05cadaaceffb2e91cb2c975460c591f538ded3d977f989e12" exitCode=0
Jul 15 14:36:30.675158 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.675133    2571 generic.go:356] "Generic (PLEG): container finished" podID="c368aa90-1525-412e-aadc-5b22c89fba2e" containerID="c570f56bddcae9243b46a4114f206745134e00f7acbbceb1636ea1f2d9209db4" exitCode=0
Jul 15 14:36:30.675158 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.675140    2571 generic.go:356] "Generic (PLEG): container finished" podID="c368aa90-1525-412e-aadc-5b22c89fba2e" containerID="0c687b067459dd59a6709a4794227569d3b45415e8a59f703df1bb92baf46b94" exitCode=0
Jul 15 14:36:30.675459 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.675148    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c368aa90-1525-412e-aadc-5b22c89fba2e","Type":"ContainerDied","Data":"d6c75003442eb7cedac9b7360c016e883168f6df2e42495f5d0a5bb1d4c3dceb"}
Jul 15 14:36:30.675459 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.675188    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:36:30.675459 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.675255    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c368aa90-1525-412e-aadc-5b22c89fba2e","Type":"ContainerDied","Data":"4e91c2db974a94f165b27c986a9de8c19fed2992c4c427c8c78cc46f007ec193"}
Jul 15 14:36:30.675459 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.675295    2571 scope.go:117] "RemoveContainer" containerID="d6c75003442eb7cedac9b7360c016e883168f6df2e42495f5d0a5bb1d4c3dceb"
Jul 15 14:36:30.675459 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.675304    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c368aa90-1525-412e-aadc-5b22c89fba2e","Type":"ContainerDied","Data":"c2dae48e4ddc3857b01b78d3f58ffcbe06486dedf0529a44a97fd27b8f9a4595"}
Jul 15 14:36:30.675459 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.675331    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c368aa90-1525-412e-aadc-5b22c89fba2e","Type":"ContainerDied","Data":"46700f688f7aa7f05cadaaceffb2e91cb2c975460c591f538ded3d977f989e12"}
Jul 15 14:36:30.675459 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.675356    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c368aa90-1525-412e-aadc-5b22c89fba2e","Type":"ContainerDied","Data":"c570f56bddcae9243b46a4114f206745134e00f7acbbceb1636ea1f2d9209db4"}
Jul 15 14:36:30.675459 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.675380    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c368aa90-1525-412e-aadc-5b22c89fba2e","Type":"ContainerDied","Data":"0c687b067459dd59a6709a4794227569d3b45415e8a59f703df1bb92baf46b94"}
Jul 15 14:36:30.675459 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.675403    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"c368aa90-1525-412e-aadc-5b22c89fba2e","Type":"ContainerDied","Data":"83a2cbd71db3fa49019bfc735fd0658ae321bed073290d1d81a79e85c6e1f0f0"}
Jul 15 14:36:30.684225 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.684204    2571 scope.go:117] "RemoveContainer" containerID="4e91c2db974a94f165b27c986a9de8c19fed2992c4c427c8c78cc46f007ec193"
Jul 15 14:36:30.690849 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.690829    2571 scope.go:117] "RemoveContainer" containerID="c2dae48e4ddc3857b01b78d3f58ffcbe06486dedf0529a44a97fd27b8f9a4595"
Jul 15 14:36:30.697400 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.697384    2571 scope.go:117] "RemoveContainer" containerID="46700f688f7aa7f05cadaaceffb2e91cb2c975460c591f538ded3d977f989e12"
Jul 15 14:36:30.703578 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.703556    2571 scope.go:117] "RemoveContainer" containerID="c570f56bddcae9243b46a4114f206745134e00f7acbbceb1636ea1f2d9209db4"
Jul 15 14:36:30.707529 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.707506    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 14:36:30.711128 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.711110    2571 scope.go:117] "RemoveContainer" containerID="0c687b067459dd59a6709a4794227569d3b45415e8a59f703df1bb92baf46b94"
Jul 15 14:36:30.712794 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.712777    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 14:36:30.719297 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.719261    2571 scope.go:117] "RemoveContainer" containerID="7c3d63d8023cc83a149c97bae5a89a5e12db4da27d3a5dd87a9c00e1d6652747"
Jul 15 14:36:30.727423 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.727404    2571 scope.go:117] "RemoveContainer" containerID="d6c75003442eb7cedac9b7360c016e883168f6df2e42495f5d0a5bb1d4c3dceb"
Jul 15 14:36:30.727702 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:36:30.727678    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6c75003442eb7cedac9b7360c016e883168f6df2e42495f5d0a5bb1d4c3dceb\": container with ID starting with d6c75003442eb7cedac9b7360c016e883168f6df2e42495f5d0a5bb1d4c3dceb not found: ID does not exist" containerID="d6c75003442eb7cedac9b7360c016e883168f6df2e42495f5d0a5bb1d4c3dceb"
Jul 15 14:36:30.727785 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.727714    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6c75003442eb7cedac9b7360c016e883168f6df2e42495f5d0a5bb1d4c3dceb"} err="failed to get container status \"d6c75003442eb7cedac9b7360c016e883168f6df2e42495f5d0a5bb1d4c3dceb\": rpc error: code = NotFound desc = could not find container \"d6c75003442eb7cedac9b7360c016e883168f6df2e42495f5d0a5bb1d4c3dceb\": container with ID starting with d6c75003442eb7cedac9b7360c016e883168f6df2e42495f5d0a5bb1d4c3dceb not found: ID does not exist"
Jul 15 14:36:30.727785 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.727741    2571 scope.go:117] "RemoveContainer" containerID="4e91c2db974a94f165b27c986a9de8c19fed2992c4c427c8c78cc46f007ec193"
Jul 15 14:36:30.728022 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:36:30.728002    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e91c2db974a94f165b27c986a9de8c19fed2992c4c427c8c78cc46f007ec193\": container with ID starting with 4e91c2db974a94f165b27c986a9de8c19fed2992c4c427c8c78cc46f007ec193 not found: ID does not exist" containerID="4e91c2db974a94f165b27c986a9de8c19fed2992c4c427c8c78cc46f007ec193"
Jul 15 14:36:30.728103 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.728025    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e91c2db974a94f165b27c986a9de8c19fed2992c4c427c8c78cc46f007ec193"} err="failed to get container status \"4e91c2db974a94f165b27c986a9de8c19fed2992c4c427c8c78cc46f007ec193\": rpc error: code = NotFound desc = could not find container \"4e91c2db974a94f165b27c986a9de8c19fed2992c4c427c8c78cc46f007ec193\": container with ID starting with 4e91c2db974a94f165b27c986a9de8c19fed2992c4c427c8c78cc46f007ec193 not found: ID does not exist"
Jul 15 14:36:30.728103 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.728041    2571 scope.go:117] "RemoveContainer" containerID="c2dae48e4ddc3857b01b78d3f58ffcbe06486dedf0529a44a97fd27b8f9a4595"
Jul 15 14:36:30.728378 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:36:30.728258    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2dae48e4ddc3857b01b78d3f58ffcbe06486dedf0529a44a97fd27b8f9a4595\": container with ID starting with c2dae48e4ddc3857b01b78d3f58ffcbe06486dedf0529a44a97fd27b8f9a4595 not found: ID does not exist" containerID="c2dae48e4ddc3857b01b78d3f58ffcbe06486dedf0529a44a97fd27b8f9a4595"
Jul 15 14:36:30.728447 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.728385    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2dae48e4ddc3857b01b78d3f58ffcbe06486dedf0529a44a97fd27b8f9a4595"} err="failed to get container status \"c2dae48e4ddc3857b01b78d3f58ffcbe06486dedf0529a44a97fd27b8f9a4595\": rpc error: code = NotFound desc = could not find container \"c2dae48e4ddc3857b01b78d3f58ffcbe06486dedf0529a44a97fd27b8f9a4595\": container with ID starting with c2dae48e4ddc3857b01b78d3f58ffcbe06486dedf0529a44a97fd27b8f9a4595 not found: ID does not exist"
Jul 15 14:36:30.728447 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.728398    2571 scope.go:117] "RemoveContainer" containerID="46700f688f7aa7f05cadaaceffb2e91cb2c975460c591f538ded3d977f989e12"
Jul 15 14:36:30.728662 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:36:30.728639    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"46700f688f7aa7f05cadaaceffb2e91cb2c975460c591f538ded3d977f989e12\": container with ID starting with 46700f688f7aa7f05cadaaceffb2e91cb2c975460c591f538ded3d977f989e12 not found: ID does not exist" containerID="46700f688f7aa7f05cadaaceffb2e91cb2c975460c591f538ded3d977f989e12"
Jul 15 14:36:30.728703 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.728671    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46700f688f7aa7f05cadaaceffb2e91cb2c975460c591f538ded3d977f989e12"} err="failed to get container status \"46700f688f7aa7f05cadaaceffb2e91cb2c975460c591f538ded3d977f989e12\": rpc error: code = NotFound desc = could not find container \"46700f688f7aa7f05cadaaceffb2e91cb2c975460c591f538ded3d977f989e12\": container with ID starting with 46700f688f7aa7f05cadaaceffb2e91cb2c975460c591f538ded3d977f989e12 not found: ID does not exist"
Jul 15 14:36:30.728703 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.728693    2571 scope.go:117] "RemoveContainer" containerID="c570f56bddcae9243b46a4114f206745134e00f7acbbceb1636ea1f2d9209db4"
Jul 15 14:36:30.728959 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:36:30.728939    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c570f56bddcae9243b46a4114f206745134e00f7acbbceb1636ea1f2d9209db4\": container with ID starting with c570f56bddcae9243b46a4114f206745134e00f7acbbceb1636ea1f2d9209db4 not found: ID does not exist" containerID="c570f56bddcae9243b46a4114f206745134e00f7acbbceb1636ea1f2d9209db4"
Jul 15 14:36:30.729008 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.728966    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c570f56bddcae9243b46a4114f206745134e00f7acbbceb1636ea1f2d9209db4"} err="failed to get container status \"c570f56bddcae9243b46a4114f206745134e00f7acbbceb1636ea1f2d9209db4\": rpc error: code = NotFound desc = could not find container \"c570f56bddcae9243b46a4114f206745134e00f7acbbceb1636ea1f2d9209db4\": container with ID starting with c570f56bddcae9243b46a4114f206745134e00f7acbbceb1636ea1f2d9209db4 not found: ID does not exist"
Jul 15 14:36:30.729008 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.728983    2571 scope.go:117] "RemoveContainer" containerID="0c687b067459dd59a6709a4794227569d3b45415e8a59f703df1bb92baf46b94"
Jul 15 14:36:30.729215 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:36:30.729197    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c687b067459dd59a6709a4794227569d3b45415e8a59f703df1bb92baf46b94\": container with ID starting with 0c687b067459dd59a6709a4794227569d3b45415e8a59f703df1bb92baf46b94 not found: ID does not exist" containerID="0c687b067459dd59a6709a4794227569d3b45415e8a59f703df1bb92baf46b94"
Jul 15 14:36:30.729297 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.729222    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c687b067459dd59a6709a4794227569d3b45415e8a59f703df1bb92baf46b94"} err="failed to get container status \"0c687b067459dd59a6709a4794227569d3b45415e8a59f703df1bb92baf46b94\": rpc error: code = NotFound desc = could not find container \"0c687b067459dd59a6709a4794227569d3b45415e8a59f703df1bb92baf46b94\": container with ID starting with 0c687b067459dd59a6709a4794227569d3b45415e8a59f703df1bb92baf46b94 not found: ID does not exist"
Jul 15 14:36:30.729297 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.729242    2571 scope.go:117] "RemoveContainer" containerID="7c3d63d8023cc83a149c97bae5a89a5e12db4da27d3a5dd87a9c00e1d6652747"
Jul 15 14:36:30.729469 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:36:30.729454    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c3d63d8023cc83a149c97bae5a89a5e12db4da27d3a5dd87a9c00e1d6652747\": container with ID starting with 7c3d63d8023cc83a149c97bae5a89a5e12db4da27d3a5dd87a9c00e1d6652747 not found: ID does not exist" containerID="7c3d63d8023cc83a149c97bae5a89a5e12db4da27d3a5dd87a9c00e1d6652747"
Jul 15 14:36:30.729506 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.729473    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c3d63d8023cc83a149c97bae5a89a5e12db4da27d3a5dd87a9c00e1d6652747"} err="failed to get container status \"7c3d63d8023cc83a149c97bae5a89a5e12db4da27d3a5dd87a9c00e1d6652747\": rpc error: code = NotFound desc = could not find container \"7c3d63d8023cc83a149c97bae5a89a5e12db4da27d3a5dd87a9c00e1d6652747\": container with ID starting with 7c3d63d8023cc83a149c97bae5a89a5e12db4da27d3a5dd87a9c00e1d6652747 not found: ID does not exist"
Jul 15 14:36:30.729506 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.729488    2571 scope.go:117] "RemoveContainer" containerID="d6c75003442eb7cedac9b7360c016e883168f6df2e42495f5d0a5bb1d4c3dceb"
Jul 15 14:36:30.729702 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.729686    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6c75003442eb7cedac9b7360c016e883168f6df2e42495f5d0a5bb1d4c3dceb"} err="failed to get container status \"d6c75003442eb7cedac9b7360c016e883168f6df2e42495f5d0a5bb1d4c3dceb\": rpc error: code = NotFound desc = could not find container \"d6c75003442eb7cedac9b7360c016e883168f6df2e42495f5d0a5bb1d4c3dceb\": container with ID starting with d6c75003442eb7cedac9b7360c016e883168f6df2e42495f5d0a5bb1d4c3dceb not found: ID does not exist"
Jul 15 14:36:30.729747 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.729703    2571 scope.go:117] "RemoveContainer" containerID="4e91c2db974a94f165b27c986a9de8c19fed2992c4c427c8c78cc46f007ec193"
Jul 15 14:36:30.729906 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.729889    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e91c2db974a94f165b27c986a9de8c19fed2992c4c427c8c78cc46f007ec193"} err="failed to get container status \"4e91c2db974a94f165b27c986a9de8c19fed2992c4c427c8c78cc46f007ec193\": rpc error: code = NotFound desc = could not find container \"4e91c2db974a94f165b27c986a9de8c19fed2992c4c427c8c78cc46f007ec193\": container with ID starting with 4e91c2db974a94f165b27c986a9de8c19fed2992c4c427c8c78cc46f007ec193 not found: ID does not exist"
Jul 15 14:36:30.729970 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.729908    2571 scope.go:117] "RemoveContainer" containerID="c2dae48e4ddc3857b01b78d3f58ffcbe06486dedf0529a44a97fd27b8f9a4595"
Jul 15 14:36:30.730104 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.730087    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2dae48e4ddc3857b01b78d3f58ffcbe06486dedf0529a44a97fd27b8f9a4595"} err="failed to get container status \"c2dae48e4ddc3857b01b78d3f58ffcbe06486dedf0529a44a97fd27b8f9a4595\": rpc error: code = NotFound desc = could not find container \"c2dae48e4ddc3857b01b78d3f58ffcbe06486dedf0529a44a97fd27b8f9a4595\": container with ID starting with c2dae48e4ddc3857b01b78d3f58ffcbe06486dedf0529a44a97fd27b8f9a4595 not found: ID does not exist"
Jul 15 14:36:30.730147 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.730115    2571 scope.go:117] "RemoveContainer" containerID="46700f688f7aa7f05cadaaceffb2e91cb2c975460c591f538ded3d977f989e12"
Jul 15 14:36:30.730356 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.730337    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46700f688f7aa7f05cadaaceffb2e91cb2c975460c591f538ded3d977f989e12"} err="failed to get container status \"46700f688f7aa7f05cadaaceffb2e91cb2c975460c591f538ded3d977f989e12\": rpc error: code = NotFound desc = could not find container \"46700f688f7aa7f05cadaaceffb2e91cb2c975460c591f538ded3d977f989e12\": container with ID starting with 46700f688f7aa7f05cadaaceffb2e91cb2c975460c591f538ded3d977f989e12 not found: ID does not exist"
Jul 15 14:36:30.730415 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.730358    2571 scope.go:117] "RemoveContainer" containerID="c570f56bddcae9243b46a4114f206745134e00f7acbbceb1636ea1f2d9209db4"
Jul 15 14:36:30.730551 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.730536    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c570f56bddcae9243b46a4114f206745134e00f7acbbceb1636ea1f2d9209db4"} err="failed to get container status \"c570f56bddcae9243b46a4114f206745134e00f7acbbceb1636ea1f2d9209db4\": rpc error: code = NotFound desc = could not find container \"c570f56bddcae9243b46a4114f206745134e00f7acbbceb1636ea1f2d9209db4\": container with ID starting with c570f56bddcae9243b46a4114f206745134e00f7acbbceb1636ea1f2d9209db4 not found: ID does not exist"
Jul 15 14:36:30.730594 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.730551    2571 scope.go:117] "RemoveContainer" containerID="0c687b067459dd59a6709a4794227569d3b45415e8a59f703df1bb92baf46b94"
Jul 15 14:36:30.730720 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.730703    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c687b067459dd59a6709a4794227569d3b45415e8a59f703df1bb92baf46b94"} err="failed to get container status \"0c687b067459dd59a6709a4794227569d3b45415e8a59f703df1bb92baf46b94\": rpc error: code = NotFound desc = could not find container \"0c687b067459dd59a6709a4794227569d3b45415e8a59f703df1bb92baf46b94\": container with ID starting with 0c687b067459dd59a6709a4794227569d3b45415e8a59f703df1bb92baf46b94 not found: ID does not exist"
Jul 15 14:36:30.730783 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.730723    2571 scope.go:117] "RemoveContainer" containerID="7c3d63d8023cc83a149c97bae5a89a5e12db4da27d3a5dd87a9c00e1d6652747"
Jul 15 14:36:30.730920 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.730901    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c3d63d8023cc83a149c97bae5a89a5e12db4da27d3a5dd87a9c00e1d6652747"} err="failed to get container status \"7c3d63d8023cc83a149c97bae5a89a5e12db4da27d3a5dd87a9c00e1d6652747\": rpc error: code = NotFound desc = could not find container \"7c3d63d8023cc83a149c97bae5a89a5e12db4da27d3a5dd87a9c00e1d6652747\": container with ID starting with 7c3d63d8023cc83a149c97bae5a89a5e12db4da27d3a5dd87a9c00e1d6652747 not found: ID does not exist"
Jul 15 14:36:30.730965 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.730921    2571 scope.go:117] "RemoveContainer" containerID="d6c75003442eb7cedac9b7360c016e883168f6df2e42495f5d0a5bb1d4c3dceb"
Jul 15 14:36:30.731149 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.731130    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6c75003442eb7cedac9b7360c016e883168f6df2e42495f5d0a5bb1d4c3dceb"} err="failed to get container status \"d6c75003442eb7cedac9b7360c016e883168f6df2e42495f5d0a5bb1d4c3dceb\": rpc error: code = NotFound desc = could not find container \"d6c75003442eb7cedac9b7360c016e883168f6df2e42495f5d0a5bb1d4c3dceb\": container with ID starting with d6c75003442eb7cedac9b7360c016e883168f6df2e42495f5d0a5bb1d4c3dceb not found: ID does not exist"
Jul 15 14:36:30.731211 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.731155    2571 scope.go:117] "RemoveContainer" containerID="4e91c2db974a94f165b27c986a9de8c19fed2992c4c427c8c78cc46f007ec193"
Jul 15 14:36:30.731373 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.731357    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e91c2db974a94f165b27c986a9de8c19fed2992c4c427c8c78cc46f007ec193"} err="failed to get container status \"4e91c2db974a94f165b27c986a9de8c19fed2992c4c427c8c78cc46f007ec193\": rpc error: code = NotFound desc = could not find container \"4e91c2db974a94f165b27c986a9de8c19fed2992c4c427c8c78cc46f007ec193\": container with ID starting with 4e91c2db974a94f165b27c986a9de8c19fed2992c4c427c8c78cc46f007ec193 not found: ID does not exist"
Jul 15 14:36:30.731422 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.731374    2571 scope.go:117] "RemoveContainer" containerID="c2dae48e4ddc3857b01b78d3f58ffcbe06486dedf0529a44a97fd27b8f9a4595"
Jul 15 14:36:30.731551 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.731536    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2dae48e4ddc3857b01b78d3f58ffcbe06486dedf0529a44a97fd27b8f9a4595"} err="failed to get container status \"c2dae48e4ddc3857b01b78d3f58ffcbe06486dedf0529a44a97fd27b8f9a4595\": rpc error: code = NotFound desc = could not find container \"c2dae48e4ddc3857b01b78d3f58ffcbe06486dedf0529a44a97fd27b8f9a4595\": container with ID starting with c2dae48e4ddc3857b01b78d3f58ffcbe06486dedf0529a44a97fd27b8f9a4595 not found: ID does not exist"
Jul 15 14:36:30.731591 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.731551    2571 scope.go:117] "RemoveContainer" containerID="46700f688f7aa7f05cadaaceffb2e91cb2c975460c591f538ded3d977f989e12"
Jul 15 14:36:30.731728 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.731714    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46700f688f7aa7f05cadaaceffb2e91cb2c975460c591f538ded3d977f989e12"} err="failed to get container status \"46700f688f7aa7f05cadaaceffb2e91cb2c975460c591f538ded3d977f989e12\": rpc error: code = NotFound desc = could not find container \"46700f688f7aa7f05cadaaceffb2e91cb2c975460c591f538ded3d977f989e12\": container with ID starting with 46700f688f7aa7f05cadaaceffb2e91cb2c975460c591f538ded3d977f989e12 not found: ID does not exist"
Jul 15 14:36:30.731766 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.731728    2571 scope.go:117] "RemoveContainer" containerID="c570f56bddcae9243b46a4114f206745134e00f7acbbceb1636ea1f2d9209db4"
Jul 15 14:36:30.731905 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.731888    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c570f56bddcae9243b46a4114f206745134e00f7acbbceb1636ea1f2d9209db4"} err="failed to get container status \"c570f56bddcae9243b46a4114f206745134e00f7acbbceb1636ea1f2d9209db4\": rpc error: code = NotFound desc = could not find container \"c570f56bddcae9243b46a4114f206745134e00f7acbbceb1636ea1f2d9209db4\": container with ID starting with c570f56bddcae9243b46a4114f206745134e00f7acbbceb1636ea1f2d9209db4 not found: ID does not exist"
Jul 15 14:36:30.731957 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.731905    2571 scope.go:117] "RemoveContainer" containerID="0c687b067459dd59a6709a4794227569d3b45415e8a59f703df1bb92baf46b94"
Jul 15 14:36:30.732106 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.732087    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c687b067459dd59a6709a4794227569d3b45415e8a59f703df1bb92baf46b94"} err="failed to get container status \"0c687b067459dd59a6709a4794227569d3b45415e8a59f703df1bb92baf46b94\": rpc error: code = NotFound desc = could not find container \"0c687b067459dd59a6709a4794227569d3b45415e8a59f703df1bb92baf46b94\": container with ID starting with 0c687b067459dd59a6709a4794227569d3b45415e8a59f703df1bb92baf46b94 not found: ID does not exist"
Jul 15 14:36:30.732163 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.732108    2571 scope.go:117] "RemoveContainer" containerID="7c3d63d8023cc83a149c97bae5a89a5e12db4da27d3a5dd87a9c00e1d6652747"
Jul 15 14:36:30.732333 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.732314    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c3d63d8023cc83a149c97bae5a89a5e12db4da27d3a5dd87a9c00e1d6652747"} err="failed to get container status \"7c3d63d8023cc83a149c97bae5a89a5e12db4da27d3a5dd87a9c00e1d6652747\": rpc error: code = NotFound desc = could not find container \"7c3d63d8023cc83a149c97bae5a89a5e12db4da27d3a5dd87a9c00e1d6652747\": container with ID starting with 7c3d63d8023cc83a149c97bae5a89a5e12db4da27d3a5dd87a9c00e1d6652747 not found: ID does not exist"
Jul 15 14:36:30.732395 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.732333    2571 scope.go:117] "RemoveContainer" containerID="d6c75003442eb7cedac9b7360c016e883168f6df2e42495f5d0a5bb1d4c3dceb"
Jul 15 14:36:30.732539 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.732522    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6c75003442eb7cedac9b7360c016e883168f6df2e42495f5d0a5bb1d4c3dceb"} err="failed to get container status \"d6c75003442eb7cedac9b7360c016e883168f6df2e42495f5d0a5bb1d4c3dceb\": rpc error: code = NotFound desc = could not find container \"d6c75003442eb7cedac9b7360c016e883168f6df2e42495f5d0a5bb1d4c3dceb\": container with ID starting with d6c75003442eb7cedac9b7360c016e883168f6df2e42495f5d0a5bb1d4c3dceb not found: ID does not exist"
Jul 15 14:36:30.732581 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.732540    2571 scope.go:117] "RemoveContainer" containerID="4e91c2db974a94f165b27c986a9de8c19fed2992c4c427c8c78cc46f007ec193"
Jul 15 14:36:30.732744 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.732728    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e91c2db974a94f165b27c986a9de8c19fed2992c4c427c8c78cc46f007ec193"} err="failed to get container status \"4e91c2db974a94f165b27c986a9de8c19fed2992c4c427c8c78cc46f007ec193\": rpc error: code = NotFound desc = could not find container \"4e91c2db974a94f165b27c986a9de8c19fed2992c4c427c8c78cc46f007ec193\": container with ID starting with 4e91c2db974a94f165b27c986a9de8c19fed2992c4c427c8c78cc46f007ec193 not found: ID does not exist"
Jul 15 14:36:30.732806 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.732746    2571 scope.go:117] "RemoveContainer" containerID="c2dae48e4ddc3857b01b78d3f58ffcbe06486dedf0529a44a97fd27b8f9a4595"
Jul 15 14:36:30.732929 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.732914    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2dae48e4ddc3857b01b78d3f58ffcbe06486dedf0529a44a97fd27b8f9a4595"} err="failed to get container status \"c2dae48e4ddc3857b01b78d3f58ffcbe06486dedf0529a44a97fd27b8f9a4595\": rpc error: code = NotFound desc = could not find container \"c2dae48e4ddc3857b01b78d3f58ffcbe06486dedf0529a44a97fd27b8f9a4595\": container with ID starting with c2dae48e4ddc3857b01b78d3f58ffcbe06486dedf0529a44a97fd27b8f9a4595 not found: ID does not exist"
Jul 15 14:36:30.732968 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.732929    2571 scope.go:117] "RemoveContainer" containerID="46700f688f7aa7f05cadaaceffb2e91cb2c975460c591f538ded3d977f989e12"
Jul 15 14:36:30.733117 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.733101    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46700f688f7aa7f05cadaaceffb2e91cb2c975460c591f538ded3d977f989e12"} err="failed to get container status \"46700f688f7aa7f05cadaaceffb2e91cb2c975460c591f538ded3d977f989e12\": rpc error: code = NotFound desc = could not find container \"46700f688f7aa7f05cadaaceffb2e91cb2c975460c591f538ded3d977f989e12\": container with ID starting with 46700f688f7aa7f05cadaaceffb2e91cb2c975460c591f538ded3d977f989e12 not found: ID does not exist"
Jul 15 14:36:30.733162 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.733117    2571 scope.go:117] "RemoveContainer" containerID="c570f56bddcae9243b46a4114f206745134e00f7acbbceb1636ea1f2d9209db4"
Jul 15 14:36:30.733346 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.733328    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c570f56bddcae9243b46a4114f206745134e00f7acbbceb1636ea1f2d9209db4"} err="failed to get container status \"c570f56bddcae9243b46a4114f206745134e00f7acbbceb1636ea1f2d9209db4\": rpc error: code = NotFound desc = could not find container \"c570f56bddcae9243b46a4114f206745134e00f7acbbceb1636ea1f2d9209db4\": container with ID starting with c570f56bddcae9243b46a4114f206745134e00f7acbbceb1636ea1f2d9209db4 not found: ID does not exist"
Jul 15 14:36:30.733411 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.733348    2571 scope.go:117] "RemoveContainer" containerID="0c687b067459dd59a6709a4794227569d3b45415e8a59f703df1bb92baf46b94"
Jul 15 14:36:30.733563 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.733546    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c687b067459dd59a6709a4794227569d3b45415e8a59f703df1bb92baf46b94"} err="failed to get container status \"0c687b067459dd59a6709a4794227569d3b45415e8a59f703df1bb92baf46b94\": rpc error: code = NotFound desc = could not find container \"0c687b067459dd59a6709a4794227569d3b45415e8a59f703df1bb92baf46b94\": container with ID starting with 0c687b067459dd59a6709a4794227569d3b45415e8a59f703df1bb92baf46b94 not found: ID does not exist"
Jul 15 14:36:30.733608 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.733564    2571 scope.go:117] "RemoveContainer" containerID="7c3d63d8023cc83a149c97bae5a89a5e12db4da27d3a5dd87a9c00e1d6652747"
Jul 15 14:36:30.733752 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.733734    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c3d63d8023cc83a149c97bae5a89a5e12db4da27d3a5dd87a9c00e1d6652747"} err="failed to get container status \"7c3d63d8023cc83a149c97bae5a89a5e12db4da27d3a5dd87a9c00e1d6652747\": rpc error: code = NotFound desc = could not find container \"7c3d63d8023cc83a149c97bae5a89a5e12db4da27d3a5dd87a9c00e1d6652747\": container with ID starting with 7c3d63d8023cc83a149c97bae5a89a5e12db4da27d3a5dd87a9c00e1d6652747 not found: ID does not exist"
Jul 15 14:36:30.733818 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.733753    2571 scope.go:117] "RemoveContainer" containerID="d6c75003442eb7cedac9b7360c016e883168f6df2e42495f5d0a5bb1d4c3dceb"
Jul 15 14:36:30.733971 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.733958    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6c75003442eb7cedac9b7360c016e883168f6df2e42495f5d0a5bb1d4c3dceb"} err="failed to get container status \"d6c75003442eb7cedac9b7360c016e883168f6df2e42495f5d0a5bb1d4c3dceb\": rpc error: code = NotFound desc = could not find container \"d6c75003442eb7cedac9b7360c016e883168f6df2e42495f5d0a5bb1d4c3dceb\": container with ID starting with d6c75003442eb7cedac9b7360c016e883168f6df2e42495f5d0a5bb1d4c3dceb not found: ID does not exist"
Jul 15 14:36:30.734009 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.733971    2571 scope.go:117] "RemoveContainer" containerID="4e91c2db974a94f165b27c986a9de8c19fed2992c4c427c8c78cc46f007ec193"
Jul 15 14:36:30.734153 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.734136    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e91c2db974a94f165b27c986a9de8c19fed2992c4c427c8c78cc46f007ec193"} err="failed to get container status \"4e91c2db974a94f165b27c986a9de8c19fed2992c4c427c8c78cc46f007ec193\": rpc error: code = NotFound desc = could not find container \"4e91c2db974a94f165b27c986a9de8c19fed2992c4c427c8c78cc46f007ec193\": container with ID starting with 4e91c2db974a94f165b27c986a9de8c19fed2992c4c427c8c78cc46f007ec193 not found: ID does not exist"
Jul 15 14:36:30.734216 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.734154    2571 scope.go:117] "RemoveContainer" containerID="c2dae48e4ddc3857b01b78d3f58ffcbe06486dedf0529a44a97fd27b8f9a4595"
Jul 15 14:36:30.734378 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.734361    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2dae48e4ddc3857b01b78d3f58ffcbe06486dedf0529a44a97fd27b8f9a4595"} err="failed to get container status \"c2dae48e4ddc3857b01b78d3f58ffcbe06486dedf0529a44a97fd27b8f9a4595\": rpc error: code = NotFound desc = could not find container \"c2dae48e4ddc3857b01b78d3f58ffcbe06486dedf0529a44a97fd27b8f9a4595\": container with ID starting with c2dae48e4ddc3857b01b78d3f58ffcbe06486dedf0529a44a97fd27b8f9a4595 not found: ID does not exist"
Jul 15 14:36:30.734442 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.734378    2571 scope.go:117] "RemoveContainer" containerID="46700f688f7aa7f05cadaaceffb2e91cb2c975460c591f538ded3d977f989e12"
Jul 15 14:36:30.734593 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.734578    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46700f688f7aa7f05cadaaceffb2e91cb2c975460c591f538ded3d977f989e12"} err="failed to get container status \"46700f688f7aa7f05cadaaceffb2e91cb2c975460c591f538ded3d977f989e12\": rpc error: code = NotFound desc = could not find container \"46700f688f7aa7f05cadaaceffb2e91cb2c975460c591f538ded3d977f989e12\": container with ID starting with 46700f688f7aa7f05cadaaceffb2e91cb2c975460c591f538ded3d977f989e12 not found: ID does not exist"
Jul 15 14:36:30.734650 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.734595    2571 scope.go:117] "RemoveContainer" containerID="c570f56bddcae9243b46a4114f206745134e00f7acbbceb1636ea1f2d9209db4"
Jul 15 14:36:30.734786 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.734767    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c570f56bddcae9243b46a4114f206745134e00f7acbbceb1636ea1f2d9209db4"} err="failed to get container status \"c570f56bddcae9243b46a4114f206745134e00f7acbbceb1636ea1f2d9209db4\": rpc error: code = NotFound desc = could not find container \"c570f56bddcae9243b46a4114f206745134e00f7acbbceb1636ea1f2d9209db4\": container with ID starting with c570f56bddcae9243b46a4114f206745134e00f7acbbceb1636ea1f2d9209db4 not found: ID does not exist"
Jul 15 14:36:30.734833 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.734787    2571 scope.go:117] "RemoveContainer" containerID="0c687b067459dd59a6709a4794227569d3b45415e8a59f703df1bb92baf46b94"
Jul 15 14:36:30.734977 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.734956    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c687b067459dd59a6709a4794227569d3b45415e8a59f703df1bb92baf46b94"} err="failed to get container status \"0c687b067459dd59a6709a4794227569d3b45415e8a59f703df1bb92baf46b94\": rpc error: code = NotFound desc = could not find container \"0c687b067459dd59a6709a4794227569d3b45415e8a59f703df1bb92baf46b94\": container with ID starting with 0c687b067459dd59a6709a4794227569d3b45415e8a59f703df1bb92baf46b94 not found: ID does not exist"
Jul 15 14:36:30.735014 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.734978    2571 scope.go:117] "RemoveContainer" containerID="7c3d63d8023cc83a149c97bae5a89a5e12db4da27d3a5dd87a9c00e1d6652747"
Jul 15 14:36:30.735201 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.735183    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c3d63d8023cc83a149c97bae5a89a5e12db4da27d3a5dd87a9c00e1d6652747"} err="failed to get container status \"7c3d63d8023cc83a149c97bae5a89a5e12db4da27d3a5dd87a9c00e1d6652747\": rpc error: code = NotFound desc = could not find container \"7c3d63d8023cc83a149c97bae5a89a5e12db4da27d3a5dd87a9c00e1d6652747\": container with ID starting with 7c3d63d8023cc83a149c97bae5a89a5e12db4da27d3a5dd87a9c00e1d6652747 not found: ID does not exist"
Jul 15 14:36:30.735313 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.735204    2571 scope.go:117] "RemoveContainer" containerID="d6c75003442eb7cedac9b7360c016e883168f6df2e42495f5d0a5bb1d4c3dceb"
Jul 15 14:36:30.735413 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.735396    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6c75003442eb7cedac9b7360c016e883168f6df2e42495f5d0a5bb1d4c3dceb"} err="failed to get container status \"d6c75003442eb7cedac9b7360c016e883168f6df2e42495f5d0a5bb1d4c3dceb\": rpc error: code = NotFound desc = could not find container \"d6c75003442eb7cedac9b7360c016e883168f6df2e42495f5d0a5bb1d4c3dceb\": container with ID starting with d6c75003442eb7cedac9b7360c016e883168f6df2e42495f5d0a5bb1d4c3dceb not found: ID does not exist"
Jul 15 14:36:30.735460 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.735414    2571 scope.go:117] "RemoveContainer" containerID="4e91c2db974a94f165b27c986a9de8c19fed2992c4c427c8c78cc46f007ec193"
Jul 15 14:36:30.735631 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.735613    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e91c2db974a94f165b27c986a9de8c19fed2992c4c427c8c78cc46f007ec193"} err="failed to get container status \"4e91c2db974a94f165b27c986a9de8c19fed2992c4c427c8c78cc46f007ec193\": rpc error: code = NotFound desc = could not find container \"4e91c2db974a94f165b27c986a9de8c19fed2992c4c427c8c78cc46f007ec193\": container with ID starting with 4e91c2db974a94f165b27c986a9de8c19fed2992c4c427c8c78cc46f007ec193 not found: ID does not exist"
Jul 15 14:36:30.735696 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.735633    2571 scope.go:117] "RemoveContainer" containerID="c2dae48e4ddc3857b01b78d3f58ffcbe06486dedf0529a44a97fd27b8f9a4595"
Jul 15 14:36:30.735841 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.735825    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2dae48e4ddc3857b01b78d3f58ffcbe06486dedf0529a44a97fd27b8f9a4595"} err="failed to get container status \"c2dae48e4ddc3857b01b78d3f58ffcbe06486dedf0529a44a97fd27b8f9a4595\": rpc error: code = NotFound desc = could not find container \"c2dae48e4ddc3857b01b78d3f58ffcbe06486dedf0529a44a97fd27b8f9a4595\": container with ID starting with c2dae48e4ddc3857b01b78d3f58ffcbe06486dedf0529a44a97fd27b8f9a4595 not found: ID does not exist"
Jul 15 14:36:30.735885 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.735842    2571 scope.go:117] "RemoveContainer" containerID="46700f688f7aa7f05cadaaceffb2e91cb2c975460c591f538ded3d977f989e12"
Jul 15 14:36:30.736028 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.736012    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"46700f688f7aa7f05cadaaceffb2e91cb2c975460c591f538ded3d977f989e12"} err="failed to get container status \"46700f688f7aa7f05cadaaceffb2e91cb2c975460c591f538ded3d977f989e12\": rpc error: code = NotFound desc = could not find container \"46700f688f7aa7f05cadaaceffb2e91cb2c975460c591f538ded3d977f989e12\": container with ID starting with 46700f688f7aa7f05cadaaceffb2e91cb2c975460c591f538ded3d977f989e12 not found: ID does not exist"
Jul 15 14:36:30.736070 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.736029    2571 scope.go:117] "RemoveContainer" containerID="c570f56bddcae9243b46a4114f206745134e00f7acbbceb1636ea1f2d9209db4"
Jul 15 14:36:30.736231 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.736215    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c570f56bddcae9243b46a4114f206745134e00f7acbbceb1636ea1f2d9209db4"} err="failed to get container status \"c570f56bddcae9243b46a4114f206745134e00f7acbbceb1636ea1f2d9209db4\": rpc error: code = NotFound desc = could not find container \"c570f56bddcae9243b46a4114f206745134e00f7acbbceb1636ea1f2d9209db4\": container with ID starting with c570f56bddcae9243b46a4114f206745134e00f7acbbceb1636ea1f2d9209db4 not found: ID does not exist"
Jul 15 14:36:30.736317 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.736233    2571 scope.go:117] "RemoveContainer" containerID="0c687b067459dd59a6709a4794227569d3b45415e8a59f703df1bb92baf46b94"
Jul 15 14:36:30.736431 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.736415    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c687b067459dd59a6709a4794227569d3b45415e8a59f703df1bb92baf46b94"} err="failed to get container status \"0c687b067459dd59a6709a4794227569d3b45415e8a59f703df1bb92baf46b94\": rpc error: code = NotFound desc = could not find container \"0c687b067459dd59a6709a4794227569d3b45415e8a59f703df1bb92baf46b94\": container with ID starting with 0c687b067459dd59a6709a4794227569d3b45415e8a59f703df1bb92baf46b94 not found: ID does not exist"
Jul 15 14:36:30.736481 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.736431    2571 scope.go:117] "RemoveContainer" containerID="7c3d63d8023cc83a149c97bae5a89a5e12db4da27d3a5dd87a9c00e1d6652747"
Jul 15 14:36:30.736642 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.736625    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c3d63d8023cc83a149c97bae5a89a5e12db4da27d3a5dd87a9c00e1d6652747"} err="failed to get container status \"7c3d63d8023cc83a149c97bae5a89a5e12db4da27d3a5dd87a9c00e1d6652747\": rpc error: code = NotFound desc = could not find container \"7c3d63d8023cc83a149c97bae5a89a5e12db4da27d3a5dd87a9c00e1d6652747\": container with ID starting with 7c3d63d8023cc83a149c97bae5a89a5e12db4da27d3a5dd87a9c00e1d6652747 not found: ID does not exist"
Jul 15 14:36:30.752924 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.752905    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c368aa90-1525-412e-aadc-5b22c89fba2e" path="/var/lib/kubelet/pods/c368aa90-1525-412e-aadc-5b22c89fba2e/volumes"
Jul 15 14:36:30.753403 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.753391    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 14:36:30.753636 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.753626    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c368aa90-1525-412e-aadc-5b22c89fba2e" containerName="kube-rbac-proxy"
Jul 15 14:36:30.753668 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.753639    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c368aa90-1525-412e-aadc-5b22c89fba2e" containerName="kube-rbac-proxy"
Jul 15 14:36:30.753668 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.753650    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c368aa90-1525-412e-aadc-5b22c89fba2e" containerName="kube-rbac-proxy-web"
Jul 15 14:36:30.753668 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.753655    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c368aa90-1525-412e-aadc-5b22c89fba2e" containerName="kube-rbac-proxy-web"
Jul 15 14:36:30.753668 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.753666    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c368aa90-1525-412e-aadc-5b22c89fba2e" containerName="prometheus"
Jul 15 14:36:30.753823 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.753671    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c368aa90-1525-412e-aadc-5b22c89fba2e" containerName="prometheus"
Jul 15 14:36:30.753823 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.753677    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c368aa90-1525-412e-aadc-5b22c89fba2e" containerName="kube-rbac-proxy-thanos"
Jul 15 14:36:30.753823 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.753682    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c368aa90-1525-412e-aadc-5b22c89fba2e" containerName="kube-rbac-proxy-thanos"
Jul 15 14:36:30.753823 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.753688    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c368aa90-1525-412e-aadc-5b22c89fba2e" containerName="init-config-reloader"
Jul 15 14:36:30.753823 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.753693    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c368aa90-1525-412e-aadc-5b22c89fba2e" containerName="init-config-reloader"
Jul 15 14:36:30.753823 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.753698    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c368aa90-1525-412e-aadc-5b22c89fba2e" containerName="config-reloader"
Jul 15 14:36:30.753823 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.753703    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c368aa90-1525-412e-aadc-5b22c89fba2e" containerName="config-reloader"
Jul 15 14:36:30.753823 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.753711    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c632d732-9454-4773-bfae-ae68b1f0ac4d" containerName="registry"
Jul 15 14:36:30.753823 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.753715    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c632d732-9454-4773-bfae-ae68b1f0ac4d" containerName="registry"
Jul 15 14:36:30.753823 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.753724    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c368aa90-1525-412e-aadc-5b22c89fba2e" containerName="thanos-sidecar"
Jul 15 14:36:30.753823 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.753729    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c368aa90-1525-412e-aadc-5b22c89fba2e" containerName="thanos-sidecar"
Jul 15 14:36:30.753823 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.753772    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="c632d732-9454-4773-bfae-ae68b1f0ac4d" containerName="registry"
Jul 15 14:36:30.753823 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.753780    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="c368aa90-1525-412e-aadc-5b22c89fba2e" containerName="kube-rbac-proxy-web"
Jul 15 14:36:30.753823 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.753787    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="c368aa90-1525-412e-aadc-5b22c89fba2e" containerName="config-reloader"
Jul 15 14:36:30.753823 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.753793    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="c368aa90-1525-412e-aadc-5b22c89fba2e" containerName="kube-rbac-proxy-thanos"
Jul 15 14:36:30.753823 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.753797    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="c368aa90-1525-412e-aadc-5b22c89fba2e" containerName="prometheus"
Jul 15 14:36:30.753823 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.753802    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="c368aa90-1525-412e-aadc-5b22c89fba2e" containerName="thanos-sidecar"
Jul 15 14:36:30.753823 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.753807    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="c368aa90-1525-412e-aadc-5b22c89fba2e" containerName="kube-rbac-proxy"
Jul 15 14:36:30.758926 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.758911    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:36:30.762386 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.762370    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 15 14:36:30.762611 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.762596    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 15 14:36:30.762746 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.762708    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 15 14:36:30.762746 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.762721    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 15 14:36:30.762965 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.762791    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 15 14:36:30.762965 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.762816    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 15 14:36:30.762965 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.762959    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 15 14:36:30.763340 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.763292    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 15 14:36:30.763411 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.763294    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 15 14:36:30.763411 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.763366    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 15 14:36:30.763590 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.763573    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 15 14:36:30.763672 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.763647    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 15 14:36:30.763672 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.763656    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 15 14:36:30.764166 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.764148    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-cl5jt\""
Jul 15 14:36:30.764244 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.764221    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-3kfqjb44gcfvc\""
Jul 15 14:36:30.768400 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.768380    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 15 14:36:30.771443 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.771426    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 15 14:36:30.776758 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.776734    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 14:36:30.823162 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.823133    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/50c44957-5c6a-45e6-b3c2-4b92bc516948-config-out\") pod \"prometheus-k8s-0\" (UID: \"50c44957-5c6a-45e6-b3c2-4b92bc516948\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:36:30.823162 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.823161    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/50c44957-5c6a-45e6-b3c2-4b92bc516948-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"50c44957-5c6a-45e6-b3c2-4b92bc516948\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:36:30.823356 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.823187    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/50c44957-5c6a-45e6-b3c2-4b92bc516948-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"50c44957-5c6a-45e6-b3c2-4b92bc516948\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:36:30.823356 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.823204    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50c44957-5c6a-45e6-b3c2-4b92bc516948-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"50c44957-5c6a-45e6-b3c2-4b92bc516948\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:36:30.823356 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.823243    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/50c44957-5c6a-45e6-b3c2-4b92bc516948-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"50c44957-5c6a-45e6-b3c2-4b92bc516948\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:36:30.823356 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.823293    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/50c44957-5c6a-45e6-b3c2-4b92bc516948-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"50c44957-5c6a-45e6-b3c2-4b92bc516948\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:36:30.823356 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.823321    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50c44957-5c6a-45e6-b3c2-4b92bc516948-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"50c44957-5c6a-45e6-b3c2-4b92bc516948\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:36:30.823356 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.823350    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/50c44957-5c6a-45e6-b3c2-4b92bc516948-web-config\") pod \"prometheus-k8s-0\" (UID: \"50c44957-5c6a-45e6-b3c2-4b92bc516948\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:36:30.823527 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.823366    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gxbpd\" (UniqueName: \"kubernetes.io/projected/50c44957-5c6a-45e6-b3c2-4b92bc516948-kube-api-access-gxbpd\") pod \"prometheus-k8s-0\" (UID: \"50c44957-5c6a-45e6-b3c2-4b92bc516948\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:36:30.823527 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.823402    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/50c44957-5c6a-45e6-b3c2-4b92bc516948-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"50c44957-5c6a-45e6-b3c2-4b92bc516948\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:36:30.823527 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.823432    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/50c44957-5c6a-45e6-b3c2-4b92bc516948-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"50c44957-5c6a-45e6-b3c2-4b92bc516948\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:36:30.823527 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.823459    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/50c44957-5c6a-45e6-b3c2-4b92bc516948-config\") pod \"prometheus-k8s-0\" (UID: \"50c44957-5c6a-45e6-b3c2-4b92bc516948\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:36:30.823527 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.823488    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/50c44957-5c6a-45e6-b3c2-4b92bc516948-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"50c44957-5c6a-45e6-b3c2-4b92bc516948\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:36:30.823527 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.823504    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50c44957-5c6a-45e6-b3c2-4b92bc516948-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"50c44957-5c6a-45e6-b3c2-4b92bc516948\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:36:30.823527 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.823522    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/50c44957-5c6a-45e6-b3c2-4b92bc516948-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"50c44957-5c6a-45e6-b3c2-4b92bc516948\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:36:30.823737 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.823551    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/50c44957-5c6a-45e6-b3c2-4b92bc516948-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"50c44957-5c6a-45e6-b3c2-4b92bc516948\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:36:30.823737 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.823568    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50c44957-5c6a-45e6-b3c2-4b92bc516948-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"50c44957-5c6a-45e6-b3c2-4b92bc516948\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:36:30.823737 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.823581    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/50c44957-5c6a-45e6-b3c2-4b92bc516948-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"50c44957-5c6a-45e6-b3c2-4b92bc516948\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:36:30.823737 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.823608    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/50c44957-5c6a-45e6-b3c2-4b92bc516948-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"50c44957-5c6a-45e6-b3c2-4b92bc516948\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:36:30.823737 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.823631    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/50c44957-5c6a-45e6-b3c2-4b92bc516948-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"50c44957-5c6a-45e6-b3c2-4b92bc516948\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:36:30.924190 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.924154    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/50c44957-5c6a-45e6-b3c2-4b92bc516948-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"50c44957-5c6a-45e6-b3c2-4b92bc516948\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:36:30.924190 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.924192    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50c44957-5c6a-45e6-b3c2-4b92bc516948-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"50c44957-5c6a-45e6-b3c2-4b92bc516948\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:36:30.924490 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.924211    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/50c44957-5c6a-45e6-b3c2-4b92bc516948-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"50c44957-5c6a-45e6-b3c2-4b92bc516948\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:36:30.924490 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.924238    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/50c44957-5c6a-45e6-b3c2-4b92bc516948-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"50c44957-5c6a-45e6-b3c2-4b92bc516948\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:36:30.924490 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.924263    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/50c44957-5c6a-45e6-b3c2-4b92bc516948-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"50c44957-5c6a-45e6-b3c2-4b92bc516948\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:36:30.924490 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.924317    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/50c44957-5c6a-45e6-b3c2-4b92bc516948-config-out\") pod \"prometheus-k8s-0\" (UID: \"50c44957-5c6a-45e6-b3c2-4b92bc516948\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:36:30.924490 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.924343    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/50c44957-5c6a-45e6-b3c2-4b92bc516948-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"50c44957-5c6a-45e6-b3c2-4b92bc516948\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:36:30.924490 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.924469    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/50c44957-5c6a-45e6-b3c2-4b92bc516948-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"50c44957-5c6a-45e6-b3c2-4b92bc516948\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:36:30.924769 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.924509    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50c44957-5c6a-45e6-b3c2-4b92bc516948-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"50c44957-5c6a-45e6-b3c2-4b92bc516948\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:36:30.924769 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.924542    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/50c44957-5c6a-45e6-b3c2-4b92bc516948-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"50c44957-5c6a-45e6-b3c2-4b92bc516948\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:36:30.924769 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.924569    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/50c44957-5c6a-45e6-b3c2-4b92bc516948-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"50c44957-5c6a-45e6-b3c2-4b92bc516948\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:36:30.924769 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.924596    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50c44957-5c6a-45e6-b3c2-4b92bc516948-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"50c44957-5c6a-45e6-b3c2-4b92bc516948\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:36:30.924769 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.924628    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/50c44957-5c6a-45e6-b3c2-4b92bc516948-web-config\") pod \"prometheus-k8s-0\" (UID: \"50c44957-5c6a-45e6-b3c2-4b92bc516948\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:36:30.924769 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.924652    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gxbpd\" (UniqueName: \"kubernetes.io/projected/50c44957-5c6a-45e6-b3c2-4b92bc516948-kube-api-access-gxbpd\") pod \"prometheus-k8s-0\" (UID: \"50c44957-5c6a-45e6-b3c2-4b92bc516948\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:36:30.924769 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.924681    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/50c44957-5c6a-45e6-b3c2-4b92bc516948-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"50c44957-5c6a-45e6-b3c2-4b92bc516948\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:36:30.924769 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.924715    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/50c44957-5c6a-45e6-b3c2-4b92bc516948-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"50c44957-5c6a-45e6-b3c2-4b92bc516948\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:36:30.924769 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.924757    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/50c44957-5c6a-45e6-b3c2-4b92bc516948-config\") pod \"prometheus-k8s-0\" (UID: \"50c44957-5c6a-45e6-b3c2-4b92bc516948\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:36:30.925288 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.924801    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/50c44957-5c6a-45e6-b3c2-4b92bc516948-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"50c44957-5c6a-45e6-b3c2-4b92bc516948\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:36:30.925288 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.924824    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50c44957-5c6a-45e6-b3c2-4b92bc516948-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"50c44957-5c6a-45e6-b3c2-4b92bc516948\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:36:30.925288 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.924851    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/50c44957-5c6a-45e6-b3c2-4b92bc516948-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"50c44957-5c6a-45e6-b3c2-4b92bc516948\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:36:30.925288 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.924928    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/50c44957-5c6a-45e6-b3c2-4b92bc516948-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"50c44957-5c6a-45e6-b3c2-4b92bc516948\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:36:30.925288 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.925009    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50c44957-5c6a-45e6-b3c2-4b92bc516948-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"50c44957-5c6a-45e6-b3c2-4b92bc516948\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:36:30.925573 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.925550    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/50c44957-5c6a-45e6-b3c2-4b92bc516948-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"50c44957-5c6a-45e6-b3c2-4b92bc516948\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:36:30.925633 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.925581    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/50c44957-5c6a-45e6-b3c2-4b92bc516948-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"50c44957-5c6a-45e6-b3c2-4b92bc516948\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:36:30.926317 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.926290    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50c44957-5c6a-45e6-b3c2-4b92bc516948-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"50c44957-5c6a-45e6-b3c2-4b92bc516948\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:36:30.926564 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.926539    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/50c44957-5c6a-45e6-b3c2-4b92bc516948-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"50c44957-5c6a-45e6-b3c2-4b92bc516948\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:36:30.927373 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.927349    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/50c44957-5c6a-45e6-b3c2-4b92bc516948-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"50c44957-5c6a-45e6-b3c2-4b92bc516948\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:36:30.928051 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.928020    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/50c44957-5c6a-45e6-b3c2-4b92bc516948-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"50c44957-5c6a-45e6-b3c2-4b92bc516948\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:36:30.928134 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.928063    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/50c44957-5c6a-45e6-b3c2-4b92bc516948-config-out\") pod \"prometheus-k8s-0\" (UID: \"50c44957-5c6a-45e6-b3c2-4b92bc516948\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:36:30.928134 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.928066    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/50c44957-5c6a-45e6-b3c2-4b92bc516948-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"50c44957-5c6a-45e6-b3c2-4b92bc516948\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:36:30.928550 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.928529    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/50c44957-5c6a-45e6-b3c2-4b92bc516948-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"50c44957-5c6a-45e6-b3c2-4b92bc516948\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:36:30.928943 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.928917    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/50c44957-5c6a-45e6-b3c2-4b92bc516948-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"50c44957-5c6a-45e6-b3c2-4b92bc516948\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:36:30.929083 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.929057    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/50c44957-5c6a-45e6-b3c2-4b92bc516948-config\") pod \"prometheus-k8s-0\" (UID: \"50c44957-5c6a-45e6-b3c2-4b92bc516948\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:36:30.929163 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.929090    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/50c44957-5c6a-45e6-b3c2-4b92bc516948-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"50c44957-5c6a-45e6-b3c2-4b92bc516948\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:36:30.929347 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.929330    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/50c44957-5c6a-45e6-b3c2-4b92bc516948-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"50c44957-5c6a-45e6-b3c2-4b92bc516948\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:36:30.929745 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.929722    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/50c44957-5c6a-45e6-b3c2-4b92bc516948-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"50c44957-5c6a-45e6-b3c2-4b92bc516948\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:36:30.930085 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.930069    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/50c44957-5c6a-45e6-b3c2-4b92bc516948-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"50c44957-5c6a-45e6-b3c2-4b92bc516948\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:36:30.930147 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.930125    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/50c44957-5c6a-45e6-b3c2-4b92bc516948-web-config\") pod \"prometheus-k8s-0\" (UID: \"50c44957-5c6a-45e6-b3c2-4b92bc516948\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:36:30.930227 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.930211    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/50c44957-5c6a-45e6-b3c2-4b92bc516948-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"50c44957-5c6a-45e6-b3c2-4b92bc516948\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:36:30.937427 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:30.937412    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gxbpd\" (UniqueName: \"kubernetes.io/projected/50c44957-5c6a-45e6-b3c2-4b92bc516948-kube-api-access-gxbpd\") pod \"prometheus-k8s-0\" (UID: \"50c44957-5c6a-45e6-b3c2-4b92bc516948\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:36:31.068732 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:31.068711    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:36:31.217234 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:36:31.217205    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50c44957_5c6a_45e6_b3c2_4b92bc516948.slice/crio-af4069ba180ff52612d5d9bfcc191443c612beeabf4cd03498920f6433615a24 WatchSource:0}: Error finding container af4069ba180ff52612d5d9bfcc191443c612beeabf4cd03498920f6433615a24: Status 404 returned error can't find the container with id af4069ba180ff52612d5d9bfcc191443c612beeabf4cd03498920f6433615a24
Jul 15 14:36:31.219602 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:31.219580    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 14:36:31.679804 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:31.679772    2571 generic.go:356] "Generic (PLEG): container finished" podID="50c44957-5c6a-45e6-b3c2-4b92bc516948" containerID="7cda2a0c72eed75a3d2043f9effefb1ec8a104314cbe3be5315825d180e3224d" exitCode=0
Jul 15 14:36:31.679953 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:31.679860    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50c44957-5c6a-45e6-b3c2-4b92bc516948","Type":"ContainerDied","Data":"7cda2a0c72eed75a3d2043f9effefb1ec8a104314cbe3be5315825d180e3224d"}
Jul 15 14:36:31.679953 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:31.679924    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50c44957-5c6a-45e6-b3c2-4b92bc516948","Type":"ContainerStarted","Data":"af4069ba180ff52612d5d9bfcc191443c612beeabf4cd03498920f6433615a24"}
Jul 15 14:36:32.688512 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:32.688479    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50c44957-5c6a-45e6-b3c2-4b92bc516948","Type":"ContainerStarted","Data":"ac54f43e647eddf7e39a49542b2432b594d0fb17583095c36988f8b4233b710a"}
Jul 15 14:36:32.688857 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:32.688572    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50c44957-5c6a-45e6-b3c2-4b92bc516948","Type":"ContainerStarted","Data":"083b7f15f758e0eba9bf513bb08b10cca0b7329d90da1ffcfbc0fbacc28fbdfb"}
Jul 15 14:36:32.688857 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:32.688601    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50c44957-5c6a-45e6-b3c2-4b92bc516948","Type":"ContainerStarted","Data":"a2bb5fe870edb0b8888547e3d339bdbd916ae01dd8eab921f149741bfac4122c"}
Jul 15 14:36:32.688857 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:32.688639    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50c44957-5c6a-45e6-b3c2-4b92bc516948","Type":"ContainerStarted","Data":"bcd54e7f59a6963cb6d940e62dc3fa6e98518eb82b84fd08ed1bd291bafb5cca"}
Jul 15 14:36:32.688857 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:32.688667    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50c44957-5c6a-45e6-b3c2-4b92bc516948","Type":"ContainerStarted","Data":"668c82fe7f6dc2dab3fa62d4d4d472dec7d916a9802e8ade20114121bc5769c3"}
Jul 15 14:36:32.688857 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:32.688690    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"50c44957-5c6a-45e6-b3c2-4b92bc516948","Type":"ContainerStarted","Data":"86be0513a69725c1fc03c6f955df931a0dd0e0d7e8f15dcce10a7bbdd471deb8"}
Jul 15 14:36:32.724626 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:32.724578    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.701992078 podStartE2EDuration="2.724561891s" totalImagesPullingTime="0s" totalInitContainerRuntime="22.569813ms" isStatefulPod=false podCreationTimestamp="2026-07-15 14:36:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:36:32.723098992 +0000 UTC m=+176.238916875" watchObservedRunningTime="2026-07-15 14:36:32.724561891 +0000 UTC m=+176.240379761"
Jul 15 14:36:33.802993 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:33.802962    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:36:33.928357 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:33.928325    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:36:34.027537 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:34.027504    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:36:34.527837 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:34.527808    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:36:36.069863 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:36.069826    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:36:45.197083 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:45.197052    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:36:45.293217 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:45.293182    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:36:45.363392 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:36:45.363363    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:37:23.578063 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:37:23.578030    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:37:31.069341 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:37:31.069301    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:37:31.084521 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:37:31.084494    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:37:31.925884 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:37:31.925854    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 14:37:39.997584 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:37:39.997553    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:37:40.093189 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:37:40.093157    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:37:40.370220 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:37:40.370188    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:37:44.670183 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:37:44.670147    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:37:44.772388 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:37:44.772354    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:37:44.870442 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:37:44.870412    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:37:45.408454 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:37:45.408421    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:37:45.483212 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:37:45.483180    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:37:51.960402 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:37:51.960374    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:37:52.060895 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:37:52.060865    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:37:55.403106 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:37:55.403074    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:37:55.459845 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:37:55.459815    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:37:55.526651 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:37:55.526620    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:38:01.857002 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:38:01.856924    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:38:04.725324 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:38:04.725291    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:38:04.797364 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:38:04.797335    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:38:37.794743 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:38:37.794713    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-42mdh_0de0f3ad-e228-4c27-9b2c-de1a5844dcdb/console-operator/1.log"
Jul 15 14:38:37.796790 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:38:37.796768    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-42mdh_0de0f3ad-e228-4c27-9b2c-de1a5844dcdb/console-operator/1.log"
Jul 15 14:38:37.799374 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:38:37.799353    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8tt2_12bf26b1-5c4a-4e51-beb3-b17d7e7c4656/ovn-acl-logging/0.log"
Jul 15 14:38:37.801519 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:38:37.801500    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8tt2_12bf26b1-5c4a-4e51-beb3-b17d7e7c4656/ovn-acl-logging/0.log"
Jul 15 14:38:37.805338 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:38:37.805319    2571 kubelet.go:1648] "Image garbage collection succeeded"
Jul 15 14:38:44.667115 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:38:44.667082    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:38:46.459138 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:38:46.459081    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:39:11.844780 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:39:11.844747    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:39:12.245108 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:39:12.245020    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:39:15.866190 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:39:15.866153    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:39:15.973519 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:39:15.973490    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:39:17.848658 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:39:17.848622    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:39:17.939670 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:39:17.939634    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:39:20.237667 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:39:20.237640    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:39:20.730134 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:39:20.725897    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:39:22.505362 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:39:22.505328    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:39:22.583737 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:39:22.583703    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:39:28.443577 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:39:28.443547    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:39:29.859782 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:39:29.859748    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:39:30.549827 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:39:30.549774    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:39:30.795544 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:39:30.795516    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:39:30.900113 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:39:30.900076    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:39:36.394697 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:39:36.394660    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:39:36.485941 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:39:36.485908    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:39:38.573300 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:39:38.573251    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:39:53.246868 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:39:53.246833    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:39:53.354793 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:39:53.354761    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:39:53.888171 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:39:53.888138    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:39:54.081512 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:39:54.081476    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:39:54.181708 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:39:54.181633    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:39:54.294376 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:39:54.294341    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c6dcffcc7-hm86t"]
Jul 15 14:39:54.297646 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:39:54.297631    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6c6dcffcc7-hm86t"
Jul 15 14:39:54.309346 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:39:54.309326    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 15 14:39:54.309604 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:39:54.309580    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 15 14:39:54.309604 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:39:54.309601    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 15 14:39:54.310036 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:39:54.310021    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-vdrdb\""
Jul 15 14:39:54.310311 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:39:54.310287    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 15 14:39:54.327552 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:39:54.327523    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c6dcffcc7-hm86t"]
Jul 15 14:39:54.415038 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:39:54.415003    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8f934a9f-b3fe-460c-94e8-6807e3fd915c-manifests\") pod \"opendatahub-operator-controller-manager-6c6dcffcc7-hm86t\" (UID: \"8f934a9f-b3fe-460c-94e8-6807e3fd915c\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6dcffcc7-hm86t"
Jul 15 14:39:54.415204 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:39:54.415049    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8f934a9f-b3fe-460c-94e8-6807e3fd915c-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c6dcffcc7-hm86t\" (UID: \"8f934a9f-b3fe-460c-94e8-6807e3fd915c\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6dcffcc7-hm86t"
Jul 15 14:39:54.415204 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:39:54.415079    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8f934a9f-b3fe-460c-94e8-6807e3fd915c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c6dcffcc7-hm86t\" (UID: \"8f934a9f-b3fe-460c-94e8-6807e3fd915c\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6dcffcc7-hm86t"
Jul 15 14:39:54.415204 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:39:54.415146    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wnz8z\" (UniqueName: \"kubernetes.io/projected/8f934a9f-b3fe-460c-94e8-6807e3fd915c-kube-api-access-wnz8z\") pod \"opendatahub-operator-controller-manager-6c6dcffcc7-hm86t\" (UID: \"8f934a9f-b3fe-460c-94e8-6807e3fd915c\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6dcffcc7-hm86t"
Jul 15 14:39:54.415204 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:39:54.415195    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f934a9f-b3fe-460c-94e8-6807e3fd915c-tmp\") pod \"opendatahub-operator-controller-manager-6c6dcffcc7-hm86t\" (UID: \"8f934a9f-b3fe-460c-94e8-6807e3fd915c\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6dcffcc7-hm86t"
Jul 15 14:39:54.515664 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:39:54.515578    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8f934a9f-b3fe-460c-94e8-6807e3fd915c-manifests\") pod \"opendatahub-operator-controller-manager-6c6dcffcc7-hm86t\" (UID: \"8f934a9f-b3fe-460c-94e8-6807e3fd915c\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6dcffcc7-hm86t"
Jul 15 14:39:54.515664 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:39:54.515622    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8f934a9f-b3fe-460c-94e8-6807e3fd915c-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c6dcffcc7-hm86t\" (UID: \"8f934a9f-b3fe-460c-94e8-6807e3fd915c\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6dcffcc7-hm86t"
Jul 15 14:39:54.515664 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:39:54.515642    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8f934a9f-b3fe-460c-94e8-6807e3fd915c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c6dcffcc7-hm86t\" (UID: \"8f934a9f-b3fe-460c-94e8-6807e3fd915c\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6dcffcc7-hm86t"
Jul 15 14:39:54.515894 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:39:54.515675    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wnz8z\" (UniqueName: \"kubernetes.io/projected/8f934a9f-b3fe-460c-94e8-6807e3fd915c-kube-api-access-wnz8z\") pod \"opendatahub-operator-controller-manager-6c6dcffcc7-hm86t\" (UID: \"8f934a9f-b3fe-460c-94e8-6807e3fd915c\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6dcffcc7-hm86t"
Jul 15 14:39:54.515894 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:39:54.515722    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f934a9f-b3fe-460c-94e8-6807e3fd915c-tmp\") pod \"opendatahub-operator-controller-manager-6c6dcffcc7-hm86t\" (UID: \"8f934a9f-b3fe-460c-94e8-6807e3fd915c\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6dcffcc7-hm86t"
Jul 15 14:39:54.516052 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:39:54.516030    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/8f934a9f-b3fe-460c-94e8-6807e3fd915c-manifests\") pod \"opendatahub-operator-controller-manager-6c6dcffcc7-hm86t\" (UID: \"8f934a9f-b3fe-460c-94e8-6807e3fd915c\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6dcffcc7-hm86t"
Jul 15 14:39:54.517956 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:39:54.517927    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/8f934a9f-b3fe-460c-94e8-6807e3fd915c-tmp\") pod \"opendatahub-operator-controller-manager-6c6dcffcc7-hm86t\" (UID: \"8f934a9f-b3fe-460c-94e8-6807e3fd915c\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6dcffcc7-hm86t"
Jul 15 14:39:54.518183 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:39:54.518163    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/8f934a9f-b3fe-460c-94e8-6807e3fd915c-webhook-cert\") pod \"opendatahub-operator-controller-manager-6c6dcffcc7-hm86t\" (UID: \"8f934a9f-b3fe-460c-94e8-6807e3fd915c\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6dcffcc7-hm86t"
Jul 15 14:39:54.518296 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:39:54.518257    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/8f934a9f-b3fe-460c-94e8-6807e3fd915c-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6c6dcffcc7-hm86t\" (UID: \"8f934a9f-b3fe-460c-94e8-6807e3fd915c\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6dcffcc7-hm86t"
Jul 15 14:39:54.527353 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:39:54.527333    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wnz8z\" (UniqueName: \"kubernetes.io/projected/8f934a9f-b3fe-460c-94e8-6807e3fd915c-kube-api-access-wnz8z\") pod \"opendatahub-operator-controller-manager-6c6dcffcc7-hm86t\" (UID: \"8f934a9f-b3fe-460c-94e8-6807e3fd915c\") " pod="opendatahub/opendatahub-operator-controller-manager-6c6dcffcc7-hm86t"
Jul 15 14:39:54.581437 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:39:54.581405    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:39:54.607032 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:39:54.607004    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6c6dcffcc7-hm86t"
Jul 15 14:39:54.680681 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:39:54.680653    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:39:54.752140 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:39:54.752114    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f934a9f_b3fe_460c_94e8_6807e3fd915c.slice/crio-38f0be47e4ab4fac89485b82c4c1cc8150dc1b4dc705837a3254b908ece5629c WatchSource:0}: Error finding container 38f0be47e4ab4fac89485b82c4c1cc8150dc1b4dc705837a3254b908ece5629c: Status 404 returned error can't find the container with id 38f0be47e4ab4fac89485b82c4c1cc8150dc1b4dc705837a3254b908ece5629c
Jul 15 14:39:54.752614 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:39:54.752598    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6c6dcffcc7-hm86t"]
Jul 15 14:39:54.758490 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:39:54.758460    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 14:39:55.116399 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:39:55.116334    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:39:55.222439 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:39:55.222413    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:39:55.440625 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:39:55.440533    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c6dcffcc7-hm86t" event={"ID":"8f934a9f-b3fe-460c-94e8-6807e3fd915c","Type":"ContainerStarted","Data":"38f0be47e4ab4fac89485b82c4c1cc8150dc1b4dc705837a3254b908ece5629c"}
Jul 15 14:39:58.457154 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:39:58.457119    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c6dcffcc7-hm86t" event={"ID":"8f934a9f-b3fe-460c-94e8-6807e3fd915c","Type":"ContainerStarted","Data":"5951ada068bafce7e6f0578fca83633979af161680d5def6f0fac9588c87dfcc"}
Jul 15 14:39:59.462342 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:39:59.462309    2571 generic.go:356] "Generic (PLEG): container finished" podID="8f934a9f-b3fe-460c-94e8-6807e3fd915c" containerID="5951ada068bafce7e6f0578fca83633979af161680d5def6f0fac9588c87dfcc" exitCode=0
Jul 15 14:39:59.462737 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:39:59.462387    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c6dcffcc7-hm86t" event={"ID":"8f934a9f-b3fe-460c-94e8-6807e3fd915c","Type":"ContainerDied","Data":"5951ada068bafce7e6f0578fca83633979af161680d5def6f0fac9588c87dfcc"}
Jul 15 14:39:59.992258 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:39:59.992228    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:40:00.084207 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:00.084177    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:40:02.481434 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:02.481400    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6c6dcffcc7-hm86t" event={"ID":"8f934a9f-b3fe-460c-94e8-6807e3fd915c","Type":"ContainerStarted","Data":"0a9efc5761f74705f3df1a103ecdc4c52b6fc843a874ffd01814304920db51ce"}
Jul 15 14:40:02.481822 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:02.481496    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6c6dcffcc7-hm86t"
Jul 15 14:40:02.557092 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:02.557036    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6c6dcffcc7-hm86t" podStartSLOduration=2.725906165 podStartE2EDuration="8.55702042s" totalImagesPullingTime="4.788265177s" totalInitContainerRuntime="1.042849078s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:39:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:40:02.554587102 +0000 UTC m=+386.070404973" watchObservedRunningTime="2026-07-15 14:40:02.55702042 +0000 UTC m=+386.072838290"
Jul 15 14:40:04.845480 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:04.845454    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:40:04.950339 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:04.950296    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:40:05.088432 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:05.088399    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:40:05.213387 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:05.213301    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:40:11.191996 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:11.191960    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-68975544d6-qgxb9"]
Jul 15 14:40:11.200431 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:11.200405    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-68975544d6-qgxb9"
Jul 15 14:40:11.207913 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:11.207894    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 15 14:40:11.208014 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:11.207893    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 15 14:40:11.208014 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:11.207894    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-mz6sr\""
Jul 15 14:40:11.210413 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:11.210394    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 15 14:40:11.210549 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:11.210440    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 15 14:40:11.210648 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:11.210631    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 15 14:40:11.216876 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:11.216854    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-68975544d6-qgxb9"]
Jul 15 14:40:11.367498 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:11.367462    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fm5cd\" (UniqueName: \"kubernetes.io/projected/6cbc15b1-cedc-4513-a9eb-942459eb40c9-kube-api-access-fm5cd\") pod \"lws-controller-manager-68975544d6-qgxb9\" (UID: \"6cbc15b1-cedc-4513-a9eb-942459eb40c9\") " pod="openshift-lws-operator/lws-controller-manager-68975544d6-qgxb9"
Jul 15 14:40:11.367498 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:11.367502    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6cbc15b1-cedc-4513-a9eb-942459eb40c9-manager-config\") pod \"lws-controller-manager-68975544d6-qgxb9\" (UID: \"6cbc15b1-cedc-4513-a9eb-942459eb40c9\") " pod="openshift-lws-operator/lws-controller-manager-68975544d6-qgxb9"
Jul 15 14:40:11.367701 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:11.367554    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6cbc15b1-cedc-4513-a9eb-942459eb40c9-metrics-cert\") pod \"lws-controller-manager-68975544d6-qgxb9\" (UID: \"6cbc15b1-cedc-4513-a9eb-942459eb40c9\") " pod="openshift-lws-operator/lws-controller-manager-68975544d6-qgxb9"
Jul 15 14:40:11.367701 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:11.367590    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6cbc15b1-cedc-4513-a9eb-942459eb40c9-cert\") pod \"lws-controller-manager-68975544d6-qgxb9\" (UID: \"6cbc15b1-cedc-4513-a9eb-942459eb40c9\") " pod="openshift-lws-operator/lws-controller-manager-68975544d6-qgxb9"
Jul 15 14:40:11.468887 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:11.468799    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fm5cd\" (UniqueName: \"kubernetes.io/projected/6cbc15b1-cedc-4513-a9eb-942459eb40c9-kube-api-access-fm5cd\") pod \"lws-controller-manager-68975544d6-qgxb9\" (UID: \"6cbc15b1-cedc-4513-a9eb-942459eb40c9\") " pod="openshift-lws-operator/lws-controller-manager-68975544d6-qgxb9"
Jul 15 14:40:11.468887 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:11.468838    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6cbc15b1-cedc-4513-a9eb-942459eb40c9-manager-config\") pod \"lws-controller-manager-68975544d6-qgxb9\" (UID: \"6cbc15b1-cedc-4513-a9eb-942459eb40c9\") " pod="openshift-lws-operator/lws-controller-manager-68975544d6-qgxb9"
Jul 15 14:40:11.469059 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:11.468892    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6cbc15b1-cedc-4513-a9eb-942459eb40c9-metrics-cert\") pod \"lws-controller-manager-68975544d6-qgxb9\" (UID: \"6cbc15b1-cedc-4513-a9eb-942459eb40c9\") " pod="openshift-lws-operator/lws-controller-manager-68975544d6-qgxb9"
Jul 15 14:40:11.469059 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:11.468907    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6cbc15b1-cedc-4513-a9eb-942459eb40c9-cert\") pod \"lws-controller-manager-68975544d6-qgxb9\" (UID: \"6cbc15b1-cedc-4513-a9eb-942459eb40c9\") " pod="openshift-lws-operator/lws-controller-manager-68975544d6-qgxb9"
Jul 15 14:40:11.469598 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:11.469575    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/6cbc15b1-cedc-4513-a9eb-942459eb40c9-manager-config\") pod \"lws-controller-manager-68975544d6-qgxb9\" (UID: \"6cbc15b1-cedc-4513-a9eb-942459eb40c9\") " pod="openshift-lws-operator/lws-controller-manager-68975544d6-qgxb9"
Jul 15 14:40:11.471768 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:11.471734    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/6cbc15b1-cedc-4513-a9eb-942459eb40c9-metrics-cert\") pod \"lws-controller-manager-68975544d6-qgxb9\" (UID: \"6cbc15b1-cedc-4513-a9eb-942459eb40c9\") " pod="openshift-lws-operator/lws-controller-manager-68975544d6-qgxb9"
Jul 15 14:40:11.471936 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:11.471916    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/6cbc15b1-cedc-4513-a9eb-942459eb40c9-cert\") pod \"lws-controller-manager-68975544d6-qgxb9\" (UID: \"6cbc15b1-cedc-4513-a9eb-942459eb40c9\") " pod="openshift-lws-operator/lws-controller-manager-68975544d6-qgxb9"
Jul 15 14:40:11.480925 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:11.480896    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fm5cd\" (UniqueName: \"kubernetes.io/projected/6cbc15b1-cedc-4513-a9eb-942459eb40c9-kube-api-access-fm5cd\") pod \"lws-controller-manager-68975544d6-qgxb9\" (UID: \"6cbc15b1-cedc-4513-a9eb-942459eb40c9\") " pod="openshift-lws-operator/lws-controller-manager-68975544d6-qgxb9"
Jul 15 14:40:11.509796 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:11.509760    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-68975544d6-qgxb9"
Jul 15 14:40:11.656591 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:11.656555    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-68975544d6-qgxb9"]
Jul 15 14:40:11.662903 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:40:11.662876    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6cbc15b1_cedc_4513_a9eb_942459eb40c9.slice/crio-84b76b140dc62ed546ff2c647402f513cc526b57c148e42155d1e6b983241215 WatchSource:0}: Error finding container 84b76b140dc62ed546ff2c647402f513cc526b57c148e42155d1e6b983241215: Status 404 returned error can't find the container with id 84b76b140dc62ed546ff2c647402f513cc526b57c148e42155d1e6b983241215
Jul 15 14:40:12.523859 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:12.523824    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-68975544d6-qgxb9" event={"ID":"6cbc15b1-cedc-4513-a9eb-942459eb40c9","Type":"ContainerStarted","Data":"84b76b140dc62ed546ff2c647402f513cc526b57c148e42155d1e6b983241215"}
Jul 15 14:40:13.488087 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:13.488053    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6c6dcffcc7-hm86t"
Jul 15 14:40:15.518883 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:15.518842    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:40:15.645383 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:15.645348    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:40:16.303621 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:16.303587    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:40:16.396542 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:16.396509    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:40:16.495078 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:16.495055    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:40:16.544060 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:16.544020    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-68975544d6-qgxb9" event={"ID":"6cbc15b1-cedc-4513-a9eb-942459eb40c9","Type":"ContainerStarted","Data":"c7d3df07e5cca25c22b5007842300d620b6595dfb76ea84b91bbf6cd582cee47"}
Jul 15 14:40:16.544514 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:16.544163    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-68975544d6-qgxb9"
Jul 15 14:40:16.567387 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:16.567342    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-68975544d6-qgxb9" podStartSLOduration=0.787426102 podStartE2EDuration="5.567328782s" totalImagesPullingTime="4.77990268s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:40:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:40:16.566612344 +0000 UTC m=+400.082430215" watchObservedRunningTime="2026-07-15 14:40:16.567328782 +0000 UTC m=+400.083146651"
Jul 15 14:40:16.601037 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:16.601010    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:40:16.997379 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:16.997297    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:40:18.027911 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:18.027880    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:40:20.774970 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:20.774938    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:40:20.874323 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:20.874293    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:40:27.061960 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:27.061925    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:40:27.195356 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:27.195321    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-85d556468c-f6s4p"]
Jul 15 14:40:27.198768 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:27.198744    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-85d556468c-f6s4p"
Jul 15 14:40:27.203294 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:27.203261    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 15 14:40:27.204215 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:27.204195    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-ld2h7\""
Jul 15 14:40:27.205598 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:27.205577    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 15 14:40:27.209344 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:27.209325    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74c720bd-3a70-401d-9c15-8927f2783589-tls-certs\") pod \"kube-auth-proxy-85d556468c-f6s4p\" (UID: \"74c720bd-3a70-401d-9c15-8927f2783589\") " pod="openshift-ingress/kube-auth-proxy-85d556468c-f6s4p"
Jul 15 14:40:27.209437 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:27.209411    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j95v6\" (UniqueName: \"kubernetes.io/projected/74c720bd-3a70-401d-9c15-8927f2783589-kube-api-access-j95v6\") pod \"kube-auth-proxy-85d556468c-f6s4p\" (UID: \"74c720bd-3a70-401d-9c15-8927f2783589\") " pod="openshift-ingress/kube-auth-proxy-85d556468c-f6s4p"
Jul 15 14:40:27.209494 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:27.209455    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74c720bd-3a70-401d-9c15-8927f2783589-tmp\") pod \"kube-auth-proxy-85d556468c-f6s4p\" (UID: \"74c720bd-3a70-401d-9c15-8927f2783589\") " pod="openshift-ingress/kube-auth-proxy-85d556468c-f6s4p"
Jul 15 14:40:27.258601 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:27.258575    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-85d556468c-f6s4p"]
Jul 15 14:40:27.310603 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:27.310564    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j95v6\" (UniqueName: \"kubernetes.io/projected/74c720bd-3a70-401d-9c15-8927f2783589-kube-api-access-j95v6\") pod \"kube-auth-proxy-85d556468c-f6s4p\" (UID: \"74c720bd-3a70-401d-9c15-8927f2783589\") " pod="openshift-ingress/kube-auth-proxy-85d556468c-f6s4p"
Jul 15 14:40:27.310603 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:27.310613    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74c720bd-3a70-401d-9c15-8927f2783589-tmp\") pod \"kube-auth-proxy-85d556468c-f6s4p\" (UID: \"74c720bd-3a70-401d-9c15-8927f2783589\") " pod="openshift-ingress/kube-auth-proxy-85d556468c-f6s4p"
Jul 15 14:40:27.310787 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:27.310639    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74c720bd-3a70-401d-9c15-8927f2783589-tls-certs\") pod \"kube-auth-proxy-85d556468c-f6s4p\" (UID: \"74c720bd-3a70-401d-9c15-8927f2783589\") " pod="openshift-ingress/kube-auth-proxy-85d556468c-f6s4p"
Jul 15 14:40:27.312796 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:27.312736    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/74c720bd-3a70-401d-9c15-8927f2783589-tmp\") pod \"kube-auth-proxy-85d556468c-f6s4p\" (UID: \"74c720bd-3a70-401d-9c15-8927f2783589\") " pod="openshift-ingress/kube-auth-proxy-85d556468c-f6s4p"
Jul 15 14:40:27.313002 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:27.312981    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/74c720bd-3a70-401d-9c15-8927f2783589-tls-certs\") pod \"kube-auth-proxy-85d556468c-f6s4p\" (UID: \"74c720bd-3a70-401d-9c15-8927f2783589\") " pod="openshift-ingress/kube-auth-proxy-85d556468c-f6s4p"
Jul 15 14:40:27.329933 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:27.329908    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j95v6\" (UniqueName: \"kubernetes.io/projected/74c720bd-3a70-401d-9c15-8927f2783589-kube-api-access-j95v6\") pod \"kube-auth-proxy-85d556468c-f6s4p\" (UID: \"74c720bd-3a70-401d-9c15-8927f2783589\") " pod="openshift-ingress/kube-auth-proxy-85d556468c-f6s4p"
Jul 15 14:40:27.508292 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:27.508245    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-85d556468c-f6s4p"
Jul 15 14:40:27.550179 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:27.550151    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-68975544d6-qgxb9"
Jul 15 14:40:27.618914 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:27.618867    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:40:27.664152 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:27.664112    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-85d556468c-f6s4p"]
Jul 15 14:40:27.666763 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:40:27.666738    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod74c720bd_3a70_401d_9c15_8927f2783589.slice/crio-8562465619bfb3655df6abb13c610870b6ab916bf0bdaf468ba01d6e6965e437 WatchSource:0}: Error finding container 8562465619bfb3655df6abb13c610870b6ab916bf0bdaf468ba01d6e6965e437: Status 404 returned error can't find the container with id 8562465619bfb3655df6abb13c610870b6ab916bf0bdaf468ba01d6e6965e437
Jul 15 14:40:27.717777 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:27.717745    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:40:27.810311 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:27.810262    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:40:27.891193 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:27.891097    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:40:27.983163 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:27.983128    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:40:28.594507 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:28.594471    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-85d556468c-f6s4p" event={"ID":"74c720bd-3a70-401d-9c15-8927f2783589","Type":"ContainerStarted","Data":"8562465619bfb3655df6abb13c610870b6ab916bf0bdaf468ba01d6e6965e437"}
Jul 15 14:40:29.061245 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:29.061172    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:40:29.159022 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:29.158993    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:40:29.263777 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:29.263748    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:40:29.361969 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:29.361870    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:40:29.635666 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:29.635585    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:40:29.810526 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:29.810497    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:40:31.611183 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:31.611148    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-85d556468c-f6s4p" event={"ID":"74c720bd-3a70-401d-9c15-8927f2783589","Type":"ContainerStarted","Data":"031e746def5fe3109a7d8c7c8a296eb5d851f5067ec1fbc7375a7bae5d486eff"}
Jul 15 14:40:31.646476 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:31.646421    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-85d556468c-f6s4p" podStartSLOduration=1.770493325 podStartE2EDuration="4.646406525s" totalImagesPullingTime="2.8759132s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:40:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:40:31.646017243 +0000 UTC m=+415.161835113" watchObservedRunningTime="2026-07-15 14:40:31.646406525 +0000 UTC m=+415.162224396"
Jul 15 14:40:31.882832 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:31.882737    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:40:34.137949 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:34.137911    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:40:34.245380 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:34.245334    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:40:34.907259 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:34.907229    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:40:35.031813 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:35.031779    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:40:36.458815 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:36.458785    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:40:36.559841 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:40:36.559806    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:41:17.153809 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:41:17.153714    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:41:17.282179 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:41:17.282147    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:41:17.438671 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:41:17.438568    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:41:18.160744 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:41:18.160709    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:41:18.358379 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:41:18.358344    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:41:39.651910 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:41:39.651876    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:41:39.749902 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:41:39.749875    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:41:47.413059 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:41:47.413020    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:41:50.635144 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:41:50.635106    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:41:50.738106 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:41:50.738060    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:41:51.072317 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:41:51.072287    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:41:51.521523 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:41:51.521443    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:41:53.739578 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:41:53.739544    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-jqk86"]
Jul 15 14:41:53.742883 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:41:53.742865    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jqk86"
Jul 15 14:41:53.746352 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:41:53.746329    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 15 14:41:53.746662 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:41:53.746644    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 15 14:41:53.747511 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:41:53.747497    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-ss2f5\""
Jul 15 14:41:53.747605 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:41:53.747588    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 15 14:41:53.767023 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:41:53.766982    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-jqk86"]
Jul 15 14:41:53.838588 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:41:53.838555    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-84zm2\" (UniqueName: \"kubernetes.io/projected/ec684fc0-49ba-4242-809c-604f814d226e-kube-api-access-84zm2\") pod \"dns-operator-controller-manager-864dd78c4c-jqk86\" (UID: \"ec684fc0-49ba-4242-809c-604f814d226e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jqk86"
Jul 15 14:41:53.940013 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:41:53.939967    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-84zm2\" (UniqueName: \"kubernetes.io/projected/ec684fc0-49ba-4242-809c-604f814d226e-kube-api-access-84zm2\") pod \"dns-operator-controller-manager-864dd78c4c-jqk86\" (UID: \"ec684fc0-49ba-4242-809c-604f814d226e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jqk86"
Jul 15 14:41:53.953963 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:41:53.953927    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-84zm2\" (UniqueName: \"kubernetes.io/projected/ec684fc0-49ba-4242-809c-604f814d226e-kube-api-access-84zm2\") pod \"dns-operator-controller-manager-864dd78c4c-jqk86\" (UID: \"ec684fc0-49ba-4242-809c-604f814d226e\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jqk86"
Jul 15 14:41:54.053050 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:41:54.052958    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jqk86"
Jul 15 14:41:54.204299 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:41:54.204252    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-jqk86"]
Jul 15 14:41:54.205894 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:41:54.205858    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podec684fc0_49ba_4242_809c_604f814d226e.slice/crio-b7be023f7d83e1c64fb72fb19c7adf7671b71b501c9dc5104b3d5f7e511d43f6 WatchSource:0}: Error finding container b7be023f7d83e1c64fb72fb19c7adf7671b71b501c9dc5104b3d5f7e511d43f6: Status 404 returned error can't find the container with id b7be023f7d83e1c64fb72fb19c7adf7671b71b501c9dc5104b3d5f7e511d43f6
Jul 15 14:41:54.336431 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:41:54.336396    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:41:54.970039 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:41:54.970003    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jqk86" event={"ID":"ec684fc0-49ba-4242-809c-604f814d226e","Type":"ContainerStarted","Data":"b7be023f7d83e1c64fb72fb19c7adf7671b71b501c9dc5104b3d5f7e511d43f6"}
Jul 15 14:41:55.379434 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:41:55.379403    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:41:56.980311 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:41:56.980259    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jqk86" event={"ID":"ec684fc0-49ba-4242-809c-604f814d226e","Type":"ContainerStarted","Data":"cd8409176ad026dd0701fe7a085aa318cba589065f8f61ef4a78285b72e67b2e"}
Jul 15 14:41:56.980737 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:41:56.980447    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jqk86"
Jul 15 14:41:57.008417 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:41:57.008363    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jqk86" podStartSLOduration=1.7082490049999999 podStartE2EDuration="4.008346782s" totalImagesPullingTime="2.300097777s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:41:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:41:57.004545886 +0000 UTC m=+500.520363757" watchObservedRunningTime="2026-07-15 14:41:57.008346782 +0000 UTC m=+500.524164653"
Jul 15 14:41:57.741409 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:41:57.741376    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:41:59.002331 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:41:59.002298    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:41:59.317586 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:41:59.317552    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:42:00.314961 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:00.314932    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:42:06.109724 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:06.109689    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:42:06.217391 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:06.217364    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:42:07.986864 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:07.986837    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-jqk86"
Jul 15 14:42:09.223609 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:09.223567    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:42:09.314060 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:09.314024    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:42:11.114219 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:11.114181    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:42:11.125882 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:11.125855    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-zdmzl"]
Jul 15 14:42:11.129242 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:11.129222    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zdmzl"
Jul 15 14:42:11.134818 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:11.134799    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"plugin-serving-cert\""
Jul 15 14:42:11.135528 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:11.135375    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-hxgsr\""
Jul 15 14:42:11.135528 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:11.135413    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kuadrant-console-nginx-conf\""
Jul 15 14:42:11.156081 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:11.156051    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-zdmzl"]
Jul 15 14:42:11.286570 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:11.286530    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jxdb\" (UniqueName: \"kubernetes.io/projected/96e93437-f9c3-4102-9673-efebb4c4cdae-kube-api-access-5jxdb\") pod \"kuadrant-console-plugin-66b5774985-zdmzl\" (UID: \"96e93437-f9c3-4102-9673-efebb4c4cdae\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zdmzl"
Jul 15 14:42:11.286570 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:11.286575    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/96e93437-f9c3-4102-9673-efebb4c4cdae-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-zdmzl\" (UID: \"96e93437-f9c3-4102-9673-efebb4c4cdae\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zdmzl"
Jul 15 14:42:11.286779 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:11.286597    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/96e93437-f9c3-4102-9673-efebb4c4cdae-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-zdmzl\" (UID: \"96e93437-f9c3-4102-9673-efebb4c4cdae\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zdmzl"
Jul 15 14:42:11.347844 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:11.347813    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:42:11.387803 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:11.387721    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jxdb\" (UniqueName: \"kubernetes.io/projected/96e93437-f9c3-4102-9673-efebb4c4cdae-kube-api-access-5jxdb\") pod \"kuadrant-console-plugin-66b5774985-zdmzl\" (UID: \"96e93437-f9c3-4102-9673-efebb4c4cdae\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zdmzl"
Jul 15 14:42:11.387803 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:11.387761    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/96e93437-f9c3-4102-9673-efebb4c4cdae-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-zdmzl\" (UID: \"96e93437-f9c3-4102-9673-efebb4c4cdae\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zdmzl"
Jul 15 14:42:11.387803 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:11.387780    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/96e93437-f9c3-4102-9673-efebb4c4cdae-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-zdmzl\" (UID: \"96e93437-f9c3-4102-9673-efebb4c4cdae\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zdmzl"
Jul 15 14:42:11.388414 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:11.388394    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/96e93437-f9c3-4102-9673-efebb4c4cdae-nginx-conf\") pod \"kuadrant-console-plugin-66b5774985-zdmzl\" (UID: \"96e93437-f9c3-4102-9673-efebb4c4cdae\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zdmzl"
Jul 15 14:42:11.390080 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:11.390055    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugin-serving-cert\" (UniqueName: \"kubernetes.io/secret/96e93437-f9c3-4102-9673-efebb4c4cdae-plugin-serving-cert\") pod \"kuadrant-console-plugin-66b5774985-zdmzl\" (UID: \"96e93437-f9c3-4102-9673-efebb4c4cdae\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zdmzl"
Jul 15 14:42:11.396941 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:11.396917    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jxdb\" (UniqueName: \"kubernetes.io/projected/96e93437-f9c3-4102-9673-efebb4c4cdae-kube-api-access-5jxdb\") pod \"kuadrant-console-plugin-66b5774985-zdmzl\" (UID: \"96e93437-f9c3-4102-9673-efebb4c4cdae\") " pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zdmzl"
Jul 15 14:42:11.451903 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:11.451873    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zdmzl"
Jul 15 14:42:11.586639 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:11.586602    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-console-plugin-66b5774985-zdmzl"]
Jul 15 14:42:12.052989 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:12.052944    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zdmzl" event={"ID":"96e93437-f9c3-4102-9673-efebb4c4cdae","Type":"ContainerStarted","Data":"d87d52efaa74df933c556c314b1e25ce37a2afff45febee63dfed0b6fc726327"}
Jul 15 14:42:13.477699 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:13.477668    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:42:13.714903 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:13.714863    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:42:13.771874 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:13.771783    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:42:20.642542 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:20.642502    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rtwkx"]
Jul 15 14:42:20.684667 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:20.684632    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rtwkx"]
Jul 15 14:42:20.684833 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:20.684781    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rtwkx"
Jul 15 14:42:20.692294 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:20.692218    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-7wm4v\""
Jul 15 14:42:20.774691 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:20.774659    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c42ed9d9-c4e3-4f52-b0bb-78142ffeb845-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-rtwkx\" (UID: \"c42ed9d9-c4e3-4f52-b0bb-78142ffeb845\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rtwkx"
Jul 15 14:42:20.774867 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:20.774725    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9zxqp\" (UniqueName: \"kubernetes.io/projected/c42ed9d9-c4e3-4f52-b0bb-78142ffeb845-kube-api-access-9zxqp\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-rtwkx\" (UID: \"c42ed9d9-c4e3-4f52-b0bb-78142ffeb845\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rtwkx"
Jul 15 14:42:20.875442 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:20.875404    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c42ed9d9-c4e3-4f52-b0bb-78142ffeb845-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-rtwkx\" (UID: \"c42ed9d9-c4e3-4f52-b0bb-78142ffeb845\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rtwkx"
Jul 15 14:42:20.875628 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:20.875481    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9zxqp\" (UniqueName: \"kubernetes.io/projected/c42ed9d9-c4e3-4f52-b0bb-78142ffeb845-kube-api-access-9zxqp\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-rtwkx\" (UID: \"c42ed9d9-c4e3-4f52-b0bb-78142ffeb845\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rtwkx"
Jul 15 14:42:20.875875 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:20.875854    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c42ed9d9-c4e3-4f52-b0bb-78142ffeb845-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-rtwkx\" (UID: \"c42ed9d9-c4e3-4f52-b0bb-78142ffeb845\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rtwkx"
Jul 15 14:42:20.904872 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:20.904795    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9zxqp\" (UniqueName: \"kubernetes.io/projected/c42ed9d9-c4e3-4f52-b0bb-78142ffeb845-kube-api-access-9zxqp\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-rtwkx\" (UID: \"c42ed9d9-c4e3-4f52-b0bb-78142ffeb845\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rtwkx"
Jul 15 14:42:20.998166 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:20.998130    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rtwkx"
Jul 15 14:42:21.622563 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:21.622525    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rtwkx"]
Jul 15 14:42:21.632809 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:21.632777    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rtwkx"]
Jul 15 14:42:21.698878 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:21.698813    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xkmwj"]
Jul 15 14:42:21.724610 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:21.724565    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xkmwj"]
Jul 15 14:42:21.724787 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:21.724677    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xkmwj"
Jul 15 14:42:21.784617 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:21.784575    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8ae7e8a-8169-4c4d-b932-dc2c967ca68e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xkmwj\" (UID: \"c8ae7e8a-8169-4c4d-b932-dc2c967ca68e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xkmwj"
Jul 15 14:42:21.784786 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:21.784624    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5ljjs\" (UniqueName: \"kubernetes.io/projected/c8ae7e8a-8169-4c4d-b932-dc2c967ca68e-kube-api-access-5ljjs\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xkmwj\" (UID: \"c8ae7e8a-8169-4c4d-b932-dc2c967ca68e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xkmwj"
Jul 15 14:42:21.886154 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:21.886064    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8ae7e8a-8169-4c4d-b932-dc2c967ca68e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xkmwj\" (UID: \"c8ae7e8a-8169-4c4d-b932-dc2c967ca68e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xkmwj"
Jul 15 14:42:21.886154 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:21.886111    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5ljjs\" (UniqueName: \"kubernetes.io/projected/c8ae7e8a-8169-4c4d-b932-dc2c967ca68e-kube-api-access-5ljjs\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xkmwj\" (UID: \"c8ae7e8a-8169-4c4d-b932-dc2c967ca68e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xkmwj"
Jul 15 14:42:21.886563 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:21.886535    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8ae7e8a-8169-4c4d-b932-dc2c967ca68e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xkmwj\" (UID: \"c8ae7e8a-8169-4c4d-b932-dc2c967ca68e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xkmwj"
Jul 15 14:42:21.905330 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:21.905297    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5ljjs\" (UniqueName: \"kubernetes.io/projected/c8ae7e8a-8169-4c4d-b932-dc2c967ca68e-kube-api-access-5ljjs\") pod \"kuadrant-operator-controller-manager-8684c9ff49-xkmwj\" (UID: \"c8ae7e8a-8169-4c4d-b932-dc2c967ca68e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xkmwj"
Jul 15 14:42:22.039172 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:22.038384    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xkmwj"
Jul 15 14:42:23.193997 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:23.193955    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:42:23.294392 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:23.294353    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:42:23.530736 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:23.530659    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:42:23.630688 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:23.630624    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:42:23.974567 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:23.974532    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:42:24.094555 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:24.094511    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:42:28.123903 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:28.123869    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:42:28.225526 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:28.225495    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:42:29.738170 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:29.738090    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:42:30.837548 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:30.837495    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:42:33.563736 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:33.563702    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xkmwj"]
Jul 15 14:42:34.627395 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:34.627371    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xkmwj"]
Jul 15 14:42:34.628668 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:42:34.628636    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8ae7e8a_8169_4c4d_b932_dc2c967ca68e.slice/crio-409dfd0c66e13917739cf0b065ed65c0e0ddbd44c7dd16c8e5fa932fba8a586a WatchSource:0}: Error finding container 409dfd0c66e13917739cf0b065ed65c0e0ddbd44c7dd16c8e5fa932fba8a586a: Status 404 returned error can't find the container with id 409dfd0c66e13917739cf0b065ed65c0e0ddbd44c7dd16c8e5fa932fba8a586a
Jul 15 14:42:34.969059 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:34.969030    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:42:35.069773 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:35.069737    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:42:35.176350 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:35.176307    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zdmzl" event={"ID":"96e93437-f9c3-4102-9673-efebb4c4cdae","Type":"ContainerStarted","Data":"6848c06ae1e8c6d07a92ae32023524aedd2c60c8e69006dc13ebd7ec27247e11"}
Jul 15 14:42:35.177784 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:35.177754    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xkmwj" event={"ID":"c8ae7e8a-8169-4c4d-b932-dc2c967ca68e","Type":"ContainerStarted","Data":"409dfd0c66e13917739cf0b065ed65c0e0ddbd44c7dd16c8e5fa932fba8a586a"}
Jul 15 14:42:35.201620 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:35.201574    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-console-plugin-66b5774985-zdmzl" podStartSLOduration=1.278582978 podStartE2EDuration="24.201559112s" totalImagesPullingTime="22.922976134s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:42:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:42:35.200970883 +0000 UTC m=+538.716788778" watchObservedRunningTime="2026-07-15 14:42:35.201559112 +0000 UTC m=+538.717376997"
Jul 15 14:42:36.998145 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:42:36.998100    2571 log.go:32] "RunPodSandbox from runtime service failed" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-6fb7879bc9-rtwkx_kuadrant-system_c42ed9d9-c4e3-4f52-b0bb-78142ffeb845_0(2a0c731f678b36dd795f76bdad2961478df652e74d6b5da929ed9b4ec52f3c16): error adding pod kuadrant-system_kuadrant-operator-controller-manager-6fb7879bc9-rtwkx to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}"
Jul 15 14:42:36.998495 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:42:36.998169    2571 kuberuntime_sandbox.go:71] "Failed to create sandbox for pod" err="rpc error: code = Unknown desc = failed to create pod network sandbox k8s_kuadrant-operator-controller-manager-6fb7879bc9-rtwkx_kuadrant-system_c42ed9d9-c4e3-4f52-b0bb-78142ffeb845_0(2a0c731f678b36dd795f76bdad2961478df652e74d6b5da929ed9b4ec52f3c16): error adding pod kuadrant-system_kuadrant-operator-controller-manager-6fb7879bc9-rtwkx to CNI network \"multus-cni-network\": plugin type=\"multus-shim\" name=\"multus-cni-network\" failed (add): CmdAdd (shim): failed to send CNI request: Post \"http://dummy/cni\": EOF: StdinData: {\"auxiliaryCNIChainName\":\"vendor-cni-chain\",\"binDir\":\"/var/lib/cni/bin\",\"clusterNetwork\":\"/host/run/multus/cni/net.d/10-ovn-kubernetes.conf\",\"cniVersion\":\"0.3.1\",\"daemonSocketDir\":\"/run/multus/socket\",\"globalNamespaces\":\"default,openshift-multus,openshift-sriov-network-operator,openshift-cnv\",\"logLevel\":\"verbose\",\"logToStderr\":true,\"name\":\"multus-cni-network\",\"namespaceIsolation\":true,\"type\":\"multus-shim\"}" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rtwkx"
Jul 15 14:42:37.187637 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:37.187600    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rtwkx"
Jul 15 14:42:37.190542 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:42:37.190508    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-rtwkx\" is forbidden: User \"system:node:ip-10-0-140-61.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-61.ec2.internal' and this object" podUID="c42ed9d9-c4e3-4f52-b0bb-78142ffeb845" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rtwkx"
Jul 15 14:42:37.195257 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:37.195234    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rtwkx"
Jul 15 14:42:37.197854 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:42:37.197819    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-rtwkx\" is forbidden: User \"system:node:ip-10-0-140-61.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-61.ec2.internal' and this object" podUID="c42ed9d9-c4e3-4f52-b0bb-78142ffeb845" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rtwkx"
Jul 15 14:42:37.342468 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:37.342427    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9zxqp\" (UniqueName: \"kubernetes.io/projected/c42ed9d9-c4e3-4f52-b0bb-78142ffeb845-kube-api-access-9zxqp\") pod \"c42ed9d9-c4e3-4f52-b0bb-78142ffeb845\" (UID: \"c42ed9d9-c4e3-4f52-b0bb-78142ffeb845\") "
Jul 15 14:42:37.342662 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:37.342502    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c42ed9d9-c4e3-4f52-b0bb-78142ffeb845-extensions-socket-volume\") pod \"c42ed9d9-c4e3-4f52-b0bb-78142ffeb845\" (UID: \"c42ed9d9-c4e3-4f52-b0bb-78142ffeb845\") "
Jul 15 14:42:37.342962 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:37.342937    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c42ed9d9-c4e3-4f52-b0bb-78142ffeb845-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c42ed9d9-c4e3-4f52-b0bb-78142ffeb845" (UID: "c42ed9d9-c4e3-4f52-b0bb-78142ffeb845"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 14:42:37.344728 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:37.344704    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c42ed9d9-c4e3-4f52-b0bb-78142ffeb845-kube-api-access-9zxqp" (OuterVolumeSpecName: "kube-api-access-9zxqp") pod "c42ed9d9-c4e3-4f52-b0bb-78142ffeb845" (UID: "c42ed9d9-c4e3-4f52-b0bb-78142ffeb845"). InnerVolumeSpecName "kube-api-access-9zxqp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 14:42:37.443485 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:37.443441    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9zxqp\" (UniqueName: \"kubernetes.io/projected/c42ed9d9-c4e3-4f52-b0bb-78142ffeb845-kube-api-access-9zxqp\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 14:42:37.443485 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:37.443477    2571 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c42ed9d9-c4e3-4f52-b0bb-78142ffeb845-extensions-socket-volume\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 14:42:38.192893 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:38.192859    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rtwkx"
Jul 15 14:42:38.196051 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:42:38.196013    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-rtwkx\" is forbidden: User \"system:node:ip-10-0-140-61.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-61.ec2.internal' and this object" podUID="c42ed9d9-c4e3-4f52-b0bb-78142ffeb845" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rtwkx"
Jul 15 14:42:38.204232 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:42:38.204200    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-rtwkx\" is forbidden: User \"system:node:ip-10-0-140-61.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-61.ec2.internal' and this object" podUID="c42ed9d9-c4e3-4f52-b0bb-78142ffeb845" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rtwkx"
Jul 15 14:42:38.755098 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:38.755062    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c42ed9d9-c4e3-4f52-b0bb-78142ffeb845" path="/var/lib/kubelet/pods/c42ed9d9-c4e3-4f52-b0bb-78142ffeb845/volumes"
Jul 15 14:42:38.760526 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:42:38.760485    2571 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-rtwkx\" is forbidden: User \"system:node:ip-10-0-140-61.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-61.ec2.internal' and this object" podUID="c42ed9d9-c4e3-4f52-b0bb-78142ffeb845" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-rtwkx"
Jul 15 14:42:39.530247 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:39.530203    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:42:39.631542 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:39.631500    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:42:40.204857 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:40.204823    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xkmwj" event={"ID":"c8ae7e8a-8169-4c4d-b932-dc2c967ca68e","Type":"ContainerStarted","Data":"39fdb46d6d1b5dc9d12e0808fe2934b1befd0ce8f1bc80a57280e69da80a108d"}
Jul 15 14:42:40.205042 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:40.204880    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xkmwj" podUID="c8ae7e8a-8169-4c4d-b932-dc2c967ca68e" containerName="manager" containerID="cri-o://39fdb46d6d1b5dc9d12e0808fe2934b1befd0ce8f1bc80a57280e69da80a108d" gracePeriod=10
Jul 15 14:42:40.205042 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:40.204943    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xkmwj"
Jul 15 14:42:40.238693 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:40.238640    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xkmwj" podStartSLOduration=14.465086831 podStartE2EDuration="19.238622947s" totalImagesPullingTime="4.773536116s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:42:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:42:40.238120522 +0000 UTC m=+543.753938389" watchObservedRunningTime="2026-07-15 14:42:40.238622947 +0000 UTC m=+543.754440818"
Jul 15 14:42:40.951885 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:40.951860    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xkmwj"
Jul 15 14:42:41.074607 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:41.074523    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5ljjs\" (UniqueName: \"kubernetes.io/projected/c8ae7e8a-8169-4c4d-b932-dc2c967ca68e-kube-api-access-5ljjs\") pod \"c8ae7e8a-8169-4c4d-b932-dc2c967ca68e\" (UID: \"c8ae7e8a-8169-4c4d-b932-dc2c967ca68e\") "
Jul 15 14:42:41.074607 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:41.074579    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8ae7e8a-8169-4c4d-b932-dc2c967ca68e-extensions-socket-volume\") pod \"c8ae7e8a-8169-4c4d-b932-dc2c967ca68e\" (UID: \"c8ae7e8a-8169-4c4d-b932-dc2c967ca68e\") "
Jul 15 14:42:41.075021 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:41.074986    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c8ae7e8a-8169-4c4d-b932-dc2c967ca68e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "c8ae7e8a-8169-4c4d-b932-dc2c967ca68e" (UID: "c8ae7e8a-8169-4c4d-b932-dc2c967ca68e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 14:42:41.076577 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:41.076543    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8ae7e8a-8169-4c4d-b932-dc2c967ca68e-kube-api-access-5ljjs" (OuterVolumeSpecName: "kube-api-access-5ljjs") pod "c8ae7e8a-8169-4c4d-b932-dc2c967ca68e" (UID: "c8ae7e8a-8169-4c4d-b932-dc2c967ca68e"). InnerVolumeSpecName "kube-api-access-5ljjs". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 14:42:41.175434 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:41.175397    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5ljjs\" (UniqueName: \"kubernetes.io/projected/c8ae7e8a-8169-4c4d-b932-dc2c967ca68e-kube-api-access-5ljjs\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 14:42:41.175434 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:41.175427    2571 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/c8ae7e8a-8169-4c4d-b932-dc2c967ca68e-extensions-socket-volume\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 14:42:41.210357 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:41.210321    2571 generic.go:356] "Generic (PLEG): container finished" podID="c8ae7e8a-8169-4c4d-b932-dc2c967ca68e" containerID="39fdb46d6d1b5dc9d12e0808fe2934b1befd0ce8f1bc80a57280e69da80a108d" exitCode=0
Jul 15 14:42:41.210520 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:41.210367    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xkmwj"
Jul 15 14:42:41.210520 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:41.210370    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xkmwj" event={"ID":"c8ae7e8a-8169-4c4d-b932-dc2c967ca68e","Type":"ContainerDied","Data":"39fdb46d6d1b5dc9d12e0808fe2934b1befd0ce8f1bc80a57280e69da80a108d"}
Jul 15 14:42:41.210520 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:41.210422    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xkmwj" event={"ID":"c8ae7e8a-8169-4c4d-b932-dc2c967ca68e","Type":"ContainerDied","Data":"409dfd0c66e13917739cf0b065ed65c0e0ddbd44c7dd16c8e5fa932fba8a586a"}
Jul 15 14:42:41.210520 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:41.210451    2571 scope.go:117] "RemoveContainer" containerID="39fdb46d6d1b5dc9d12e0808fe2934b1befd0ce8f1bc80a57280e69da80a108d"
Jul 15 14:42:41.219405 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:41.219385    2571 scope.go:117] "RemoveContainer" containerID="39fdb46d6d1b5dc9d12e0808fe2934b1befd0ce8f1bc80a57280e69da80a108d"
Jul 15 14:42:41.219690 ip-10-0-140-61 kubenswrapper[2571]: E0715 14:42:41.219664    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39fdb46d6d1b5dc9d12e0808fe2934b1befd0ce8f1bc80a57280e69da80a108d\": container with ID starting with 39fdb46d6d1b5dc9d12e0808fe2934b1befd0ce8f1bc80a57280e69da80a108d not found: ID does not exist" containerID="39fdb46d6d1b5dc9d12e0808fe2934b1befd0ce8f1bc80a57280e69da80a108d"
Jul 15 14:42:41.219753 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:41.219701    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39fdb46d6d1b5dc9d12e0808fe2934b1befd0ce8f1bc80a57280e69da80a108d"} err="failed to get container status \"39fdb46d6d1b5dc9d12e0808fe2934b1befd0ce8f1bc80a57280e69da80a108d\": rpc error: code = NotFound desc = could not find container \"39fdb46d6d1b5dc9d12e0808fe2934b1befd0ce8f1bc80a57280e69da80a108d\": container with ID starting with 39fdb46d6d1b5dc9d12e0808fe2934b1befd0ce8f1bc80a57280e69da80a108d not found: ID does not exist"
Jul 15 14:42:41.242328 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:41.242300    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xkmwj"]
Jul 15 14:42:41.248687 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:41.248663    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-xkmwj"]
Jul 15 14:42:42.752982 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:42.752949    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8ae7e8a-8169-4c4d-b932-dc2c967ca68e" path="/var/lib/kubelet/pods/c8ae7e8a-8169-4c4d-b932-dc2c967ca68e/volumes"
Jul 15 14:42:43.643449 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:43.643418    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:42:43.749615 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:43.749583    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:42:46.445214 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:46.445183    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:42:46.558167 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:46.558132    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:42:48.865752 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:48.865723    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:42:48.950081 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:48.950041    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:42:50.275653 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:50.275620    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:42:50.661917 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:50.661884    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:42:52.869285 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:52.869244    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:42:52.955245 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:42:52.955192    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:43:01.721104 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:43:01.721068    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:43:01.820794 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:43:01.820765    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:43:07.261265 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:43:07.261232    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:43:07.376836 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:43:07.376803    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:43:07.443590 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:43:07.443561    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:43:07.788787 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:43:07.788755    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 14:43:07.789128 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:43:07.789115    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8ae7e8a-8169-4c4d-b932-dc2c967ca68e" containerName="manager"
Jul 15 14:43:07.789171 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:43:07.789130    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8ae7e8a-8169-4c4d-b932-dc2c967ca68e" containerName="manager"
Jul 15 14:43:07.789205 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:43:07.789192    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8ae7e8a-8169-4c4d-b932-dc2c967ca68e" containerName="manager"
Jul 15 14:43:07.845642 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:43:07.845607    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 14:43:07.845642 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:43:07.845646    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 14:43:07.845836 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:43:07.845719    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"
Jul 15 14:43:07.848934 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:43:07.848914    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 15 14:43:07.876466 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:43:07.876432    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tfn5j\" (UniqueName: \"kubernetes.io/projected/3443d05e-3fe0-470e-9351-4ca696489616-kube-api-access-tfn5j\") pod \"limitador-limitador-54d6d988d5-fpcdh\" (UID: \"3443d05e-3fe0-470e-9351-4ca696489616\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"
Jul 15 14:43:07.876616 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:43:07.876545    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3443d05e-3fe0-470e-9351-4ca696489616-config-file\") pod \"limitador-limitador-54d6d988d5-fpcdh\" (UID: \"3443d05e-3fe0-470e-9351-4ca696489616\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"
Jul 15 14:43:07.977687 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:43:07.977655    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3443d05e-3fe0-470e-9351-4ca696489616-config-file\") pod \"limitador-limitador-54d6d988d5-fpcdh\" (UID: \"3443d05e-3fe0-470e-9351-4ca696489616\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"
Jul 15 14:43:07.977834 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:43:07.977718    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tfn5j\" (UniqueName: \"kubernetes.io/projected/3443d05e-3fe0-470e-9351-4ca696489616-kube-api-access-tfn5j\") pod \"limitador-limitador-54d6d988d5-fpcdh\" (UID: \"3443d05e-3fe0-470e-9351-4ca696489616\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"
Jul 15 14:43:07.978255 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:43:07.978237    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/3443d05e-3fe0-470e-9351-4ca696489616-config-file\") pod \"limitador-limitador-54d6d988d5-fpcdh\" (UID: \"3443d05e-3fe0-470e-9351-4ca696489616\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"
Jul 15 14:43:07.989941 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:43:07.989913    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tfn5j\" (UniqueName: \"kubernetes.io/projected/3443d05e-3fe0-470e-9351-4ca696489616-kube-api-access-tfn5j\") pod \"limitador-limitador-54d6d988d5-fpcdh\" (UID: \"3443d05e-3fe0-470e-9351-4ca696489616\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"
Jul 15 14:43:08.155549 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:43:08.155514    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"
Jul 15 14:43:08.190886 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:43:08.190859    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:43:08.292688 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:43:08.292658    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 14:43:08.293776 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:43:08.293750    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3443d05e_3fe0_470e_9351_4ca696489616.slice/crio-d1566eda66f4c78198e7ead58a3ad6a94c990e5523313b4b31724829947d8d71 WatchSource:0}: Error finding container d1566eda66f4c78198e7ead58a3ad6a94c990e5523313b4b31724829947d8d71: Status 404 returned error can't find the container with id d1566eda66f4c78198e7ead58a3ad6a94c990e5523313b4b31724829947d8d71
Jul 15 14:43:08.316802 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:43:08.316779    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:43:08.330354 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:43:08.330325    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-fpcdh" event={"ID":"3443d05e-3fe0-470e-9351-4ca696489616","Type":"ContainerStarted","Data":"d1566eda66f4c78198e7ead58a3ad6a94c990e5523313b4b31724829947d8d71"}
Jul 15 14:43:10.661682 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:43:10.661650    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:43:10.769347 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:43:10.769315    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:43:11.346329 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:43:11.346292    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-fpcdh" event={"ID":"3443d05e-3fe0-470e-9351-4ca696489616","Type":"ContainerStarted","Data":"72686d3b78b8842d7e914fac2251500dc9ff375acb505d365d20ee7ecd9393da"}
Jul 15 14:43:11.346553 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:43:11.346388    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"
Jul 15 14:43:11.368901 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:43:11.368846    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-fpcdh" podStartSLOduration=1.6323281440000001 podStartE2EDuration="4.368829797s" totalImagesPullingTime="2.736501653s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:43:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:43:11.367623585 +0000 UTC m=+574.883441470" watchObservedRunningTime="2026-07-15 14:43:11.368829797 +0000 UTC m=+574.884647668"
Jul 15 14:43:13.857747 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:43:13.857715    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:43:13.917264 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:43:13.917229    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:43:22.352548 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:43:22.352517    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"
Jul 15 14:43:24.219906 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:43:24.219861    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:43:24.314221 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:43:24.314187    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:43:25.887589 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:43:25.887552    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:43:34.161155 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:43:34.161120    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:43:34.233354 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:43:34.233322    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:43:36.670264 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:43:36.670232    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:43:37.434898 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:43:37.434856    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:43:37.830866 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:43:37.830838    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-42mdh_0de0f3ad-e228-4c27-9b2c-de1a5844dcdb/console-operator/1.log"
Jul 15 14:43:37.831239 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:43:37.831125    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-42mdh_0de0f3ad-e228-4c27-9b2c-de1a5844dcdb/console-operator/1.log"
Jul 15 14:43:37.835146 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:43:37.835124    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8tt2_12bf26b1-5c4a-4e51-beb3-b17d7e7c4656/ovn-acl-logging/0.log"
Jul 15 14:43:37.835485 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:43:37.835469    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8tt2_12bf26b1-5c4a-4e51-beb3-b17d7e7c4656/ovn-acl-logging/0.log"
Jul 15 14:43:44.705552 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:43:44.705437    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:43:46.019015 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:43:46.018987    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:43:46.093006 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:43:46.092976    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:43:46.153633 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:43:46.153604    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:43:49.631368 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:43:49.631334    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:43:51.088347 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:43:51.088305    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:44:21.618602 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:44:21.618570    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:44:21.706464 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:44:21.706435    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:44:22.137403 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:44:22.137371    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:44:22.427313 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:44:22.427214    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:44:22.937659 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:44:22.937625    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:44:23.038253 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:44:23.038223    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:44:23.375146 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:44:23.375110    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 14:44:25.779815 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:44:25.779786    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:44:32.875216 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:44:32.875187    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:44:32.982014 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:44:32.981983    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:44:36.003677 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:44:36.003645    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:44:45.705864 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:44:45.705827    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:44:46.255703 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:44:46.255666    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 14:44:53.516284 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:44:53.516233    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:44:54.314415 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:44:54.314371    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 14:45:00.141333 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:00.141298    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735445-rp922"]
Jul 15 14:45:00.143525 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:00.143507    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735445-rp922"
Jul 15 14:45:00.146301 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:00.146261    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7kbgk\""
Jul 15 14:45:00.152934 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:00.152914    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735445-rp922"
Jul 15 14:45:00.154155 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:00.154131    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735445-rp922"]
Jul 15 14:45:00.280282 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:00.280246    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735445-rp922"]
Jul 15 14:45:00.281792 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:45:00.281761    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e14df4c_1d0c_42b2_9354_0230b0656ecc.slice/crio-1f4afc50c6380b9c2b5df682708aebf5822c1f926e6500f2def42b3df94e85ee WatchSource:0}: Error finding container 1f4afc50c6380b9c2b5df682708aebf5822c1f926e6500f2def42b3df94e85ee: Status 404 returned error can't find the container with id 1f4afc50c6380b9c2b5df682708aebf5822c1f926e6500f2def42b3df94e85ee
Jul 15 14:45:00.283627 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:00.283614    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 14:45:00.823363 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:00.823318    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735445-rp922" event={"ID":"5e14df4c-1d0c-42b2-9354-0230b0656ecc","Type":"ContainerStarted","Data":"1f4afc50c6380b9c2b5df682708aebf5822c1f926e6500f2def42b3df94e85ee"}
Jul 15 14:45:02.833708 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:02.833669    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735445-rp922" event={"ID":"5e14df4c-1d0c-42b2-9354-0230b0656ecc","Type":"ContainerStarted","Data":"1fc205432662321e9b87356c8f6f15757cd5cc987ac1a2b0e920bdd6a2a2b047"}
Jul 15 14:45:02.857627 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:02.857543    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735445-rp922" podStartSLOduration=0.798298596 podStartE2EDuration="2.85752959s" totalImagesPullingTime="2.059230994s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:45:02.857521815 +0000 UTC m=+686.373339685" watchObservedRunningTime="2026-07-15 14:45:02.85752959 +0000 UTC m=+686.373347440"
Jul 15 14:45:03.839591 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:03.839554    2571 generic.go:356] "Generic (PLEG): container finished" podID="5e14df4c-1d0c-42b2-9354-0230b0656ecc" containerID="1fc205432662321e9b87356c8f6f15757cd5cc987ac1a2b0e920bdd6a2a2b047" exitCode=0
Jul 15 14:45:03.839956 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:03.839639    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735445-rp922" event={"ID":"5e14df4c-1d0c-42b2-9354-0230b0656ecc","Type":"ContainerDied","Data":"1fc205432662321e9b87356c8f6f15757cd5cc987ac1a2b0e920bdd6a2a2b047"}
Jul 15 14:45:04.969625 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:04.969604    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735445-rp922"
Jul 15 14:45:05.849414 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:05.849381    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735445-rp922" event={"ID":"5e14df4c-1d0c-42b2-9354-0230b0656ecc","Type":"ContainerDied","Data":"1f4afc50c6380b9c2b5df682708aebf5822c1f926e6500f2def42b3df94e85ee"}
Jul 15 14:45:05.849414 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:05.849411    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735445-rp922"
Jul 15 14:45:05.849639 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:05.849436    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1f4afc50c6380b9c2b5df682708aebf5822c1f926e6500f2def42b3df94e85ee"
Jul 15 14:45:10.503483 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:10.503437    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-fccvt"]
Jul 15 14:45:10.503828 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:10.503783    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e14df4c-1d0c-42b2-9354-0230b0656ecc" containerName="cleanup"
Jul 15 14:45:10.503828 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:10.503793    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e14df4c-1d0c-42b2-9354-0230b0656ecc" containerName="cleanup"
Jul 15 14:45:10.503893 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:10.503853    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e14df4c-1d0c-42b2-9354-0230b0656ecc" containerName="cleanup"
Jul 15 14:45:10.505499 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:10.505482    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fccvt"
Jul 15 14:45:10.509695 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:10.509669    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 15 14:45:10.509802 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:10.509700    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-68jzd\""
Jul 15 14:45:10.509802 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:10.509738    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 15 14:45:10.509802 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:10.509702    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 15 14:45:10.521491 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:10.521457    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-fccvt"]
Jul 15 14:45:10.634104 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:10.634068    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd05fd7e-57cc-43f1-9b46-b524b56b14e4-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fccvt\" (UID: \"fd05fd7e-57cc-43f1-9b46-b524b56b14e4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fccvt"
Jul 15 14:45:10.634248 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:10.634111    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd05fd7e-57cc-43f1-9b46-b524b56b14e4-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fccvt\" (UID: \"fd05fd7e-57cc-43f1-9b46-b524b56b14e4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fccvt"
Jul 15 14:45:10.634248 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:10.634172    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd05fd7e-57cc-43f1-9b46-b524b56b14e4-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fccvt\" (UID: \"fd05fd7e-57cc-43f1-9b46-b524b56b14e4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fccvt"
Jul 15 14:45:10.634248 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:10.634189    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd05fd7e-57cc-43f1-9b46-b524b56b14e4-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fccvt\" (UID: \"fd05fd7e-57cc-43f1-9b46-b524b56b14e4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fccvt"
Jul 15 14:45:10.634248 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:10.634216    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd05fd7e-57cc-43f1-9b46-b524b56b14e4-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fccvt\" (UID: \"fd05fd7e-57cc-43f1-9b46-b524b56b14e4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fccvt"
Jul 15 14:45:10.634409 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:10.634263    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-98688\" (UniqueName: \"kubernetes.io/projected/fd05fd7e-57cc-43f1-9b46-b524b56b14e4-kube-api-access-98688\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fccvt\" (UID: \"fd05fd7e-57cc-43f1-9b46-b524b56b14e4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fccvt"
Jul 15 14:45:10.735076 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:10.735024    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd05fd7e-57cc-43f1-9b46-b524b56b14e4-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fccvt\" (UID: \"fd05fd7e-57cc-43f1-9b46-b524b56b14e4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fccvt"
Jul 15 14:45:10.735302 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:10.735091    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd05fd7e-57cc-43f1-9b46-b524b56b14e4-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fccvt\" (UID: \"fd05fd7e-57cc-43f1-9b46-b524b56b14e4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fccvt"
Jul 15 14:45:10.735302 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:10.735148    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd05fd7e-57cc-43f1-9b46-b524b56b14e4-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fccvt\" (UID: \"fd05fd7e-57cc-43f1-9b46-b524b56b14e4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fccvt"
Jul 15 14:45:10.735302 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:10.735172    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd05fd7e-57cc-43f1-9b46-b524b56b14e4-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fccvt\" (UID: \"fd05fd7e-57cc-43f1-9b46-b524b56b14e4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fccvt"
Jul 15 14:45:10.735302 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:10.735205    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd05fd7e-57cc-43f1-9b46-b524b56b14e4-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fccvt\" (UID: \"fd05fd7e-57cc-43f1-9b46-b524b56b14e4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fccvt"
Jul 15 14:45:10.735302 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:10.735241    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-98688\" (UniqueName: \"kubernetes.io/projected/fd05fd7e-57cc-43f1-9b46-b524b56b14e4-kube-api-access-98688\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fccvt\" (UID: \"fd05fd7e-57cc-43f1-9b46-b524b56b14e4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fccvt"
Jul 15 14:45:10.735592 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:10.735552    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fd05fd7e-57cc-43f1-9b46-b524b56b14e4-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fccvt\" (UID: \"fd05fd7e-57cc-43f1-9b46-b524b56b14e4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fccvt"
Jul 15 14:45:10.735638 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:10.735609    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fd05fd7e-57cc-43f1-9b46-b524b56b14e4-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fccvt\" (UID: \"fd05fd7e-57cc-43f1-9b46-b524b56b14e4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fccvt"
Jul 15 14:45:10.735681 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:10.735632    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fd05fd7e-57cc-43f1-9b46-b524b56b14e4-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fccvt\" (UID: \"fd05fd7e-57cc-43f1-9b46-b524b56b14e4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fccvt"
Jul 15 14:45:10.737427 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:10.737411    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fd05fd7e-57cc-43f1-9b46-b524b56b14e4-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fccvt\" (UID: \"fd05fd7e-57cc-43f1-9b46-b524b56b14e4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fccvt"
Jul 15 14:45:10.737670 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:10.737655    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fd05fd7e-57cc-43f1-9b46-b524b56b14e4-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fccvt\" (UID: \"fd05fd7e-57cc-43f1-9b46-b524b56b14e4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fccvt"
Jul 15 14:45:10.746732 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:10.746707    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-98688\" (UniqueName: \"kubernetes.io/projected/fd05fd7e-57cc-43f1-9b46-b524b56b14e4-kube-api-access-98688\") pod \"e2e-trlp-test-simulated-kserve-598466548d-fccvt\" (UID: \"fd05fd7e-57cc-43f1-9b46-b524b56b14e4\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fccvt"
Jul 15 14:45:10.815178 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:10.815151    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fccvt"
Jul 15 14:45:10.938731 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:10.938701    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-fccvt"]
Jul 15 14:45:10.945419 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:45:10.945385    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd05fd7e_57cc_43f1_9b46_b524b56b14e4.slice/crio-6380ea90205d0a737699158f4b59b27dc2bb59bb2423d9784f0ab09f01795713 WatchSource:0}: Error finding container 6380ea90205d0a737699158f4b59b27dc2bb59bb2423d9784f0ab09f01795713: Status 404 returned error can't find the container with id 6380ea90205d0a737699158f4b59b27dc2bb59bb2423d9784f0ab09f01795713
Jul 15 14:45:11.710028 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:11.709990    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 14:45:11.881773 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:11.881729    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fccvt" event={"ID":"fd05fd7e-57cc-43f1-9b46-b524b56b14e4","Type":"ContainerStarted","Data":"6380ea90205d0a737699158f4b59b27dc2bb59bb2423d9784f0ab09f01795713"}
Jul 15 14:45:12.829181 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:12.829152    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:45:12.887175 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:12.887148    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fccvt" event={"ID":"fd05fd7e-57cc-43f1-9b46-b524b56b14e4","Type":"ContainerStarted","Data":"e30ad0183713ee0ae6b21ae56cc78ce503e113a9fe04a3ac0de0bd132e0f6ad1"}
Jul 15 14:45:12.909670 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:12.909628    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fccvt" podStartSLOduration=1.396905359 podStartE2EDuration="2.909614189s" totalImagesPullingTime="1.51270883s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:45:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:45:12.907229404 +0000 UTC m=+696.423047273" watchObservedRunningTime="2026-07-15 14:45:12.909614189 +0000 UTC m=+696.425432059"
Jul 15 14:45:16.811228 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:16.811195    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:45:18.309933 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:18.309904    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 14:45:20.815373 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:20.815330    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fccvt"
Jul 15 14:45:20.815749 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:20.815406    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fccvt"
Jul 15 14:45:20.827510 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:20.827483    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fccvt"
Jul 15 14:45:20.931992 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:20.931967    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-fccvt"
Jul 15 14:45:28.613118 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:28.613086    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-gdsjv"]
Jul 15 14:45:28.616490 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:28.616474    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gdsjv"
Jul 15 14:45:28.619310 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:28.619291    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 15 14:45:28.626241 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:28.626219    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-gdsjv"]
Jul 15 14:45:28.689519 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:28.689491    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:45:28.790722 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:28.790664    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8cf78ce9-6c4c-46d5-a6a1-4dcae05b8f20-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gdsjv\" (UID: \"8cf78ce9-6c4c-46d5-a6a1-4dcae05b8f20\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gdsjv"
Jul 15 14:45:28.790722 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:28.790698    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8cf78ce9-6c4c-46d5-a6a1-4dcae05b8f20-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gdsjv\" (UID: \"8cf78ce9-6c4c-46d5-a6a1-4dcae05b8f20\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gdsjv"
Jul 15 14:45:28.790855 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:28.790731    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8cf78ce9-6c4c-46d5-a6a1-4dcae05b8f20-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gdsjv\" (UID: \"8cf78ce9-6c4c-46d5-a6a1-4dcae05b8f20\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gdsjv"
Jul 15 14:45:28.790855 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:28.790814    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8cf78ce9-6c4c-46d5-a6a1-4dcae05b8f20-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gdsjv\" (UID: \"8cf78ce9-6c4c-46d5-a6a1-4dcae05b8f20\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gdsjv"
Jul 15 14:45:28.790855 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:28.790845    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8cf78ce9-6c4c-46d5-a6a1-4dcae05b8f20-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gdsjv\" (UID: \"8cf78ce9-6c4c-46d5-a6a1-4dcae05b8f20\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gdsjv"
Jul 15 14:45:28.790949 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:28.790860    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rr4zh\" (UniqueName: \"kubernetes.io/projected/8cf78ce9-6c4c-46d5-a6a1-4dcae05b8f20-kube-api-access-rr4zh\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gdsjv\" (UID: \"8cf78ce9-6c4c-46d5-a6a1-4dcae05b8f20\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gdsjv"
Jul 15 14:45:28.891585 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:28.891525    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8cf78ce9-6c4c-46d5-a6a1-4dcae05b8f20-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gdsjv\" (UID: \"8cf78ce9-6c4c-46d5-a6a1-4dcae05b8f20\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gdsjv"
Jul 15 14:45:28.891585 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:28.891555    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8cf78ce9-6c4c-46d5-a6a1-4dcae05b8f20-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gdsjv\" (UID: \"8cf78ce9-6c4c-46d5-a6a1-4dcae05b8f20\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gdsjv"
Jul 15 14:45:28.891585 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:28.891577    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rr4zh\" (UniqueName: \"kubernetes.io/projected/8cf78ce9-6c4c-46d5-a6a1-4dcae05b8f20-kube-api-access-rr4zh\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gdsjv\" (UID: \"8cf78ce9-6c4c-46d5-a6a1-4dcae05b8f20\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gdsjv"
Jul 15 14:45:28.891771 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:28.891608    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8cf78ce9-6c4c-46d5-a6a1-4dcae05b8f20-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gdsjv\" (UID: \"8cf78ce9-6c4c-46d5-a6a1-4dcae05b8f20\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gdsjv"
Jul 15 14:45:28.891771 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:28.891627    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8cf78ce9-6c4c-46d5-a6a1-4dcae05b8f20-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gdsjv\" (UID: \"8cf78ce9-6c4c-46d5-a6a1-4dcae05b8f20\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gdsjv"
Jul 15 14:45:28.891771 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:28.891665    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8cf78ce9-6c4c-46d5-a6a1-4dcae05b8f20-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gdsjv\" (UID: \"8cf78ce9-6c4c-46d5-a6a1-4dcae05b8f20\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gdsjv"
Jul 15 14:45:28.892006 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:28.891978    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8cf78ce9-6c4c-46d5-a6a1-4dcae05b8f20-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gdsjv\" (UID: \"8cf78ce9-6c4c-46d5-a6a1-4dcae05b8f20\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gdsjv"
Jul 15 14:45:28.892101 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:28.892044    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8cf78ce9-6c4c-46d5-a6a1-4dcae05b8f20-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gdsjv\" (UID: \"8cf78ce9-6c4c-46d5-a6a1-4dcae05b8f20\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gdsjv"
Jul 15 14:45:28.892101 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:28.892068    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8cf78ce9-6c4c-46d5-a6a1-4dcae05b8f20-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gdsjv\" (UID: \"8cf78ce9-6c4c-46d5-a6a1-4dcae05b8f20\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gdsjv"
Jul 15 14:45:28.893756 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:28.893728    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8cf78ce9-6c4c-46d5-a6a1-4dcae05b8f20-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gdsjv\" (UID: \"8cf78ce9-6c4c-46d5-a6a1-4dcae05b8f20\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gdsjv"
Jul 15 14:45:28.893977 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:28.893957    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8cf78ce9-6c4c-46d5-a6a1-4dcae05b8f20-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gdsjv\" (UID: \"8cf78ce9-6c4c-46d5-a6a1-4dcae05b8f20\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gdsjv"
Jul 15 14:45:28.901904 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:28.901880    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rr4zh\" (UniqueName: \"kubernetes.io/projected/8cf78ce9-6c4c-46d5-a6a1-4dcae05b8f20-kube-api-access-rr4zh\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gdsjv\" (UID: \"8cf78ce9-6c4c-46d5-a6a1-4dcae05b8f20\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gdsjv"
Jul 15 14:45:28.926609 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:28.926588    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gdsjv"
Jul 15 14:45:29.055500 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:29.055476    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-gdsjv"]
Jul 15 14:45:29.058054 ip-10-0-140-61 kubenswrapper[2571]: W0715 14:45:29.058026    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8cf78ce9_6c4c_46d5_a6a1_4dcae05b8f20.slice/crio-4cf21eb25072ecf65d12a01622badd1416626d78ccffa6c77efe94f749b3172e WatchSource:0}: Error finding container 4cf21eb25072ecf65d12a01622badd1416626d78ccffa6c77efe94f749b3172e: Status 404 returned error can't find the container with id 4cf21eb25072ecf65d12a01622badd1416626d78ccffa6c77efe94f749b3172e
Jul 15 14:45:29.962004 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:29.961969    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gdsjv" event={"ID":"8cf78ce9-6c4c-46d5-a6a1-4dcae05b8f20","Type":"ContainerStarted","Data":"e79e980e3624cd678856396b1f059759d881e698764ebe4103ac3b69f1c6e699"}
Jul 15 14:45:29.962415 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:29.962017    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gdsjv" event={"ID":"8cf78ce9-6c4c-46d5-a6a1-4dcae05b8f20","Type":"ContainerStarted","Data":"4cf21eb25072ecf65d12a01622badd1416626d78ccffa6c77efe94f749b3172e"}
Jul 15 14:45:29.990375 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:29.990327    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gdsjv" podStartSLOduration=1.685581751 podStartE2EDuration="1.990311976s" totalImagesPullingTime="304.730225ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 14:45:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 14:45:29.988690609 +0000 UTC m=+713.504508480" watchObservedRunningTime="2026-07-15 14:45:29.990311976 +0000 UTC m=+713.506129846"
Jul 15 14:45:30.715878 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:30.715841    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 14:45:33.511119 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:33.511089    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:45:38.926878 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:38.926834    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gdsjv"
Jul 15 14:45:38.926878 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:38.926899    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gdsjv"
Jul 15 14:45:38.938890 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:38.938860    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gdsjv"
Jul 15 14:45:39.011825 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:39.011797    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gdsjv"
Jul 15 14:45:42.908665 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:45:42.908631    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 14:46:35.204177 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:46:35.204137    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:46:35.298562 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:46:35.298527    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:46:36.411915 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:46:36.411888    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:46:36.486551 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:46:36.486517    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:46:59.335440 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:46:59.335357    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:46:59.400466 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:46:59.400436    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:47:00.114313 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:47:00.114254    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:47:00.176004 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:47:00.175977    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:47:07.311665 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:47:07.311632    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 14:47:09.456954 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:47:09.456921    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:47:16.905209 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:47:16.905175    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 14:47:18.603835 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:47:18.603800    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:47:27.599641 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:47:27.599609    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 14:47:36.697429 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:47:36.697395    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 14:47:47.596140 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:47:47.596094    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 14:47:50.047988 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:47:50.047954    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:47:51.915227 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:47:51.915196    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:47:56.843664 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:47:56.843627    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:48:17.500754 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:48:17.500667    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 14:48:29.691078 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:48:29.690994    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 14:48:33.924280 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:48:33.924249    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:48:34.024064 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:48:34.024031    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:48:34.169651 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:48:34.169617    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:48:37.862078 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:48:37.862049    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-42mdh_0de0f3ad-e228-4c27-9b2c-de1a5844dcdb/console-operator/1.log"
Jul 15 14:48:37.862771 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:48:37.862754    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-42mdh_0de0f3ad-e228-4c27-9b2c-de1a5844dcdb/console-operator/1.log"
Jul 15 14:48:37.866100 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:48:37.866082    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8tt2_12bf26b1-5c4a-4e51-beb3-b17d7e7c4656/ovn-acl-logging/0.log"
Jul 15 14:48:37.867063 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:48:37.867046    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8tt2_12bf26b1-5c4a-4e51-beb3-b17d7e7c4656/ovn-acl-logging/0.log"
Jul 15 14:48:41.518738 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:48:41.518704    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:48:41.627073 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:48:41.627045    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:48:41.731803 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:48:41.731768    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:48:41.909238 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:48:41.909203    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:48:48.061252 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:48:48.061218    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:48:48.119894 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:48:48.119858    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:49:05.598942 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:49:05.598902    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 14:49:06.312115 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:49:06.312080    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:49:16.195884 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:49:16.195845    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 14:49:26.502408 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:49:26.502370    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 14:49:38.094758 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:49:38.094711    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 14:49:48.494761 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:49:48.494714    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 14:49:59.108576 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:49:59.108365    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 14:50:09.993823 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:50:09.993789    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 14:50:19.884401 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:50:19.884365    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 14:50:45.409546 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:50:45.409514    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 14:50:56.092742 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:50:56.092705    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 14:51:19.491689 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:51:19.491655    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 14:51:29.410430 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:51:29.410338    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 14:51:44.698843 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:51:44.698808    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 14:51:54.893187 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:51:54.893152    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 14:52:10.300472 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:52:10.300433    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 14:53:13.782441 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:53:13.782393    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:53:13.868376 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:53:13.868340    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:53:37.889068 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:53:37.889037    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-42mdh_0de0f3ad-e228-4c27-9b2c-de1a5844dcdb/console-operator/1.log"
Jul 15 14:53:37.890527 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:53:37.890502    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-42mdh_0de0f3ad-e228-4c27-9b2c-de1a5844dcdb/console-operator/1.log"
Jul 15 14:53:37.899636 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:53:37.899604    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8tt2_12bf26b1-5c4a-4e51-beb3-b17d7e7c4656/ovn-acl-logging/0.log"
Jul 15 14:53:37.900778 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:53:37.900755    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8tt2_12bf26b1-5c4a-4e51-beb3-b17d7e7c4656/ovn-acl-logging/0.log"
Jul 15 14:54:12.702671 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:54:12.702635    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 14:54:24.501567 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:54:24.501536    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 14:54:34.092643 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:54:34.092567    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 14:54:45.592030 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:54:45.591996    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 14:54:56.398893 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:54:56.398857    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 14:55:08.002774 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:55:08.002737    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 14:55:16.796600 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:55:16.796570    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 14:55:27.788961 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:55:27.788929    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 14:55:38.292850 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:55:38.292813    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 14:55:47.106574 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:55:47.106534    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 14:56:01.098473 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:56:01.098391    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 14:56:17.821819 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:56:17.821783    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 14:56:24.370923 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:56:24.370885    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:56:26.995680 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:56:26.995648    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 14:56:28.330448 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:56:28.330411    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:56:36.927448 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:56:36.927411    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:56:37.204858 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:56:37.204770    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 14:56:47.707909 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:56:47.707872    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 14:57:04.695326 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:57:04.695289    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 14:57:16.199320 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:57:16.199283    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 14:57:25.393757 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:57:25.393722    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 14:57:35.697990 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:57:35.697901    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 14:57:45.502151 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:57:45.502113    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 14:57:55.292611 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:57:55.292578    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 14:58:02.511388 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:58:02.511354    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:58:08.189533 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:58:08.189500    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 14:58:17.494963 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:58:17.494918    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 14:58:27.389707 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:58:27.389674    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 14:58:36.890576 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:58:36.890534    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 14:58:37.922536 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:58:37.922510    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-42mdh_0de0f3ad-e228-4c27-9b2c-de1a5844dcdb/console-operator/1.log"
Jul 15 14:58:37.923564 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:58:37.923539    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-42mdh_0de0f3ad-e228-4c27-9b2c-de1a5844dcdb/console-operator/1.log"
Jul 15 14:58:37.926604 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:58:37.926585    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8tt2_12bf26b1-5c4a-4e51-beb3-b17d7e7c4656/ovn-acl-logging/0.log"
Jul 15 14:58:37.927602 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:58:37.927585    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8tt2_12bf26b1-5c4a-4e51-beb3-b17d7e7c4656/ovn-acl-logging/0.log"
Jul 15 14:58:49.502825 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:58:49.502781    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 14:58:56.294115 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:58:56.294081    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 14:59:16.097896 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:59:16.097860    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 14:59:29.984076 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:59:29.984042    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 14:59:42.302539 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:59:42.302503    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 14:59:44.116899 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:59:44.116862    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:59:49.534435 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:59:49.534396    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 14:59:54.298621 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:59:54.298588    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 14:59:57.815320 ip-10-0-140-61 kubenswrapper[2571]: I0715 14:59:57.815262    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:00:03.417504 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:00:03.417470    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:00:06.397042 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:00:06.397007    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 15:00:06.478265 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:00:06.478237    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:00:06.574308 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:00:06.574256    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:00:07.044130 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:00:07.044070    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:00:13.354879 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:00:13.354845    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:00:13.823393 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:00:13.823365    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:00:13.883959 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:00:13.883935    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:00:14.690497 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:00:14.690461    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:00:14.787350 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:00:14.787319    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:00:14.854933 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:00:14.854898    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:00:15.040246 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:00:15.040165    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:00:15.383946 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:00:15.383918    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:00:15.487193 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:00:15.487155    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:00:17.359600 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:00:17.359574    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:00:18.291845 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:00:18.291811    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 15:00:19.894081 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:00:19.894053    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a5fa064-t9mfz"]
Jul 15 15:00:19.896971 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:00:19.896955    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a5fa064-t9mfz"
Jul 15 15:00:19.899170 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:00:19.899147    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7kbgk\""
Jul 15 15:00:19.899321 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:00:19.899239    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 15:00:19.904036 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:00:19.903683    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a5fa064-t9mfz"]
Jul 15 15:00:20.011058 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:00:20.011028    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/57bbfa84-238c-42c6-9092-28f4e3737400-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8a5fa064-t9mfz\" (UID: \"57bbfa84-238c-42c6-9092-28f4e3737400\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a5fa064-t9mfz"
Jul 15 15:00:20.111476 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:00:20.111439    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/57bbfa84-238c-42c6-9092-28f4e3737400-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8a5fa064-t9mfz\" (UID: \"57bbfa84-238c-42c6-9092-28f4e3737400\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a5fa064-t9mfz"
Jul 15 15:00:20.112060 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:00:20.112041    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/57bbfa84-238c-42c6-9092-28f4e3737400-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-8a5fa064-t9mfz\" (UID: \"57bbfa84-238c-42c6-9092-28f4e3737400\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a5fa064-t9mfz"
Jul 15 15:00:20.207489 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:00:20.207403    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a5fa064-t9mfz"
Jul 15 15:00:20.334641 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:00:20.334603    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a5fa064-t9mfz"]
Jul 15 15:00:20.336037 ip-10-0-140-61 kubenswrapper[2571]: W0715 15:00:20.336007    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57bbfa84_238c_42c6_9092_28f4e3737400.slice/crio-a88c5eea6f7a599594db695bd1793d949a38c712405fac3f531ce2c8ae08a458 WatchSource:0}: Error finding container a88c5eea6f7a599594db695bd1793d949a38c712405fac3f531ce2c8ae08a458: Status 404 returned error can't find the container with id a88c5eea6f7a599594db695bd1793d949a38c712405fac3f531ce2c8ae08a458
Jul 15 15:00:20.946070 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:00:20.946034    2571 generic.go:356] "Generic (PLEG): container finished" podID="57bbfa84-238c-42c6-9092-28f4e3737400" containerID="557a024645321bb6da6d4c8c82a6d87dba51b96c25e363cf4eb31e03e282a9d8" exitCode=7
Jul 15 15:00:20.946430 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:00:20.946085    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a5fa064-t9mfz" event={"ID":"57bbfa84-238c-42c6-9092-28f4e3737400","Type":"ContainerDied","Data":"557a024645321bb6da6d4c8c82a6d87dba51b96c25e363cf4eb31e03e282a9d8"}
Jul 15 15:00:20.946430 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:00:20.946139    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a5fa064-t9mfz" event={"ID":"57bbfa84-238c-42c6-9092-28f4e3737400","Type":"ContainerStarted","Data":"a88c5eea6f7a599594db695bd1793d949a38c712405fac3f531ce2c8ae08a458"}
Jul 15 15:00:20.946430 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:00:20.946336    2571 scope.go:117] "RemoveContainer" containerID="557a024645321bb6da6d4c8c82a6d87dba51b96c25e363cf4eb31e03e282a9d8"
Jul 15 15:00:21.952412 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:00:21.952381    2571 generic.go:356] "Generic (PLEG): container finished" podID="57bbfa84-238c-42c6-9092-28f4e3737400" containerID="7def213f3c3df685bd7ece6107242dfa821d078de1804f81aa06d124b1efc027" exitCode=7
Jul 15 15:00:21.952820 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:00:21.952417    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a5fa064-t9mfz" event={"ID":"57bbfa84-238c-42c6-9092-28f4e3737400","Type":"ContainerDied","Data":"7def213f3c3df685bd7ece6107242dfa821d078de1804f81aa06d124b1efc027"}
Jul 15 15:00:21.952820 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:00:21.952460    2571 scope.go:117] "RemoveContainer" containerID="557a024645321bb6da6d4c8c82a6d87dba51b96c25e363cf4eb31e03e282a9d8"
Jul 15 15:00:21.952820 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:00:21.952619    2571 scope.go:117] "RemoveContainer" containerID="7def213f3c3df685bd7ece6107242dfa821d078de1804f81aa06d124b1efc027"
Jul 15 15:00:21.952942 ip-10-0-140-61 kubenswrapper[2571]: E0715 15:00:21.952846    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-8a5fa064-t9mfz_odh-ai-gateway-infra(57bbfa84-238c-42c6-9092-28f4e3737400)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a5fa064-t9mfz" podUID="57bbfa84-238c-42c6-9092-28f4e3737400"
Jul 15 15:00:22.958608 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:00:22.958571    2571 scope.go:117] "RemoveContainer" containerID="7def213f3c3df685bd7ece6107242dfa821d078de1804f81aa06d124b1efc027"
Jul 15 15:00:22.958969 ip-10-0-140-61 kubenswrapper[2571]: E0715 15:00:22.958748    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-8a5fa064-t9mfz_odh-ai-gateway-infra(57bbfa84-238c-42c6-9092-28f4e3737400)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a5fa064-t9mfz" podUID="57bbfa84-238c-42c6-9092-28f4e3737400"
Jul 15 15:00:37.747562 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:00:37.747487    2571 scope.go:117] "RemoveContainer" containerID="7def213f3c3df685bd7ece6107242dfa821d078de1804f81aa06d124b1efc027"
Jul 15 15:00:38.029774 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:00:38.029741    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a5fa064-t9mfz" event={"ID":"57bbfa84-238c-42c6-9092-28f4e3737400","Type":"ContainerStarted","Data":"246e66aa3c9d2f89897148fd37aed3b495953c8d99332584d6ea0af485d89b07"}
Jul 15 15:00:38.049101 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:00:38.049048    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a5fa064-t9mfz" podStartSLOduration=19.049034736 podStartE2EDuration="19.049034736s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:00:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:00:38.047296423 +0000 UTC m=+1621.563114291" watchObservedRunningTime="2026-07-15 15:00:38.049034736 +0000 UTC m=+1621.564852607"
Jul 15 15:00:39.035608 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:00:39.035577    2571 generic.go:356] "Generic (PLEG): container finished" podID="57bbfa84-238c-42c6-9092-28f4e3737400" containerID="246e66aa3c9d2f89897148fd37aed3b495953c8d99332584d6ea0af485d89b07" exitCode=0
Jul 15 15:00:39.036034 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:00:39.035657    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a5fa064-t9mfz" event={"ID":"57bbfa84-238c-42c6-9092-28f4e3737400","Type":"ContainerDied","Data":"246e66aa3c9d2f89897148fd37aed3b495953c8d99332584d6ea0af485d89b07"}
Jul 15 15:00:39.036034 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:00:39.035717    2571 scope.go:117] "RemoveContainer" containerID="7def213f3c3df685bd7ece6107242dfa821d078de1804f81aa06d124b1efc027"
Jul 15 15:00:39.059040 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:00:39.059016    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a5fa064-t9mfz"]
Jul 15 15:00:40.173728 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:00:40.173702    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a5fa064-t9mfz"
Jul 15 15:00:40.288748 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:00:40.288715    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/57bbfa84-238c-42c6-9092-28f4e3737400-maas-api-service-ca\") pod \"57bbfa84-238c-42c6-9092-28f4e3737400\" (UID: \"57bbfa84-238c-42c6-9092-28f4e3737400\") "
Jul 15 15:00:40.289067 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:00:40.289045    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57bbfa84-238c-42c6-9092-28f4e3737400-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "57bbfa84-238c-42c6-9092-28f4e3737400" (UID: "57bbfa84-238c-42c6-9092-28f4e3737400"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 15:00:40.389622 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:00:40.389589    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/57bbfa84-238c-42c6-9092-28f4e3737400-maas-api-service-ca\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 15:00:41.047723 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:00:41.047636    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a5fa064-t9mfz" event={"ID":"57bbfa84-238c-42c6-9092-28f4e3737400","Type":"ContainerDied","Data":"a88c5eea6f7a599594db695bd1793d949a38c712405fac3f531ce2c8ae08a458"}
Jul 15 15:00:41.047723 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:00:41.047664    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a5fa064-t9mfz"
Jul 15 15:00:41.047723 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:00:41.047683    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a88c5eea6f7a599594db695bd1793d949a38c712405fac3f531ce2c8ae08a458"
Jul 15 15:00:41.090779 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:00:41.090748    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a5fa064-t9mfz"]
Jul 15 15:00:41.100206 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:00:41.100170    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-8a5fa064-t9mfz"]
Jul 15 15:00:42.753477 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:00:42.753448    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57bbfa84-238c-42c6-9092-28f4e3737400" path="/var/lib/kubelet/pods/57bbfa84-238c-42c6-9092-28f4e3737400/volumes"
Jul 15 15:01:30.428734 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:01:30.428696    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:01:32.989079 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:01:32.989049    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 15:01:35.039060 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:01:35.039023    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:01:41.105673 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:01:41.105633    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:01:41.207361 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:01:41.207330    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:01:48.454691 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:01:48.454656    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:01:48.512736 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:01:48.512712    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:01:51.665220 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:01:51.665175    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc2c3cfa-nnbxq"]
Jul 15 15:01:51.665725 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:01:51.665692    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57bbfa84-238c-42c6-9092-28f4e3737400" containerName="revoke-keys"
Jul 15 15:01:51.665725 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:01:51.665711    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="57bbfa84-238c-42c6-9092-28f4e3737400" containerName="revoke-keys"
Jul 15 15:01:51.665840 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:01:51.665729    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57bbfa84-238c-42c6-9092-28f4e3737400" containerName="revoke-keys"
Jul 15 15:01:51.665840 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:01:51.665738    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="57bbfa84-238c-42c6-9092-28f4e3737400" containerName="revoke-keys"
Jul 15 15:01:51.665944 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:01:51.665844    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="57bbfa84-238c-42c6-9092-28f4e3737400" containerName="revoke-keys"
Jul 15 15:01:51.665944 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:01:51.665857    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="57bbfa84-238c-42c6-9092-28f4e3737400" containerName="revoke-keys"
Jul 15 15:01:51.668758 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:01:51.668735    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc2c3cfa-nnbxq"
Jul 15 15:01:51.671380 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:01:51.671349    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 15:01:51.671511 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:01:51.671384    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7kbgk\""
Jul 15 15:01:51.675600 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:01:51.675577    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc2c3cfa-nnbxq"]
Jul 15 15:01:51.694689 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:01:51.694651    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2170ee43-5e3a-4336-a847-8ba6edf9df71-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-fc2c3cfa-nnbxq\" (UID: \"2170ee43-5e3a-4336-a847-8ba6edf9df71\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc2c3cfa-nnbxq"
Jul 15 15:01:51.795976 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:01:51.795934    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2170ee43-5e3a-4336-a847-8ba6edf9df71-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-fc2c3cfa-nnbxq\" (UID: \"2170ee43-5e3a-4336-a847-8ba6edf9df71\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc2c3cfa-nnbxq"
Jul 15 15:01:51.796605 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:01:51.796582    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2170ee43-5e3a-4336-a847-8ba6edf9df71-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-fc2c3cfa-nnbxq\" (UID: \"2170ee43-5e3a-4336-a847-8ba6edf9df71\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc2c3cfa-nnbxq"
Jul 15 15:01:51.894340 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:01:51.894307    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:01:51.980907 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:01:51.980813    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc2c3cfa-nnbxq"
Jul 15 15:01:51.994438 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:01:51.994337    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:01:52.118890 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:01:52.118864    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc2c3cfa-nnbxq"]
Jul 15 15:01:52.121013 ip-10-0-140-61 kubenswrapper[2571]: W0715 15:01:52.120986    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2170ee43_5e3a_4336_a847_8ba6edf9df71.slice/crio-bc652675eceec59a730cfc3e2b6459e321f77db33ae89098d5401c8a0d8c3060 WatchSource:0}: Error finding container bc652675eceec59a730cfc3e2b6459e321f77db33ae89098d5401c8a0d8c3060: Status 404 returned error can't find the container with id bc652675eceec59a730cfc3e2b6459e321f77db33ae89098d5401c8a0d8c3060
Jul 15 15:01:52.361881 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:01:52.361844    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc2c3cfa-nnbxq" event={"ID":"2170ee43-5e3a-4336-a847-8ba6edf9df71","Type":"ContainerStarted","Data":"bc652675eceec59a730cfc3e2b6459e321f77db33ae89098d5401c8a0d8c3060"}
Jul 15 15:01:53.367387 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:01:53.367353    2571 generic.go:356] "Generic (PLEG): container finished" podID="2170ee43-5e3a-4336-a847-8ba6edf9df71" containerID="73bf579717ead786d7011f62b7d199a942c75fe1bb08df8f14e4a7a4ded511c2" exitCode=7
Jul 15 15:01:53.367387 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:01:53.367391    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc2c3cfa-nnbxq" event={"ID":"2170ee43-5e3a-4336-a847-8ba6edf9df71","Type":"ContainerDied","Data":"73bf579717ead786d7011f62b7d199a942c75fe1bb08df8f14e4a7a4ded511c2"}
Jul 15 15:01:53.367804 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:01:53.367652    2571 scope.go:117] "RemoveContainer" containerID="73bf579717ead786d7011f62b7d199a942c75fe1bb08df8f14e4a7a4ded511c2"
Jul 15 15:01:54.373860 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:01:54.373819    2571 generic.go:356] "Generic (PLEG): container finished" podID="2170ee43-5e3a-4336-a847-8ba6edf9df71" containerID="03208b990348a760e3098a099814de46be767db7e1569e1660c24dd527bfe471" exitCode=7
Jul 15 15:01:54.374335 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:01:54.373898    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc2c3cfa-nnbxq" event={"ID":"2170ee43-5e3a-4336-a847-8ba6edf9df71","Type":"ContainerDied","Data":"03208b990348a760e3098a099814de46be767db7e1569e1660c24dd527bfe471"}
Jul 15 15:01:54.374335 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:01:54.373959    2571 scope.go:117] "RemoveContainer" containerID="73bf579717ead786d7011f62b7d199a942c75fe1bb08df8f14e4a7a4ded511c2"
Jul 15 15:01:54.374335 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:01:54.374152    2571 scope.go:117] "RemoveContainer" containerID="03208b990348a760e3098a099814de46be767db7e1569e1660c24dd527bfe471"
Jul 15 15:01:54.374454 ip-10-0-140-61 kubenswrapper[2571]: E0715 15:01:54.374398    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-fc2c3cfa-nnbxq_odh-ai-gateway-infra(2170ee43-5e3a-4336-a847-8ba6edf9df71)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc2c3cfa-nnbxq" podUID="2170ee43-5e3a-4336-a847-8ba6edf9df71"
Jul 15 15:01:55.227950 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:01:55.227913    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 15:01:55.258026 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:01:55.257994    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:01:55.380506 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:01:55.380481    2571 scope.go:117] "RemoveContainer" containerID="03208b990348a760e3098a099814de46be767db7e1569e1660c24dd527bfe471"
Jul 15 15:01:55.380879 ip-10-0-140-61 kubenswrapper[2571]: E0715 15:01:55.380655    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-fc2c3cfa-nnbxq_odh-ai-gateway-infra(2170ee43-5e3a-4336-a847-8ba6edf9df71)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc2c3cfa-nnbxq" podUID="2170ee43-5e3a-4336-a847-8ba6edf9df71"
Jul 15 15:02:08.749660 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:02:08.749622    2571 scope.go:117] "RemoveContainer" containerID="03208b990348a760e3098a099814de46be767db7e1569e1660c24dd527bfe471"
Jul 15 15:02:09.446281 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:02:09.446208    2571 generic.go:356] "Generic (PLEG): container finished" podID="2170ee43-5e3a-4336-a847-8ba6edf9df71" containerID="0aa6f7a0953b5e7b1e7c9ca416b8d2654eedd108ee3382f27663817a2af27617" exitCode=0
Jul 15 15:02:09.446467 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:02:09.446303    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc2c3cfa-nnbxq" event={"ID":"2170ee43-5e3a-4336-a847-8ba6edf9df71","Type":"ContainerDied","Data":"0aa6f7a0953b5e7b1e7c9ca416b8d2654eedd108ee3382f27663817a2af27617"}
Jul 15 15:02:09.446467 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:02:09.446374    2571 scope.go:117] "RemoveContainer" containerID="03208b990348a760e3098a099814de46be767db7e1569e1660c24dd527bfe471"
Jul 15 15:02:10.484719 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:02:10.484687    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc2c3cfa-nnbxq"]
Jul 15 15:02:10.585093 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:02:10.585068    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc2c3cfa-nnbxq"
Jul 15 15:02:10.659054 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:02:10.659019    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2170ee43-5e3a-4336-a847-8ba6edf9df71-maas-api-service-ca\") pod \"2170ee43-5e3a-4336-a847-8ba6edf9df71\" (UID: \"2170ee43-5e3a-4336-a847-8ba6edf9df71\") "
Jul 15 15:02:10.659387 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:02:10.659367    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2170ee43-5e3a-4336-a847-8ba6edf9df71-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2170ee43-5e3a-4336-a847-8ba6edf9df71" (UID: "2170ee43-5e3a-4336-a847-8ba6edf9df71"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 15:02:10.759768 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:02:10.759668    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2170ee43-5e3a-4336-a847-8ba6edf9df71-maas-api-service-ca\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 15:02:11.458262 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:02:11.458221    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc2c3cfa-nnbxq" event={"ID":"2170ee43-5e3a-4336-a847-8ba6edf9df71","Type":"ContainerDied","Data":"bc652675eceec59a730cfc3e2b6459e321f77db33ae89098d5401c8a0d8c3060"}
Jul 15 15:02:11.458262 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:02:11.458256    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc2c3cfa-nnbxq"
Jul 15 15:02:11.458588 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:02:11.458286    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bc652675eceec59a730cfc3e2b6459e321f77db33ae89098d5401c8a0d8c3060"
Jul 15 15:02:11.489211 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:02:11.489176    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc2c3cfa-nnbxq"]
Jul 15 15:02:11.495830 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:02:11.495802    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-fc2c3cfa-nnbxq"]
Jul 15 15:02:12.753557 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:02:12.753526    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2170ee43-5e3a-4336-a847-8ba6edf9df71" path="/var/lib/kubelet/pods/2170ee43-5e3a-4336-a847-8ba6edf9df71/volumes"
Jul 15 15:02:51.815720 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:02:51.815655    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:02:51.921878 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:02:51.921853    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:02:52.322969 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:02:52.322943    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:02:54.692464 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:02:54.692426    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 15:02:58.094119 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:02:58.094079    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:02:58.379947 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:02:58.379857    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:02:58.479955 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:02:58.479926    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:02:58.621052 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:02:58.621020    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:02:58.719798 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:02:58.719713    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:02:59.717950 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:02:59.717918    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:02:59.806235 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:02:59.806203    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:02:59.873477 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:02:59.873442    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:03:00.476835 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:03:00.476800    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:03:00.578074 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:03:00.578043    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:03:00.678239 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:03:00.678212    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:03:02.077110 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:03:02.077078    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:03:06.095185 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:03:06.095146    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 15:03:15.726871 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:03:15.726833    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:03:15.829327 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:03:15.829290    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:03:21.455812 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:03:21.455773    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:03:21.555229 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:03:21.555196    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:03:22.953169 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:03:22.953139    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:03:23.019039 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:03:23.019009    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:03:37.957816 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:03:37.957790    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-42mdh_0de0f3ad-e228-4c27-9b2c-de1a5844dcdb/console-operator/1.log"
Jul 15 15:03:37.958300 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:03:37.957834    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-42mdh_0de0f3ad-e228-4c27-9b2c-de1a5844dcdb/console-operator/1.log"
Jul 15 15:03:37.962101 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:03:37.962081    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8tt2_12bf26b1-5c4a-4e51-beb3-b17d7e7c4656/ovn-acl-logging/0.log"
Jul 15 15:03:37.962218 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:03:37.962196    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8tt2_12bf26b1-5c4a-4e51-beb3-b17d7e7c4656/ovn-acl-logging/0.log"
Jul 15 15:03:54.884179 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:03:54.884142    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a418840f-2t5s7"]
Jul 15 15:03:54.884634 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:03:54.884496    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2170ee43-5e3a-4336-a847-8ba6edf9df71" containerName="revoke-keys"
Jul 15 15:03:54.884634 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:03:54.884508    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="2170ee43-5e3a-4336-a847-8ba6edf9df71" containerName="revoke-keys"
Jul 15 15:03:54.884634 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:03:54.884515    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2170ee43-5e3a-4336-a847-8ba6edf9df71" containerName="revoke-keys"
Jul 15 15:03:54.884634 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:03:54.884520    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="2170ee43-5e3a-4336-a847-8ba6edf9df71" containerName="revoke-keys"
Jul 15 15:03:54.884634 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:03:54.884549    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57bbfa84-238c-42c6-9092-28f4e3737400" containerName="revoke-keys"
Jul 15 15:03:54.884634 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:03:54.884554    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="57bbfa84-238c-42c6-9092-28f4e3737400" containerName="revoke-keys"
Jul 15 15:03:54.884634 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:03:54.884604    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="2170ee43-5e3a-4336-a847-8ba6edf9df71" containerName="revoke-keys"
Jul 15 15:03:54.884634 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:03:54.884615    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="2170ee43-5e3a-4336-a847-8ba6edf9df71" containerName="revoke-keys"
Jul 15 15:03:54.884634 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:03:54.884620    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="57bbfa84-238c-42c6-9092-28f4e3737400" containerName="revoke-keys"
Jul 15 15:03:54.887559 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:03:54.887542    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a418840f-2t5s7"
Jul 15 15:03:54.889979 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:03:54.889955    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 15:03:54.890120 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:03:54.890016    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7kbgk\""
Jul 15 15:03:54.893479 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:03:54.893452    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a418840f-2t5s7"]
Jul 15 15:03:55.081880 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:03:55.081839    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb6f0850-854e-46ff-8534-d9230bd40ec2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a418840f-2t5s7\" (UID: \"bb6f0850-854e-46ff-8534-d9230bd40ec2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a418840f-2t5s7"
Jul 15 15:03:55.182883 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:03:55.182792    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb6f0850-854e-46ff-8534-d9230bd40ec2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a418840f-2t5s7\" (UID: \"bb6f0850-854e-46ff-8534-d9230bd40ec2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a418840f-2t5s7"
Jul 15 15:03:55.183469 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:03:55.183448    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb6f0850-854e-46ff-8534-d9230bd40ec2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-a418840f-2t5s7\" (UID: \"bb6f0850-854e-46ff-8534-d9230bd40ec2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a418840f-2t5s7"
Jul 15 15:03:55.199807 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:03:55.199771    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a418840f-2t5s7"
Jul 15 15:03:55.332800 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:03:55.332775    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a418840f-2t5s7"]
Jul 15 15:03:55.334542 ip-10-0-140-61 kubenswrapper[2571]: W0715 15:03:55.334513    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb6f0850_854e_46ff_8534_d9230bd40ec2.slice/crio-aed8e9d95fa0d7dfa07fe528f39eeff759e535bff1c9658c7b7ade6e59441a8b WatchSource:0}: Error finding container aed8e9d95fa0d7dfa07fe528f39eeff759e535bff1c9658c7b7ade6e59441a8b: Status 404 returned error can't find the container with id aed8e9d95fa0d7dfa07fe528f39eeff759e535bff1c9658c7b7ade6e59441a8b
Jul 15 15:03:55.949827 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:03:55.949796    2571 generic.go:356] "Generic (PLEG): container finished" podID="bb6f0850-854e-46ff-8534-d9230bd40ec2" containerID="e215e3f891a041ba62ebb78265ed188b96fb17e87b9e62680ba3b0dfade55703" exitCode=0
Jul 15 15:03:55.950178 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:03:55.949835    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a418840f-2t5s7" event={"ID":"bb6f0850-854e-46ff-8534-d9230bd40ec2","Type":"ContainerDied","Data":"e215e3f891a041ba62ebb78265ed188b96fb17e87b9e62680ba3b0dfade55703"}
Jul 15 15:03:55.950178 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:03:55.949878    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a418840f-2t5s7" event={"ID":"bb6f0850-854e-46ff-8534-d9230bd40ec2","Type":"ContainerStarted","Data":"aed8e9d95fa0d7dfa07fe528f39eeff759e535bff1c9658c7b7ade6e59441a8b"}
Jul 15 15:03:57.080806 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:03:57.080782    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a418840f-2t5s7"
Jul 15 15:03:57.095549 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:03:57.095523    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb6f0850-854e-46ff-8534-d9230bd40ec2-maas-api-service-ca\") pod \"bb6f0850-854e-46ff-8534-d9230bd40ec2\" (UID: \"bb6f0850-854e-46ff-8534-d9230bd40ec2\") "
Jul 15 15:03:57.095888 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:03:57.095870    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/bb6f0850-854e-46ff-8534-d9230bd40ec2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "bb6f0850-854e-46ff-8534-d9230bd40ec2" (UID: "bb6f0850-854e-46ff-8534-d9230bd40ec2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 15:03:57.196587 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:03:57.196550    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb6f0850-854e-46ff-8534-d9230bd40ec2-maas-api-service-ca\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 15:03:57.960215 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:03:57.960184    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a418840f-2t5s7"
Jul 15 15:03:57.960399 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:03:57.960218    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-a418840f-2t5s7" event={"ID":"bb6f0850-854e-46ff-8534-d9230bd40ec2","Type":"ContainerDied","Data":"aed8e9d95fa0d7dfa07fe528f39eeff759e535bff1c9658c7b7ade6e59441a8b"}
Jul 15 15:03:57.960399 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:03:57.960265    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aed8e9d95fa0d7dfa07fe528f39eeff759e535bff1c9658c7b7ade6e59441a8b"
Jul 15 15:04:05.551975 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:04:05.551940    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:04:08.495408 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:04:08.495372    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 15:04:10.006026 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:04:10.005993    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:04:16.149462 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:04:16.149344    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:04:16.208814 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:04:16.208780    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:04:21.058079 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:04:21.058039    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:04:21.394664 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:04:21.394634    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:04:22.489649 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:04:22.489617    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:04:22.584005 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:04:22.583966    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:04:22.755336 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:04:22.755217    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:04:22.918654 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:04:22.918607    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:04:23.303151 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:04:23.303115    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:04:23.397293 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:04:23.397246    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:04:25.593529 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:04:25.593490    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 15:04:26.925063 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:04:26.925030    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9c3abd0e-l822b"]
Jul 15 15:04:26.925436 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:04:26.925390    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bb6f0850-854e-46ff-8534-d9230bd40ec2" containerName="revoke-keys"
Jul 15 15:04:26.925436 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:04:26.925401    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="bb6f0850-854e-46ff-8534-d9230bd40ec2" containerName="revoke-keys"
Jul 15 15:04:26.925436 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:04:26.925421    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2170ee43-5e3a-4336-a847-8ba6edf9df71" containerName="revoke-keys"
Jul 15 15:04:26.925436 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:04:26.925428    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="2170ee43-5e3a-4336-a847-8ba6edf9df71" containerName="revoke-keys"
Jul 15 15:04:26.925576 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:04:26.925484    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="2170ee43-5e3a-4336-a847-8ba6edf9df71" containerName="revoke-keys"
Jul 15 15:04:26.925576 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:04:26.925495    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="bb6f0850-854e-46ff-8534-d9230bd40ec2" containerName="revoke-keys"
Jul 15 15:04:26.928624 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:04:26.928603    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9c3abd0e-l822b"
Jul 15 15:04:26.931031 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:04:26.931013    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 15:04:26.931168 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:04:26.931067    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7kbgk\""
Jul 15 15:04:26.935424 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:04:26.935405    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9c3abd0e-l822b"]
Jul 15 15:04:27.024514 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:04:27.024482    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c87c197-660d-43e6-bb5e-441f4ea74f8c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-9c3abd0e-l822b\" (UID: \"4c87c197-660d-43e6-bb5e-441f4ea74f8c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9c3abd0e-l822b"
Jul 15 15:04:27.125684 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:04:27.125647    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c87c197-660d-43e6-bb5e-441f4ea74f8c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-9c3abd0e-l822b\" (UID: \"4c87c197-660d-43e6-bb5e-441f4ea74f8c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9c3abd0e-l822b"
Jul 15 15:04:27.126308 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:04:27.126262    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c87c197-660d-43e6-bb5e-441f4ea74f8c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-9c3abd0e-l822b\" (UID: \"4c87c197-660d-43e6-bb5e-441f4ea74f8c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9c3abd0e-l822b"
Jul 15 15:04:27.240628 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:04:27.240548    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9c3abd0e-l822b"
Jul 15 15:04:27.371974 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:04:27.371940    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9c3abd0e-l822b"]
Jul 15 15:04:27.373526 ip-10-0-140-61 kubenswrapper[2571]: W0715 15:04:27.373503    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4c87c197_660d_43e6_bb5e_441f4ea74f8c.slice/crio-7bdc3ed0adbfa634ffe1bd754c2b87cf9cf2a2aba30f9d1f6c26b8fc285d09f2 WatchSource:0}: Error finding container 7bdc3ed0adbfa634ffe1bd754c2b87cf9cf2a2aba30f9d1f6c26b8fc285d09f2: Status 404 returned error can't find the container with id 7bdc3ed0adbfa634ffe1bd754c2b87cf9cf2a2aba30f9d1f6c26b8fc285d09f2
Jul 15 15:04:27.484075 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:04:27.484050    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:04:27.586517 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:04:27.586479    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:04:28.107138 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:04:28.107111    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9c3abd0e-l822b" event={"ID":"4c87c197-660d-43e6-bb5e-441f4ea74f8c","Type":"ContainerStarted","Data":"51ca542d57b5f4c5db9283a6fdf605d944a4d564d6c8dc3c5e0cc5b8b5cf05d5"}
Jul 15 15:04:28.107435 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:04:28.107160    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9c3abd0e-l822b" event={"ID":"4c87c197-660d-43e6-bb5e-441f4ea74f8c","Type":"ContainerStarted","Data":"7bdc3ed0adbfa634ffe1bd754c2b87cf9cf2a2aba30f9d1f6c26b8fc285d09f2"}
Jul 15 15:04:28.107435 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:04:28.107334    2571 scope.go:117] "RemoveContainer" containerID="51ca542d57b5f4c5db9283a6fdf605d944a4d564d6c8dc3c5e0cc5b8b5cf05d5"
Jul 15 15:04:29.115836 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:04:29.115792    2571 generic.go:356] "Generic (PLEG): container finished" podID="4c87c197-660d-43e6-bb5e-441f4ea74f8c" containerID="51ca542d57b5f4c5db9283a6fdf605d944a4d564d6c8dc3c5e0cc5b8b5cf05d5" exitCode=7
Jul 15 15:04:29.115836 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:04:29.115830    2571 generic.go:356] "Generic (PLEG): container finished" podID="4c87c197-660d-43e6-bb5e-441f4ea74f8c" containerID="f1671cc89950cf763b405a8957f96422fbdf3be218eb546a5625dfd3e3b5ab52" exitCode=7
Jul 15 15:04:29.116399 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:04:29.115859    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9c3abd0e-l822b" event={"ID":"4c87c197-660d-43e6-bb5e-441f4ea74f8c","Type":"ContainerDied","Data":"51ca542d57b5f4c5db9283a6fdf605d944a4d564d6c8dc3c5e0cc5b8b5cf05d5"}
Jul 15 15:04:29.116399 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:04:29.115917    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9c3abd0e-l822b" event={"ID":"4c87c197-660d-43e6-bb5e-441f4ea74f8c","Type":"ContainerDied","Data":"f1671cc89950cf763b405a8957f96422fbdf3be218eb546a5625dfd3e3b5ab52"}
Jul 15 15:04:29.116399 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:04:29.115943    2571 scope.go:117] "RemoveContainer" containerID="51ca542d57b5f4c5db9283a6fdf605d944a4d564d6c8dc3c5e0cc5b8b5cf05d5"
Jul 15 15:04:29.116399 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:04:29.116113    2571 scope.go:117] "RemoveContainer" containerID="f1671cc89950cf763b405a8957f96422fbdf3be218eb546a5625dfd3e3b5ab52"
Jul 15 15:04:29.116399 ip-10-0-140-61 kubenswrapper[2571]: E0715 15:04:29.116370    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-9c3abd0e-l822b_odh-ai-gateway-infra(4c87c197-660d-43e6-bb5e-441f4ea74f8c)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9c3abd0e-l822b" podUID="4c87c197-660d-43e6-bb5e-441f4ea74f8c"
Jul 15 15:04:29.128555 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:04:29.128534    2571 scope.go:117] "RemoveContainer" containerID="51ca542d57b5f4c5db9283a6fdf605d944a4d564d6c8dc3c5e0cc5b8b5cf05d5"
Jul 15 15:04:29.128883 ip-10-0-140-61 kubenswrapper[2571]: E0715 15:04:29.128860    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"51ca542d57b5f4c5db9283a6fdf605d944a4d564d6c8dc3c5e0cc5b8b5cf05d5\": container with ID starting with 51ca542d57b5f4c5db9283a6fdf605d944a4d564d6c8dc3c5e0cc5b8b5cf05d5 not found: ID does not exist" containerID="51ca542d57b5f4c5db9283a6fdf605d944a4d564d6c8dc3c5e0cc5b8b5cf05d5"
Jul 15 15:04:29.128934 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:04:29.128893    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"51ca542d57b5f4c5db9283a6fdf605d944a4d564d6c8dc3c5e0cc5b8b5cf05d5"} err="failed to get container status \"51ca542d57b5f4c5db9283a6fdf605d944a4d564d6c8dc3c5e0cc5b8b5cf05d5\": rpc error: code = NotFound desc = could not find container \"51ca542d57b5f4c5db9283a6fdf605d944a4d564d6c8dc3c5e0cc5b8b5cf05d5\": container with ID starting with 51ca542d57b5f4c5db9283a6fdf605d944a4d564d6c8dc3c5e0cc5b8b5cf05d5 not found: ID does not exist"
Jul 15 15:04:30.122527 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:04:30.122499    2571 scope.go:117] "RemoveContainer" containerID="f1671cc89950cf763b405a8957f96422fbdf3be218eb546a5625dfd3e3b5ab52"
Jul 15 15:04:30.122952 ip-10-0-140-61 kubenswrapper[2571]: E0715 15:04:30.122699    2571 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-9c3abd0e-l822b_odh-ai-gateway-infra(4c87c197-660d-43e6-bb5e-441f4ea74f8c)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9c3abd0e-l822b" podUID="4c87c197-660d-43e6-bb5e-441f4ea74f8c"
Jul 15 15:04:31.110645 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:04:31.110614    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:04:31.711852 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:04:31.711819    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:04:43.747757 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:04:43.747721    2571 scope.go:117] "RemoveContainer" containerID="f1671cc89950cf763b405a8957f96422fbdf3be218eb546a5625dfd3e3b5ab52"
Jul 15 15:04:44.192159 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:04:44.192121    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9c3abd0e-l822b" event={"ID":"4c87c197-660d-43e6-bb5e-441f4ea74f8c","Type":"ContainerStarted","Data":"b7a6d8ddb7d7269027e3941580b7d883939d6745b435712bef5ab9092043b05d"}
Jul 15 15:04:44.210287 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:04:44.210214    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9c3abd0e-l822b" podStartSLOduration=18.210194422 podStartE2EDuration="18.210194422s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:04:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:04:44.208405563 +0000 UTC m=+1867.724223435" watchObservedRunningTime="2026-07-15 15:04:44.210194422 +0000 UTC m=+1867.726012697"
Jul 15 15:04:45.198190 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:04:45.198154    2571 generic.go:356] "Generic (PLEG): container finished" podID="4c87c197-660d-43e6-bb5e-441f4ea74f8c" containerID="b7a6d8ddb7d7269027e3941580b7d883939d6745b435712bef5ab9092043b05d" exitCode=0
Jul 15 15:04:45.198652 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:04:45.198208    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9c3abd0e-l822b" event={"ID":"4c87c197-660d-43e6-bb5e-441f4ea74f8c","Type":"ContainerDied","Data":"b7a6d8ddb7d7269027e3941580b7d883939d6745b435712bef5ab9092043b05d"}
Jul 15 15:04:45.198652 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:04:45.198284    2571 scope.go:117] "RemoveContainer" containerID="f1671cc89950cf763b405a8957f96422fbdf3be218eb546a5625dfd3e3b5ab52"
Jul 15 15:04:45.225883 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:04:45.225851    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9c3abd0e-l822b"]
Jul 15 15:04:46.337101 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:04:46.337074    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9c3abd0e-l822b"
Jul 15 15:04:46.497470 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:04:46.497373    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c87c197-660d-43e6-bb5e-441f4ea74f8c-maas-api-service-ca\") pod \"4c87c197-660d-43e6-bb5e-441f4ea74f8c\" (UID: \"4c87c197-660d-43e6-bb5e-441f4ea74f8c\") "
Jul 15 15:04:46.497725 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:04:46.497703    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4c87c197-660d-43e6-bb5e-441f4ea74f8c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4c87c197-660d-43e6-bb5e-441f4ea74f8c" (UID: "4c87c197-660d-43e6-bb5e-441f4ea74f8c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 15:04:46.598241 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:04:46.598202    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4c87c197-660d-43e6-bb5e-441f4ea74f8c-maas-api-service-ca\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 15:04:47.210877 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:04:47.210842    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9c3abd0e-l822b"
Jul 15 15:04:47.211086 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:04:47.210877    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9c3abd0e-l822b" event={"ID":"4c87c197-660d-43e6-bb5e-441f4ea74f8c","Type":"ContainerDied","Data":"7bdc3ed0adbfa634ffe1bd754c2b87cf9cf2a2aba30f9d1f6c26b8fc285d09f2"}
Jul 15 15:04:47.211086 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:04:47.210931    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7bdc3ed0adbfa634ffe1bd754c2b87cf9cf2a2aba30f9d1f6c26b8fc285d09f2"
Jul 15 15:04:47.248216 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:04:47.248172    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9c3abd0e-l822b"]
Jul 15 15:04:47.257840 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:04:47.257799    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9c3abd0e-l822b"]
Jul 15 15:04:48.752850 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:04:48.752815    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4c87c197-660d-43e6-bb5e-441f4ea74f8c" path="/var/lib/kubelet/pods/4c87c197-660d-43e6-bb5e-441f4ea74f8c/volumes"
Jul 15 15:04:55.846948 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:04:55.846914    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:05:01.897808 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:05:01.897728    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:05:02.104054 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:05:02.104020    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:05:06.771678 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:05:06.771645    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:05:27.025459 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:05:27.025424    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9c3abd0e-khkhz"]
Jul 15 15:05:27.025915 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:05:27.025758    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c87c197-660d-43e6-bb5e-441f4ea74f8c" containerName="revoke-keys"
Jul 15 15:05:27.025915 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:05:27.025768    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c87c197-660d-43e6-bb5e-441f4ea74f8c" containerName="revoke-keys"
Jul 15 15:05:27.025915 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:05:27.025779    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c87c197-660d-43e6-bb5e-441f4ea74f8c" containerName="revoke-keys"
Jul 15 15:05:27.025915 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:05:27.025784    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c87c197-660d-43e6-bb5e-441f4ea74f8c" containerName="revoke-keys"
Jul 15 15:05:27.025915 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:05:27.025850    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c87c197-660d-43e6-bb5e-441f4ea74f8c" containerName="revoke-keys"
Jul 15 15:05:27.025915 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:05:27.025863    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c87c197-660d-43e6-bb5e-441f4ea74f8c" containerName="revoke-keys"
Jul 15 15:05:27.028879 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:05:27.028860    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9c3abd0e-khkhz"
Jul 15 15:05:27.031409 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:05:27.031388    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7kbgk\""
Jul 15 15:05:27.031531 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:05:27.031454    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 15:05:27.035494 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:05:27.035474    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9c3abd0e-khkhz"]
Jul 15 15:05:27.165652 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:05:27.165611    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/60b24b3f-51e7-494b-ba9c-88841ac4d3e6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-9c3abd0e-khkhz\" (UID: \"60b24b3f-51e7-494b-ba9c-88841ac4d3e6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9c3abd0e-khkhz"
Jul 15 15:05:27.266717 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:05:27.266679    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/60b24b3f-51e7-494b-ba9c-88841ac4d3e6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-9c3abd0e-khkhz\" (UID: \"60b24b3f-51e7-494b-ba9c-88841ac4d3e6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9c3abd0e-khkhz"
Jul 15 15:05:27.267337 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:05:27.267318    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/60b24b3f-51e7-494b-ba9c-88841ac4d3e6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-9c3abd0e-khkhz\" (UID: \"60b24b3f-51e7-494b-ba9c-88841ac4d3e6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9c3abd0e-khkhz"
Jul 15 15:05:27.340173 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:05:27.340142    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9c3abd0e-khkhz"
Jul 15 15:05:27.474087 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:05:27.474060    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9c3abd0e-khkhz"]
Jul 15 15:05:27.476443 ip-10-0-140-61 kubenswrapper[2571]: W0715 15:05:27.476410    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod60b24b3f_51e7_494b_ba9c_88841ac4d3e6.slice/crio-84d1fcf1dfa1ae10862d9191d9bc60cc6d36281b987364cd9396f0169a1106b3 WatchSource:0}: Error finding container 84d1fcf1dfa1ae10862d9191d9bc60cc6d36281b987364cd9396f0169a1106b3: Status 404 returned error can't find the container with id 84d1fcf1dfa1ae10862d9191d9bc60cc6d36281b987364cd9396f0169a1106b3
Jul 15 15:05:28.414546 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:05:28.414500    2571 generic.go:356] "Generic (PLEG): container finished" podID="60b24b3f-51e7-494b-ba9c-88841ac4d3e6" containerID="55dbb7097355c694a0d135e6d09397b2d8a485ffba15c3cd6937f2289bb1753d" exitCode=0
Jul 15 15:05:28.414917 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:05:28.414583    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9c3abd0e-khkhz" event={"ID":"60b24b3f-51e7-494b-ba9c-88841ac4d3e6","Type":"ContainerDied","Data":"55dbb7097355c694a0d135e6d09397b2d8a485ffba15c3cd6937f2289bb1753d"}
Jul 15 15:05:28.414917 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:05:28.414672    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9c3abd0e-khkhz" event={"ID":"60b24b3f-51e7-494b-ba9c-88841ac4d3e6","Type":"ContainerStarted","Data":"84d1fcf1dfa1ae10862d9191d9bc60cc6d36281b987364cd9396f0169a1106b3"}
Jul 15 15:05:29.550734 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:05:29.550707    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9c3abd0e-khkhz"
Jul 15 15:05:29.687522 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:05:29.687432    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/60b24b3f-51e7-494b-ba9c-88841ac4d3e6-maas-api-service-ca\") pod \"60b24b3f-51e7-494b-ba9c-88841ac4d3e6\" (UID: \"60b24b3f-51e7-494b-ba9c-88841ac4d3e6\") "
Jul 15 15:05:29.687795 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:05:29.687773    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/60b24b3f-51e7-494b-ba9c-88841ac4d3e6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "60b24b3f-51e7-494b-ba9c-88841ac4d3e6" (UID: "60b24b3f-51e7-494b-ba9c-88841ac4d3e6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 15:05:29.788281 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:05:29.788242    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/60b24b3f-51e7-494b-ba9c-88841ac4d3e6-maas-api-service-ca\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 15:05:30.424770 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:05:30.424737    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9c3abd0e-khkhz"
Jul 15 15:05:30.424954 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:05:30.424748    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-9c3abd0e-khkhz" event={"ID":"60b24b3f-51e7-494b-ba9c-88841ac4d3e6","Type":"ContainerDied","Data":"84d1fcf1dfa1ae10862d9191d9bc60cc6d36281b987364cd9396f0169a1106b3"}
Jul 15 15:05:30.424954 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:05:30.424859    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="84d1fcf1dfa1ae10862d9191d9bc60cc6d36281b987364cd9396f0169a1106b3"
Jul 15 15:05:37.582946 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:05:37.582913    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:05:40.397740 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:05:40.397703    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 15:05:42.117011 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:05:42.116981    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:05:48.129539 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:05:48.129499    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:05:48.192479 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:05:48.192439    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:05:52.335631 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:05:52.335595    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:05:52.919766 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:05:52.919737    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:05:53.020097 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:05:53.020068    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:05:53.120310 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:05:53.120256    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:05:54.598312 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:05:54.598262    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:05:59.093042 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:05:59.093007    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:06:00.756702 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:06:00.756673    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:06:00.863575 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:06:00.863540    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:06:00.961729 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:06:00.961694    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:06:01.226574 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:06:01.226531    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:06:01.497839 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:06:01.497751    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:06:30.209187 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:06:30.209101    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:06:33.879580 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:06:33.879545    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:06:35.074185 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:06:35.074144    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:06:38.000390 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:06:38.000357    2571 scope.go:117] "RemoveContainer" containerID="246e66aa3c9d2f89897148fd37aed3b495953c8d99332584d6ea0af485d89b07"
Jul 15 15:06:49.962816 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:06:49.962776    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:06:56.212453 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:06:56.212412    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:06:56.637948 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:06:56.637915    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:06:56.735300 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:06:56.735241    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:07:06.943347 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:07:06.943317    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:07:07.809047 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:07:07.808996    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:07:14.065684 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:07:14.065625    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:07:14.134869 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:07:14.134825    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:07:14.209481 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:07:14.209450    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:07:14.303143 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:07:14.303105    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:07:14.403546 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:07:14.403456    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:07:15.135740 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:07:15.135703    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:07:15.226069 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:07:15.226027    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:07:15.322165 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:07:15.322129    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:07:16.954328 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:07:16.954298    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:07:17.496157 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:07:17.496121    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 15:07:23.165875 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:07:23.165834    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:07:23.265983 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:07:23.265951    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:07:23.840922 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:07:23.840890    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:07:26.891241 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:07:26.891204    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 15:07:30.103526 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:07:30.103485    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:07:30.165728 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:07:30.165693    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:07:30.354378 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:07:30.354264    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:07:30.703795 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:07:30.703712    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:07:31.232714 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:07:31.232682    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:07:33.557541 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:07:33.557502    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:07:33.659597 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:07:33.659563    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:07:33.756602 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:07:33.756574    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:07:34.313941 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:07:34.313900    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:07:34.414674 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:07:34.414637    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:07:34.516405 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:07:34.516360    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:07:38.081066 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:07:38.081026    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:07:38.750533 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:07:38.750499    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:07:38.849559 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:07:38.849525    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:07:38.893258 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:07:38.893225    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 15:07:39.193686 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:07:39.193648    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:07:45.417443 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:07:45.417402    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:07:45.516798 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:07:45.516766    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:07:45.796826 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:07:45.796740    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-88acceda-xzhft"]
Jul 15 15:07:45.797128 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:07:45.797114    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="60b24b3f-51e7-494b-ba9c-88841ac4d3e6" containerName="revoke-keys"
Jul 15 15:07:45.797177 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:07:45.797129    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="60b24b3f-51e7-494b-ba9c-88841ac4d3e6" containerName="revoke-keys"
Jul 15 15:07:45.797177 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:07:45.797158    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4c87c197-660d-43e6-bb5e-441f4ea74f8c" containerName="revoke-keys"
Jul 15 15:07:45.797177 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:07:45.797164    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="4c87c197-660d-43e6-bb5e-441f4ea74f8c" containerName="revoke-keys"
Jul 15 15:07:45.797297 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:07:45.797225    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="60b24b3f-51e7-494b-ba9c-88841ac4d3e6" containerName="revoke-keys"
Jul 15 15:07:45.797297 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:07:45.797235    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="4c87c197-660d-43e6-bb5e-441f4ea74f8c" containerName="revoke-keys"
Jul 15 15:07:45.800349 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:07:45.800331    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-88acceda-xzhft"
Jul 15 15:07:45.802932 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:07:45.802912    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 15:07:45.803058 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:07:45.802983    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7kbgk\""
Jul 15 15:07:45.808589 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:07:45.808559    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-88acceda-xzhft"]
Jul 15 15:07:45.905321 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:07:45.905258    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0ef5eb5-aa2e-4fe3-baf7-2486d64b1f06-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-88acceda-xzhft\" (UID: \"b0ef5eb5-aa2e-4fe3-baf7-2486d64b1f06\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-88acceda-xzhft"
Jul 15 15:07:46.006866 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:07:46.006826    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0ef5eb5-aa2e-4fe3-baf7-2486d64b1f06-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-88acceda-xzhft\" (UID: \"b0ef5eb5-aa2e-4fe3-baf7-2486d64b1f06\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-88acceda-xzhft"
Jul 15 15:07:46.007511 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:07:46.007491    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0ef5eb5-aa2e-4fe3-baf7-2486d64b1f06-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-88acceda-xzhft\" (UID: \"b0ef5eb5-aa2e-4fe3-baf7-2486d64b1f06\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-88acceda-xzhft"
Jul 15 15:07:46.112531 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:07:46.112499    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-88acceda-xzhft"
Jul 15 15:07:46.247579 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:07:46.247552    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-88acceda-xzhft"]
Jul 15 15:07:46.249830 ip-10-0-140-61 kubenswrapper[2571]: W0715 15:07:46.249804    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0ef5eb5_aa2e_4fe3_baf7_2486d64b1f06.slice/crio-e5b6301fa41f158e4798fea56b01d7b213bf9f99bb9f91f19c971b7ac5565068 WatchSource:0}: Error finding container e5b6301fa41f158e4798fea56b01d7b213bf9f99bb9f91f19c971b7ac5565068: Status 404 returned error can't find the container with id e5b6301fa41f158e4798fea56b01d7b213bf9f99bb9f91f19c971b7ac5565068
Jul 15 15:07:47.083023 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:07:47.082986    2571 generic.go:356] "Generic (PLEG): container finished" podID="b0ef5eb5-aa2e-4fe3-baf7-2486d64b1f06" containerID="feea942ed3c6b559521872dade1d53292cb5f75a8ce6148b874a6f8b143029d5" exitCode=0
Jul 15 15:07:47.083456 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:07:47.083078    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-88acceda-xzhft" event={"ID":"b0ef5eb5-aa2e-4fe3-baf7-2486d64b1f06","Type":"ContainerDied","Data":"feea942ed3c6b559521872dade1d53292cb5f75a8ce6148b874a6f8b143029d5"}
Jul 15 15:07:47.083456 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:07:47.083130    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-88acceda-xzhft" event={"ID":"b0ef5eb5-aa2e-4fe3-baf7-2486d64b1f06","Type":"ContainerStarted","Data":"e5b6301fa41f158e4798fea56b01d7b213bf9f99bb9f91f19c971b7ac5565068"}
Jul 15 15:07:48.220787 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:07:48.220757    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-88acceda-xzhft"
Jul 15 15:07:48.329531 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:07:48.329491    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0ef5eb5-aa2e-4fe3-baf7-2486d64b1f06-maas-api-service-ca\") pod \"b0ef5eb5-aa2e-4fe3-baf7-2486d64b1f06\" (UID: \"b0ef5eb5-aa2e-4fe3-baf7-2486d64b1f06\") "
Jul 15 15:07:48.329858 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:07:48.329834    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b0ef5eb5-aa2e-4fe3-baf7-2486d64b1f06-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b0ef5eb5-aa2e-4fe3-baf7-2486d64b1f06" (UID: "b0ef5eb5-aa2e-4fe3-baf7-2486d64b1f06"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 15:07:48.430593 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:07:48.430484    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b0ef5eb5-aa2e-4fe3-baf7-2486d64b1f06-maas-api-service-ca\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 15:07:49.093949 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:07:49.093920    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-88acceda-xzhft"
Jul 15 15:07:49.094124 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:07:49.093949    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-88acceda-xzhft" event={"ID":"b0ef5eb5-aa2e-4fe3-baf7-2486d64b1f06","Type":"ContainerDied","Data":"e5b6301fa41f158e4798fea56b01d7b213bf9f99bb9f91f19c971b7ac5565068"}
Jul 15 15:07:49.094124 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:07:49.094003    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e5b6301fa41f158e4798fea56b01d7b213bf9f99bb9f91f19c971b7ac5565068"
Jul 15 15:07:56.318211 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:07:56.318169    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:07:59.394104 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:07:59.394019    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 15:08:00.884703 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:00.884668    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:08:07.124435 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:07.124396    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:08:07.224826 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:07.224791    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:08:11.569118 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:11.569087    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:08:11.786996 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:11.786965    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:08:11.899683 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:11.899606    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:08:11.998884 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:11.998856    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:08:12.108393 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:12.108361    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:08:16.687814 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:16.687777    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:08:16.788109 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:16.788077    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:08:18.277920 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:18.277891    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:08:18.328147 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:18.328106    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:08:18.406998 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:18.406969    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:08:18.507661 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:18.507629    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:08:18.640561 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:18.640523    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:08:24.523388 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:24.523348    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:08:24.581972 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:24.581941    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:08:31.414489 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:31.414447    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:08:31.733911 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:31.733834    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:08:34.541321 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:34.541289    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:08:34.853546 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:34.853513    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:08:34.956385 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:34.956356    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:08:35.055375 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:35.055335    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:08:35.155229 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:35.155150    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:08:35.683107 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:35.683074    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:08:35.786057 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:35.786015    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:08:37.988091 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:37.988064    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-42mdh_0de0f3ad-e228-4c27-9b2c-de1a5844dcdb/console-operator/1.log"
Jul 15 15:08:37.989283 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:37.989248    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-42mdh_0de0f3ad-e228-4c27-9b2c-de1a5844dcdb/console-operator/1.log"
Jul 15 15:08:37.992558 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:37.992541    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8tt2_12bf26b1-5c4a-4e51-beb3-b17d7e7c4656/ovn-acl-logging/0.log"
Jul 15 15:08:37.993455 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:37.993436    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8tt2_12bf26b1-5c4a-4e51-beb3-b17d7e7c4656/ovn-acl-logging/0.log"
Jul 15 15:08:38.026148 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:38.026123    2571 scope.go:117] "RemoveContainer" containerID="0aa6f7a0953b5e7b1e7c9ca416b8d2654eedd108ee3382f27663817a2af27617"
Jul 15 15:08:38.386786 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:38.386752    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 15:08:39.344322 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:39.344290    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:08:48.211984 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:48.211950    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-ca6c4f33/e2e-lifecycle-model-ca6c4f33-kserve-579ccd899f-zfklj"]
Jul 15 15:08:48.212482 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:48.212329    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b0ef5eb5-aa2e-4fe3-baf7-2486d64b1f06" containerName="revoke-keys"
Jul 15 15:08:48.212482 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:48.212341    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="b0ef5eb5-aa2e-4fe3-baf7-2486d64b1f06" containerName="revoke-keys"
Jul 15 15:08:48.212482 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:48.212429    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="b0ef5eb5-aa2e-4fe3-baf7-2486d64b1f06" containerName="revoke-keys"
Jul 15 15:08:48.215515 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:48.215495    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-ca6c4f33/e2e-lifecycle-model-ca6c4f33-kserve-579ccd899f-zfklj"
Jul 15 15:08:48.218058 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:48.218031    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-ca6c4f33\"/\"openshift-service-ca.crt\""
Jul 15 15:08:48.218193 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:48.218058    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-ca6c4f33\"/\"kube-root-ca.crt\""
Jul 15 15:08:48.219054 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:48.219036    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-ca6c4f33\"/\"e2e-lifecycle-model-ca6c4f33-kserve-self-signed-certs\""
Jul 15 15:08:48.219163 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:48.219082    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-ca6c4f33\"/\"default-dockercfg-d44m9\""
Jul 15 15:08:48.222793 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:48.222767    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-ca6c4f33/e2e-lifecycle-model-ca6c4f33-kserve-579ccd899f-zfklj"]
Jul 15 15:08:48.225529 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:48.225509    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:08:48.270361 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:48.270323    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rwkcm\" (UniqueName: \"kubernetes.io/projected/5a373faa-83be-4206-a107-052bd67aa98d-kube-api-access-rwkcm\") pod \"e2e-lifecycle-model-ca6c4f33-kserve-579ccd899f-zfklj\" (UID: \"5a373faa-83be-4206-a107-052bd67aa98d\") " pod="ai-tenant-e2e-mt-ca6c4f33/e2e-lifecycle-model-ca6c4f33-kserve-579ccd899f-zfklj"
Jul 15 15:08:48.270523 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:48.270381    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a373faa-83be-4206-a107-052bd67aa98d-model-cache\") pod \"e2e-lifecycle-model-ca6c4f33-kserve-579ccd899f-zfklj\" (UID: \"5a373faa-83be-4206-a107-052bd67aa98d\") " pod="ai-tenant-e2e-mt-ca6c4f33/e2e-lifecycle-model-ca6c4f33-kserve-579ccd899f-zfklj"
Jul 15 15:08:48.270523 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:48.270410    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a373faa-83be-4206-a107-052bd67aa98d-home\") pod \"e2e-lifecycle-model-ca6c4f33-kserve-579ccd899f-zfklj\" (UID: \"5a373faa-83be-4206-a107-052bd67aa98d\") " pod="ai-tenant-e2e-mt-ca6c4f33/e2e-lifecycle-model-ca6c4f33-kserve-579ccd899f-zfklj"
Jul 15 15:08:48.270523 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:48.270508    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a373faa-83be-4206-a107-052bd67aa98d-dshm\") pod \"e2e-lifecycle-model-ca6c4f33-kserve-579ccd899f-zfklj\" (UID: \"5a373faa-83be-4206-a107-052bd67aa98d\") " pod="ai-tenant-e2e-mt-ca6c4f33/e2e-lifecycle-model-ca6c4f33-kserve-579ccd899f-zfklj"
Jul 15 15:08:48.270676 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:48.270535    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a373faa-83be-4206-a107-052bd67aa98d-tmp-dir\") pod \"e2e-lifecycle-model-ca6c4f33-kserve-579ccd899f-zfklj\" (UID: \"5a373faa-83be-4206-a107-052bd67aa98d\") " pod="ai-tenant-e2e-mt-ca6c4f33/e2e-lifecycle-model-ca6c4f33-kserve-579ccd899f-zfklj"
Jul 15 15:08:48.270676 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:48.270554    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a373faa-83be-4206-a107-052bd67aa98d-tls-certs\") pod \"e2e-lifecycle-model-ca6c4f33-kserve-579ccd899f-zfklj\" (UID: \"5a373faa-83be-4206-a107-052bd67aa98d\") " pod="ai-tenant-e2e-mt-ca6c4f33/e2e-lifecycle-model-ca6c4f33-kserve-579ccd899f-zfklj"
Jul 15 15:08:48.371589 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:48.371555    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a373faa-83be-4206-a107-052bd67aa98d-home\") pod \"e2e-lifecycle-model-ca6c4f33-kserve-579ccd899f-zfklj\" (UID: \"5a373faa-83be-4206-a107-052bd67aa98d\") " pod="ai-tenant-e2e-mt-ca6c4f33/e2e-lifecycle-model-ca6c4f33-kserve-579ccd899f-zfklj"
Jul 15 15:08:48.371761 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:48.371632    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a373faa-83be-4206-a107-052bd67aa98d-dshm\") pod \"e2e-lifecycle-model-ca6c4f33-kserve-579ccd899f-zfklj\" (UID: \"5a373faa-83be-4206-a107-052bd67aa98d\") " pod="ai-tenant-e2e-mt-ca6c4f33/e2e-lifecycle-model-ca6c4f33-kserve-579ccd899f-zfklj"
Jul 15 15:08:48.371761 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:48.371660    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a373faa-83be-4206-a107-052bd67aa98d-tmp-dir\") pod \"e2e-lifecycle-model-ca6c4f33-kserve-579ccd899f-zfklj\" (UID: \"5a373faa-83be-4206-a107-052bd67aa98d\") " pod="ai-tenant-e2e-mt-ca6c4f33/e2e-lifecycle-model-ca6c4f33-kserve-579ccd899f-zfklj"
Jul 15 15:08:48.371761 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:48.371681    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a373faa-83be-4206-a107-052bd67aa98d-tls-certs\") pod \"e2e-lifecycle-model-ca6c4f33-kserve-579ccd899f-zfklj\" (UID: \"5a373faa-83be-4206-a107-052bd67aa98d\") " pod="ai-tenant-e2e-mt-ca6c4f33/e2e-lifecycle-model-ca6c4f33-kserve-579ccd899f-zfklj"
Jul 15 15:08:48.371761 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:48.371748    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rwkcm\" (UniqueName: \"kubernetes.io/projected/5a373faa-83be-4206-a107-052bd67aa98d-kube-api-access-rwkcm\") pod \"e2e-lifecycle-model-ca6c4f33-kserve-579ccd899f-zfklj\" (UID: \"5a373faa-83be-4206-a107-052bd67aa98d\") " pod="ai-tenant-e2e-mt-ca6c4f33/e2e-lifecycle-model-ca6c4f33-kserve-579ccd899f-zfklj"
Jul 15 15:08:48.371962 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:48.371803    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a373faa-83be-4206-a107-052bd67aa98d-model-cache\") pod \"e2e-lifecycle-model-ca6c4f33-kserve-579ccd899f-zfklj\" (UID: \"5a373faa-83be-4206-a107-052bd67aa98d\") " pod="ai-tenant-e2e-mt-ca6c4f33/e2e-lifecycle-model-ca6c4f33-kserve-579ccd899f-zfklj"
Jul 15 15:08:48.372034 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:48.372011    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a373faa-83be-4206-a107-052bd67aa98d-home\") pod \"e2e-lifecycle-model-ca6c4f33-kserve-579ccd899f-zfklj\" (UID: \"5a373faa-83be-4206-a107-052bd67aa98d\") " pod="ai-tenant-e2e-mt-ca6c4f33/e2e-lifecycle-model-ca6c4f33-kserve-579ccd899f-zfklj"
Jul 15 15:08:48.372096 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:48.372030    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a373faa-83be-4206-a107-052bd67aa98d-tmp-dir\") pod \"e2e-lifecycle-model-ca6c4f33-kserve-579ccd899f-zfklj\" (UID: \"5a373faa-83be-4206-a107-052bd67aa98d\") " pod="ai-tenant-e2e-mt-ca6c4f33/e2e-lifecycle-model-ca6c4f33-kserve-579ccd899f-zfklj"
Jul 15 15:08:48.372096 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:48.372090    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a373faa-83be-4206-a107-052bd67aa98d-model-cache\") pod \"e2e-lifecycle-model-ca6c4f33-kserve-579ccd899f-zfklj\" (UID: \"5a373faa-83be-4206-a107-052bd67aa98d\") " pod="ai-tenant-e2e-mt-ca6c4f33/e2e-lifecycle-model-ca6c4f33-kserve-579ccd899f-zfklj"
Jul 15 15:08:48.373961 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:48.373943    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a373faa-83be-4206-a107-052bd67aa98d-dshm\") pod \"e2e-lifecycle-model-ca6c4f33-kserve-579ccd899f-zfklj\" (UID: \"5a373faa-83be-4206-a107-052bd67aa98d\") " pod="ai-tenant-e2e-mt-ca6c4f33/e2e-lifecycle-model-ca6c4f33-kserve-579ccd899f-zfklj"
Jul 15 15:08:48.374149 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:48.374133    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a373faa-83be-4206-a107-052bd67aa98d-tls-certs\") pod \"e2e-lifecycle-model-ca6c4f33-kserve-579ccd899f-zfklj\" (UID: \"5a373faa-83be-4206-a107-052bd67aa98d\") " pod="ai-tenant-e2e-mt-ca6c4f33/e2e-lifecycle-model-ca6c4f33-kserve-579ccd899f-zfklj"
Jul 15 15:08:48.380660 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:48.380634    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rwkcm\" (UniqueName: \"kubernetes.io/projected/5a373faa-83be-4206-a107-052bd67aa98d-kube-api-access-rwkcm\") pod \"e2e-lifecycle-model-ca6c4f33-kserve-579ccd899f-zfklj\" (UID: \"5a373faa-83be-4206-a107-052bd67aa98d\") " pod="ai-tenant-e2e-mt-ca6c4f33/e2e-lifecycle-model-ca6c4f33-kserve-579ccd899f-zfklj"
Jul 15 15:08:48.525788 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:48.525702    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-ca6c4f33/e2e-lifecycle-model-ca6c4f33-kserve-579ccd899f-zfklj"
Jul 15 15:08:48.660188 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:48.660160    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-ca6c4f33/e2e-lifecycle-model-ca6c4f33-kserve-579ccd899f-zfklj"]
Jul 15 15:08:48.662123 ip-10-0-140-61 kubenswrapper[2571]: W0715 15:08:48.662095    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod5a373faa_83be_4206_a107_052bd67aa98d.slice/crio-e7520fe8066ae6203563f51a7abe2b540c212368ef66f46a0f0e9b64c443ee84 WatchSource:0}: Error finding container e7520fe8066ae6203563f51a7abe2b540c212368ef66f46a0f0e9b64c443ee84: Status 404 returned error can't find the container with id e7520fe8066ae6203563f51a7abe2b540c212368ef66f46a0f0e9b64c443ee84
Jul 15 15:08:49.389773 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:49.389734    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-ca6c4f33/e2e-lifecycle-model-ca6c4f33-kserve-579ccd899f-zfklj" event={"ID":"5a373faa-83be-4206-a107-052bd67aa98d","Type":"ContainerStarted","Data":"7b1bcb0d7289a73c52e5de94602d11a28533b30164a77067dbaec3a0022b1979"}
Jul 15 15:08:49.390130 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:49.389784    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-ca6c4f33/e2e-lifecycle-model-ca6c4f33-kserve-579ccd899f-zfklj" event={"ID":"5a373faa-83be-4206-a107-052bd67aa98d","Type":"ContainerStarted","Data":"e7520fe8066ae6203563f51a7abe2b540c212368ef66f46a0f0e9b64c443ee84"}
Jul 15 15:08:49.410642 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:49.410591    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-ca6c4f33/e2e-lifecycle-model-ca6c4f33-kserve-579ccd899f-zfklj" podStartSLOduration=1.410568381 podStartE2EDuration="1.410568381s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:08:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:08:49.408836644 +0000 UTC m=+2112.924654516" watchObservedRunningTime="2026-07-15 15:08:49.410568381 +0000 UTC m=+2112.926386280"
Jul 15 15:08:51.860264 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:51.860229    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 15:08:58.526663 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:58.526608    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-ca6c4f33/e2e-lifecycle-model-ca6c4f33-kserve-579ccd899f-zfklj"
Jul 15 15:08:58.527085 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:58.526681    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-ca6c4f33/e2e-lifecycle-model-ca6c4f33-kserve-579ccd899f-zfklj"
Jul 15 15:08:58.539153 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:58.539126    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-ca6c4f33/e2e-lifecycle-model-ca6c4f33-kserve-579ccd899f-zfklj"
Jul 15 15:08:59.448363 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:08:59.448335    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-ca6c4f33/e2e-lifecycle-model-ca6c4f33-kserve-579ccd899f-zfklj"
Jul 15 15:09:06.402510 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:09:06.402474    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 15:09:23.910835 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:09:23.910803    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:09:27.585686 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:09:27.585654    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 15:09:28.525055 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:09:28.525021    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:09:33.508984 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:09:33.508946    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-ca6c4f33/e2e-lifecycle-model-ca6c4f33-kserve-579ccd899f-zfklj"]
Jul 15 15:09:33.560033 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:09:33.560007    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:09:48.529901 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:09:48.529834    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-ca6c4f33/e2e-lifecycle-model-ca6c4f33-kserve-579ccd899f-zfklj" podUID="5a373faa-83be-4206-a107-052bd67aa98d" containerName="main" containerID="cri-o://7b1bcb0d7289a73c52e5de94602d11a28533b30164a77067dbaec3a0022b1979" gracePeriod=45
Jul 15 15:09:48.673418 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:09:48.673383    2571 generic.go:356] "Generic (PLEG): container finished" podID="5a373faa-83be-4206-a107-052bd67aa98d" containerID="7b1bcb0d7289a73c52e5de94602d11a28533b30164a77067dbaec3a0022b1979" exitCode=0
Jul 15 15:09:48.673568 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:09:48.673453    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-ca6c4f33/e2e-lifecycle-model-ca6c4f33-kserve-579ccd899f-zfklj" event={"ID":"5a373faa-83be-4206-a107-052bd67aa98d","Type":"ContainerDied","Data":"7b1bcb0d7289a73c52e5de94602d11a28533b30164a77067dbaec3a0022b1979"}
Jul 15 15:09:48.783637 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:09:48.783580    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-ca6c4f33/e2e-lifecycle-model-ca6c4f33-kserve-579ccd899f-zfklj"
Jul 15 15:09:48.915259 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:09:48.915213    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a373faa-83be-4206-a107-052bd67aa98d-tmp-dir\") pod \"5a373faa-83be-4206-a107-052bd67aa98d\" (UID: \"5a373faa-83be-4206-a107-052bd67aa98d\") "
Jul 15 15:09:48.915483 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:09:48.915308    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a373faa-83be-4206-a107-052bd67aa98d-home\") pod \"5a373faa-83be-4206-a107-052bd67aa98d\" (UID: \"5a373faa-83be-4206-a107-052bd67aa98d\") "
Jul 15 15:09:48.915483 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:09:48.915337    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a373faa-83be-4206-a107-052bd67aa98d-model-cache\") pod \"5a373faa-83be-4206-a107-052bd67aa98d\" (UID: \"5a373faa-83be-4206-a107-052bd67aa98d\") "
Jul 15 15:09:48.915483 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:09:48.915364    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a373faa-83be-4206-a107-052bd67aa98d-dshm\") pod \"5a373faa-83be-4206-a107-052bd67aa98d\" (UID: \"5a373faa-83be-4206-a107-052bd67aa98d\") "
Jul 15 15:09:48.915483 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:09:48.915412    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a373faa-83be-4206-a107-052bd67aa98d-tls-certs\") pod \"5a373faa-83be-4206-a107-052bd67aa98d\" (UID: \"5a373faa-83be-4206-a107-052bd67aa98d\") "
Jul 15 15:09:48.915483 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:09:48.915448    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rwkcm\" (UniqueName: \"kubernetes.io/projected/5a373faa-83be-4206-a107-052bd67aa98d-kube-api-access-rwkcm\") pod \"5a373faa-83be-4206-a107-052bd67aa98d\" (UID: \"5a373faa-83be-4206-a107-052bd67aa98d\") "
Jul 15 15:09:48.915740 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:09:48.915575    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a373faa-83be-4206-a107-052bd67aa98d-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "5a373faa-83be-4206-a107-052bd67aa98d" (UID: "5a373faa-83be-4206-a107-052bd67aa98d"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:09:48.915740 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:09:48.915611    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a373faa-83be-4206-a107-052bd67aa98d-model-cache" (OuterVolumeSpecName: "model-cache") pod "5a373faa-83be-4206-a107-052bd67aa98d" (UID: "5a373faa-83be-4206-a107-052bd67aa98d"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:09:48.915740 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:09:48.915629    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a373faa-83be-4206-a107-052bd67aa98d-home" (OuterVolumeSpecName: "home") pod "5a373faa-83be-4206-a107-052bd67aa98d" (UID: "5a373faa-83be-4206-a107-052bd67aa98d"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:09:48.915876 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:09:48.915785    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5a373faa-83be-4206-a107-052bd67aa98d-tmp-dir\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 15:09:48.915876 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:09:48.915805    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5a373faa-83be-4206-a107-052bd67aa98d-home\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 15:09:48.915876 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:09:48.915819    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5a373faa-83be-4206-a107-052bd67aa98d-model-cache\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 15:09:48.917811 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:09:48.917778    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5a373faa-83be-4206-a107-052bd67aa98d-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "5a373faa-83be-4206-a107-052bd67aa98d" (UID: "5a373faa-83be-4206-a107-052bd67aa98d"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 15:09:48.917811 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:09:48.917780    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5a373faa-83be-4206-a107-052bd67aa98d-dshm" (OuterVolumeSpecName: "dshm") pod "5a373faa-83be-4206-a107-052bd67aa98d" (UID: "5a373faa-83be-4206-a107-052bd67aa98d"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:09:48.918002 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:09:48.917842    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5a373faa-83be-4206-a107-052bd67aa98d-kube-api-access-rwkcm" (OuterVolumeSpecName: "kube-api-access-rwkcm") pod "5a373faa-83be-4206-a107-052bd67aa98d" (UID: "5a373faa-83be-4206-a107-052bd67aa98d"). InnerVolumeSpecName "kube-api-access-rwkcm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:09:49.016925 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:09:49.016876    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5a373faa-83be-4206-a107-052bd67aa98d-dshm\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 15:09:49.016925 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:09:49.016910    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5a373faa-83be-4206-a107-052bd67aa98d-tls-certs\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 15:09:49.016925 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:09:49.016927    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rwkcm\" (UniqueName: \"kubernetes.io/projected/5a373faa-83be-4206-a107-052bd67aa98d-kube-api-access-rwkcm\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 15:09:49.680086 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:09:49.680052    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-ca6c4f33/e2e-lifecycle-model-ca6c4f33-kserve-579ccd899f-zfklj" event={"ID":"5a373faa-83be-4206-a107-052bd67aa98d","Type":"ContainerDied","Data":"e7520fe8066ae6203563f51a7abe2b540c212368ef66f46a0f0e9b64c443ee84"}
Jul 15 15:09:49.680586 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:09:49.680099    2571 scope.go:117] "RemoveContainer" containerID="7b1bcb0d7289a73c52e5de94602d11a28533b30164a77067dbaec3a0022b1979"
Jul 15 15:09:49.680586 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:09:49.680062    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-ca6c4f33/e2e-lifecycle-model-ca6c4f33-kserve-579ccd899f-zfklj"
Jul 15 15:09:49.702407 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:09:49.702383    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-ca6c4f33/e2e-lifecycle-model-ca6c4f33-kserve-579ccd899f-zfklj"]
Jul 15 15:09:49.707189 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:09:49.707169    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-ca6c4f33/e2e-lifecycle-model-ca6c4f33-kserve-579ccd899f-zfklj"]
Jul 15 15:09:50.753406 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:09:50.753373    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5a373faa-83be-4206-a107-052bd67aa98d" path="/var/lib/kubelet/pods/5a373faa-83be-4206-a107-052bd67aa98d/volumes"
Jul 15 15:09:54.279869 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:09:54.279836    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:09:55.102519 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:09:55.102481    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:10:00.998830 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:10:00.998794    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:10:06.924377 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:10:06.924345    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:10:06.981223 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:10:06.981155    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:10:10.748800 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:10:10.748729    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:10:10.983118 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:10:10.983091    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:10:12.007226 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:10:12.007194    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:10:12.107160 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:10:12.107110    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:10:12.207787 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:10:12.207735    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:10:12.956106 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:10:12.956071    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:10:13.050871 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:10:13.050839    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:10:13.150581 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:10:13.150523    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:10:14.494108 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:10:14.494076    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 15:10:14.533028 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:10:14.532999    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:10:20.523722 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:10:20.523680    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:10:20.621186 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:10:20.621148    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:10:21.195643 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:10:21.195614    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:10:28.593292 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:10:28.593242    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 15:10:29.020941 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:10:29.020829    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:10:29.522340 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:10:29.522298    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:10:38.107383 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:10:38.107349    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:10:38.453103 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:10:38.453021    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:10:59.487754 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:10:59.487674    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:11:05.649761 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:05.649721    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:11:05.708506 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:05.708472    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:11:06.025153 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:06.025065    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:11:06.346346 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:06.346308    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:11:06.857621 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:06.857586    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:11:09.746922 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:09.746889    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:11:09.847725 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:09.847695    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:11:09.945546 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:09.945517    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:11:10.056790 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:10.056755    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:11:10.432730 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:10.432655    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:11:10.526893 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:10.526863    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:11:14.259880 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:14.259847    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:11:14.613506 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:14.613473    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:11:14.941569 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:14.941488    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:11:15.056841 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:15.056800    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:11:17.384703 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:17.384673    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:11:17.480253 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:17.480210    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-1e3693-66f586f76-x8n6w"]
Jul 15 15:11:17.480862 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:17.480836    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5a373faa-83be-4206-a107-052bd67aa98d" containerName="main"
Jul 15 15:11:17.480862 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:17.480861    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="5a373faa-83be-4206-a107-052bd67aa98d" containerName="main"
Jul 15 15:11:17.481070 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:17.480997    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="5a373faa-83be-4206-a107-052bd67aa98d" containerName="main"
Jul 15 15:11:17.484162 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:17.484143    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1e3693-66f586f76-x8n6w"
Jul 15 15:11:17.486756 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:17.486738    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-inf-b-1e3693-serving-cert\""
Jul 15 15:11:17.486881 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:17.486747    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 15 15:11:17.486881 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:17.486778    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-chv7n\""
Jul 15 15:11:17.487015 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:17.486973    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 15:11:17.493687 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:17.493664    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-1e3693-66f586f76-x8n6w"]
Jul 15 15:11:17.493966 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:17.493834    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j92pz\" (UniqueName: \"kubernetes.io/projected/34ef2722-b1bf-4464-9024-9e0213b9ea9a-kube-api-access-j92pz\") pod \"maas-api-e2e-inf-b-1e3693-66f586f76-x8n6w\" (UID: \"34ef2722-b1bf-4464-9024-9e0213b9ea9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1e3693-66f586f76-x8n6w"
Jul 15 15:11:17.494306 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:17.494242    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34ef2722-b1bf-4464-9024-9e0213b9ea9a-openshift-service-ca\") pod \"maas-api-e2e-inf-b-1e3693-66f586f76-x8n6w\" (UID: \"34ef2722-b1bf-4464-9024-9e0213b9ea9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1e3693-66f586f76-x8n6w"
Jul 15 15:11:17.494542 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:17.494506    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34ef2722-b1bf-4464-9024-9e0213b9ea9a-maas-api-tls\") pod \"maas-api-e2e-inf-b-1e3693-66f586f76-x8n6w\" (UID: \"34ef2722-b1bf-4464-9024-9e0213b9ea9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1e3693-66f586f76-x8n6w"
Jul 15 15:11:17.590287 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:17.590245    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 15:11:17.595108 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:17.595080    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34ef2722-b1bf-4464-9024-9e0213b9ea9a-openshift-service-ca\") pod \"maas-api-e2e-inf-b-1e3693-66f586f76-x8n6w\" (UID: \"34ef2722-b1bf-4464-9024-9e0213b9ea9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1e3693-66f586f76-x8n6w"
Jul 15 15:11:17.595298 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:17.595139    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34ef2722-b1bf-4464-9024-9e0213b9ea9a-maas-api-tls\") pod \"maas-api-e2e-inf-b-1e3693-66f586f76-x8n6w\" (UID: \"34ef2722-b1bf-4464-9024-9e0213b9ea9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1e3693-66f586f76-x8n6w"
Jul 15 15:11:17.595298 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:17.595171    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j92pz\" (UniqueName: \"kubernetes.io/projected/34ef2722-b1bf-4464-9024-9e0213b9ea9a-kube-api-access-j92pz\") pod \"maas-api-e2e-inf-b-1e3693-66f586f76-x8n6w\" (UID: \"34ef2722-b1bf-4464-9024-9e0213b9ea9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1e3693-66f586f76-x8n6w"
Jul 15 15:11:17.595860 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:17.595837    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34ef2722-b1bf-4464-9024-9e0213b9ea9a-openshift-service-ca\") pod \"maas-api-e2e-inf-b-1e3693-66f586f76-x8n6w\" (UID: \"34ef2722-b1bf-4464-9024-9e0213b9ea9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1e3693-66f586f76-x8n6w"
Jul 15 15:11:17.597653 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:17.597629    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34ef2722-b1bf-4464-9024-9e0213b9ea9a-maas-api-tls\") pod \"maas-api-e2e-inf-b-1e3693-66f586f76-x8n6w\" (UID: \"34ef2722-b1bf-4464-9024-9e0213b9ea9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1e3693-66f586f76-x8n6w"
Jul 15 15:11:17.606661 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:17.606628    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j92pz\" (UniqueName: \"kubernetes.io/projected/34ef2722-b1bf-4464-9024-9e0213b9ea9a-kube-api-access-j92pz\") pod \"maas-api-e2e-inf-b-1e3693-66f586f76-x8n6w\" (UID: \"34ef2722-b1bf-4464-9024-9e0213b9ea9a\") " pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1e3693-66f586f76-x8n6w"
Jul 15 15:11:17.798664 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:17.798568    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1e3693-66f586f76-x8n6w"
Jul 15 15:11:17.933108 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:17.933077    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-1e3693-66f586f76-x8n6w"]
Jul 15 15:11:17.935117 ip-10-0-140-61 kubenswrapper[2571]: W0715 15:11:17.935086    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod34ef2722_b1bf_4464_9024_9e0213b9ea9a.slice/crio-bdef661b2d57a6422512587375cdb80d76064de24fa3697dbc7aa78a16350fbe WatchSource:0}: Error finding container bdef661b2d57a6422512587375cdb80d76064de24fa3697dbc7aa78a16350fbe: Status 404 returned error can't find the container with id bdef661b2d57a6422512587375cdb80d76064de24fa3697dbc7aa78a16350fbe
Jul 15 15:11:17.936412 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:17.936393    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 15:11:18.114321 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:18.114257    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1e3693-66f586f76-x8n6w" event={"ID":"34ef2722-b1bf-4464-9024-9e0213b9ea9a","Type":"ContainerStarted","Data":"bdef661b2d57a6422512587375cdb80d76064de24fa3697dbc7aa78a16350fbe"}
Jul 15 15:11:19.281115 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:19.281035    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:11:19.381194 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:19.381158    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:11:21.132604 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:21.132567    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1e3693-66f586f76-x8n6w" event={"ID":"34ef2722-b1bf-4464-9024-9e0213b9ea9a","Type":"ContainerStarted","Data":"d34f8f106675a2e4a0380b28d8af0e57420c4b06f542d8e97bcb74845178a28e"}
Jul 15 15:11:21.133015 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:21.132638    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1e3693-66f586f76-x8n6w"
Jul 15 15:11:21.154424 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:21.154375    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1e3693-66f586f76-x8n6w" podStartSLOduration=1.843976583 podStartE2EDuration="4.154358027s" totalImagesPullingTime="2.310381444s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:11:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:11:21.153611029 +0000 UTC m=+2264.669428903" watchObservedRunningTime="2026-07-15 15:11:21.154358027 +0000 UTC m=+2264.670175899"
Jul 15 15:11:21.904903 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:21.904865    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:11:26.883785 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:26.883749    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-e47fbc/test-model-e47fbc-kserve-6f84c7f887-mz4rz"]
Jul 15 15:11:26.886521 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:26.886504    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-e47fbc/test-model-e47fbc-kserve-6f84c7f887-mz4rz"
Jul 15 15:11:26.889149 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:26.889124    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-e47fbc\"/\"test-model-e47fbc-kserve-self-signed-certs\""
Jul 15 15:11:26.890095 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:26.890077    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-e47fbc\"/\"default-dockercfg-j6t4t\""
Jul 15 15:11:26.890184 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:26.890080    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-e47fbc\"/\"kube-root-ca.crt\""
Jul 15 15:11:26.890184 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:26.890080    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-e47fbc\"/\"openshift-service-ca.crt\""
Jul 15 15:11:26.895782 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:26.895755    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-e47fbc/test-model-e47fbc-kserve-6f84c7f887-mz4rz"]
Jul 15 15:11:26.979280 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:26.979246    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fce292b6-2be9-4a16-9ff6-3c3afed68224-home\") pod \"test-model-e47fbc-kserve-6f84c7f887-mz4rz\" (UID: \"fce292b6-2be9-4a16-9ff6-3c3afed68224\") " pod="ai-tenant-e2e-inf-a-e47fbc/test-model-e47fbc-kserve-6f84c7f887-mz4rz"
Jul 15 15:11:26.979462 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:26.979301    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fce292b6-2be9-4a16-9ff6-3c3afed68224-tmp-dir\") pod \"test-model-e47fbc-kserve-6f84c7f887-mz4rz\" (UID: \"fce292b6-2be9-4a16-9ff6-3c3afed68224\") " pod="ai-tenant-e2e-inf-a-e47fbc/test-model-e47fbc-kserve-6f84c7f887-mz4rz"
Jul 15 15:11:26.979462 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:26.979340    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fce292b6-2be9-4a16-9ff6-3c3afed68224-tls-certs\") pod \"test-model-e47fbc-kserve-6f84c7f887-mz4rz\" (UID: \"fce292b6-2be9-4a16-9ff6-3c3afed68224\") " pod="ai-tenant-e2e-inf-a-e47fbc/test-model-e47fbc-kserve-6f84c7f887-mz4rz"
Jul 15 15:11:26.979462 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:26.979356    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fce292b6-2be9-4a16-9ff6-3c3afed68224-dshm\") pod \"test-model-e47fbc-kserve-6f84c7f887-mz4rz\" (UID: \"fce292b6-2be9-4a16-9ff6-3c3afed68224\") " pod="ai-tenant-e2e-inf-a-e47fbc/test-model-e47fbc-kserve-6f84c7f887-mz4rz"
Jul 15 15:11:26.979462 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:26.979396    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wdrpm\" (UniqueName: \"kubernetes.io/projected/fce292b6-2be9-4a16-9ff6-3c3afed68224-kube-api-access-wdrpm\") pod \"test-model-e47fbc-kserve-6f84c7f887-mz4rz\" (UID: \"fce292b6-2be9-4a16-9ff6-3c3afed68224\") " pod="ai-tenant-e2e-inf-a-e47fbc/test-model-e47fbc-kserve-6f84c7f887-mz4rz"
Jul 15 15:11:26.979462 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:26.979438    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fce292b6-2be9-4a16-9ff6-3c3afed68224-model-cache\") pod \"test-model-e47fbc-kserve-6f84c7f887-mz4rz\" (UID: \"fce292b6-2be9-4a16-9ff6-3c3afed68224\") " pod="ai-tenant-e2e-inf-a-e47fbc/test-model-e47fbc-kserve-6f84c7f887-mz4rz"
Jul 15 15:11:27.080810 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:27.080776    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fce292b6-2be9-4a16-9ff6-3c3afed68224-model-cache\") pod \"test-model-e47fbc-kserve-6f84c7f887-mz4rz\" (UID: \"fce292b6-2be9-4a16-9ff6-3c3afed68224\") " pod="ai-tenant-e2e-inf-a-e47fbc/test-model-e47fbc-kserve-6f84c7f887-mz4rz"
Jul 15 15:11:27.080993 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:27.080833    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fce292b6-2be9-4a16-9ff6-3c3afed68224-home\") pod \"test-model-e47fbc-kserve-6f84c7f887-mz4rz\" (UID: \"fce292b6-2be9-4a16-9ff6-3c3afed68224\") " pod="ai-tenant-e2e-inf-a-e47fbc/test-model-e47fbc-kserve-6f84c7f887-mz4rz"
Jul 15 15:11:27.081033 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:27.081002    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fce292b6-2be9-4a16-9ff6-3c3afed68224-tmp-dir\") pod \"test-model-e47fbc-kserve-6f84c7f887-mz4rz\" (UID: \"fce292b6-2be9-4a16-9ff6-3c3afed68224\") " pod="ai-tenant-e2e-inf-a-e47fbc/test-model-e47fbc-kserve-6f84c7f887-mz4rz"
Jul 15 15:11:27.081081 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:27.081064    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fce292b6-2be9-4a16-9ff6-3c3afed68224-tls-certs\") pod \"test-model-e47fbc-kserve-6f84c7f887-mz4rz\" (UID: \"fce292b6-2be9-4a16-9ff6-3c3afed68224\") " pod="ai-tenant-e2e-inf-a-e47fbc/test-model-e47fbc-kserve-6f84c7f887-mz4rz"
Jul 15 15:11:27.081123 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:27.081099    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fce292b6-2be9-4a16-9ff6-3c3afed68224-dshm\") pod \"test-model-e47fbc-kserve-6f84c7f887-mz4rz\" (UID: \"fce292b6-2be9-4a16-9ff6-3c3afed68224\") " pod="ai-tenant-e2e-inf-a-e47fbc/test-model-e47fbc-kserve-6f84c7f887-mz4rz"
Jul 15 15:11:27.081172 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:27.081157    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wdrpm\" (UniqueName: \"kubernetes.io/projected/fce292b6-2be9-4a16-9ff6-3c3afed68224-kube-api-access-wdrpm\") pod \"test-model-e47fbc-kserve-6f84c7f887-mz4rz\" (UID: \"fce292b6-2be9-4a16-9ff6-3c3afed68224\") " pod="ai-tenant-e2e-inf-a-e47fbc/test-model-e47fbc-kserve-6f84c7f887-mz4rz"
Jul 15 15:11:27.081221 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:27.081206    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fce292b6-2be9-4a16-9ff6-3c3afed68224-model-cache\") pod \"test-model-e47fbc-kserve-6f84c7f887-mz4rz\" (UID: \"fce292b6-2be9-4a16-9ff6-3c3afed68224\") " pod="ai-tenant-e2e-inf-a-e47fbc/test-model-e47fbc-kserve-6f84c7f887-mz4rz"
Jul 15 15:11:27.081293 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:27.081213    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fce292b6-2be9-4a16-9ff6-3c3afed68224-home\") pod \"test-model-e47fbc-kserve-6f84c7f887-mz4rz\" (UID: \"fce292b6-2be9-4a16-9ff6-3c3afed68224\") " pod="ai-tenant-e2e-inf-a-e47fbc/test-model-e47fbc-kserve-6f84c7f887-mz4rz"
Jul 15 15:11:27.081362 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:27.081328    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fce292b6-2be9-4a16-9ff6-3c3afed68224-tmp-dir\") pod \"test-model-e47fbc-kserve-6f84c7f887-mz4rz\" (UID: \"fce292b6-2be9-4a16-9ff6-3c3afed68224\") " pod="ai-tenant-e2e-inf-a-e47fbc/test-model-e47fbc-kserve-6f84c7f887-mz4rz"
Jul 15 15:11:27.083384 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:27.083362    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fce292b6-2be9-4a16-9ff6-3c3afed68224-dshm\") pod \"test-model-e47fbc-kserve-6f84c7f887-mz4rz\" (UID: \"fce292b6-2be9-4a16-9ff6-3c3afed68224\") " pod="ai-tenant-e2e-inf-a-e47fbc/test-model-e47fbc-kserve-6f84c7f887-mz4rz"
Jul 15 15:11:27.083721 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:27.083702    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fce292b6-2be9-4a16-9ff6-3c3afed68224-tls-certs\") pod \"test-model-e47fbc-kserve-6f84c7f887-mz4rz\" (UID: \"fce292b6-2be9-4a16-9ff6-3c3afed68224\") " pod="ai-tenant-e2e-inf-a-e47fbc/test-model-e47fbc-kserve-6f84c7f887-mz4rz"
Jul 15 15:11:27.090185 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:27.090163    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wdrpm\" (UniqueName: \"kubernetes.io/projected/fce292b6-2be9-4a16-9ff6-3c3afed68224-kube-api-access-wdrpm\") pod \"test-model-e47fbc-kserve-6f84c7f887-mz4rz\" (UID: \"fce292b6-2be9-4a16-9ff6-3c3afed68224\") " pod="ai-tenant-e2e-inf-a-e47fbc/test-model-e47fbc-kserve-6f84c7f887-mz4rz"
Jul 15 15:11:27.143782 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:27.143712    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1e3693-66f586f76-x8n6w"
Jul 15 15:11:27.196935 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:27.196901    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-e47fbc/test-model-e47fbc-kserve-6f84c7f887-mz4rz"
Jul 15 15:11:27.205640 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:27.205609    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:11:27.330797 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:27.330763    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-e47fbc/test-model-e47fbc-kserve-6f84c7f887-mz4rz"]
Jul 15 15:11:27.334004 ip-10-0-140-61 kubenswrapper[2571]: W0715 15:11:27.333978    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfce292b6_2be9_4a16_9ff6_3c3afed68224.slice/crio-2a3ad84f006eb264df0f5d7de3278e2ff3df0b0e0a80c57fe8b192a3a0c7620b WatchSource:0}: Error finding container 2a3ad84f006eb264df0f5d7de3278e2ff3df0b0e0a80c57fe8b192a3a0c7620b: Status 404 returned error can't find the container with id 2a3ad84f006eb264df0f5d7de3278e2ff3df0b0e0a80c57fe8b192a3a0c7620b
Jul 15 15:11:28.164431 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:28.164399    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-e47fbc/test-model-e47fbc-kserve-6f84c7f887-mz4rz" event={"ID":"fce292b6-2be9-4a16-9ff6-3c3afed68224","Type":"ContainerStarted","Data":"85df076bdf34dbcdba3fd8bfcccce7a3df29e7b2d182f151700666e2ef3cb36c"}
Jul 15 15:11:28.164810 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:28.164439    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-e47fbc/test-model-e47fbc-kserve-6f84c7f887-mz4rz" event={"ID":"fce292b6-2be9-4a16-9ff6-3c3afed68224","Type":"ContainerStarted","Data":"2a3ad84f006eb264df0f5d7de3278e2ff3df0b0e0a80c57fe8b192a3a0c7620b"}
Jul 15 15:11:28.185183 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:28.185134    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-e47fbc/test-model-e47fbc-kserve-6f84c7f887-mz4rz" podStartSLOduration=2.18511744 podStartE2EDuration="2.18511744s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:11:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:11:28.184394395 +0000 UTC m=+2271.700212267" watchObservedRunningTime="2026-07-15 15:11:28.18511744 +0000 UTC m=+2271.700935311"
Jul 15 15:11:31.395213 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:31.395177    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:11:31.492933 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:31.492898    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 15:11:31.495765 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:31.495738    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:11:37.197236 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:37.197181    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-e47fbc/test-model-e47fbc-kserve-6f84c7f887-mz4rz"
Jul 15 15:11:37.197661 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:37.197249    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-e47fbc/test-model-e47fbc-kserve-6f84c7f887-mz4rz"
Jul 15 15:11:37.210176 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:37.210147    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-e47fbc/test-model-e47fbc-kserve-6f84c7f887-mz4rz"
Jul 15 15:11:37.221540 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:37.221518    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-e47fbc/test-model-e47fbc-kserve-6f84c7f887-mz4rz"
Jul 15 15:11:38.062534 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:38.062494    2571 scope.go:117] "RemoveContainer" containerID="b7a6d8ddb7d7269027e3941580b7d883939d6745b435712bef5ab9092043b05d"
Jul 15 15:11:40.389924 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:40.389870    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:11:44.851250 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:44.851211    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:11:45.485692 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:45.485658    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 15:11:54.191968 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:54.191914    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-1e3693/test-model-1e3693-kserve-8565769f55-ff5kz"]
Jul 15 15:11:54.196941 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:54.196917    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-1e3693/test-model-1e3693-kserve-8565769f55-ff5kz"
Jul 15 15:11:54.200813 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:54.200784    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-1e3693\"/\"default-dockercfg-ms4tc\""
Jul 15 15:11:54.200954 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:54.200828    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-1e3693\"/\"openshift-service-ca.crt\""
Jul 15 15:11:54.200954 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:54.200844    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-1e3693\"/\"test-model-1e3693-kserve-self-signed-certs\""
Jul 15 15:11:54.201104 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:54.201065    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-1e3693\"/\"kube-root-ca.crt\""
Jul 15 15:11:54.203738 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:54.203716    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-1e3693/test-model-1e3693-kserve-8565769f55-ff5kz"]
Jul 15 15:11:54.217431 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:54.217408    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:11:54.330794 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:54.330753    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec18fb12-5afc-414b-94db-7c9ed1285f23-tmp-dir\") pod \"test-model-1e3693-kserve-8565769f55-ff5kz\" (UID: \"ec18fb12-5afc-414b-94db-7c9ed1285f23\") " pod="ai-tenant-e2e-inf-b-1e3693/test-model-1e3693-kserve-8565769f55-ff5kz"
Jul 15 15:11:54.330982 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:54.330812    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec18fb12-5afc-414b-94db-7c9ed1285f23-dshm\") pod \"test-model-1e3693-kserve-8565769f55-ff5kz\" (UID: \"ec18fb12-5afc-414b-94db-7c9ed1285f23\") " pod="ai-tenant-e2e-inf-b-1e3693/test-model-1e3693-kserve-8565769f55-ff5kz"
Jul 15 15:11:54.330982 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:54.330851    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec18fb12-5afc-414b-94db-7c9ed1285f23-tls-certs\") pod \"test-model-1e3693-kserve-8565769f55-ff5kz\" (UID: \"ec18fb12-5afc-414b-94db-7c9ed1285f23\") " pod="ai-tenant-e2e-inf-b-1e3693/test-model-1e3693-kserve-8565769f55-ff5kz"
Jul 15 15:11:54.330982 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:54.330950    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec18fb12-5afc-414b-94db-7c9ed1285f23-model-cache\") pod \"test-model-1e3693-kserve-8565769f55-ff5kz\" (UID: \"ec18fb12-5afc-414b-94db-7c9ed1285f23\") " pod="ai-tenant-e2e-inf-b-1e3693/test-model-1e3693-kserve-8565769f55-ff5kz"
Jul 15 15:11:54.331106 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:54.330980    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec18fb12-5afc-414b-94db-7c9ed1285f23-home\") pod \"test-model-1e3693-kserve-8565769f55-ff5kz\" (UID: \"ec18fb12-5afc-414b-94db-7c9ed1285f23\") " pod="ai-tenant-e2e-inf-b-1e3693/test-model-1e3693-kserve-8565769f55-ff5kz"
Jul 15 15:11:54.331106 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:54.331016    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwf6z\" (UniqueName: \"kubernetes.io/projected/ec18fb12-5afc-414b-94db-7c9ed1285f23-kube-api-access-kwf6z\") pod \"test-model-1e3693-kserve-8565769f55-ff5kz\" (UID: \"ec18fb12-5afc-414b-94db-7c9ed1285f23\") " pod="ai-tenant-e2e-inf-b-1e3693/test-model-1e3693-kserve-8565769f55-ff5kz"
Jul 15 15:11:54.431487 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:54.431456    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec18fb12-5afc-414b-94db-7c9ed1285f23-model-cache\") pod \"test-model-1e3693-kserve-8565769f55-ff5kz\" (UID: \"ec18fb12-5afc-414b-94db-7c9ed1285f23\") " pod="ai-tenant-e2e-inf-b-1e3693/test-model-1e3693-kserve-8565769f55-ff5kz"
Jul 15 15:11:54.431487 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:54.431490    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec18fb12-5afc-414b-94db-7c9ed1285f23-home\") pod \"test-model-1e3693-kserve-8565769f55-ff5kz\" (UID: \"ec18fb12-5afc-414b-94db-7c9ed1285f23\") " pod="ai-tenant-e2e-inf-b-1e3693/test-model-1e3693-kserve-8565769f55-ff5kz"
Jul 15 15:11:54.431718 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:54.431518    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwf6z\" (UniqueName: \"kubernetes.io/projected/ec18fb12-5afc-414b-94db-7c9ed1285f23-kube-api-access-kwf6z\") pod \"test-model-1e3693-kserve-8565769f55-ff5kz\" (UID: \"ec18fb12-5afc-414b-94db-7c9ed1285f23\") " pod="ai-tenant-e2e-inf-b-1e3693/test-model-1e3693-kserve-8565769f55-ff5kz"
Jul 15 15:11:54.431718 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:54.431561    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec18fb12-5afc-414b-94db-7c9ed1285f23-tmp-dir\") pod \"test-model-1e3693-kserve-8565769f55-ff5kz\" (UID: \"ec18fb12-5afc-414b-94db-7c9ed1285f23\") " pod="ai-tenant-e2e-inf-b-1e3693/test-model-1e3693-kserve-8565769f55-ff5kz"
Jul 15 15:11:54.431718 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:54.431587    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec18fb12-5afc-414b-94db-7c9ed1285f23-dshm\") pod \"test-model-1e3693-kserve-8565769f55-ff5kz\" (UID: \"ec18fb12-5afc-414b-94db-7c9ed1285f23\") " pod="ai-tenant-e2e-inf-b-1e3693/test-model-1e3693-kserve-8565769f55-ff5kz"
Jul 15 15:11:54.431718 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:54.431602    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec18fb12-5afc-414b-94db-7c9ed1285f23-tls-certs\") pod \"test-model-1e3693-kserve-8565769f55-ff5kz\" (UID: \"ec18fb12-5afc-414b-94db-7c9ed1285f23\") " pod="ai-tenant-e2e-inf-b-1e3693/test-model-1e3693-kserve-8565769f55-ff5kz"
Jul 15 15:11:54.431958 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:54.431934    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec18fb12-5afc-414b-94db-7c9ed1285f23-tmp-dir\") pod \"test-model-1e3693-kserve-8565769f55-ff5kz\" (UID: \"ec18fb12-5afc-414b-94db-7c9ed1285f23\") " pod="ai-tenant-e2e-inf-b-1e3693/test-model-1e3693-kserve-8565769f55-ff5kz"
Jul 15 15:11:54.432044 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:54.431964    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec18fb12-5afc-414b-94db-7c9ed1285f23-home\") pod \"test-model-1e3693-kserve-8565769f55-ff5kz\" (UID: \"ec18fb12-5afc-414b-94db-7c9ed1285f23\") " pod="ai-tenant-e2e-inf-b-1e3693/test-model-1e3693-kserve-8565769f55-ff5kz"
Jul 15 15:11:54.432044 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:54.431934    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec18fb12-5afc-414b-94db-7c9ed1285f23-model-cache\") pod \"test-model-1e3693-kserve-8565769f55-ff5kz\" (UID: \"ec18fb12-5afc-414b-94db-7c9ed1285f23\") " pod="ai-tenant-e2e-inf-b-1e3693/test-model-1e3693-kserve-8565769f55-ff5kz"
Jul 15 15:11:54.433770 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:54.433755    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec18fb12-5afc-414b-94db-7c9ed1285f23-dshm\") pod \"test-model-1e3693-kserve-8565769f55-ff5kz\" (UID: \"ec18fb12-5afc-414b-94db-7c9ed1285f23\") " pod="ai-tenant-e2e-inf-b-1e3693/test-model-1e3693-kserve-8565769f55-ff5kz"
Jul 15 15:11:54.434037 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:54.434021    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec18fb12-5afc-414b-94db-7c9ed1285f23-tls-certs\") pod \"test-model-1e3693-kserve-8565769f55-ff5kz\" (UID: \"ec18fb12-5afc-414b-94db-7c9ed1285f23\") " pod="ai-tenant-e2e-inf-b-1e3693/test-model-1e3693-kserve-8565769f55-ff5kz"
Jul 15 15:11:54.440743 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:54.440721    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwf6z\" (UniqueName: \"kubernetes.io/projected/ec18fb12-5afc-414b-94db-7c9ed1285f23-kube-api-access-kwf6z\") pod \"test-model-1e3693-kserve-8565769f55-ff5kz\" (UID: \"ec18fb12-5afc-414b-94db-7c9ed1285f23\") " pod="ai-tenant-e2e-inf-b-1e3693/test-model-1e3693-kserve-8565769f55-ff5kz"
Jul 15 15:11:54.507702 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:54.507619    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-1e3693/test-model-1e3693-kserve-8565769f55-ff5kz"
Jul 15 15:11:54.637003 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:54.636981    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-1e3693/test-model-1e3693-kserve-8565769f55-ff5kz"]
Jul 15 15:11:54.638606 ip-10-0-140-61 kubenswrapper[2571]: W0715 15:11:54.638570    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podec18fb12_5afc_414b_94db_7c9ed1285f23.slice/crio-dd1e15d5d551b9c8b57b6fe6e1114f4a02b8208d4a217fd90a7b422d5b7f1a83 WatchSource:0}: Error finding container dd1e15d5d551b9c8b57b6fe6e1114f4a02b8208d4a217fd90a7b422d5b7f1a83: Status 404 returned error can't find the container with id dd1e15d5d551b9c8b57b6fe6e1114f4a02b8208d4a217fd90a7b422d5b7f1a83
Jul 15 15:11:55.291405 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:55.291363    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-1e3693/test-model-1e3693-kserve-8565769f55-ff5kz" event={"ID":"ec18fb12-5afc-414b-94db-7c9ed1285f23","Type":"ContainerStarted","Data":"eacb07422cc46a0c1c10a90b876bd2dece76fab50b67e3b1774b64adac9ddb3e"}
Jul 15 15:11:55.291405 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:55.291411    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-1e3693/test-model-1e3693-kserve-8565769f55-ff5kz" event={"ID":"ec18fb12-5afc-414b-94db-7c9ed1285f23","Type":"ContainerStarted","Data":"dd1e15d5d551b9c8b57b6fe6e1114f4a02b8208d4a217fd90a7b422d5b7f1a83"}
Jul 15 15:11:55.309194 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:55.309141    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-1e3693/test-model-1e3693-kserve-8565769f55-ff5kz" podStartSLOduration=1.309124863 podStartE2EDuration="1.309124863s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:11:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:11:55.30788798 +0000 UTC m=+2298.823705851" watchObservedRunningTime="2026-07-15 15:11:55.309124863 +0000 UTC m=+2298.824942733"
Jul 15 15:11:59.922951 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:11:59.922918    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 15:12:04.508545 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:04.508503    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-1e3693/test-model-1e3693-kserve-8565769f55-ff5kz"
Jul 15 15:12:04.509050 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:04.508567    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-1e3693/test-model-1e3693-kserve-8565769f55-ff5kz"
Jul 15 15:12:04.521142 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:04.521112    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-1e3693/test-model-1e3693-kserve-8565769f55-ff5kz"
Jul 15 15:12:05.353897 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:05.353864    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-1e3693/test-model-1e3693-kserve-8565769f55-ff5kz"
Jul 15 15:12:13.990614 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:13.990581    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 15:12:15.924256 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:15.924221    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:12:15.981892 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:15.981860    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:12:30.725373 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:30.725290    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-e47fbc/test-model-e47fbc-kserve-6f84c7f887-mz4rz"]
Jul 15 15:12:30.744641 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:30.744612    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:12:31.678895 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:31.678854    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-1e3693/test-model-1e3693-kserve-8565769f55-ff5kz"]
Jul 15 15:12:31.696338 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:31.696289    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:12:32.364449 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:32.364421    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:12:32.466204 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:32.466172    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:12:35.398827 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:35.398790    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 15:12:42.304683 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:42.304646    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:12:45.745204 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:45.745163    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-e47fbc/test-model-e47fbc-kserve-6f84c7f887-mz4rz" podUID="fce292b6-2be9-4a16-9ff6-3c3afed68224" containerName="main" containerID="cri-o://85df076bdf34dbcdba3fd8bfcccce7a3df29e7b2d182f151700666e2ef3cb36c" gracePeriod=45
Jul 15 15:12:45.993022 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:45.992988    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-e47fbc/test-model-e47fbc-kserve-6f84c7f887-mz4rz"
Jul 15 15:12:46.000124 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:46.000064    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fce292b6-2be9-4a16-9ff6-3c3afed68224-home\") pod \"fce292b6-2be9-4a16-9ff6-3c3afed68224\" (UID: \"fce292b6-2be9-4a16-9ff6-3c3afed68224\") "
Jul 15 15:12:46.000124 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:46.000093    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fce292b6-2be9-4a16-9ff6-3c3afed68224-tls-certs\") pod \"fce292b6-2be9-4a16-9ff6-3c3afed68224\" (UID: \"fce292b6-2be9-4a16-9ff6-3c3afed68224\") "
Jul 15 15:12:46.000124 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:46.000121    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fce292b6-2be9-4a16-9ff6-3c3afed68224-model-cache\") pod \"fce292b6-2be9-4a16-9ff6-3c3afed68224\" (UID: \"fce292b6-2be9-4a16-9ff6-3c3afed68224\") "
Jul 15 15:12:46.000401 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:46.000163    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fce292b6-2be9-4a16-9ff6-3c3afed68224-dshm\") pod \"fce292b6-2be9-4a16-9ff6-3c3afed68224\" (UID: \"fce292b6-2be9-4a16-9ff6-3c3afed68224\") "
Jul 15 15:12:46.000401 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:46.000193    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fce292b6-2be9-4a16-9ff6-3c3afed68224-tmp-dir\") pod \"fce292b6-2be9-4a16-9ff6-3c3afed68224\" (UID: \"fce292b6-2be9-4a16-9ff6-3c3afed68224\") "
Jul 15 15:12:46.000401 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:46.000217    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wdrpm\" (UniqueName: \"kubernetes.io/projected/fce292b6-2be9-4a16-9ff6-3c3afed68224-kube-api-access-wdrpm\") pod \"fce292b6-2be9-4a16-9ff6-3c3afed68224\" (UID: \"fce292b6-2be9-4a16-9ff6-3c3afed68224\") "
Jul 15 15:12:46.000538 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:46.000395    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fce292b6-2be9-4a16-9ff6-3c3afed68224-home" (OuterVolumeSpecName: "home") pod "fce292b6-2be9-4a16-9ff6-3c3afed68224" (UID: "fce292b6-2be9-4a16-9ff6-3c3afed68224"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:12:46.000538 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:46.000408    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fce292b6-2be9-4a16-9ff6-3c3afed68224-model-cache" (OuterVolumeSpecName: "model-cache") pod "fce292b6-2be9-4a16-9ff6-3c3afed68224" (UID: "fce292b6-2be9-4a16-9ff6-3c3afed68224"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:12:46.000538 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:46.000524    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fce292b6-2be9-4a16-9ff6-3c3afed68224-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "fce292b6-2be9-4a16-9ff6-3c3afed68224" (UID: "fce292b6-2be9-4a16-9ff6-3c3afed68224"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:12:46.000642 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:46.000549    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/fce292b6-2be9-4a16-9ff6-3c3afed68224-home\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 15:12:46.000642 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:46.000569    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/fce292b6-2be9-4a16-9ff6-3c3afed68224-model-cache\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 15:12:46.002399 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:46.002378    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fce292b6-2be9-4a16-9ff6-3c3afed68224-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "fce292b6-2be9-4a16-9ff6-3c3afed68224" (UID: "fce292b6-2be9-4a16-9ff6-3c3afed68224"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 15:12:46.002480 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:46.002395    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fce292b6-2be9-4a16-9ff6-3c3afed68224-dshm" (OuterVolumeSpecName: "dshm") pod "fce292b6-2be9-4a16-9ff6-3c3afed68224" (UID: "fce292b6-2be9-4a16-9ff6-3c3afed68224"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:12:46.002480 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:46.002406    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fce292b6-2be9-4a16-9ff6-3c3afed68224-kube-api-access-wdrpm" (OuterVolumeSpecName: "kube-api-access-wdrpm") pod "fce292b6-2be9-4a16-9ff6-3c3afed68224" (UID: "fce292b6-2be9-4a16-9ff6-3c3afed68224"). InnerVolumeSpecName "kube-api-access-wdrpm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:12:46.101326 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:46.101258    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/fce292b6-2be9-4a16-9ff6-3c3afed68224-dshm\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 15:12:46.101326 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:46.101321    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/fce292b6-2be9-4a16-9ff6-3c3afed68224-tmp-dir\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 15:12:46.101326 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:46.101334    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wdrpm\" (UniqueName: \"kubernetes.io/projected/fce292b6-2be9-4a16-9ff6-3c3afed68224-kube-api-access-wdrpm\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 15:12:46.101556 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:46.101344    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/fce292b6-2be9-4a16-9ff6-3c3afed68224-tls-certs\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 15:12:46.537873 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:46.537841    2571 generic.go:356] "Generic (PLEG): container finished" podID="fce292b6-2be9-4a16-9ff6-3c3afed68224" containerID="85df076bdf34dbcdba3fd8bfcccce7a3df29e7b2d182f151700666e2ef3cb36c" exitCode=0
Jul 15 15:12:46.538069 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:46.537889    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-e47fbc/test-model-e47fbc-kserve-6f84c7f887-mz4rz"
Jul 15 15:12:46.538069 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:46.537883    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-e47fbc/test-model-e47fbc-kserve-6f84c7f887-mz4rz" event={"ID":"fce292b6-2be9-4a16-9ff6-3c3afed68224","Type":"ContainerDied","Data":"85df076bdf34dbcdba3fd8bfcccce7a3df29e7b2d182f151700666e2ef3cb36c"}
Jul 15 15:12:46.538069 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:46.538006    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-e47fbc/test-model-e47fbc-kserve-6f84c7f887-mz4rz" event={"ID":"fce292b6-2be9-4a16-9ff6-3c3afed68224","Type":"ContainerDied","Data":"2a3ad84f006eb264df0f5d7de3278e2ff3df0b0e0a80c57fe8b192a3a0c7620b"}
Jul 15 15:12:46.538069 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:46.538032    2571 scope.go:117] "RemoveContainer" containerID="85df076bdf34dbcdba3fd8bfcccce7a3df29e7b2d182f151700666e2ef3cb36c"
Jul 15 15:12:46.546922 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:46.546904    2571 scope.go:117] "RemoveContainer" containerID="85df076bdf34dbcdba3fd8bfcccce7a3df29e7b2d182f151700666e2ef3cb36c"
Jul 15 15:12:46.547155 ip-10-0-140-61 kubenswrapper[2571]: E0715 15:12:46.547133    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"85df076bdf34dbcdba3fd8bfcccce7a3df29e7b2d182f151700666e2ef3cb36c\": container with ID starting with 85df076bdf34dbcdba3fd8bfcccce7a3df29e7b2d182f151700666e2ef3cb36c not found: ID does not exist" containerID="85df076bdf34dbcdba3fd8bfcccce7a3df29e7b2d182f151700666e2ef3cb36c"
Jul 15 15:12:46.547252 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:46.547161    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"85df076bdf34dbcdba3fd8bfcccce7a3df29e7b2d182f151700666e2ef3cb36c"} err="failed to get container status \"85df076bdf34dbcdba3fd8bfcccce7a3df29e7b2d182f151700666e2ef3cb36c\": rpc error: code = NotFound desc = could not find container \"85df076bdf34dbcdba3fd8bfcccce7a3df29e7b2d182f151700666e2ef3cb36c\": container with ID starting with 85df076bdf34dbcdba3fd8bfcccce7a3df29e7b2d182f151700666e2ef3cb36c not found: ID does not exist"
Jul 15 15:12:46.560387 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:46.560362    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-e47fbc/test-model-e47fbc-kserve-6f84c7f887-mz4rz"]
Jul 15 15:12:46.562052 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:46.562033    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-e47fbc/test-model-e47fbc-kserve-6f84c7f887-mz4rz"]
Jul 15 15:12:46.698502 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:46.698461    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-1e3693/test-model-1e3693-kserve-8565769f55-ff5kz" podUID="ec18fb12-5afc-414b-94db-7c9ed1285f23" containerName="main" containerID="cri-o://eacb07422cc46a0c1c10a90b876bd2dece76fab50b67e3b1774b64adac9ddb3e" gracePeriod=45
Jul 15 15:12:46.753709 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:46.753671    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fce292b6-2be9-4a16-9ff6-3c3afed68224" path="/var/lib/kubelet/pods/fce292b6-2be9-4a16-9ff6-3c3afed68224/volumes"
Jul 15 15:12:46.905635 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:46.905606    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:12:46.943913 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:46.943890    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-1e3693/test-model-1e3693-kserve-8565769f55-ff5kz"
Jul 15 15:12:47.009249 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:47.009213    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec18fb12-5afc-414b-94db-7c9ed1285f23-model-cache\") pod \"ec18fb12-5afc-414b-94db-7c9ed1285f23\" (UID: \"ec18fb12-5afc-414b-94db-7c9ed1285f23\") "
Jul 15 15:12:47.009467 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:47.009289    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec18fb12-5afc-414b-94db-7c9ed1285f23-home\") pod \"ec18fb12-5afc-414b-94db-7c9ed1285f23\" (UID: \"ec18fb12-5afc-414b-94db-7c9ed1285f23\") "
Jul 15 15:12:47.009467 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:47.009323    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kwf6z\" (UniqueName: \"kubernetes.io/projected/ec18fb12-5afc-414b-94db-7c9ed1285f23-kube-api-access-kwf6z\") pod \"ec18fb12-5afc-414b-94db-7c9ed1285f23\" (UID: \"ec18fb12-5afc-414b-94db-7c9ed1285f23\") "
Jul 15 15:12:47.009467 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:47.009371    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec18fb12-5afc-414b-94db-7c9ed1285f23-dshm\") pod \"ec18fb12-5afc-414b-94db-7c9ed1285f23\" (UID: \"ec18fb12-5afc-414b-94db-7c9ed1285f23\") "
Jul 15 15:12:47.009467 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:47.009397    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec18fb12-5afc-414b-94db-7c9ed1285f23-tls-certs\") pod \"ec18fb12-5afc-414b-94db-7c9ed1285f23\" (UID: \"ec18fb12-5afc-414b-94db-7c9ed1285f23\") "
Jul 15 15:12:47.009467 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:47.009436    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec18fb12-5afc-414b-94db-7c9ed1285f23-tmp-dir\") pod \"ec18fb12-5afc-414b-94db-7c9ed1285f23\" (UID: \"ec18fb12-5afc-414b-94db-7c9ed1285f23\") "
Jul 15 15:12:47.009704 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:47.009586    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec18fb12-5afc-414b-94db-7c9ed1285f23-model-cache" (OuterVolumeSpecName: "model-cache") pod "ec18fb12-5afc-414b-94db-7c9ed1285f23" (UID: "ec18fb12-5afc-414b-94db-7c9ed1285f23"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:12:47.009704 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:47.009644    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec18fb12-5afc-414b-94db-7c9ed1285f23-home" (OuterVolumeSpecName: "home") pod "ec18fb12-5afc-414b-94db-7c9ed1285f23" (UID: "ec18fb12-5afc-414b-94db-7c9ed1285f23"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:12:47.009774 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:47.009705    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec18fb12-5afc-414b-94db-7c9ed1285f23-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "ec18fb12-5afc-414b-94db-7c9ed1285f23" (UID: "ec18fb12-5afc-414b-94db-7c9ed1285f23"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:12:47.009808 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:47.009773    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ec18fb12-5afc-414b-94db-7c9ed1285f23-model-cache\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 15:12:47.009808 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:47.009788    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ec18fb12-5afc-414b-94db-7c9ed1285f23-home\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 15:12:47.011720 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:47.011698    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ec18fb12-5afc-414b-94db-7c9ed1285f23-dshm" (OuterVolumeSpecName: "dshm") pod "ec18fb12-5afc-414b-94db-7c9ed1285f23" (UID: "ec18fb12-5afc-414b-94db-7c9ed1285f23"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:12:47.011720 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:47.011704    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ec18fb12-5afc-414b-94db-7c9ed1285f23-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "ec18fb12-5afc-414b-94db-7c9ed1285f23" (UID: "ec18fb12-5afc-414b-94db-7c9ed1285f23"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 15:12:47.011890 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:47.011719    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ec18fb12-5afc-414b-94db-7c9ed1285f23-kube-api-access-kwf6z" (OuterVolumeSpecName: "kube-api-access-kwf6z") pod "ec18fb12-5afc-414b-94db-7c9ed1285f23" (UID: "ec18fb12-5afc-414b-94db-7c9ed1285f23"). InnerVolumeSpecName "kube-api-access-kwf6z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:12:47.110514 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:47.110427    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ec18fb12-5afc-414b-94db-7c9ed1285f23-tmp-dir\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 15:12:47.110514 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:47.110458    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kwf6z\" (UniqueName: \"kubernetes.io/projected/ec18fb12-5afc-414b-94db-7c9ed1285f23-kube-api-access-kwf6z\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 15:12:47.110514 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:47.110469    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ec18fb12-5afc-414b-94db-7c9ed1285f23-dshm\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 15:12:47.110514 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:47.110480    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ec18fb12-5afc-414b-94db-7c9ed1285f23-tls-certs\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 15:12:47.545564 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:47.545463    2571 generic.go:356] "Generic (PLEG): container finished" podID="ec18fb12-5afc-414b-94db-7c9ed1285f23" containerID="eacb07422cc46a0c1c10a90b876bd2dece76fab50b67e3b1774b64adac9ddb3e" exitCode=0
Jul 15 15:12:47.545564 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:47.545506    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-1e3693/test-model-1e3693-kserve-8565769f55-ff5kz"
Jul 15 15:12:47.545564 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:47.545545    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-1e3693/test-model-1e3693-kserve-8565769f55-ff5kz" event={"ID":"ec18fb12-5afc-414b-94db-7c9ed1285f23","Type":"ContainerDied","Data":"eacb07422cc46a0c1c10a90b876bd2dece76fab50b67e3b1774b64adac9ddb3e"}
Jul 15 15:12:47.545846 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:47.545592    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-1e3693/test-model-1e3693-kserve-8565769f55-ff5kz" event={"ID":"ec18fb12-5afc-414b-94db-7c9ed1285f23","Type":"ContainerDied","Data":"dd1e15d5d551b9c8b57b6fe6e1114f4a02b8208d4a217fd90a7b422d5b7f1a83"}
Jul 15 15:12:47.545846 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:47.545611    2571 scope.go:117] "RemoveContainer" containerID="eacb07422cc46a0c1c10a90b876bd2dece76fab50b67e3b1774b64adac9ddb3e"
Jul 15 15:12:47.556800 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:47.556761    2571 scope.go:117] "RemoveContainer" containerID="eacb07422cc46a0c1c10a90b876bd2dece76fab50b67e3b1774b64adac9ddb3e"
Jul 15 15:12:47.557182 ip-10-0-140-61 kubenswrapper[2571]: E0715 15:12:47.557158    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eacb07422cc46a0c1c10a90b876bd2dece76fab50b67e3b1774b64adac9ddb3e\": container with ID starting with eacb07422cc46a0c1c10a90b876bd2dece76fab50b67e3b1774b64adac9ddb3e not found: ID does not exist" containerID="eacb07422cc46a0c1c10a90b876bd2dece76fab50b67e3b1774b64adac9ddb3e"
Jul 15 15:12:47.557342 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:47.557187    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eacb07422cc46a0c1c10a90b876bd2dece76fab50b67e3b1774b64adac9ddb3e"} err="failed to get container status \"eacb07422cc46a0c1c10a90b876bd2dece76fab50b67e3b1774b64adac9ddb3e\": rpc error: code = NotFound desc = could not find container \"eacb07422cc46a0c1c10a90b876bd2dece76fab50b67e3b1774b64adac9ddb3e\": container with ID starting with eacb07422cc46a0c1c10a90b876bd2dece76fab50b67e3b1774b64adac9ddb3e not found: ID does not exist"
Jul 15 15:12:47.571036 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:47.570997    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-1e3693/test-model-1e3693-kserve-8565769f55-ff5kz"]
Jul 15 15:12:47.574262 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:47.574237    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-1e3693/test-model-1e3693-kserve-8565769f55-ff5kz"]
Jul 15 15:12:47.591741 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:47.591708    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 15:12:48.753607 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:48.753574    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ec18fb12-5afc-414b-94db-7c9ed1285f23" path="/var/lib/kubelet/pods/ec18fb12-5afc-414b-94db-7c9ed1285f23/volumes"
Jul 15 15:12:55.711659 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:55.711605    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:12:55.767004 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:55.766967    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:12:57.271633 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:57.271599    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:12:57.613487 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:57.613442    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:12:57.856488 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:57.856459    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:12:57.968926 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:57.968845    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1e3693-dltls"]
Jul 15 15:12:57.969204 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:57.969193    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fce292b6-2be9-4a16-9ff6-3c3afed68224" containerName="main"
Jul 15 15:12:57.969253 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:57.969205    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="fce292b6-2be9-4a16-9ff6-3c3afed68224" containerName="main"
Jul 15 15:12:57.969253 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:57.969230    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ec18fb12-5afc-414b-94db-7c9ed1285f23" containerName="main"
Jul 15 15:12:57.969253 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:57.969236    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="ec18fb12-5afc-414b-94db-7c9ed1285f23" containerName="main"
Jul 15 15:12:57.969401 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:57.969305    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="fce292b6-2be9-4a16-9ff6-3c3afed68224" containerName="main"
Jul 15 15:12:57.969401 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:57.969315    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="ec18fb12-5afc-414b-94db-7c9ed1285f23" containerName="main"
Jul 15 15:12:57.973623 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:57.973604    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1e3693-dltls"
Jul 15 15:12:57.976338 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:57.976316    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7kbgk\""
Jul 15 15:12:57.980106 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:57.980083    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1e3693-dltls"]
Jul 15 15:12:58.004258 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:58.004228    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/67bff24d-f114-4b6a-96d0-2abd12723f42-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-1e3693-dltls\" (UID: \"67bff24d-f114-4b6a-96d0-2abd12723f42\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1e3693-dltls"
Jul 15 15:12:58.105583 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:58.105543    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/67bff24d-f114-4b6a-96d0-2abd12723f42-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-1e3693-dltls\" (UID: \"67bff24d-f114-4b6a-96d0-2abd12723f42\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1e3693-dltls"
Jul 15 15:12:58.106219 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:58.106194    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/67bff24d-f114-4b6a-96d0-2abd12723f42-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-1e3693-dltls\" (UID: \"67bff24d-f114-4b6a-96d0-2abd12723f42\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1e3693-dltls"
Jul 15 15:12:58.286344 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:58.286232    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1e3693-dltls"
Jul 15 15:12:58.415093 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:58.415063    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1e3693-dltls"]
Jul 15 15:12:58.416801 ip-10-0-140-61 kubenswrapper[2571]: W0715 15:12:58.416768    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67bff24d_f114_4b6a_96d0_2abd12723f42.slice/crio-ef5344a3a96971136233fd0bf564ab679c445e939475132b97fbb83081ba5d3c WatchSource:0}: Error finding container ef5344a3a96971136233fd0bf564ab679c445e939475132b97fbb83081ba5d3c: Status 404 returned error can't find the container with id ef5344a3a96971136233fd0bf564ab679c445e939475132b97fbb83081ba5d3c
Jul 15 15:12:58.607883 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:58.607852    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1e3693-dltls" event={"ID":"67bff24d-f114-4b6a-96d0-2abd12723f42","Type":"ContainerStarted","Data":"ef5344a3a96971136233fd0bf564ab679c445e939475132b97fbb83081ba5d3c"}
Jul 15 15:12:58.690916 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:58.690883    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:12:58.789937 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:58.789909    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:12:59.614194 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:59.614155    2571 generic.go:356] "Generic (PLEG): container finished" podID="67bff24d-f114-4b6a-96d0-2abd12723f42" containerID="826172b4cdbcb06195697552ab351d09b1e9899439174991d124b7301a17e72d" exitCode=0
Jul 15 15:12:59.614599 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:12:59.614222    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1e3693-dltls" event={"ID":"67bff24d-f114-4b6a-96d0-2abd12723f42","Type":"ContainerDied","Data":"826172b4cdbcb06195697552ab351d09b1e9899439174991d124b7301a17e72d"}
Jul 15 15:13:00.754757 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:00.754732    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1e3693-dltls"
Jul 15 15:13:00.827662 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:00.827628    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/67bff24d-f114-4b6a-96d0-2abd12723f42-maas-api-service-ca\") pod \"67bff24d-f114-4b6a-96d0-2abd12723f42\" (UID: \"67bff24d-f114-4b6a-96d0-2abd12723f42\") "
Jul 15 15:13:00.827970 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:00.827950    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/67bff24d-f114-4b6a-96d0-2abd12723f42-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "67bff24d-f114-4b6a-96d0-2abd12723f42" (UID: "67bff24d-f114-4b6a-96d0-2abd12723f42"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 15:13:00.928793 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:00.928704    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/67bff24d-f114-4b6a-96d0-2abd12723f42-maas-api-service-ca\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 15:13:01.624939 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:01.624907    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1e3693-dltls"
Jul 15 15:13:01.625086 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:01.624947    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-1e3693-dltls" event={"ID":"67bff24d-f114-4b6a-96d0-2abd12723f42","Type":"ContainerDied","Data":"ef5344a3a96971136233fd0bf564ab679c445e939475132b97fbb83081ba5d3c"}
Jul 15 15:13:01.625086 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:01.625015    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ef5344a3a96971136233fd0bf564ab679c445e939475132b97fbb83081ba5d3c"
Jul 15 15:13:08.012125 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:08.012090    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:13:08.452729 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:08.452694    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-1e3693-66f586f76-x8n6w"]
Jul 15 15:13:08.452945 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:08.452918    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1e3693-66f586f76-x8n6w" podUID="34ef2722-b1bf-4464-9024-9e0213b9ea9a" containerName="maas-api" containerID="cri-o://d34f8f106675a2e4a0380b28d8af0e57420c4b06f542d8e97bcb74845178a28e" gracePeriod=30
Jul 15 15:13:08.482965 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:08.482937    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:13:08.895038 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:08.895015    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1e3693-66f586f76-x8n6w"
Jul 15 15:13:09.008863 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:09.008785    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j92pz\" (UniqueName: \"kubernetes.io/projected/34ef2722-b1bf-4464-9024-9e0213b9ea9a-kube-api-access-j92pz\") pod \"34ef2722-b1bf-4464-9024-9e0213b9ea9a\" (UID: \"34ef2722-b1bf-4464-9024-9e0213b9ea9a\") "
Jul 15 15:13:09.009021 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:09.008870    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34ef2722-b1bf-4464-9024-9e0213b9ea9a-maas-api-tls\") pod \"34ef2722-b1bf-4464-9024-9e0213b9ea9a\" (UID: \"34ef2722-b1bf-4464-9024-9e0213b9ea9a\") "
Jul 15 15:13:09.009021 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:09.008923    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34ef2722-b1bf-4464-9024-9e0213b9ea9a-openshift-service-ca\") pod \"34ef2722-b1bf-4464-9024-9e0213b9ea9a\" (UID: \"34ef2722-b1bf-4464-9024-9e0213b9ea9a\") "
Jul 15 15:13:09.009358 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:09.009332    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/34ef2722-b1bf-4464-9024-9e0213b9ea9a-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "34ef2722-b1bf-4464-9024-9e0213b9ea9a" (UID: "34ef2722-b1bf-4464-9024-9e0213b9ea9a"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 15:13:09.010997 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:09.010975    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/34ef2722-b1bf-4464-9024-9e0213b9ea9a-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "34ef2722-b1bf-4464-9024-9e0213b9ea9a" (UID: "34ef2722-b1bf-4464-9024-9e0213b9ea9a"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 15:13:09.010997 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:09.010984    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/34ef2722-b1bf-4464-9024-9e0213b9ea9a-kube-api-access-j92pz" (OuterVolumeSpecName: "kube-api-access-j92pz") pod "34ef2722-b1bf-4464-9024-9e0213b9ea9a" (UID: "34ef2722-b1bf-4464-9024-9e0213b9ea9a"). InnerVolumeSpecName "kube-api-access-j92pz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:13:09.110442 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:09.110413    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j92pz\" (UniqueName: \"kubernetes.io/projected/34ef2722-b1bf-4464-9024-9e0213b9ea9a-kube-api-access-j92pz\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 15:13:09.110442 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:09.110438    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/34ef2722-b1bf-4464-9024-9e0213b9ea9a-maas-api-tls\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 15:13:09.110834 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:09.110448    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/34ef2722-b1bf-4464-9024-9e0213b9ea9a-openshift-service-ca\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 15:13:09.666623 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:09.666585    2571 generic.go:356] "Generic (PLEG): container finished" podID="34ef2722-b1bf-4464-9024-9e0213b9ea9a" containerID="d34f8f106675a2e4a0380b28d8af0e57420c4b06f542d8e97bcb74845178a28e" exitCode=0
Jul 15 15:13:09.666623 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:09.666623    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1e3693-66f586f76-x8n6w"
Jul 15 15:13:09.666847 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:09.666650    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1e3693-66f586f76-x8n6w" event={"ID":"34ef2722-b1bf-4464-9024-9e0213b9ea9a","Type":"ContainerDied","Data":"d34f8f106675a2e4a0380b28d8af0e57420c4b06f542d8e97bcb74845178a28e"}
Jul 15 15:13:09.666847 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:09.666706    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-inf-b-1e3693-66f586f76-x8n6w" event={"ID":"34ef2722-b1bf-4464-9024-9e0213b9ea9a","Type":"ContainerDied","Data":"bdef661b2d57a6422512587375cdb80d76064de24fa3697dbc7aa78a16350fbe"}
Jul 15 15:13:09.666847 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:09.666730    2571 scope.go:117] "RemoveContainer" containerID="d34f8f106675a2e4a0380b28d8af0e57420c4b06f542d8e97bcb74845178a28e"
Jul 15 15:13:09.682418 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:09.682397    2571 scope.go:117] "RemoveContainer" containerID="d34f8f106675a2e4a0380b28d8af0e57420c4b06f542d8e97bcb74845178a28e"
Jul 15 15:13:09.682697 ip-10-0-140-61 kubenswrapper[2571]: E0715 15:13:09.682679    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d34f8f106675a2e4a0380b28d8af0e57420c4b06f542d8e97bcb74845178a28e\": container with ID starting with d34f8f106675a2e4a0380b28d8af0e57420c4b06f542d8e97bcb74845178a28e not found: ID does not exist" containerID="d34f8f106675a2e4a0380b28d8af0e57420c4b06f542d8e97bcb74845178a28e"
Jul 15 15:13:09.682741 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:09.682704    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d34f8f106675a2e4a0380b28d8af0e57420c4b06f542d8e97bcb74845178a28e"} err="failed to get container status \"d34f8f106675a2e4a0380b28d8af0e57420c4b06f542d8e97bcb74845178a28e\": rpc error: code = NotFound desc = could not find container \"d34f8f106675a2e4a0380b28d8af0e57420c4b06f542d8e97bcb74845178a28e\": container with ID starting with d34f8f106675a2e4a0380b28d8af0e57420c4b06f542d8e97bcb74845178a28e not found: ID does not exist"
Jul 15 15:13:09.694918 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:09.694895    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-1e3693-66f586f76-x8n6w"]
Jul 15 15:13:09.700871 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:09.700848    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-inf-b-1e3693-66f586f76-x8n6w"]
Jul 15 15:13:10.754571 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:10.754536    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="34ef2722-b1bf-4464-9024-9e0213b9ea9a" path="/var/lib/kubelet/pods/34ef2722-b1bf-4464-9024-9e0213b9ea9a/volumes"
Jul 15 15:13:11.593589 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:11.593554    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 15:13:13.061987 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:13.061958    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:13:17.927581 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:17.927547    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:13:18.025427 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:18.025395    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:13:19.207787 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:19.207759    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:13:19.265373 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:19.265343    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:13:20.214102 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:20.214067    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:13:20.315250 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:20.315215    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:13:23.774085 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:23.774051    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:13:23.990994 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:23.990959    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:13:24.325174 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:24.325138    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:13:24.653967 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:24.653883    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:13:25.019758 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:25.019673    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:13:27.525729 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:27.525697    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:13:27.619086 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:27.619054    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:13:27.623090 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:27.623063    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c7c00d-86bbb4bb6d-2bjfl"]
Jul 15 15:13:27.623487 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:27.623471    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="67bff24d-f114-4b6a-96d0-2abd12723f42" containerName="revoke-keys"
Jul 15 15:13:27.623579 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:27.623492    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="67bff24d-f114-4b6a-96d0-2abd12723f42" containerName="revoke-keys"
Jul 15 15:13:27.623579 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:27.623518    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="34ef2722-b1bf-4464-9024-9e0213b9ea9a" containerName="maas-api"
Jul 15 15:13:27.623579 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:27.623528    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="34ef2722-b1bf-4464-9024-9e0213b9ea9a" containerName="maas-api"
Jul 15 15:13:27.623732 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:27.623612    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="34ef2722-b1bf-4464-9024-9e0213b9ea9a" containerName="maas-api"
Jul 15 15:13:27.623732 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:27.623627    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="67bff24d-f114-4b6a-96d0-2abd12723f42" containerName="revoke-keys"
Jul 15 15:13:27.626669 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:27.626642    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c7c00d-86bbb4bb6d-2bjfl"
Jul 15 15:13:27.629437 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:27.629417    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 15:13:27.630402 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:27.630384    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 15 15:13:27.630510 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:27.630419    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-a-c7c00d-serving-cert\""
Jul 15 15:13:27.630510 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:27.630423    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-chv7n\""
Jul 15 15:13:27.635719 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:27.635700    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c7c00d-86bbb4bb6d-2bjfl"]
Jul 15 15:13:27.682010 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:27.681969    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4hmq\" (UniqueName: \"kubernetes.io/projected/611ffbb6-8853-4b1b-8974-d65aa551aa1e-kube-api-access-l4hmq\") pod \"maas-api-e2e-api-a-c7c00d-86bbb4bb6d-2bjfl\" (UID: \"611ffbb6-8853-4b1b-8974-d65aa551aa1e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c7c00d-86bbb4bb6d-2bjfl"
Jul 15 15:13:27.682187 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:27.682024    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/611ffbb6-8853-4b1b-8974-d65aa551aa1e-maas-api-tls\") pod \"maas-api-e2e-api-a-c7c00d-86bbb4bb6d-2bjfl\" (UID: \"611ffbb6-8853-4b1b-8974-d65aa551aa1e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c7c00d-86bbb4bb6d-2bjfl"
Jul 15 15:13:27.682187 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:27.682049    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/611ffbb6-8853-4b1b-8974-d65aa551aa1e-openshift-service-ca\") pod \"maas-api-e2e-api-a-c7c00d-86bbb4bb6d-2bjfl\" (UID: \"611ffbb6-8853-4b1b-8974-d65aa551aa1e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c7c00d-86bbb4bb6d-2bjfl"
Jul 15 15:13:27.696405 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:27.696373    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:13:27.783172 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:27.783092    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/611ffbb6-8853-4b1b-8974-d65aa551aa1e-maas-api-tls\") pod \"maas-api-e2e-api-a-c7c00d-86bbb4bb6d-2bjfl\" (UID: \"611ffbb6-8853-4b1b-8974-d65aa551aa1e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c7c00d-86bbb4bb6d-2bjfl"
Jul 15 15:13:27.783172 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:27.783131    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/611ffbb6-8853-4b1b-8974-d65aa551aa1e-openshift-service-ca\") pod \"maas-api-e2e-api-a-c7c00d-86bbb4bb6d-2bjfl\" (UID: \"611ffbb6-8853-4b1b-8974-d65aa551aa1e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c7c00d-86bbb4bb6d-2bjfl"
Jul 15 15:13:27.783384 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:27.783234    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4hmq\" (UniqueName: \"kubernetes.io/projected/611ffbb6-8853-4b1b-8974-d65aa551aa1e-kube-api-access-l4hmq\") pod \"maas-api-e2e-api-a-c7c00d-86bbb4bb6d-2bjfl\" (UID: \"611ffbb6-8853-4b1b-8974-d65aa551aa1e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c7c00d-86bbb4bb6d-2bjfl"
Jul 15 15:13:27.783822 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:27.783800    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/611ffbb6-8853-4b1b-8974-d65aa551aa1e-openshift-service-ca\") pod \"maas-api-e2e-api-a-c7c00d-86bbb4bb6d-2bjfl\" (UID: \"611ffbb6-8853-4b1b-8974-d65aa551aa1e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c7c00d-86bbb4bb6d-2bjfl"
Jul 15 15:13:27.785422 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:27.785399    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/611ffbb6-8853-4b1b-8974-d65aa551aa1e-maas-api-tls\") pod \"maas-api-e2e-api-a-c7c00d-86bbb4bb6d-2bjfl\" (UID: \"611ffbb6-8853-4b1b-8974-d65aa551aa1e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c7c00d-86bbb4bb6d-2bjfl"
Jul 15 15:13:27.793246 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:27.793226    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4hmq\" (UniqueName: \"kubernetes.io/projected/611ffbb6-8853-4b1b-8974-d65aa551aa1e-kube-api-access-l4hmq\") pod \"maas-api-e2e-api-a-c7c00d-86bbb4bb6d-2bjfl\" (UID: \"611ffbb6-8853-4b1b-8974-d65aa551aa1e\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c7c00d-86bbb4bb6d-2bjfl"
Jul 15 15:13:27.842590 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:27.842539    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:13:27.940407 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:27.940373    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c7c00d-86bbb4bb6d-2bjfl"
Jul 15 15:13:28.074213 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:28.074185    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c7c00d-86bbb4bb6d-2bjfl"]
Jul 15 15:13:28.075499 ip-10-0-140-61 kubenswrapper[2571]: W0715 15:13:28.075474    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod611ffbb6_8853_4b1b_8974_d65aa551aa1e.slice/crio-8bf7483a03b3e7c0ea331dc96b5307ebbd055dfa398e0eeb67a37036a40f4017 WatchSource:0}: Error finding container 8bf7483a03b3e7c0ea331dc96b5307ebbd055dfa398e0eeb67a37036a40f4017: Status 404 returned error can't find the container with id 8bf7483a03b3e7c0ea331dc96b5307ebbd055dfa398e0eeb67a37036a40f4017
Jul 15 15:13:28.219629 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:28.219595    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:13:28.321246 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:28.321203    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:13:28.769359 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:28.769326    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c7c00d-86bbb4bb6d-2bjfl" event={"ID":"611ffbb6-8853-4b1b-8974-d65aa551aa1e","Type":"ContainerStarted","Data":"8bf7483a03b3e7c0ea331dc96b5307ebbd055dfa398e0eeb67a37036a40f4017"}
Jul 15 15:13:29.775392 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:29.775351    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c7c00d-86bbb4bb6d-2bjfl" event={"ID":"611ffbb6-8853-4b1b-8974-d65aa551aa1e","Type":"ContainerStarted","Data":"7c93ec42039c9bd8f5e17beb1883279aae447cc518c5c9f6e8d25d3dba31193d"}
Jul 15 15:13:29.775790 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:29.775483    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c7c00d-86bbb4bb6d-2bjfl"
Jul 15 15:13:29.795671 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:29.795617    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c7c00d-86bbb4bb6d-2bjfl" podStartSLOduration=2.088559624 podStartE2EDuration="2.795601424s" totalImagesPullingTime="707.0418ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:13:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:13:29.793151367 +0000 UTC m=+2393.308969241" watchObservedRunningTime="2026-07-15 15:13:29.795601424 +0000 UTC m=+2393.311419338"
Jul 15 15:13:32.489433 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:32.489399    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 15:13:34.506639 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:34.506595    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:13:34.561482 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:34.561445    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:13:35.552391 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:35.552350    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:13:35.654509 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:35.654469    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:13:35.694675 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:35.694643    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-345426-689f94fff6-dtcnb"]
Jul 15 15:13:35.699180 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:35.699157    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-345426-689f94fff6-dtcnb"
Jul 15 15:13:35.701712 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:35.701685    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-345426-serving-cert\""
Jul 15 15:13:35.706742 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:35.706718    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-345426-689f94fff6-dtcnb"]
Jul 15 15:13:35.752508 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:35.752475    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:13:35.753578 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:35.753557    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sl7bp\" (UniqueName: \"kubernetes.io/projected/28cc2438-3c32-41aa-95fc-7f96dd51ce17-kube-api-access-sl7bp\") pod \"maas-api-e2e-api-b-345426-689f94fff6-dtcnb\" (UID: \"28cc2438-3c32-41aa-95fc-7f96dd51ce17\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-345426-689f94fff6-dtcnb"
Jul 15 15:13:35.753636 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:35.753596    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28cc2438-3c32-41aa-95fc-7f96dd51ce17-openshift-service-ca\") pod \"maas-api-e2e-api-b-345426-689f94fff6-dtcnb\" (UID: \"28cc2438-3c32-41aa-95fc-7f96dd51ce17\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-345426-689f94fff6-dtcnb"
Jul 15 15:13:35.753636 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:35.753621    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28cc2438-3c32-41aa-95fc-7f96dd51ce17-maas-api-tls\") pod \"maas-api-e2e-api-b-345426-689f94fff6-dtcnb\" (UID: \"28cc2438-3c32-41aa-95fc-7f96dd51ce17\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-345426-689f94fff6-dtcnb"
Jul 15 15:13:35.787766 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:35.787735    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c7c00d-86bbb4bb6d-2bjfl"
Jul 15 15:13:35.854595 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:35.854557    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sl7bp\" (UniqueName: \"kubernetes.io/projected/28cc2438-3c32-41aa-95fc-7f96dd51ce17-kube-api-access-sl7bp\") pod \"maas-api-e2e-api-b-345426-689f94fff6-dtcnb\" (UID: \"28cc2438-3c32-41aa-95fc-7f96dd51ce17\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-345426-689f94fff6-dtcnb"
Jul 15 15:13:35.854804 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:35.854625    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28cc2438-3c32-41aa-95fc-7f96dd51ce17-openshift-service-ca\") pod \"maas-api-e2e-api-b-345426-689f94fff6-dtcnb\" (UID: \"28cc2438-3c32-41aa-95fc-7f96dd51ce17\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-345426-689f94fff6-dtcnb"
Jul 15 15:13:35.854914 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:35.854678    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28cc2438-3c32-41aa-95fc-7f96dd51ce17-maas-api-tls\") pod \"maas-api-e2e-api-b-345426-689f94fff6-dtcnb\" (UID: \"28cc2438-3c32-41aa-95fc-7f96dd51ce17\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-345426-689f94fff6-dtcnb"
Jul 15 15:13:35.855007 ip-10-0-140-61 kubenswrapper[2571]: E0715 15:13:35.854980    2571 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-345426-serving-cert: secret "maas-api-e2e-api-b-345426-serving-cert" not found
Jul 15 15:13:35.855121 ip-10-0-140-61 kubenswrapper[2571]: E0715 15:13:35.855049    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/28cc2438-3c32-41aa-95fc-7f96dd51ce17-maas-api-tls podName:28cc2438-3c32-41aa-95fc-7f96dd51ce17 nodeName:}" failed. No retries permitted until 2026-07-15 15:13:36.355028721 +0000 UTC m=+2399.870846573 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/28cc2438-3c32-41aa-95fc-7f96dd51ce17-maas-api-tls") pod "maas-api-e2e-api-b-345426-689f94fff6-dtcnb" (UID: "28cc2438-3c32-41aa-95fc-7f96dd51ce17") : secret "maas-api-e2e-api-b-345426-serving-cert" not found
Jul 15 15:13:35.855418 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:35.855399    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28cc2438-3c32-41aa-95fc-7f96dd51ce17-openshift-service-ca\") pod \"maas-api-e2e-api-b-345426-689f94fff6-dtcnb\" (UID: \"28cc2438-3c32-41aa-95fc-7f96dd51ce17\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-345426-689f94fff6-dtcnb"
Jul 15 15:13:35.864110 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:35.864084    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sl7bp\" (UniqueName: \"kubernetes.io/projected/28cc2438-3c32-41aa-95fc-7f96dd51ce17-kube-api-access-sl7bp\") pod \"maas-api-e2e-api-b-345426-689f94fff6-dtcnb\" (UID: \"28cc2438-3c32-41aa-95fc-7f96dd51ce17\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-345426-689f94fff6-dtcnb"
Jul 15 15:13:36.103100 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:36.103069    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:13:36.354548 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:36.354512    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:13:36.359636 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:36.359613    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28cc2438-3c32-41aa-95fc-7f96dd51ce17-maas-api-tls\") pod \"maas-api-e2e-api-b-345426-689f94fff6-dtcnb\" (UID: \"28cc2438-3c32-41aa-95fc-7f96dd51ce17\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-345426-689f94fff6-dtcnb"
Jul 15 15:13:36.362083 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:36.362059    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28cc2438-3c32-41aa-95fc-7f96dd51ce17-maas-api-tls\") pod \"maas-api-e2e-api-b-345426-689f94fff6-dtcnb\" (UID: \"28cc2438-3c32-41aa-95fc-7f96dd51ce17\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-345426-689f94fff6-dtcnb"
Jul 15 15:13:36.452522 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:36.452491    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:13:36.612900 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:36.612801    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-345426-689f94fff6-dtcnb"
Jul 15 15:13:36.745534 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:36.745509    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-345426-689f94fff6-dtcnb"]
Jul 15 15:13:36.747429 ip-10-0-140-61 kubenswrapper[2571]: W0715 15:13:36.747398    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28cc2438_3c32_41aa_95fc_7f96dd51ce17.slice/crio-3042be8b26d91cd0f796862de37fa518b2b139dd4a9563bfbb6652b92a76061f WatchSource:0}: Error finding container 3042be8b26d91cd0f796862de37fa518b2b139dd4a9563bfbb6652b92a76061f: Status 404 returned error can't find the container with id 3042be8b26d91cd0f796862de37fa518b2b139dd4a9563bfbb6652b92a76061f
Jul 15 15:13:36.810762 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:36.810723    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-345426-689f94fff6-dtcnb" event={"ID":"28cc2438-3c32-41aa-95fc-7f96dd51ce17","Type":"ContainerStarted","Data":"3042be8b26d91cd0f796862de37fa518b2b139dd4a9563bfbb6652b92a76061f"}
Jul 15 15:13:37.817876 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:37.817841    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-345426-689f94fff6-dtcnb" event={"ID":"28cc2438-3c32-41aa-95fc-7f96dd51ce17","Type":"ContainerStarted","Data":"c7eec2898fadbe65ca57a12eeb4f76c1bf72894079d7821d1168d3ebe145b3c8"}
Jul 15 15:13:37.818316 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:37.818024    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-345426-689f94fff6-dtcnb"
Jul 15 15:13:37.837639 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:37.837581    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-345426-689f94fff6-dtcnb" podStartSLOduration=2.402813267 podStartE2EDuration="2.837564114s" totalImagesPullingTime="434.750847ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:13:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:13:37.835108761 +0000 UTC m=+2401.350926644" watchObservedRunningTime="2026-07-15 15:13:37.837564114 +0000 UTC m=+2401.353381986"
Jul 15 15:13:38.018332 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:38.018300    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-42mdh_0de0f3ad-e228-4c27-9b2c-de1a5844dcdb/console-operator/1.log"
Jul 15 15:13:38.019994 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:38.019969    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-42mdh_0de0f3ad-e228-4c27-9b2c-de1a5844dcdb/console-operator/1.log"
Jul 15 15:13:38.022849 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:38.022824    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8tt2_12bf26b1-5c4a-4e51-beb3-b17d7e7c4656/ovn-acl-logging/0.log"
Jul 15 15:13:38.024242 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:38.024222    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8tt2_12bf26b1-5c4a-4e51-beb3-b17d7e7c4656/ovn-acl-logging/0.log"
Jul 15 15:13:40.047802 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:40.047763    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:13:43.827776 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:43.827738    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-345426-689f94fff6-dtcnb"
Jul 15 15:13:48.645193 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:48.645155    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:13:48.744056 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:48.744022    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:13:49.197235 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:49.197200    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 15:13:57.371606 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:57.371571    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:13:57.472322 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:57.472250    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:13:58.719432 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:58.719401    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:13:58.818574 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:58.818497    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:13:58.996237 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:58.996146    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c7c00d-86bbb4bb6d-2bjfl"]
Jul 15 15:13:58.996465 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:58.996412    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c7c00d-86bbb4bb6d-2bjfl" podUID="611ffbb6-8853-4b1b-8974-d65aa551aa1e" containerName="maas-api" containerID="cri-o://7c93ec42039c9bd8f5e17beb1883279aae447cc518c5c9f6e8d25d3dba31193d" gracePeriod=30
Jul 15 15:13:59.021052 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:59.021027    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:13:59.265173 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:59.265139    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c7c00d-86bbb4bb6d-2bjfl"
Jul 15 15:13:59.367557 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:59.367523    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/611ffbb6-8853-4b1b-8974-d65aa551aa1e-maas-api-tls\") pod \"611ffbb6-8853-4b1b-8974-d65aa551aa1e\" (UID: \"611ffbb6-8853-4b1b-8974-d65aa551aa1e\") "
Jul 15 15:13:59.367746 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:59.367584    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l4hmq\" (UniqueName: \"kubernetes.io/projected/611ffbb6-8853-4b1b-8974-d65aa551aa1e-kube-api-access-l4hmq\") pod \"611ffbb6-8853-4b1b-8974-d65aa551aa1e\" (UID: \"611ffbb6-8853-4b1b-8974-d65aa551aa1e\") "
Jul 15 15:13:59.367746 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:59.367633    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/611ffbb6-8853-4b1b-8974-d65aa551aa1e-openshift-service-ca\") pod \"611ffbb6-8853-4b1b-8974-d65aa551aa1e\" (UID: \"611ffbb6-8853-4b1b-8974-d65aa551aa1e\") "
Jul 15 15:13:59.368058 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:59.368034    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/611ffbb6-8853-4b1b-8974-d65aa551aa1e-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "611ffbb6-8853-4b1b-8974-d65aa551aa1e" (UID: "611ffbb6-8853-4b1b-8974-d65aa551aa1e"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 15:13:59.369836 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:59.369814    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/611ffbb6-8853-4b1b-8974-d65aa551aa1e-kube-api-access-l4hmq" (OuterVolumeSpecName: "kube-api-access-l4hmq") pod "611ffbb6-8853-4b1b-8974-d65aa551aa1e" (UID: "611ffbb6-8853-4b1b-8974-d65aa551aa1e"). InnerVolumeSpecName "kube-api-access-l4hmq". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:13:59.369907 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:59.369888    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/611ffbb6-8853-4b1b-8974-d65aa551aa1e-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "611ffbb6-8853-4b1b-8974-d65aa551aa1e" (UID: "611ffbb6-8853-4b1b-8974-d65aa551aa1e"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 15:13:59.468665 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:59.468631    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/611ffbb6-8853-4b1b-8974-d65aa551aa1e-maas-api-tls\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 15:13:59.468665 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:59.468657    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l4hmq\" (UniqueName: \"kubernetes.io/projected/611ffbb6-8853-4b1b-8974-d65aa551aa1e-kube-api-access-l4hmq\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 15:13:59.468665 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:59.468667    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/611ffbb6-8853-4b1b-8974-d65aa551aa1e-openshift-service-ca\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 15:13:59.926363 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:59.926328    2571 generic.go:356] "Generic (PLEG): container finished" podID="611ffbb6-8853-4b1b-8974-d65aa551aa1e" containerID="7c93ec42039c9bd8f5e17beb1883279aae447cc518c5c9f6e8d25d3dba31193d" exitCode=0
Jul 15 15:13:59.926789 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:59.926369    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c7c00d-86bbb4bb6d-2bjfl"
Jul 15 15:13:59.926789 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:59.926404    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c7c00d-86bbb4bb6d-2bjfl" event={"ID":"611ffbb6-8853-4b1b-8974-d65aa551aa1e","Type":"ContainerDied","Data":"7c93ec42039c9bd8f5e17beb1883279aae447cc518c5c9f6e8d25d3dba31193d"}
Jul 15 15:13:59.926789 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:59.926455    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-a-c7c00d-86bbb4bb6d-2bjfl" event={"ID":"611ffbb6-8853-4b1b-8974-d65aa551aa1e","Type":"ContainerDied","Data":"8bf7483a03b3e7c0ea331dc96b5307ebbd055dfa398e0eeb67a37036a40f4017"}
Jul 15 15:13:59.926789 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:59.926477    2571 scope.go:117] "RemoveContainer" containerID="7c93ec42039c9bd8f5e17beb1883279aae447cc518c5c9f6e8d25d3dba31193d"
Jul 15 15:13:59.935749 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:59.935727    2571 scope.go:117] "RemoveContainer" containerID="7c93ec42039c9bd8f5e17beb1883279aae447cc518c5c9f6e8d25d3dba31193d"
Jul 15 15:13:59.936057 ip-10-0-140-61 kubenswrapper[2571]: E0715 15:13:59.936038    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7c93ec42039c9bd8f5e17beb1883279aae447cc518c5c9f6e8d25d3dba31193d\": container with ID starting with 7c93ec42039c9bd8f5e17beb1883279aae447cc518c5c9f6e8d25d3dba31193d not found: ID does not exist" containerID="7c93ec42039c9bd8f5e17beb1883279aae447cc518c5c9f6e8d25d3dba31193d"
Jul 15 15:13:59.936102 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:59.936068    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7c93ec42039c9bd8f5e17beb1883279aae447cc518c5c9f6e8d25d3dba31193d"} err="failed to get container status \"7c93ec42039c9bd8f5e17beb1883279aae447cc518c5c9f6e8d25d3dba31193d\": rpc error: code = NotFound desc = could not find container \"7c93ec42039c9bd8f5e17beb1883279aae447cc518c5c9f6e8d25d3dba31193d\": container with ID starting with 7c93ec42039c9bd8f5e17beb1883279aae447cc518c5c9f6e8d25d3dba31193d not found: ID does not exist"
Jul 15 15:13:59.949218 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:59.949183    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c7c00d-86bbb4bb6d-2bjfl"]
Jul 15 15:13:59.954349 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:13:59.954314    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-a-c7c00d-86bbb4bb6d-2bjfl"]
Jul 15 15:14:00.753491 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:00.753458    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="611ffbb6-8853-4b1b-8974-d65aa551aa1e" path="/var/lib/kubelet/pods/611ffbb6-8853-4b1b-8974-d65aa551aa1e/volumes"
Jul 15 15:14:01.994918 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:01.994879    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 15:14:03.230587 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:03.230549    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:14:09.215858 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:09.215820    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:14:09.322638 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:09.322605    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:14:13.902668 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:13.902632    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:14:14.133813 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:14.133773    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:14:14.984109 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:14.984077    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:14:15.084608 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:15.084575    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:14:24.754547 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:24.754517    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-345426-689f94fff6-dtcnb"]
Jul 15 15:14:24.756868 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:24.754799    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-345426-689f94fff6-dtcnb" podUID="28cc2438-3c32-41aa-95fc-7f96dd51ce17" containerName="maas-api" containerID="cri-o://c7eec2898fadbe65ca57a12eeb4f76c1bf72894079d7821d1168d3ebe145b3c8" gracePeriod=30
Jul 15 15:14:24.778161 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:24.778139    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:14:24.994444 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:24.994420    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-345426-689f94fff6-dtcnb"
Jul 15 15:14:25.053512 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:25.053428    2571 generic.go:356] "Generic (PLEG): container finished" podID="28cc2438-3c32-41aa-95fc-7f96dd51ce17" containerID="c7eec2898fadbe65ca57a12eeb4f76c1bf72894079d7821d1168d3ebe145b3c8" exitCode=0
Jul 15 15:14:25.053512 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:25.053469    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-345426-689f94fff6-dtcnb"
Jul 15 15:14:25.053701 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:25.053506    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-345426-689f94fff6-dtcnb" event={"ID":"28cc2438-3c32-41aa-95fc-7f96dd51ce17","Type":"ContainerDied","Data":"c7eec2898fadbe65ca57a12eeb4f76c1bf72894079d7821d1168d3ebe145b3c8"}
Jul 15 15:14:25.053701 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:25.053559    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-345426-689f94fff6-dtcnb" event={"ID":"28cc2438-3c32-41aa-95fc-7f96dd51ce17","Type":"ContainerDied","Data":"3042be8b26d91cd0f796862de37fa518b2b139dd4a9563bfbb6652b92a76061f"}
Jul 15 15:14:25.053701 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:25.053586    2571 scope.go:117] "RemoveContainer" containerID="c7eec2898fadbe65ca57a12eeb4f76c1bf72894079d7821d1168d3ebe145b3c8"
Jul 15 15:14:25.062089 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:25.062061    2571 scope.go:117] "RemoveContainer" containerID="c7eec2898fadbe65ca57a12eeb4f76c1bf72894079d7821d1168d3ebe145b3c8"
Jul 15 15:14:25.062636 ip-10-0-140-61 kubenswrapper[2571]: E0715 15:14:25.062559    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c7eec2898fadbe65ca57a12eeb4f76c1bf72894079d7821d1168d3ebe145b3c8\": container with ID starting with c7eec2898fadbe65ca57a12eeb4f76c1bf72894079d7821d1168d3ebe145b3c8 not found: ID does not exist" containerID="c7eec2898fadbe65ca57a12eeb4f76c1bf72894079d7821d1168d3ebe145b3c8"
Jul 15 15:14:25.062636 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:25.062599    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c7eec2898fadbe65ca57a12eeb4f76c1bf72894079d7821d1168d3ebe145b3c8"} err="failed to get container status \"c7eec2898fadbe65ca57a12eeb4f76c1bf72894079d7821d1168d3ebe145b3c8\": rpc error: code = NotFound desc = could not find container \"c7eec2898fadbe65ca57a12eeb4f76c1bf72894079d7821d1168d3ebe145b3c8\": container with ID starting with c7eec2898fadbe65ca57a12eeb4f76c1bf72894079d7821d1168d3ebe145b3c8 not found: ID does not exist"
Jul 15 15:14:25.092361 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:25.092333    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28cc2438-3c32-41aa-95fc-7f96dd51ce17-openshift-service-ca\") pod \"28cc2438-3c32-41aa-95fc-7f96dd51ce17\" (UID: \"28cc2438-3c32-41aa-95fc-7f96dd51ce17\") "
Jul 15 15:14:25.092504 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:25.092375    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sl7bp\" (UniqueName: \"kubernetes.io/projected/28cc2438-3c32-41aa-95fc-7f96dd51ce17-kube-api-access-sl7bp\") pod \"28cc2438-3c32-41aa-95fc-7f96dd51ce17\" (UID: \"28cc2438-3c32-41aa-95fc-7f96dd51ce17\") "
Jul 15 15:14:25.092504 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:25.092417    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28cc2438-3c32-41aa-95fc-7f96dd51ce17-maas-api-tls\") pod \"28cc2438-3c32-41aa-95fc-7f96dd51ce17\" (UID: \"28cc2438-3c32-41aa-95fc-7f96dd51ce17\") "
Jul 15 15:14:25.092683 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:25.092661    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/28cc2438-3c32-41aa-95fc-7f96dd51ce17-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "28cc2438-3c32-41aa-95fc-7f96dd51ce17" (UID: "28cc2438-3c32-41aa-95fc-7f96dd51ce17"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 15:14:25.094464 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:25.094441    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28cc2438-3c32-41aa-95fc-7f96dd51ce17-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "28cc2438-3c32-41aa-95fc-7f96dd51ce17" (UID: "28cc2438-3c32-41aa-95fc-7f96dd51ce17"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 15:14:25.094572 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:25.094535    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28cc2438-3c32-41aa-95fc-7f96dd51ce17-kube-api-access-sl7bp" (OuterVolumeSpecName: "kube-api-access-sl7bp") pod "28cc2438-3c32-41aa-95fc-7f96dd51ce17" (UID: "28cc2438-3c32-41aa-95fc-7f96dd51ce17"). InnerVolumeSpecName "kube-api-access-sl7bp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:14:25.193920 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:25.193870    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/28cc2438-3c32-41aa-95fc-7f96dd51ce17-maas-api-tls\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 15:14:25.193920 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:25.193915    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/28cc2438-3c32-41aa-95fc-7f96dd51ce17-openshift-service-ca\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 15:14:25.193920 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:25.193925    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sl7bp\" (UniqueName: \"kubernetes.io/projected/28cc2438-3c32-41aa-95fc-7f96dd51ce17-kube-api-access-sl7bp\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 15:14:25.378790 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:25.378753    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-345426-689f94fff6-dtcnb"]
Jul 15 15:14:25.384000 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:25.383976    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-345426-689f94fff6-dtcnb"]
Jul 15 15:14:26.752838 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:26.752806    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28cc2438-3c32-41aa-95fc-7f96dd51ce17" path="/var/lib/kubelet/pods/28cc2438-3c32-41aa-95fc-7f96dd51ce17/volumes"
Jul 15 15:14:27.590053 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:27.590017    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 15:14:29.353309 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:29.353261    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:14:35.367358 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:35.367323    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:14:35.467331 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:35.467295    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:14:40.072548 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:40.072519    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:14:40.328154 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:40.328058    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:14:40.674109 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:40.674079    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:14:41.003698 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:41.003613    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:14:41.518540 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:41.518502    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:14:43.964515 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:43.964477    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:14:44.063656 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:44.063619    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:14:44.190708 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:44.190670    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-0c81d7-86b8b6747c-ds7rl"]
Jul 15 15:14:44.191136 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:44.191119    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="611ffbb6-8853-4b1b-8974-d65aa551aa1e" containerName="maas-api"
Jul 15 15:14:44.191136 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:44.191138    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="611ffbb6-8853-4b1b-8974-d65aa551aa1e" containerName="maas-api"
Jul 15 15:14:44.191248 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:44.191155    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28cc2438-3c32-41aa-95fc-7f96dd51ce17" containerName="maas-api"
Jul 15 15:14:44.191248 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:44.191162    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="28cc2438-3c32-41aa-95fc-7f96dd51ce17" containerName="maas-api"
Jul 15 15:14:44.191248 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:44.191213    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="611ffbb6-8853-4b1b-8974-d65aa551aa1e" containerName="maas-api"
Jul 15 15:14:44.191248 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:44.191222    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="28cc2438-3c32-41aa-95fc-7f96dd51ce17" containerName="maas-api"
Jul 15 15:14:44.194044 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:44.194029    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0c81d7-86b8b6747c-ds7rl"
Jul 15 15:14:44.196864 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:44.196844    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-chv7n\""
Jul 15 15:14:44.197089 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:44.196898    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 15:14:44.197172 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:44.196898    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-0c81d7-serving-cert\""
Jul 15 15:14:44.197233 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:44.196898    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\""
Jul 15 15:14:44.203078 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:44.203053    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-0c81d7-86b8b6747c-ds7rl"]
Jul 15 15:14:44.218871 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:44.218808    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:14:44.257831 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:44.257803    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fnjr9\" (UniqueName: \"kubernetes.io/projected/170f7805-0244-4305-a429-e1bc8ff54acb-kube-api-access-fnjr9\") pod \"maas-api-e2e-shared-a-0c81d7-86b8b6747c-ds7rl\" (UID: \"170f7805-0244-4305-a429-e1bc8ff54acb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0c81d7-86b8b6747c-ds7rl"
Jul 15 15:14:44.257964 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:44.257833    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/170f7805-0244-4305-a429-e1bc8ff54acb-openshift-service-ca\") pod \"maas-api-e2e-shared-a-0c81d7-86b8b6747c-ds7rl\" (UID: \"170f7805-0244-4305-a429-e1bc8ff54acb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0c81d7-86b8b6747c-ds7rl"
Jul 15 15:14:44.257964 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:44.257869    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/170f7805-0244-4305-a429-e1bc8ff54acb-maas-api-tls\") pod \"maas-api-e2e-shared-a-0c81d7-86b8b6747c-ds7rl\" (UID: \"170f7805-0244-4305-a429-e1bc8ff54acb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0c81d7-86b8b6747c-ds7rl"
Jul 15 15:14:44.358777 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:44.358740    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fnjr9\" (UniqueName: \"kubernetes.io/projected/170f7805-0244-4305-a429-e1bc8ff54acb-kube-api-access-fnjr9\") pod \"maas-api-e2e-shared-a-0c81d7-86b8b6747c-ds7rl\" (UID: \"170f7805-0244-4305-a429-e1bc8ff54acb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0c81d7-86b8b6747c-ds7rl"
Jul 15 15:14:44.358777 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:44.358779    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/170f7805-0244-4305-a429-e1bc8ff54acb-openshift-service-ca\") pod \"maas-api-e2e-shared-a-0c81d7-86b8b6747c-ds7rl\" (UID: \"170f7805-0244-4305-a429-e1bc8ff54acb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0c81d7-86b8b6747c-ds7rl"
Jul 15 15:14:44.358984 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:44.358826    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/170f7805-0244-4305-a429-e1bc8ff54acb-maas-api-tls\") pod \"maas-api-e2e-shared-a-0c81d7-86b8b6747c-ds7rl\" (UID: \"170f7805-0244-4305-a429-e1bc8ff54acb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0c81d7-86b8b6747c-ds7rl"
Jul 15 15:14:44.359616 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:44.359584    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/170f7805-0244-4305-a429-e1bc8ff54acb-openshift-service-ca\") pod \"maas-api-e2e-shared-a-0c81d7-86b8b6747c-ds7rl\" (UID: \"170f7805-0244-4305-a429-e1bc8ff54acb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0c81d7-86b8b6747c-ds7rl"
Jul 15 15:14:44.361255 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:44.361235    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/170f7805-0244-4305-a429-e1bc8ff54acb-maas-api-tls\") pod \"maas-api-e2e-shared-a-0c81d7-86b8b6747c-ds7rl\" (UID: \"170f7805-0244-4305-a429-e1bc8ff54acb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0c81d7-86b8b6747c-ds7rl"
Jul 15 15:14:44.368901 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:44.368879    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fnjr9\" (UniqueName: \"kubernetes.io/projected/170f7805-0244-4305-a429-e1bc8ff54acb-kube-api-access-fnjr9\") pod \"maas-api-e2e-shared-a-0c81d7-86b8b6747c-ds7rl\" (UID: \"170f7805-0244-4305-a429-e1bc8ff54acb\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0c81d7-86b8b6747c-ds7rl"
Jul 15 15:14:44.377568 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:44.377538    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:14:44.507023 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:44.506943    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0c81d7-86b8b6747c-ds7rl"
Jul 15 15:14:44.639182 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:44.639155    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-0c81d7-86b8b6747c-ds7rl"]
Jul 15 15:14:44.640755 ip-10-0-140-61 kubenswrapper[2571]: W0715 15:14:44.640724    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod170f7805_0244_4305_a429_e1bc8ff54acb.slice/crio-4e6a4c51d817f3b2c93321787eef3c81e474664d5a48ead4119889a9bd2e8c20 WatchSource:0}: Error finding container 4e6a4c51d817f3b2c93321787eef3c81e474664d5a48ead4119889a9bd2e8c20: Status 404 returned error can't find the container with id 4e6a4c51d817f3b2c93321787eef3c81e474664d5a48ead4119889a9bd2e8c20
Jul 15 15:14:44.814481 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:44.814451    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:14:44.916358 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:44.916310    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:14:45.149840 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:45.149750    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0c81d7-86b8b6747c-ds7rl" event={"ID":"170f7805-0244-4305-a429-e1bc8ff54acb","Type":"ContainerStarted","Data":"4e6a4c51d817f3b2c93321787eef3c81e474664d5a48ead4119889a9bd2e8c20"}
Jul 15 15:14:46.155530 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:46.155494    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0c81d7-86b8b6747c-ds7rl" event={"ID":"170f7805-0244-4305-a429-e1bc8ff54acb","Type":"ContainerStarted","Data":"7430718f33e40359798e5a2664fd2eeb6a986f1b69ccb6dcc5d32d71376e9088"}
Jul 15 15:14:46.155939 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:46.155618    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0c81d7-86b8b6747c-ds7rl"
Jul 15 15:14:46.174844 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:46.174796    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0c81d7-86b8b6747c-ds7rl" podStartSLOduration=1.634606258 podStartE2EDuration="2.174780561s" totalImagesPullingTime="540.174303ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:14:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:14:46.173590795 +0000 UTC m=+2469.689408680" watchObservedRunningTime="2026-07-15 15:14:46.174780561 +0000 UTC m=+2469.690598432"
Jul 15 15:14:48.462057 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:48.462011    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:14:48.695606 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:48.695554    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 15:14:48.801524 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:48.801453    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:14:49.128348 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:49.128314    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:14:49.444713 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:49.444615    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:14:52.020186 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:52.020149    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:14:52.121530 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:52.121490    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:14:52.125569 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:52.125541    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b2aed6-b8f866497-fgd76"]
Jul 15 15:14:52.129442 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:52.129422    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b2aed6-b8f866497-fgd76"
Jul 15 15:14:52.131808 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:52.131782    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-b2aed6-serving-cert\""
Jul 15 15:14:52.140324 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:52.140247    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b2aed6-b8f866497-fgd76"]
Jul 15 15:14:52.165716 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:52.165689    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0c81d7-86b8b6747c-ds7rl"
Jul 15 15:14:52.188914 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:52.188869    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:14:52.230150 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:52.230125    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1a58a8d-1fcc-4236-9801-a07dd74c2a6f-maas-api-tls\") pod \"maas-api-e2e-shared-b-b2aed6-b8f866497-fgd76\" (UID: \"b1a58a8d-1fcc-4236-9801-a07dd74c2a6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b2aed6-b8f866497-fgd76"
Jul 15 15:14:52.230283 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:52.230156    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzqx5\" (UniqueName: \"kubernetes.io/projected/b1a58a8d-1fcc-4236-9801-a07dd74c2a6f-kube-api-access-pzqx5\") pod \"maas-api-e2e-shared-b-b2aed6-b8f866497-fgd76\" (UID: \"b1a58a8d-1fcc-4236-9801-a07dd74c2a6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b2aed6-b8f866497-fgd76"
Jul 15 15:14:52.230283 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:52.230207    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1a58a8d-1fcc-4236-9801-a07dd74c2a6f-openshift-service-ca\") pod \"maas-api-e2e-shared-b-b2aed6-b8f866497-fgd76\" (UID: \"b1a58a8d-1fcc-4236-9801-a07dd74c2a6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b2aed6-b8f866497-fgd76"
Jul 15 15:14:52.330914 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:52.330884    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1a58a8d-1fcc-4236-9801-a07dd74c2a6f-openshift-service-ca\") pod \"maas-api-e2e-shared-b-b2aed6-b8f866497-fgd76\" (UID: \"b1a58a8d-1fcc-4236-9801-a07dd74c2a6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b2aed6-b8f866497-fgd76"
Jul 15 15:14:52.331088 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:52.331068    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1a58a8d-1fcc-4236-9801-a07dd74c2a6f-maas-api-tls\") pod \"maas-api-e2e-shared-b-b2aed6-b8f866497-fgd76\" (UID: \"b1a58a8d-1fcc-4236-9801-a07dd74c2a6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b2aed6-b8f866497-fgd76"
Jul 15 15:14:52.331145 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:52.331107    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzqx5\" (UniqueName: \"kubernetes.io/projected/b1a58a8d-1fcc-4236-9801-a07dd74c2a6f-kube-api-access-pzqx5\") pod \"maas-api-e2e-shared-b-b2aed6-b8f866497-fgd76\" (UID: \"b1a58a8d-1fcc-4236-9801-a07dd74c2a6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b2aed6-b8f866497-fgd76"
Jul 15 15:14:52.331189 ip-10-0-140-61 kubenswrapper[2571]: E0715 15:14:52.331165    2571 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-b2aed6-serving-cert: secret "maas-api-e2e-shared-b-b2aed6-serving-cert" not found
Jul 15 15:14:52.331242 ip-10-0-140-61 kubenswrapper[2571]: E0715 15:14:52.331216    2571 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b1a58a8d-1fcc-4236-9801-a07dd74c2a6f-maas-api-tls podName:b1a58a8d-1fcc-4236-9801-a07dd74c2a6f nodeName:}" failed. No retries permitted until 2026-07-15 15:14:52.831201215 +0000 UTC m=+2476.347019068 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/b1a58a8d-1fcc-4236-9801-a07dd74c2a6f-maas-api-tls") pod "maas-api-e2e-shared-b-b2aed6-b8f866497-fgd76" (UID: "b1a58a8d-1fcc-4236-9801-a07dd74c2a6f") : secret "maas-api-e2e-shared-b-b2aed6-serving-cert" not found
Jul 15 15:14:52.331631 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:52.331613    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1a58a8d-1fcc-4236-9801-a07dd74c2a6f-openshift-service-ca\") pod \"maas-api-e2e-shared-b-b2aed6-b8f866497-fgd76\" (UID: \"b1a58a8d-1fcc-4236-9801-a07dd74c2a6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b2aed6-b8f866497-fgd76"
Jul 15 15:14:52.343578 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:52.343560    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzqx5\" (UniqueName: \"kubernetes.io/projected/b1a58a8d-1fcc-4236-9801-a07dd74c2a6f-kube-api-access-pzqx5\") pod \"maas-api-e2e-shared-b-b2aed6-b8f866497-fgd76\" (UID: \"b1a58a8d-1fcc-4236-9801-a07dd74c2a6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b2aed6-b8f866497-fgd76"
Jul 15 15:14:52.423932 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:52.423895    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:14:52.753439 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:52.753362    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:14:52.835095 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:52.835064    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1a58a8d-1fcc-4236-9801-a07dd74c2a6f-maas-api-tls\") pod \"maas-api-e2e-shared-b-b2aed6-b8f866497-fgd76\" (UID: \"b1a58a8d-1fcc-4236-9801-a07dd74c2a6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b2aed6-b8f866497-fgd76"
Jul 15 15:14:52.837583 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:52.837557    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1a58a8d-1fcc-4236-9801-a07dd74c2a6f-maas-api-tls\") pod \"maas-api-e2e-shared-b-b2aed6-b8f866497-fgd76\" (UID: \"b1a58a8d-1fcc-4236-9801-a07dd74c2a6f\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b2aed6-b8f866497-fgd76"
Jul 15 15:14:52.853397 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:52.853370    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:14:53.041459 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:53.041370    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b2aed6-b8f866497-fgd76"
Jul 15 15:14:53.176905 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:53.176880    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b2aed6-b8f866497-fgd76"]
Jul 15 15:14:53.178548 ip-10-0-140-61 kubenswrapper[2571]: W0715 15:14:53.178521    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1a58a8d_1fcc_4236_9801_a07dd74c2a6f.slice/crio-65d23beddd4aab1c0d9ca2eb9c2535a8c7132808ad64d30130fd7c89311f52f6 WatchSource:0}: Error finding container 65d23beddd4aab1c0d9ca2eb9c2535a8c7132808ad64d30130fd7c89311f52f6: Status 404 returned error can't find the container with id 65d23beddd4aab1c0d9ca2eb9c2535a8c7132808ad64d30130fd7c89311f52f6
Jul 15 15:14:53.188592 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:53.188564    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b2aed6-b8f866497-fgd76" event={"ID":"b1a58a8d-1fcc-4236-9801-a07dd74c2a6f","Type":"ContainerStarted","Data":"65d23beddd4aab1c0d9ca2eb9c2535a8c7132808ad64d30130fd7c89311f52f6"}
Jul 15 15:14:54.195108 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:54.195073    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b2aed6-b8f866497-fgd76" event={"ID":"b1a58a8d-1fcc-4236-9801-a07dd74c2a6f","Type":"ContainerStarted","Data":"13df9e645f467368df882c50ef2f9498fdbbe29e2975c6fd6928bd33dbb50c75"}
Jul 15 15:14:54.195568 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:54.195196    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b2aed6-b8f866497-fgd76"
Jul 15 15:14:54.212756 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:54.212707    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b2aed6-b8f866497-fgd76" podStartSLOduration=1.876279204 podStartE2EDuration="2.212692852s" totalImagesPullingTime="336.413648ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:14:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:14:54.212199547 +0000 UTC m=+2477.728017420" watchObservedRunningTime="2026-07-15 15:14:54.212692852 +0000 UTC m=+2477.728510755"
Jul 15 15:14:56.520509 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:14:56.520470    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:15:00.134251 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:00.134209    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b2aed6-29735475-2268g"]
Jul 15 15:15:00.138315 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:00.138295    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735475-vbszp"]
Jul 15 15:15:00.138398 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:00.138386    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b2aed6-29735475-2268g"
Jul 15 15:15:00.140713 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:00.140692    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7kbgk\""
Jul 15 15:15:00.141795 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:00.141773    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735475-vbszp"
Jul 15 15:15:00.144955 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:00.144925    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b2aed6-29735475-2268g"]
Jul 15 15:15:00.151693 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:00.151662    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735475-vbszp"]
Jul 15 15:15:00.159874 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:00.159647    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b2aed6-29735475-2268g"
Jul 15 15:15:00.169616 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:00.169592    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735475-vbszp"
Jul 15 15:15:00.206597 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:00.206429    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b2aed6-b8f866497-fgd76"
Jul 15 15:15:00.314043 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:00.313845    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b2aed6-29735475-2268g"]
Jul 15 15:15:00.316792 ip-10-0-140-61 kubenswrapper[2571]: W0715 15:15:00.316759    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod746df728_064f_4816_b384_9f53b92bbee9.slice/crio-8ff1e7cf76c6b70d0dff2cef063ee1b2475bf5118964c44a178f1ebc339aa61e WatchSource:0}: Error finding container 8ff1e7cf76c6b70d0dff2cef063ee1b2475bf5118964c44a178f1ebc339aa61e: Status 404 returned error can't find the container with id 8ff1e7cf76c6b70d0dff2cef063ee1b2475bf5118964c44a178f1ebc339aa61e
Jul 15 15:15:00.342211 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:00.342184    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735475-vbszp"]
Jul 15 15:15:00.343213 ip-10-0-140-61 kubenswrapper[2571]: W0715 15:15:00.343185    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod750ed856_4699_4fc8_ab4f_695f5b97d6bc.slice/crio-9382afb9200ea1b7a9928b92ddc9403ea12805fab421c28849446bfc6fe8c8f6 WatchSource:0}: Error finding container 9382afb9200ea1b7a9928b92ddc9403ea12805fab421c28849446bfc6fe8c8f6: Status 404 returned error can't find the container with id 9382afb9200ea1b7a9928b92ddc9403ea12805fab421c28849446bfc6fe8c8f6
Jul 15 15:15:01.233298 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:01.233246    2571 generic.go:356] "Generic (PLEG): container finished" podID="746df728-064f-4816-b384-9f53b92bbee9" containerID="0d9f2de3b67924bc1229b36f611c0221319ee69c4aed0992811c5df6439a5524" exitCode=0
Jul 15 15:15:01.233649 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:01.233320    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b2aed6-29735475-2268g" event={"ID":"746df728-064f-4816-b384-9f53b92bbee9","Type":"ContainerDied","Data":"0d9f2de3b67924bc1229b36f611c0221319ee69c4aed0992811c5df6439a5524"}
Jul 15 15:15:01.233649 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:01.233368    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b2aed6-29735475-2268g" event={"ID":"746df728-064f-4816-b384-9f53b92bbee9","Type":"ContainerStarted","Data":"8ff1e7cf76c6b70d0dff2cef063ee1b2475bf5118964c44a178f1ebc339aa61e"}
Jul 15 15:15:01.234792 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:01.234769    2571 generic.go:356] "Generic (PLEG): container finished" podID="750ed856-4699-4fc8-ab4f-695f5b97d6bc" containerID="801d71b42ca93afc7f463853ce8e139cb383968e6e0007aef8a730067e0e2772" exitCode=0
Jul 15 15:15:01.234871 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:01.234829    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735475-vbszp" event={"ID":"750ed856-4699-4fc8-ab4f-695f5b97d6bc","Type":"ContainerDied","Data":"801d71b42ca93afc7f463853ce8e139cb383968e6e0007aef8a730067e0e2772"}
Jul 15 15:15:01.234871 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:01.234864    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735475-vbszp" event={"ID":"750ed856-4699-4fc8-ab4f-695f5b97d6bc","Type":"ContainerStarted","Data":"9382afb9200ea1b7a9928b92ddc9403ea12805fab421c28849446bfc6fe8c8f6"}
Jul 15 15:15:02.380626 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:02.380603    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b2aed6-29735475-2268g"
Jul 15 15:15:02.407649 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:02.407628    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735475-vbszp"
Jul 15 15:15:03.245567 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:03.245541    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735475-vbszp"
Jul 15 15:15:03.245756 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:03.245579    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735475-vbszp" event={"ID":"750ed856-4699-4fc8-ab4f-695f5b97d6bc","Type":"ContainerDied","Data":"9382afb9200ea1b7a9928b92ddc9403ea12805fab421c28849446bfc6fe8c8f6"}
Jul 15 15:15:03.245756 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:03.245627    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9382afb9200ea1b7a9928b92ddc9403ea12805fab421c28849446bfc6fe8c8f6"
Jul 15 15:15:03.246960 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:03.246937    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b2aed6-29735475-2268g" event={"ID":"746df728-064f-4816-b384-9f53b92bbee9","Type":"ContainerDied","Data":"8ff1e7cf76c6b70d0dff2cef063ee1b2475bf5118964c44a178f1ebc339aa61e"}
Jul 15 15:15:03.247060 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:03.246971    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8ff1e7cf76c6b70d0dff2cef063ee1b2475bf5118964c44a178f1ebc339aa61e"
Jul 15 15:15:03.247060 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:03.246971    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b2aed6-29735475-2268g"
Jul 15 15:15:05.397527 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:05.397489    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 15:15:06.572465 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:06.572435    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:15:07.169024 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:07.168991    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:15:14.754821 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:14.754792    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:15:14.857303 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:14.857259    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:15:22.685696 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:22.685669    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:15:26.594191 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:26.594158    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 15:15:50.098057 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:50.098021    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-b2aed6/auth-test-model-b2aed6-kserve-5f755ddf99-pxjgg"]
Jul 15 15:15:50.098487 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:50.098461    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="750ed856-4699-4fc8-ab4f-695f5b97d6bc" containerName="cleanup"
Jul 15 15:15:50.098487 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:50.098475    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="750ed856-4699-4fc8-ab4f-695f5b97d6bc" containerName="cleanup"
Jul 15 15:15:50.098558 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:50.098498    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="746df728-064f-4816-b384-9f53b92bbee9" containerName="cleanup"
Jul 15 15:15:50.098558 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:50.098504    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="746df728-064f-4816-b384-9f53b92bbee9" containerName="cleanup"
Jul 15 15:15:50.098629 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:50.098571    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="746df728-064f-4816-b384-9f53b92bbee9" containerName="cleanup"
Jul 15 15:15:50.098629 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:50.098582    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="750ed856-4699-4fc8-ab4f-695f5b97d6bc" containerName="cleanup"
Jul 15 15:15:50.102047 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:50.102029    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b2aed6/auth-test-model-b2aed6-kserve-5f755ddf99-pxjgg"
Jul 15 15:15:50.106375 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:50.106344    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b2aed6\"/\"kube-root-ca.crt\""
Jul 15 15:15:50.106375 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:50.106363    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b2aed6\"/\"default-dockercfg-kvwnr\""
Jul 15 15:15:50.106375 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:50.106350    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-b2aed6\"/\"auth-test-model-b2aed6-kserve-self-signed-certs\""
Jul 15 15:15:50.106630 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:50.106404    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-b2aed6\"/\"openshift-service-ca.crt\""
Jul 15 15:15:50.111837 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:50.111811    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b2aed6/auth-test-model-b2aed6-kserve-5f755ddf99-pxjgg"]
Jul 15 15:15:50.197799 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:50.197764    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:15:50.212508 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:50.212483    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c5b45d5a-f388-4936-9b51-7a31bbe86602-home\") pod \"auth-test-model-b2aed6-kserve-5f755ddf99-pxjgg\" (UID: \"c5b45d5a-f388-4936-9b51-7a31bbe86602\") " pod="ai-tenant-e2e-shared-b-b2aed6/auth-test-model-b2aed6-kserve-5f755ddf99-pxjgg"
Jul 15 15:15:50.212677 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:50.212514    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x88bf\" (UniqueName: \"kubernetes.io/projected/c5b45d5a-f388-4936-9b51-7a31bbe86602-kube-api-access-x88bf\") pod \"auth-test-model-b2aed6-kserve-5f755ddf99-pxjgg\" (UID: \"c5b45d5a-f388-4936-9b51-7a31bbe86602\") " pod="ai-tenant-e2e-shared-b-b2aed6/auth-test-model-b2aed6-kserve-5f755ddf99-pxjgg"
Jul 15 15:15:50.212677 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:50.212532    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c5b45d5a-f388-4936-9b51-7a31bbe86602-dshm\") pod \"auth-test-model-b2aed6-kserve-5f755ddf99-pxjgg\" (UID: \"c5b45d5a-f388-4936-9b51-7a31bbe86602\") " pod="ai-tenant-e2e-shared-b-b2aed6/auth-test-model-b2aed6-kserve-5f755ddf99-pxjgg"
Jul 15 15:15:50.212677 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:50.212582    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c5b45d5a-f388-4936-9b51-7a31bbe86602-model-cache\") pod \"auth-test-model-b2aed6-kserve-5f755ddf99-pxjgg\" (UID: \"c5b45d5a-f388-4936-9b51-7a31bbe86602\") " pod="ai-tenant-e2e-shared-b-b2aed6/auth-test-model-b2aed6-kserve-5f755ddf99-pxjgg"
Jul 15 15:15:50.212813 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:50.212740    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5b45d5a-f388-4936-9b51-7a31bbe86602-tmp-dir\") pod \"auth-test-model-b2aed6-kserve-5f755ddf99-pxjgg\" (UID: \"c5b45d5a-f388-4936-9b51-7a31bbe86602\") " pod="ai-tenant-e2e-shared-b-b2aed6/auth-test-model-b2aed6-kserve-5f755ddf99-pxjgg"
Jul 15 15:15:50.212813 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:50.212779    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c5b45d5a-f388-4936-9b51-7a31bbe86602-tls-certs\") pod \"auth-test-model-b2aed6-kserve-5f755ddf99-pxjgg\" (UID: \"c5b45d5a-f388-4936-9b51-7a31bbe86602\") " pod="ai-tenant-e2e-shared-b-b2aed6/auth-test-model-b2aed6-kserve-5f755ddf99-pxjgg"
Jul 15 15:15:50.313659 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:50.313621    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c5b45d5a-f388-4936-9b51-7a31bbe86602-home\") pod \"auth-test-model-b2aed6-kserve-5f755ddf99-pxjgg\" (UID: \"c5b45d5a-f388-4936-9b51-7a31bbe86602\") " pod="ai-tenant-e2e-shared-b-b2aed6/auth-test-model-b2aed6-kserve-5f755ddf99-pxjgg"
Jul 15 15:15:50.313659 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:50.313661    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x88bf\" (UniqueName: \"kubernetes.io/projected/c5b45d5a-f388-4936-9b51-7a31bbe86602-kube-api-access-x88bf\") pod \"auth-test-model-b2aed6-kserve-5f755ddf99-pxjgg\" (UID: \"c5b45d5a-f388-4936-9b51-7a31bbe86602\") " pod="ai-tenant-e2e-shared-b-b2aed6/auth-test-model-b2aed6-kserve-5f755ddf99-pxjgg"
Jul 15 15:15:50.313914 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:50.313683    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c5b45d5a-f388-4936-9b51-7a31bbe86602-dshm\") pod \"auth-test-model-b2aed6-kserve-5f755ddf99-pxjgg\" (UID: \"c5b45d5a-f388-4936-9b51-7a31bbe86602\") " pod="ai-tenant-e2e-shared-b-b2aed6/auth-test-model-b2aed6-kserve-5f755ddf99-pxjgg"
Jul 15 15:15:50.313914 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:50.313707    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c5b45d5a-f388-4936-9b51-7a31bbe86602-model-cache\") pod \"auth-test-model-b2aed6-kserve-5f755ddf99-pxjgg\" (UID: \"c5b45d5a-f388-4936-9b51-7a31bbe86602\") " pod="ai-tenant-e2e-shared-b-b2aed6/auth-test-model-b2aed6-kserve-5f755ddf99-pxjgg"
Jul 15 15:15:50.313914 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:50.313773    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5b45d5a-f388-4936-9b51-7a31bbe86602-tmp-dir\") pod \"auth-test-model-b2aed6-kserve-5f755ddf99-pxjgg\" (UID: \"c5b45d5a-f388-4936-9b51-7a31bbe86602\") " pod="ai-tenant-e2e-shared-b-b2aed6/auth-test-model-b2aed6-kserve-5f755ddf99-pxjgg"
Jul 15 15:15:50.313914 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:50.313792    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c5b45d5a-f388-4936-9b51-7a31bbe86602-tls-certs\") pod \"auth-test-model-b2aed6-kserve-5f755ddf99-pxjgg\" (UID: \"c5b45d5a-f388-4936-9b51-7a31bbe86602\") " pod="ai-tenant-e2e-shared-b-b2aed6/auth-test-model-b2aed6-kserve-5f755ddf99-pxjgg"
Jul 15 15:15:50.314162 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:50.314125    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c5b45d5a-f388-4936-9b51-7a31bbe86602-model-cache\") pod \"auth-test-model-b2aed6-kserve-5f755ddf99-pxjgg\" (UID: \"c5b45d5a-f388-4936-9b51-7a31bbe86602\") " pod="ai-tenant-e2e-shared-b-b2aed6/auth-test-model-b2aed6-kserve-5f755ddf99-pxjgg"
Jul 15 15:15:50.314225 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:50.314184    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5b45d5a-f388-4936-9b51-7a31bbe86602-tmp-dir\") pod \"auth-test-model-b2aed6-kserve-5f755ddf99-pxjgg\" (UID: \"c5b45d5a-f388-4936-9b51-7a31bbe86602\") " pod="ai-tenant-e2e-shared-b-b2aed6/auth-test-model-b2aed6-kserve-5f755ddf99-pxjgg"
Jul 15 15:15:50.314225 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:50.314195    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c5b45d5a-f388-4936-9b51-7a31bbe86602-home\") pod \"auth-test-model-b2aed6-kserve-5f755ddf99-pxjgg\" (UID: \"c5b45d5a-f388-4936-9b51-7a31bbe86602\") " pod="ai-tenant-e2e-shared-b-b2aed6/auth-test-model-b2aed6-kserve-5f755ddf99-pxjgg"
Jul 15 15:15:50.315983 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:50.315957    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c5b45d5a-f388-4936-9b51-7a31bbe86602-dshm\") pod \"auth-test-model-b2aed6-kserve-5f755ddf99-pxjgg\" (UID: \"c5b45d5a-f388-4936-9b51-7a31bbe86602\") " pod="ai-tenant-e2e-shared-b-b2aed6/auth-test-model-b2aed6-kserve-5f755ddf99-pxjgg"
Jul 15 15:15:50.316142 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:50.316120    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c5b45d5a-f388-4936-9b51-7a31bbe86602-tls-certs\") pod \"auth-test-model-b2aed6-kserve-5f755ddf99-pxjgg\" (UID: \"c5b45d5a-f388-4936-9b51-7a31bbe86602\") " pod="ai-tenant-e2e-shared-b-b2aed6/auth-test-model-b2aed6-kserve-5f755ddf99-pxjgg"
Jul 15 15:15:50.322460 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:50.322439    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x88bf\" (UniqueName: \"kubernetes.io/projected/c5b45d5a-f388-4936-9b51-7a31bbe86602-kube-api-access-x88bf\") pod \"auth-test-model-b2aed6-kserve-5f755ddf99-pxjgg\" (UID: \"c5b45d5a-f388-4936-9b51-7a31bbe86602\") " pod="ai-tenant-e2e-shared-b-b2aed6/auth-test-model-b2aed6-kserve-5f755ddf99-pxjgg"
Jul 15 15:15:50.412213 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:50.412106    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b2aed6/auth-test-model-b2aed6-kserve-5f755ddf99-pxjgg"
Jul 15 15:15:50.565921 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:50.565896    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-b2aed6/auth-test-model-b2aed6-kserve-5f755ddf99-pxjgg"]
Jul 15 15:15:50.567709 ip-10-0-140-61 kubenswrapper[2571]: W0715 15:15:50.567682    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc5b45d5a_f388_4936_9b51_7a31bbe86602.slice/crio-bcb4b9a3387e1e61e3a382d48cabc81b2e6e26af453e79340c5453beca763907 WatchSource:0}: Error finding container bcb4b9a3387e1e61e3a382d48cabc81b2e6e26af453e79340c5453beca763907: Status 404 returned error can't find the container with id bcb4b9a3387e1e61e3a382d48cabc81b2e6e26af453e79340c5453beca763907
Jul 15 15:15:51.485895 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:51.485858    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b2aed6/auth-test-model-b2aed6-kserve-5f755ddf99-pxjgg" event={"ID":"c5b45d5a-f388-4936-9b51-7a31bbe86602","Type":"ContainerStarted","Data":"b16cd2536e25ec58ebfc52f353399834a398d3a49d4cbd6e7b906ab93d915b4a"}
Jul 15 15:15:51.485895 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:51.485902    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b2aed6/auth-test-model-b2aed6-kserve-5f755ddf99-pxjgg" event={"ID":"c5b45d5a-f388-4936-9b51-7a31bbe86602","Type":"ContainerStarted","Data":"bcb4b9a3387e1e61e3a382d48cabc81b2e6e26af453e79340c5453beca763907"}
Jul 15 15:15:51.514070 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:51.514019    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-b2aed6/auth-test-model-b2aed6-kserve-5f755ddf99-pxjgg" podStartSLOduration=1.5140055970000001 podStartE2EDuration="1.514005597s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:15:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:15:51.513176289 +0000 UTC m=+2535.028994172" watchObservedRunningTime="2026-07-15 15:15:51.514005597 +0000 UTC m=+2535.029823467"
Jul 15 15:15:53.494791 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:15:53.494749    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 15:16:00.412389 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:16:00.412346    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-b2aed6/auth-test-model-b2aed6-kserve-5f755ddf99-pxjgg"
Jul 15 15:16:00.412389 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:16:00.412390    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-b2aed6/auth-test-model-b2aed6-kserve-5f755ddf99-pxjgg"
Jul 15 15:16:00.424660 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:16:00.424634    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-b2aed6/auth-test-model-b2aed6-kserve-5f755ddf99-pxjgg"
Jul 15 15:16:00.543469 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:16:00.543440    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-b2aed6/auth-test-model-b2aed6-kserve-5f755ddf99-pxjgg"
Jul 15 15:16:08.504244 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:16:08.504203    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 15:16:26.895012 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:16:26.894974    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 15:16:46.902365 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:16:46.902325    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 15:17:03.898396 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:17:03.898315    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 15:17:18.696735 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:17:18.696702    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 15:17:19.622566 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:17:19.622531    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:17:35.189512 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:17:35.189477    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 15:17:53.493559 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:17:53.493522    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 15:17:58.353662 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:17:58.353600    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:17:59.283750 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:17:59.283715    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b2aed6/auth-test-model-b2aed6-kserve-5f755ddf99-pxjgg"]
Jul 15 15:17:59.318478 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:17:59.318441    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:18:11.397286 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:11.397235    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-0c81d7/sub-test-model-0c81d7-kserve-596dfdc5bf-lt9pq"]
Jul 15 15:18:11.400981 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:11.400964    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0c81d7/sub-test-model-0c81d7-kserve-596dfdc5bf-lt9pq"
Jul 15 15:18:11.404464 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:11.404444    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-0c81d7\"/\"default-dockercfg-67sdb\""
Jul 15 15:18:11.404585 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:11.404450    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-0c81d7\"/\"openshift-service-ca.crt\""
Jul 15 15:18:11.404585 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:11.404448    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-0c81d7\"/\"sub-test-model-0c81d7-kserve-self-signed-certs\""
Jul 15 15:18:11.404585 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:11.404522    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-0c81d7\"/\"kube-root-ca.crt\""
Jul 15 15:18:11.414040 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:11.414017    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-0c81d7/sub-test-model-0c81d7-kserve-596dfdc5bf-lt9pq"]
Jul 15 15:18:11.425045 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:11.425011    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:18:11.494677 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:11.494629    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/940bfc53-d1c7-4edf-99a8-05c037648c90-tls-certs\") pod \"sub-test-model-0c81d7-kserve-596dfdc5bf-lt9pq\" (UID: \"940bfc53-d1c7-4edf-99a8-05c037648c90\") " pod="ai-tenant-e2e-shared-a-0c81d7/sub-test-model-0c81d7-kserve-596dfdc5bf-lt9pq"
Jul 15 15:18:11.494866 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:11.494704    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/940bfc53-d1c7-4edf-99a8-05c037648c90-dshm\") pod \"sub-test-model-0c81d7-kserve-596dfdc5bf-lt9pq\" (UID: \"940bfc53-d1c7-4edf-99a8-05c037648c90\") " pod="ai-tenant-e2e-shared-a-0c81d7/sub-test-model-0c81d7-kserve-596dfdc5bf-lt9pq"
Jul 15 15:18:11.494866 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:11.494741    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/940bfc53-d1c7-4edf-99a8-05c037648c90-tmp-dir\") pod \"sub-test-model-0c81d7-kserve-596dfdc5bf-lt9pq\" (UID: \"940bfc53-d1c7-4edf-99a8-05c037648c90\") " pod="ai-tenant-e2e-shared-a-0c81d7/sub-test-model-0c81d7-kserve-596dfdc5bf-lt9pq"
Jul 15 15:18:11.494866 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:11.494774    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/940bfc53-d1c7-4edf-99a8-05c037648c90-model-cache\") pod \"sub-test-model-0c81d7-kserve-596dfdc5bf-lt9pq\" (UID: \"940bfc53-d1c7-4edf-99a8-05c037648c90\") " pod="ai-tenant-e2e-shared-a-0c81d7/sub-test-model-0c81d7-kserve-596dfdc5bf-lt9pq"
Jul 15 15:18:11.494866 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:11.494800    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zn4pr\" (UniqueName: \"kubernetes.io/projected/940bfc53-d1c7-4edf-99a8-05c037648c90-kube-api-access-zn4pr\") pod \"sub-test-model-0c81d7-kserve-596dfdc5bf-lt9pq\" (UID: \"940bfc53-d1c7-4edf-99a8-05c037648c90\") " pod="ai-tenant-e2e-shared-a-0c81d7/sub-test-model-0c81d7-kserve-596dfdc5bf-lt9pq"
Jul 15 15:18:11.495044 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:11.494893    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/940bfc53-d1c7-4edf-99a8-05c037648c90-home\") pod \"sub-test-model-0c81d7-kserve-596dfdc5bf-lt9pq\" (UID: \"940bfc53-d1c7-4edf-99a8-05c037648c90\") " pod="ai-tenant-e2e-shared-a-0c81d7/sub-test-model-0c81d7-kserve-596dfdc5bf-lt9pq"
Jul 15 15:18:11.595637 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:11.595602    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/940bfc53-d1c7-4edf-99a8-05c037648c90-home\") pod \"sub-test-model-0c81d7-kserve-596dfdc5bf-lt9pq\" (UID: \"940bfc53-d1c7-4edf-99a8-05c037648c90\") " pod="ai-tenant-e2e-shared-a-0c81d7/sub-test-model-0c81d7-kserve-596dfdc5bf-lt9pq"
Jul 15 15:18:11.595827 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:11.595667    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/940bfc53-d1c7-4edf-99a8-05c037648c90-tls-certs\") pod \"sub-test-model-0c81d7-kserve-596dfdc5bf-lt9pq\" (UID: \"940bfc53-d1c7-4edf-99a8-05c037648c90\") " pod="ai-tenant-e2e-shared-a-0c81d7/sub-test-model-0c81d7-kserve-596dfdc5bf-lt9pq"
Jul 15 15:18:11.595827 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:11.595692    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/940bfc53-d1c7-4edf-99a8-05c037648c90-dshm\") pod \"sub-test-model-0c81d7-kserve-596dfdc5bf-lt9pq\" (UID: \"940bfc53-d1c7-4edf-99a8-05c037648c90\") " pod="ai-tenant-e2e-shared-a-0c81d7/sub-test-model-0c81d7-kserve-596dfdc5bf-lt9pq"
Jul 15 15:18:11.595827 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:11.595717    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/940bfc53-d1c7-4edf-99a8-05c037648c90-tmp-dir\") pod \"sub-test-model-0c81d7-kserve-596dfdc5bf-lt9pq\" (UID: \"940bfc53-d1c7-4edf-99a8-05c037648c90\") " pod="ai-tenant-e2e-shared-a-0c81d7/sub-test-model-0c81d7-kserve-596dfdc5bf-lt9pq"
Jul 15 15:18:11.595827 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:11.595734    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/940bfc53-d1c7-4edf-99a8-05c037648c90-model-cache\") pod \"sub-test-model-0c81d7-kserve-596dfdc5bf-lt9pq\" (UID: \"940bfc53-d1c7-4edf-99a8-05c037648c90\") " pod="ai-tenant-e2e-shared-a-0c81d7/sub-test-model-0c81d7-kserve-596dfdc5bf-lt9pq"
Jul 15 15:18:11.595827 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:11.595753    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zn4pr\" (UniqueName: \"kubernetes.io/projected/940bfc53-d1c7-4edf-99a8-05c037648c90-kube-api-access-zn4pr\") pod \"sub-test-model-0c81d7-kserve-596dfdc5bf-lt9pq\" (UID: \"940bfc53-d1c7-4edf-99a8-05c037648c90\") " pod="ai-tenant-e2e-shared-a-0c81d7/sub-test-model-0c81d7-kserve-596dfdc5bf-lt9pq"
Jul 15 15:18:11.596113 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:11.596052    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/940bfc53-d1c7-4edf-99a8-05c037648c90-home\") pod \"sub-test-model-0c81d7-kserve-596dfdc5bf-lt9pq\" (UID: \"940bfc53-d1c7-4edf-99a8-05c037648c90\") " pod="ai-tenant-e2e-shared-a-0c81d7/sub-test-model-0c81d7-kserve-596dfdc5bf-lt9pq"
Jul 15 15:18:11.596172 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:11.596128    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/940bfc53-d1c7-4edf-99a8-05c037648c90-tmp-dir\") pod \"sub-test-model-0c81d7-kserve-596dfdc5bf-lt9pq\" (UID: \"940bfc53-d1c7-4edf-99a8-05c037648c90\") " pod="ai-tenant-e2e-shared-a-0c81d7/sub-test-model-0c81d7-kserve-596dfdc5bf-lt9pq"
Jul 15 15:18:11.596172 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:11.596137    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/940bfc53-d1c7-4edf-99a8-05c037648c90-model-cache\") pod \"sub-test-model-0c81d7-kserve-596dfdc5bf-lt9pq\" (UID: \"940bfc53-d1c7-4edf-99a8-05c037648c90\") " pod="ai-tenant-e2e-shared-a-0c81d7/sub-test-model-0c81d7-kserve-596dfdc5bf-lt9pq"
Jul 15 15:18:11.597948 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:11.597926    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/940bfc53-d1c7-4edf-99a8-05c037648c90-dshm\") pod \"sub-test-model-0c81d7-kserve-596dfdc5bf-lt9pq\" (UID: \"940bfc53-d1c7-4edf-99a8-05c037648c90\") " pod="ai-tenant-e2e-shared-a-0c81d7/sub-test-model-0c81d7-kserve-596dfdc5bf-lt9pq"
Jul 15 15:18:11.598233 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:11.598212    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/940bfc53-d1c7-4edf-99a8-05c037648c90-tls-certs\") pod \"sub-test-model-0c81d7-kserve-596dfdc5bf-lt9pq\" (UID: \"940bfc53-d1c7-4edf-99a8-05c037648c90\") " pod="ai-tenant-e2e-shared-a-0c81d7/sub-test-model-0c81d7-kserve-596dfdc5bf-lt9pq"
Jul 15 15:18:11.604952 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:11.604933    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zn4pr\" (UniqueName: \"kubernetes.io/projected/940bfc53-d1c7-4edf-99a8-05c037648c90-kube-api-access-zn4pr\") pod \"sub-test-model-0c81d7-kserve-596dfdc5bf-lt9pq\" (UID: \"940bfc53-d1c7-4edf-99a8-05c037648c90\") " pod="ai-tenant-e2e-shared-a-0c81d7/sub-test-model-0c81d7-kserve-596dfdc5bf-lt9pq"
Jul 15 15:18:11.710509 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:11.710409    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0c81d7/sub-test-model-0c81d7-kserve-596dfdc5bf-lt9pq"
Jul 15 15:18:11.850441 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:11.850413    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-0c81d7/sub-test-model-0c81d7-kserve-596dfdc5bf-lt9pq"]
Jul 15 15:18:11.852396 ip-10-0-140-61 kubenswrapper[2571]: W0715 15:18:11.852369    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod940bfc53_d1c7_4edf_99a8_05c037648c90.slice/crio-dbdc1f185fb6768cdfe3bbae35a3967fa4f171fd4e06e60dbdcaa15d18753f49 WatchSource:0}: Error finding container dbdc1f185fb6768cdfe3bbae35a3967fa4f171fd4e06e60dbdcaa15d18753f49: Status 404 returned error can't find the container with id dbdc1f185fb6768cdfe3bbae35a3967fa4f171fd4e06e60dbdcaa15d18753f49
Jul 15 15:18:12.172677 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:12.172643    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0c81d7/sub-test-model-0c81d7-kserve-596dfdc5bf-lt9pq" event={"ID":"940bfc53-d1c7-4edf-99a8-05c037648c90","Type":"ContainerStarted","Data":"d6f82e1ee141c72bafe6c4b42d24835772cdebc71f42056d234428701aed7c5c"}
Jul 15 15:18:12.172677 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:12.172683    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0c81d7/sub-test-model-0c81d7-kserve-596dfdc5bf-lt9pq" event={"ID":"940bfc53-d1c7-4edf-99a8-05c037648c90","Type":"ContainerStarted","Data":"dbdc1f185fb6768cdfe3bbae35a3967fa4f171fd4e06e60dbdcaa15d18753f49"}
Jul 15 15:18:12.193856 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:12.193805    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-0c81d7/sub-test-model-0c81d7-kserve-596dfdc5bf-lt9pq" podStartSLOduration=1.193789507 podStartE2EDuration="1.193789507s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:18:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:18:12.192469364 +0000 UTC m=+2675.708287234" watchObservedRunningTime="2026-07-15 15:18:12.193789507 +0000 UTC m=+2675.709607482"
Jul 15 15:18:12.388323 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:12.388286    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 15:18:14.303379 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:14.303336    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-b2aed6/auth-test-model-b2aed6-kserve-5f755ddf99-pxjgg" podUID="c5b45d5a-f388-4936-9b51-7a31bbe86602" containerName="main" containerID="cri-o://b16cd2536e25ec58ebfc52f353399834a398d3a49d4cbd6e7b906ab93d915b4a" gracePeriod=45
Jul 15 15:18:14.555390 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:14.555364    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b2aed6/auth-test-model-b2aed6-kserve-5f755ddf99-pxjgg"
Jul 15 15:18:14.725854 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:14.725803    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c5b45d5a-f388-4936-9b51-7a31bbe86602-home\") pod \"c5b45d5a-f388-4936-9b51-7a31bbe86602\" (UID: \"c5b45d5a-f388-4936-9b51-7a31bbe86602\") "
Jul 15 15:18:14.725854 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:14.725858    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5b45d5a-f388-4936-9b51-7a31bbe86602-tmp-dir\") pod \"c5b45d5a-f388-4936-9b51-7a31bbe86602\" (UID: \"c5b45d5a-f388-4936-9b51-7a31bbe86602\") "
Jul 15 15:18:14.726132 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:14.725898    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c5b45d5a-f388-4936-9b51-7a31bbe86602-tls-certs\") pod \"c5b45d5a-f388-4936-9b51-7a31bbe86602\" (UID: \"c5b45d5a-f388-4936-9b51-7a31bbe86602\") "
Jul 15 15:18:14.726132 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:14.725968    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c5b45d5a-f388-4936-9b51-7a31bbe86602-model-cache\") pod \"c5b45d5a-f388-4936-9b51-7a31bbe86602\" (UID: \"c5b45d5a-f388-4936-9b51-7a31bbe86602\") "
Jul 15 15:18:14.726132 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:14.725987    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x88bf\" (UniqueName: \"kubernetes.io/projected/c5b45d5a-f388-4936-9b51-7a31bbe86602-kube-api-access-x88bf\") pod \"c5b45d5a-f388-4936-9b51-7a31bbe86602\" (UID: \"c5b45d5a-f388-4936-9b51-7a31bbe86602\") "
Jul 15 15:18:14.726132 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:14.726019    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c5b45d5a-f388-4936-9b51-7a31bbe86602-dshm\") pod \"c5b45d5a-f388-4936-9b51-7a31bbe86602\" (UID: \"c5b45d5a-f388-4936-9b51-7a31bbe86602\") "
Jul 15 15:18:14.726335 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:14.726137    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5b45d5a-f388-4936-9b51-7a31bbe86602-home" (OuterVolumeSpecName: "home") pod "c5b45d5a-f388-4936-9b51-7a31bbe86602" (UID: "c5b45d5a-f388-4936-9b51-7a31bbe86602"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:18:14.726335 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:14.726168    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5b45d5a-f388-4936-9b51-7a31bbe86602-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c5b45d5a-f388-4936-9b51-7a31bbe86602" (UID: "c5b45d5a-f388-4936-9b51-7a31bbe86602"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:18:14.726335 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:14.726216    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5b45d5a-f388-4936-9b51-7a31bbe86602-model-cache" (OuterVolumeSpecName: "model-cache") pod "c5b45d5a-f388-4936-9b51-7a31bbe86602" (UID: "c5b45d5a-f388-4936-9b51-7a31bbe86602"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:18:14.726335 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:14.726328    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c5b45d5a-f388-4936-9b51-7a31bbe86602-model-cache\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 15:18:14.726465 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:14.726340    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c5b45d5a-f388-4936-9b51-7a31bbe86602-home\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 15:18:14.726465 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:14.726349    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c5b45d5a-f388-4936-9b51-7a31bbe86602-tmp-dir\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 15:18:14.728313 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:14.728285    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c5b45d5a-f388-4936-9b51-7a31bbe86602-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c5b45d5a-f388-4936-9b51-7a31bbe86602" (UID: "c5b45d5a-f388-4936-9b51-7a31bbe86602"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 15:18:14.728548 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:14.728254    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c5b45d5a-f388-4936-9b51-7a31bbe86602-kube-api-access-x88bf" (OuterVolumeSpecName: "kube-api-access-x88bf") pod "c5b45d5a-f388-4936-9b51-7a31bbe86602" (UID: "c5b45d5a-f388-4936-9b51-7a31bbe86602"). InnerVolumeSpecName "kube-api-access-x88bf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:18:14.728743 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:14.728244    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c5b45d5a-f388-4936-9b51-7a31bbe86602-dshm" (OuterVolumeSpecName: "dshm") pod "c5b45d5a-f388-4936-9b51-7a31bbe86602" (UID: "c5b45d5a-f388-4936-9b51-7a31bbe86602"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:18:14.827518 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:14.827440    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c5b45d5a-f388-4936-9b51-7a31bbe86602-tls-certs\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 15:18:14.827518 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:14.827466    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x88bf\" (UniqueName: \"kubernetes.io/projected/c5b45d5a-f388-4936-9b51-7a31bbe86602-kube-api-access-x88bf\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 15:18:14.827518 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:14.827475    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c5b45d5a-f388-4936-9b51-7a31bbe86602-dshm\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 15:18:15.189316 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:15.189205    2571 generic.go:356] "Generic (PLEG): container finished" podID="c5b45d5a-f388-4936-9b51-7a31bbe86602" containerID="b16cd2536e25ec58ebfc52f353399834a398d3a49d4cbd6e7b906ab93d915b4a" exitCode=0
Jul 15 15:18:15.189316 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:15.189284    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-b2aed6/auth-test-model-b2aed6-kserve-5f755ddf99-pxjgg"
Jul 15 15:18:15.189542 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:15.189312    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b2aed6/auth-test-model-b2aed6-kserve-5f755ddf99-pxjgg" event={"ID":"c5b45d5a-f388-4936-9b51-7a31bbe86602","Type":"ContainerDied","Data":"b16cd2536e25ec58ebfc52f353399834a398d3a49d4cbd6e7b906ab93d915b4a"}
Jul 15 15:18:15.189542 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:15.189362    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-b2aed6/auth-test-model-b2aed6-kserve-5f755ddf99-pxjgg" event={"ID":"c5b45d5a-f388-4936-9b51-7a31bbe86602","Type":"ContainerDied","Data":"bcb4b9a3387e1e61e3a382d48cabc81b2e6e26af453e79340c5453beca763907"}
Jul 15 15:18:15.189542 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:15.189384    2571 scope.go:117] "RemoveContainer" containerID="b16cd2536e25ec58ebfc52f353399834a398d3a49d4cbd6e7b906ab93d915b4a"
Jul 15 15:18:15.198000 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:15.197981    2571 scope.go:117] "RemoveContainer" containerID="b16cd2536e25ec58ebfc52f353399834a398d3a49d4cbd6e7b906ab93d915b4a"
Jul 15 15:18:15.198318 ip-10-0-140-61 kubenswrapper[2571]: E0715 15:18:15.198296    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b16cd2536e25ec58ebfc52f353399834a398d3a49d4cbd6e7b906ab93d915b4a\": container with ID starting with b16cd2536e25ec58ebfc52f353399834a398d3a49d4cbd6e7b906ab93d915b4a not found: ID does not exist" containerID="b16cd2536e25ec58ebfc52f353399834a398d3a49d4cbd6e7b906ab93d915b4a"
Jul 15 15:18:15.198422 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:15.198328    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b16cd2536e25ec58ebfc52f353399834a398d3a49d4cbd6e7b906ab93d915b4a"} err="failed to get container status \"b16cd2536e25ec58ebfc52f353399834a398d3a49d4cbd6e7b906ab93d915b4a\": rpc error: code = NotFound desc = could not find container \"b16cd2536e25ec58ebfc52f353399834a398d3a49d4cbd6e7b906ab93d915b4a\": container with ID starting with b16cd2536e25ec58ebfc52f353399834a398d3a49d4cbd6e7b906ab93d915b4a not found: ID does not exist"
Jul 15 15:18:15.209925 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:15.209901    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-b2aed6/auth-test-model-b2aed6-kserve-5f755ddf99-pxjgg"]
Jul 15 15:18:15.214373 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:15.214347    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-b2aed6/auth-test-model-b2aed6-kserve-5f755ddf99-pxjgg"]
Jul 15 15:18:16.754548 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:16.754518    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c5b45d5a-f388-4936-9b51-7a31bbe86602" path="/var/lib/kubelet/pods/c5b45d5a-f388-4936-9b51-7a31bbe86602/volumes"
Jul 15 15:18:18.848407 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:18.848370    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:18:18.948438 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:18.948401    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:18:21.711064 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:21.711023    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-0c81d7/sub-test-model-0c81d7-kserve-596dfdc5bf-lt9pq"
Jul 15 15:18:21.711064 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:21.711077    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-0c81d7/sub-test-model-0c81d7-kserve-596dfdc5bf-lt9pq"
Jul 15 15:18:21.723358 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:21.723325    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-0c81d7/sub-test-model-0c81d7-kserve-596dfdc5bf-lt9pq"
Jul 15 15:18:22.236347 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:22.236315    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-0c81d7/sub-test-model-0c81d7-kserve-596dfdc5bf-lt9pq"
Jul 15 15:18:25.393588 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:25.393556    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 15:18:38.051397 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:38.051317    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-42mdh_0de0f3ad-e228-4c27-9b2c-de1a5844dcdb/console-operator/1.log"
Jul 15 15:18:38.052661 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:38.052637    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-42mdh_0de0f3ad-e228-4c27-9b2c-de1a5844dcdb/console-operator/1.log"
Jul 15 15:18:38.055634 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:38.055614    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8tt2_12bf26b1-5c4a-4e51-beb3-b17d7e7c4656/ovn-acl-logging/0.log"
Jul 15 15:18:38.056836 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:38.056818    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-j8tt2_12bf26b1-5c4a-4e51-beb3-b17d7e7c4656/ovn-acl-logging/0.log"
Jul 15 15:18:38.389261 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:38.389226    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:18:42.488153 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:18:42.488110    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 15:19:03.599309 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:03.599248    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 15:19:22.791011 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:22.790966    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 15:19:24.047394 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:24.047359    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:19:28.985452 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:28.985414    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-0c81d7/sub-test-model-0c81d7-kserve-596dfdc5bf-lt9pq"]
Jul 15 15:19:29.012594 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:29.012562    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:19:29.918934 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:29.918870    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:19:37.002865 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:37.002829    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-0c81d7/rate-test-model-0c81d7-kserve-54ff7cb8f5-wmv6p"]
Jul 15 15:19:37.003243 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:37.003190    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c5b45d5a-f388-4936-9b51-7a31bbe86602" containerName="main"
Jul 15 15:19:37.003243 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:37.003202    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="c5b45d5a-f388-4936-9b51-7a31bbe86602" containerName="main"
Jul 15 15:19:37.003347 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:37.003285    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="c5b45d5a-f388-4936-9b51-7a31bbe86602" containerName="main"
Jul 15 15:19:37.006363 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:37.006347    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0c81d7/rate-test-model-0c81d7-kserve-54ff7cb8f5-wmv6p"
Jul 15 15:19:37.008836 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:37.008816    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-0c81d7\"/\"rate-test-model-0c81d7-kserve-self-signed-certs\""
Jul 15 15:19:37.015851 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:37.015832    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-0c81d7/rate-test-model-0c81d7-kserve-54ff7cb8f5-wmv6p"]
Jul 15 15:19:37.024305 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:37.024261    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:19:37.064433 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:37.064405    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc-home\") pod \"rate-test-model-0c81d7-kserve-54ff7cb8f5-wmv6p\" (UID: \"4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc\") " pod="ai-tenant-e2e-shared-a-0c81d7/rate-test-model-0c81d7-kserve-54ff7cb8f5-wmv6p"
Jul 15 15:19:37.064601 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:37.064475    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc-tmp-dir\") pod \"rate-test-model-0c81d7-kserve-54ff7cb8f5-wmv6p\" (UID: \"4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc\") " pod="ai-tenant-e2e-shared-a-0c81d7/rate-test-model-0c81d7-kserve-54ff7cb8f5-wmv6p"
Jul 15 15:19:37.064601 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:37.064555    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vns8v\" (UniqueName: \"kubernetes.io/projected/4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc-kube-api-access-vns8v\") pod \"rate-test-model-0c81d7-kserve-54ff7cb8f5-wmv6p\" (UID: \"4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc\") " pod="ai-tenant-e2e-shared-a-0c81d7/rate-test-model-0c81d7-kserve-54ff7cb8f5-wmv6p"
Jul 15 15:19:37.064601 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:37.064588    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc-dshm\") pod \"rate-test-model-0c81d7-kserve-54ff7cb8f5-wmv6p\" (UID: \"4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc\") " pod="ai-tenant-e2e-shared-a-0c81d7/rate-test-model-0c81d7-kserve-54ff7cb8f5-wmv6p"
Jul 15 15:19:37.064752 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:37.064609    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc-model-cache\") pod \"rate-test-model-0c81d7-kserve-54ff7cb8f5-wmv6p\" (UID: \"4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc\") " pod="ai-tenant-e2e-shared-a-0c81d7/rate-test-model-0c81d7-kserve-54ff7cb8f5-wmv6p"
Jul 15 15:19:37.064752 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:37.064634    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc-tls-certs\") pod \"rate-test-model-0c81d7-kserve-54ff7cb8f5-wmv6p\" (UID: \"4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc\") " pod="ai-tenant-e2e-shared-a-0c81d7/rate-test-model-0c81d7-kserve-54ff7cb8f5-wmv6p"
Jul 15 15:19:37.165353 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:37.165317    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc-model-cache\") pod \"rate-test-model-0c81d7-kserve-54ff7cb8f5-wmv6p\" (UID: \"4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc\") " pod="ai-tenant-e2e-shared-a-0c81d7/rate-test-model-0c81d7-kserve-54ff7cb8f5-wmv6p"
Jul 15 15:19:37.165544 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:37.165369    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc-tls-certs\") pod \"rate-test-model-0c81d7-kserve-54ff7cb8f5-wmv6p\" (UID: \"4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc\") " pod="ai-tenant-e2e-shared-a-0c81d7/rate-test-model-0c81d7-kserve-54ff7cb8f5-wmv6p"
Jul 15 15:19:37.165544 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:37.165417    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc-home\") pod \"rate-test-model-0c81d7-kserve-54ff7cb8f5-wmv6p\" (UID: \"4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc\") " pod="ai-tenant-e2e-shared-a-0c81d7/rate-test-model-0c81d7-kserve-54ff7cb8f5-wmv6p"
Jul 15 15:19:37.165544 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:37.165508    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc-tmp-dir\") pod \"rate-test-model-0c81d7-kserve-54ff7cb8f5-wmv6p\" (UID: \"4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc\") " pod="ai-tenant-e2e-shared-a-0c81d7/rate-test-model-0c81d7-kserve-54ff7cb8f5-wmv6p"
Jul 15 15:19:37.165723 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:37.165556    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vns8v\" (UniqueName: \"kubernetes.io/projected/4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc-kube-api-access-vns8v\") pod \"rate-test-model-0c81d7-kserve-54ff7cb8f5-wmv6p\" (UID: \"4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc\") " pod="ai-tenant-e2e-shared-a-0c81d7/rate-test-model-0c81d7-kserve-54ff7cb8f5-wmv6p"
Jul 15 15:19:37.165723 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:37.165591    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc-dshm\") pod \"rate-test-model-0c81d7-kserve-54ff7cb8f5-wmv6p\" (UID: \"4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc\") " pod="ai-tenant-e2e-shared-a-0c81d7/rate-test-model-0c81d7-kserve-54ff7cb8f5-wmv6p"
Jul 15 15:19:37.165827 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:37.165757    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc-model-cache\") pod \"rate-test-model-0c81d7-kserve-54ff7cb8f5-wmv6p\" (UID: \"4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc\") " pod="ai-tenant-e2e-shared-a-0c81d7/rate-test-model-0c81d7-kserve-54ff7cb8f5-wmv6p"
Jul 15 15:19:37.165884 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:37.165827    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc-home\") pod \"rate-test-model-0c81d7-kserve-54ff7cb8f5-wmv6p\" (UID: \"4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc\") " pod="ai-tenant-e2e-shared-a-0c81d7/rate-test-model-0c81d7-kserve-54ff7cb8f5-wmv6p"
Jul 15 15:19:37.165946 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:37.165918    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc-tmp-dir\") pod \"rate-test-model-0c81d7-kserve-54ff7cb8f5-wmv6p\" (UID: \"4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc\") " pod="ai-tenant-e2e-shared-a-0c81d7/rate-test-model-0c81d7-kserve-54ff7cb8f5-wmv6p"
Jul 15 15:19:37.167715 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:37.167694    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc-dshm\") pod \"rate-test-model-0c81d7-kserve-54ff7cb8f5-wmv6p\" (UID: \"4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc\") " pod="ai-tenant-e2e-shared-a-0c81d7/rate-test-model-0c81d7-kserve-54ff7cb8f5-wmv6p"
Jul 15 15:19:37.167999 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:37.167979    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc-tls-certs\") pod \"rate-test-model-0c81d7-kserve-54ff7cb8f5-wmv6p\" (UID: \"4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc\") " pod="ai-tenant-e2e-shared-a-0c81d7/rate-test-model-0c81d7-kserve-54ff7cb8f5-wmv6p"
Jul 15 15:19:37.174234 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:37.174208    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vns8v\" (UniqueName: \"kubernetes.io/projected/4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc-kube-api-access-vns8v\") pod \"rate-test-model-0c81d7-kserve-54ff7cb8f5-wmv6p\" (UID: \"4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc\") " pod="ai-tenant-e2e-shared-a-0c81d7/rate-test-model-0c81d7-kserve-54ff7cb8f5-wmv6p"
Jul 15 15:19:37.315734 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:37.315699    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0c81d7/rate-test-model-0c81d7-kserve-54ff7cb8f5-wmv6p"
Jul 15 15:19:37.450716 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:37.450691    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-0c81d7/rate-test-model-0c81d7-kserve-54ff7cb8f5-wmv6p"]
Jul 15 15:19:37.452226 ip-10-0-140-61 kubenswrapper[2571]: W0715 15:19:37.452195    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4b553a4d_0261_4ee1_aebe_e5fa6a03d8bc.slice/crio-a9e6893b1d262bc2d722ae2790438650fe64f60ac9af36c3f31d2b362854d6f9 WatchSource:0}: Error finding container a9e6893b1d262bc2d722ae2790438650fe64f60ac9af36c3f31d2b362854d6f9: Status 404 returned error can't find the container with id a9e6893b1d262bc2d722ae2790438650fe64f60ac9af36c3f31d2b362854d6f9
Jul 15 15:19:37.600072 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:37.599974    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0c81d7/rate-test-model-0c81d7-kserve-54ff7cb8f5-wmv6p" event={"ID":"4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc","Type":"ContainerStarted","Data":"19b469ba397dca2ddb64b48869d0756b7cae1298c4b96c18f60151d7198b64e1"}
Jul 15 15:19:37.600072 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:37.600023    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0c81d7/rate-test-model-0c81d7-kserve-54ff7cb8f5-wmv6p" event={"ID":"4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc","Type":"ContainerStarted","Data":"a9e6893b1d262bc2d722ae2790438650fe64f60ac9af36c3f31d2b362854d6f9"}
Jul 15 15:19:37.620754 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:37.620702    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-0c81d7/rate-test-model-0c81d7-kserve-54ff7cb8f5-wmv6p" podStartSLOduration=1.6206863070000002 podStartE2EDuration="1.620686307s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:19:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:19:37.618723432 +0000 UTC m=+2761.134541304" watchObservedRunningTime="2026-07-15 15:19:37.620686307 +0000 UTC m=+2761.136504183"
Jul 15 15:19:43.889918 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:43.889878    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 15:19:44.006482 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:44.006412    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-0c81d7/sub-test-model-0c81d7-kserve-596dfdc5bf-lt9pq" podUID="940bfc53-d1c7-4edf-99a8-05c037648c90" containerName="main" containerID="cri-o://d6f82e1ee141c72bafe6c4b42d24835772cdebc71f42056d234428701aed7c5c" gracePeriod=45
Jul 15 15:19:44.261416 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:44.261393    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0c81d7/sub-test-model-0c81d7-kserve-596dfdc5bf-lt9pq"
Jul 15 15:19:44.331312 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:44.331286    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/940bfc53-d1c7-4edf-99a8-05c037648c90-model-cache\") pod \"940bfc53-d1c7-4edf-99a8-05c037648c90\" (UID: \"940bfc53-d1c7-4edf-99a8-05c037648c90\") "
Jul 15 15:19:44.331457 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:44.331332    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/940bfc53-d1c7-4edf-99a8-05c037648c90-dshm\") pod \"940bfc53-d1c7-4edf-99a8-05c037648c90\" (UID: \"940bfc53-d1c7-4edf-99a8-05c037648c90\") "
Jul 15 15:19:44.331457 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:44.331361    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/940bfc53-d1c7-4edf-99a8-05c037648c90-home\") pod \"940bfc53-d1c7-4edf-99a8-05c037648c90\" (UID: \"940bfc53-d1c7-4edf-99a8-05c037648c90\") "
Jul 15 15:19:44.331457 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:44.331391    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zn4pr\" (UniqueName: \"kubernetes.io/projected/940bfc53-d1c7-4edf-99a8-05c037648c90-kube-api-access-zn4pr\") pod \"940bfc53-d1c7-4edf-99a8-05c037648c90\" (UID: \"940bfc53-d1c7-4edf-99a8-05c037648c90\") "
Jul 15 15:19:44.331457 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:44.331423    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/940bfc53-d1c7-4edf-99a8-05c037648c90-tls-certs\") pod \"940bfc53-d1c7-4edf-99a8-05c037648c90\" (UID: \"940bfc53-d1c7-4edf-99a8-05c037648c90\") "
Jul 15 15:19:44.331457 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:44.331456    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/940bfc53-d1c7-4edf-99a8-05c037648c90-tmp-dir\") pod \"940bfc53-d1c7-4edf-99a8-05c037648c90\" (UID: \"940bfc53-d1c7-4edf-99a8-05c037648c90\") "
Jul 15 15:19:44.331704 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:44.331564    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/940bfc53-d1c7-4edf-99a8-05c037648c90-model-cache" (OuterVolumeSpecName: "model-cache") pod "940bfc53-d1c7-4edf-99a8-05c037648c90" (UID: "940bfc53-d1c7-4edf-99a8-05c037648c90"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:19:44.331704 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:44.331602    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/940bfc53-d1c7-4edf-99a8-05c037648c90-home" (OuterVolumeSpecName: "home") pod "940bfc53-d1c7-4edf-99a8-05c037648c90" (UID: "940bfc53-d1c7-4edf-99a8-05c037648c90"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:19:44.331814 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:44.331737    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/940bfc53-d1c7-4edf-99a8-05c037648c90-model-cache\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 15:19:44.331814 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:44.331756    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/940bfc53-d1c7-4edf-99a8-05c037648c90-home\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 15:19:44.331814 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:44.331737    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/940bfc53-d1c7-4edf-99a8-05c037648c90-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "940bfc53-d1c7-4edf-99a8-05c037648c90" (UID: "940bfc53-d1c7-4edf-99a8-05c037648c90"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:19:44.333679 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:44.333653    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/940bfc53-d1c7-4edf-99a8-05c037648c90-dshm" (OuterVolumeSpecName: "dshm") pod "940bfc53-d1c7-4edf-99a8-05c037648c90" (UID: "940bfc53-d1c7-4edf-99a8-05c037648c90"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:19:44.333778 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:44.333655    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/940bfc53-d1c7-4edf-99a8-05c037648c90-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "940bfc53-d1c7-4edf-99a8-05c037648c90" (UID: "940bfc53-d1c7-4edf-99a8-05c037648c90"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 15:19:44.333778 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:44.333711    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/940bfc53-d1c7-4edf-99a8-05c037648c90-kube-api-access-zn4pr" (OuterVolumeSpecName: "kube-api-access-zn4pr") pod "940bfc53-d1c7-4edf-99a8-05c037648c90" (UID: "940bfc53-d1c7-4edf-99a8-05c037648c90"). InnerVolumeSpecName "kube-api-access-zn4pr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:19:44.432471 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:44.432402    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/940bfc53-d1c7-4edf-99a8-05c037648c90-tmp-dir\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 15:19:44.432471 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:44.432429    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/940bfc53-d1c7-4edf-99a8-05c037648c90-dshm\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 15:19:44.432471 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:44.432439    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zn4pr\" (UniqueName: \"kubernetes.io/projected/940bfc53-d1c7-4edf-99a8-05c037648c90-kube-api-access-zn4pr\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 15:19:44.432471 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:44.432451    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/940bfc53-d1c7-4edf-99a8-05c037648c90-tls-certs\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 15:19:44.644371 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:44.644340    2571 generic.go:356] "Generic (PLEG): container finished" podID="940bfc53-d1c7-4edf-99a8-05c037648c90" containerID="d6f82e1ee141c72bafe6c4b42d24835772cdebc71f42056d234428701aed7c5c" exitCode=0
Jul 15 15:19:44.644540 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:44.644383    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0c81d7/sub-test-model-0c81d7-kserve-596dfdc5bf-lt9pq" event={"ID":"940bfc53-d1c7-4edf-99a8-05c037648c90","Type":"ContainerDied","Data":"d6f82e1ee141c72bafe6c4b42d24835772cdebc71f42056d234428701aed7c5c"}
Jul 15 15:19:44.644540 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:44.644383    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0c81d7/sub-test-model-0c81d7-kserve-596dfdc5bf-lt9pq"
Jul 15 15:19:44.644540 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:44.644420    2571 scope.go:117] "RemoveContainer" containerID="d6f82e1ee141c72bafe6c4b42d24835772cdebc71f42056d234428701aed7c5c"
Jul 15 15:19:44.644540 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:44.644410    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0c81d7/sub-test-model-0c81d7-kserve-596dfdc5bf-lt9pq" event={"ID":"940bfc53-d1c7-4edf-99a8-05c037648c90","Type":"ContainerDied","Data":"dbdc1f185fb6768cdfe3bbae35a3967fa4f171fd4e06e60dbdcaa15d18753f49"}
Jul 15 15:19:44.653407 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:44.653389    2571 scope.go:117] "RemoveContainer" containerID="d6f82e1ee141c72bafe6c4b42d24835772cdebc71f42056d234428701aed7c5c"
Jul 15 15:19:44.653640 ip-10-0-140-61 kubenswrapper[2571]: E0715 15:19:44.653624    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d6f82e1ee141c72bafe6c4b42d24835772cdebc71f42056d234428701aed7c5c\": container with ID starting with d6f82e1ee141c72bafe6c4b42d24835772cdebc71f42056d234428701aed7c5c not found: ID does not exist" containerID="d6f82e1ee141c72bafe6c4b42d24835772cdebc71f42056d234428701aed7c5c"
Jul 15 15:19:44.653685 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:44.653648    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d6f82e1ee141c72bafe6c4b42d24835772cdebc71f42056d234428701aed7c5c"} err="failed to get container status \"d6f82e1ee141c72bafe6c4b42d24835772cdebc71f42056d234428701aed7c5c\": rpc error: code = NotFound desc = could not find container \"d6f82e1ee141c72bafe6c4b42d24835772cdebc71f42056d234428701aed7c5c\": container with ID starting with d6f82e1ee141c72bafe6c4b42d24835772cdebc71f42056d234428701aed7c5c not found: ID does not exist"
Jul 15 15:19:44.667723 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:44.667691    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-0c81d7/sub-test-model-0c81d7-kserve-596dfdc5bf-lt9pq"]
Jul 15 15:19:44.674290 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:44.674255    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-0c81d7/sub-test-model-0c81d7-kserve-596dfdc5bf-lt9pq"]
Jul 15 15:19:44.753565 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:44.753500    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="940bfc53-d1c7-4edf-99a8-05c037648c90" path="/var/lib/kubelet/pods/940bfc53-d1c7-4edf-99a8-05c037648c90/volumes"
Jul 15 15:19:47.316569 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:47.316521    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-0c81d7/rate-test-model-0c81d7-kserve-54ff7cb8f5-wmv6p"
Jul 15 15:19:47.316954 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:47.316587    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-0c81d7/rate-test-model-0c81d7-kserve-54ff7cb8f5-wmv6p"
Jul 15 15:19:47.329648 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:47.329622    2571 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-0c81d7/rate-test-model-0c81d7-kserve-54ff7cb8f5-wmv6p"
Jul 15 15:19:47.671452 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:19:47.671367    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-0c81d7/rate-test-model-0c81d7-kserve-54ff7cb8f5-wmv6p"
Jul 15 15:20:05.128667 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:20:05.128580    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:20:07.421965 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:20:07.421927    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:20:07.520552 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:20:07.520523    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:20:09.594201 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:20:09.594161    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 15:20:15.612229 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:20:15.612195    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:20:15.712006 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:20:15.711970    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:20:20.607427 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:20:20.607389    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:20:26.440787 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:20:26.440755    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:20:30.127263 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:20:30.127214    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 15:20:30.921971 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:20:30.921939    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:20:33.602934 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:20:33.602902    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:20:45.785588 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:20:45.785552    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 15:20:51.670866 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:20:51.670831    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-0c81d7/rate-test-model-0c81d7-kserve-54ff7cb8f5-wmv6p"]
Jul 15 15:20:51.689328 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:20:51.689252    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:20:52.713235 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:20:52.713199    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:20:53.654821 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:20:53.654786    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7179-140050791951408"]
Jul 15 15:20:53.655158 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:20:53.655147    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="940bfc53-d1c7-4edf-99a8-05c037648c90" containerName="main"
Jul 15 15:20:53.655216 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:20:53.655160    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="940bfc53-d1c7-4edf-99a8-05c037648c90" containerName="main"
Jul 15 15:20:53.655254 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:20:53.655232    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="940bfc53-d1c7-4edf-99a8-05c037648c90" containerName="main"
Jul 15 15:20:53.658211 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:20:53.658195    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7179-140050791951408"
Jul 15 15:20:53.660472 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:20:53.660449    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-tkmgr\""
Jul 15 15:20:53.663925 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:20:53.663901    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7179-140050791951408"]
Jul 15 15:20:53.755228 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:20:53.755190    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wd995\" (UniqueName: \"kubernetes.io/projected/828e4889-3b41-4799-8cc3-5ec5c318ae84-kube-api-access-wd995\") pod \"test-curl-7179-140050791951408\" (UID: \"828e4889-3b41-4799-8cc3-5ec5c318ae84\") " pod="opendatahub/test-curl-7179-140050791951408"
Jul 15 15:20:53.856578 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:20:53.856532    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wd995\" (UniqueName: \"kubernetes.io/projected/828e4889-3b41-4799-8cc3-5ec5c318ae84-kube-api-access-wd995\") pod \"test-curl-7179-140050791951408\" (UID: \"828e4889-3b41-4799-8cc3-5ec5c318ae84\") " pod="opendatahub/test-curl-7179-140050791951408"
Jul 15 15:20:53.866149 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:20:53.866116    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wd995\" (UniqueName: \"kubernetes.io/projected/828e4889-3b41-4799-8cc3-5ec5c318ae84-kube-api-access-wd995\") pod \"test-curl-7179-140050791951408\" (UID: \"828e4889-3b41-4799-8cc3-5ec5c318ae84\") " pod="opendatahub/test-curl-7179-140050791951408"
Jul 15 15:20:53.968915 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:20:53.968816    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7179-140050791951408"
Jul 15 15:20:54.107811 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:20:54.107777    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7179-140050791951408"]
Jul 15 15:20:54.109405 ip-10-0-140-61 kubenswrapper[2571]: W0715 15:20:54.109372    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod828e4889_3b41_4799_8cc3_5ec5c318ae84.slice/crio-4054f1e360d63c3b805ea5ae4f36eea771b78b3926f780d6f1874eb89b6b23a9 WatchSource:0}: Error finding container 4054f1e360d63c3b805ea5ae4f36eea771b78b3926f780d6f1874eb89b6b23a9: Status 404 returned error can't find the container with id 4054f1e360d63c3b805ea5ae4f36eea771b78b3926f780d6f1874eb89b6b23a9
Jul 15 15:20:54.110660 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:20:54.110641    2571 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 15:20:55.007735 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:20:55.007703    2571 generic.go:356] "Generic (PLEG): container finished" podID="828e4889-3b41-4799-8cc3-5ec5c318ae84" containerID="64c4d0339696c57d934b9f96c8092ef8f414ea984dc14a3d1fa5b980cf6729b1" exitCode=0
Jul 15 15:20:55.008149 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:20:55.007790    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7179-140050791951408" event={"ID":"828e4889-3b41-4799-8cc3-5ec5c318ae84","Type":"ContainerDied","Data":"64c4d0339696c57d934b9f96c8092ef8f414ea984dc14a3d1fa5b980cf6729b1"}
Jul 15 15:20:55.008149 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:20:55.007839    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7179-140050791951408" event={"ID":"828e4889-3b41-4799-8cc3-5ec5c318ae84","Type":"ContainerStarted","Data":"4054f1e360d63c3b805ea5ae4f36eea771b78b3926f780d6f1874eb89b6b23a9"}
Jul 15 15:20:56.144871 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:20:56.144846    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7179-140050791951408"
Jul 15 15:20:56.166035 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:20:56.166010    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7179-140050791951408_828e4889-3b41-4799-8cc3-5ec5c318ae84/test-curl-7179-140050791951408/0.log"
Jul 15 15:20:56.177341 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:20:56.177313    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wd995\" (UniqueName: \"kubernetes.io/projected/828e4889-3b41-4799-8cc3-5ec5c318ae84-kube-api-access-wd995\") pod \"828e4889-3b41-4799-8cc3-5ec5c318ae84\" (UID: \"828e4889-3b41-4799-8cc3-5ec5c318ae84\") "
Jul 15 15:20:56.179546 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:20:56.179517    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/828e4889-3b41-4799-8cc3-5ec5c318ae84-kube-api-access-wd995" (OuterVolumeSpecName: "kube-api-access-wd995") pod "828e4889-3b41-4799-8cc3-5ec5c318ae84" (UID: "828e4889-3b41-4799-8cc3-5ec5c318ae84"). InnerVolumeSpecName "kube-api-access-wd995". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:20:56.189294 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:20:56.189259    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7179-140050791951408"]
Jul 15 15:20:56.193620 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:20:56.193598    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7179-140050791951408"]
Jul 15 15:20:56.278721 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:20:56.278627    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wd995\" (UniqueName: \"kubernetes.io/projected/828e4889-3b41-4799-8cc3-5ec5c318ae84-kube-api-access-wd995\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 15:20:56.753845 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:20:56.753813    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="828e4889-3b41-4799-8cc3-5ec5c318ae84" path="/var/lib/kubelet/pods/828e4889-3b41-4799-8cc3-5ec5c318ae84/volumes"
Jul 15 15:20:57.019533 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:20:57.019440    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7179-140050791951408"
Jul 15 15:20:57.019533 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:20:57.019501    2571 scope.go:117] "RemoveContainer" containerID="64c4d0339696c57d934b9f96c8092ef8f414ea984dc14a3d1fa5b980cf6729b1"
Jul 15 15:20:59.732648 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:20:59.732613    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7179-140050791854128"]
Jul 15 15:20:59.733064 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:20:59.732998    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="828e4889-3b41-4799-8cc3-5ec5c318ae84" containerName="test-curl-7179-140050791951408"
Jul 15 15:20:59.733064 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:20:59.733011    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="828e4889-3b41-4799-8cc3-5ec5c318ae84" containerName="test-curl-7179-140050791951408"
Jul 15 15:20:59.733145 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:20:59.733107    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="828e4889-3b41-4799-8cc3-5ec5c318ae84" containerName="test-curl-7179-140050791951408"
Jul 15 15:20:59.737701 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:20:59.737679    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7179-140050791854128"
Jul 15 15:20:59.740238 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:20:59.740219    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-tkmgr\""
Jul 15 15:20:59.741235 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:20:59.741217    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7179-140050791854128"]
Jul 15 15:20:59.811201 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:20:59.811165    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmkgn\" (UniqueName: \"kubernetes.io/projected/ecec558b-6a46-4b20-b986-2d8b8d366867-kube-api-access-cmkgn\") pod \"test-curl-7179-140050791854128\" (UID: \"ecec558b-6a46-4b20-b986-2d8b8d366867\") " pod="opendatahub/test-curl-7179-140050791854128"
Jul 15 15:20:59.898243 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:20:59.898201    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 15:20:59.912026 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:20:59.911995    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmkgn\" (UniqueName: \"kubernetes.io/projected/ecec558b-6a46-4b20-b986-2d8b8d366867-kube-api-access-cmkgn\") pod \"test-curl-7179-140050791854128\" (UID: \"ecec558b-6a46-4b20-b986-2d8b8d366867\") " pod="opendatahub/test-curl-7179-140050791854128"
Jul 15 15:20:59.921311 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:20:59.921280    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmkgn\" (UniqueName: \"kubernetes.io/projected/ecec558b-6a46-4b20-b986-2d8b8d366867-kube-api-access-cmkgn\") pod \"test-curl-7179-140050791854128\" (UID: \"ecec558b-6a46-4b20-b986-2d8b8d366867\") " pod="opendatahub/test-curl-7179-140050791854128"
Jul 15 15:21:00.048516 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:00.048435    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7179-140050791854128"
Jul 15 15:21:00.194942 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:00.194914    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7179-140050791854128"]
Jul 15 15:21:00.197463 ip-10-0-140-61 kubenswrapper[2571]: W0715 15:21:00.197432    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podecec558b_6a46_4b20_b986_2d8b8d366867.slice/crio-e4bac1890589afee44a491b5ebe37ad0b3ff76b8807c9ebbd659889856748c56 WatchSource:0}: Error finding container e4bac1890589afee44a491b5ebe37ad0b3ff76b8807c9ebbd659889856748c56: Status 404 returned error can't find the container with id e4bac1890589afee44a491b5ebe37ad0b3ff76b8807c9ebbd659889856748c56
Jul 15 15:21:01.042088 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:01.042050    2571 generic.go:356] "Generic (PLEG): container finished" podID="ecec558b-6a46-4b20-b986-2d8b8d366867" containerID="939638dd13d2006de40d3f2ea539fc2890b0b8f20a2121f2186f2d21e9bcff39" exitCode=0
Jul 15 15:21:01.042542 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:01.042123    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7179-140050791854128" event={"ID":"ecec558b-6a46-4b20-b986-2d8b8d366867","Type":"ContainerDied","Data":"939638dd13d2006de40d3f2ea539fc2890b0b8f20a2121f2186f2d21e9bcff39"}
Jul 15 15:21:01.042542 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:01.042156    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7179-140050791854128" event={"ID":"ecec558b-6a46-4b20-b986-2d8b8d366867","Type":"ContainerStarted","Data":"e4bac1890589afee44a491b5ebe37ad0b3ff76b8807c9ebbd659889856748c56"}
Jul 15 15:21:02.185938 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:02.185911    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7179-140050791854128"
Jul 15 15:21:02.208344 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:02.208315    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7179-140050791854128_ecec558b-6a46-4b20-b986-2d8b8d366867/test-curl-7179-140050791854128/0.log"
Jul 15 15:21:02.236078 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:02.236036    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7179-140050791854128"]
Jul 15 15:21:02.236326 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:02.236303    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cmkgn\" (UniqueName: \"kubernetes.io/projected/ecec558b-6a46-4b20-b986-2d8b8d366867-kube-api-access-cmkgn\") pod \"ecec558b-6a46-4b20-b986-2d8b8d366867\" (UID: \"ecec558b-6a46-4b20-b986-2d8b8d366867\") "
Jul 15 15:21:02.238609 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:02.238572    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecec558b-6a46-4b20-b986-2d8b8d366867-kube-api-access-cmkgn" (OuterVolumeSpecName: "kube-api-access-cmkgn") pod "ecec558b-6a46-4b20-b986-2d8b8d366867" (UID: "ecec558b-6a46-4b20-b986-2d8b8d366867"). InnerVolumeSpecName "kube-api-access-cmkgn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:21:02.240121 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:02.240098    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7179-140050791854128"]
Jul 15 15:21:02.337237 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:02.337198    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cmkgn\" (UniqueName: \"kubernetes.io/projected/ecec558b-6a46-4b20-b986-2d8b8d366867-kube-api-access-cmkgn\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 15:21:02.753646 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:02.753563    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ecec558b-6a46-4b20-b986-2d8b8d366867" path="/var/lib/kubelet/pods/ecec558b-6a46-4b20-b986-2d8b8d366867/volumes"
Jul 15 15:21:03.052507 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:03.052422    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7179-140050791854128"
Jul 15 15:21:03.052507 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:03.052449    2571 scope.go:117] "RemoveContainer" containerID="939638dd13d2006de40d3f2ea539fc2890b0b8f20a2121f2186f2d21e9bcff39"
Jul 15 15:21:04.672423 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:04.672392    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7179-140050791855136"]
Jul 15 15:21:04.672842 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:04.672784    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecec558b-6a46-4b20-b986-2d8b8d366867" containerName="test-curl-7179-140050791854128"
Jul 15 15:21:04.672842 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:04.672798    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecec558b-6a46-4b20-b986-2d8b8d366867" containerName="test-curl-7179-140050791854128"
Jul 15 15:21:04.672915 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:04.672876    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecec558b-6a46-4b20-b986-2d8b8d366867" containerName="test-curl-7179-140050791854128"
Jul 15 15:21:04.677220 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:04.677204    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7179-140050791855136"
Jul 15 15:21:04.680067 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:04.680040    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-tkmgr\""
Jul 15 15:21:04.682810 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:04.682785    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7179-140050791855136"]
Jul 15 15:21:04.760702 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:04.760655    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9t9gm\" (UniqueName: \"kubernetes.io/projected/2ab4336d-433a-4951-822e-e3433e04379c-kube-api-access-9t9gm\") pod \"test-curl-7179-140050791855136\" (UID: \"2ab4336d-433a-4951-822e-e3433e04379c\") " pod="opendatahub/test-curl-7179-140050791855136"
Jul 15 15:21:04.862107 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:04.862073    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9t9gm\" (UniqueName: \"kubernetes.io/projected/2ab4336d-433a-4951-822e-e3433e04379c-kube-api-access-9t9gm\") pod \"test-curl-7179-140050791855136\" (UID: \"2ab4336d-433a-4951-822e-e3433e04379c\") " pod="opendatahub/test-curl-7179-140050791855136"
Jul 15 15:21:04.874448 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:04.874417    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9t9gm\" (UniqueName: \"kubernetes.io/projected/2ab4336d-433a-4951-822e-e3433e04379c-kube-api-access-9t9gm\") pod \"test-curl-7179-140050791855136\" (UID: \"2ab4336d-433a-4951-822e-e3433e04379c\") " pod="opendatahub/test-curl-7179-140050791855136"
Jul 15 15:21:04.987491 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:04.987397    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7179-140050791855136"
Jul 15 15:21:05.119130 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:05.119106    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7179-140050791855136"]
Jul 15 15:21:05.121316 ip-10-0-140-61 kubenswrapper[2571]: W0715 15:21:05.121262    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2ab4336d_433a_4951_822e_e3433e04379c.slice/crio-0216df6a9e0a62cb9556b19d8e0fc27f1b4843dd1e3f0f83dc4ec11f47fd7434 WatchSource:0}: Error finding container 0216df6a9e0a62cb9556b19d8e0fc27f1b4843dd1e3f0f83dc4ec11f47fd7434: Status 404 returned error can't find the container with id 0216df6a9e0a62cb9556b19d8e0fc27f1b4843dd1e3f0f83dc4ec11f47fd7434
Jul 15 15:21:06.070838 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:06.070797    2571 generic.go:356] "Generic (PLEG): container finished" podID="2ab4336d-433a-4951-822e-e3433e04379c" containerID="c39d693cc049b4fb3090cc73be804614cc70e677587879178562960f9c9f6bcd" exitCode=0
Jul 15 15:21:06.071325 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:06.070864    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7179-140050791855136" event={"ID":"2ab4336d-433a-4951-822e-e3433e04379c","Type":"ContainerDied","Data":"c39d693cc049b4fb3090cc73be804614cc70e677587879178562960f9c9f6bcd"}
Jul 15 15:21:06.071325 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:06.070903    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7179-140050791855136" event={"ID":"2ab4336d-433a-4951-822e-e3433e04379c","Type":"ContainerStarted","Data":"0216df6a9e0a62cb9556b19d8e0fc27f1b4843dd1e3f0f83dc4ec11f47fd7434"}
Jul 15 15:21:06.691177 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:06.691119    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-0c81d7/rate-test-model-0c81d7-kserve-54ff7cb8f5-wmv6p" podUID="4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc" containerName="main" containerID="cri-o://19b469ba397dca2ddb64b48869d0756b7cae1298c4b96c18f60151d7198b64e1" gracePeriod=45
Jul 15 15:21:06.958958 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:06.958933    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0c81d7/rate-test-model-0c81d7-kserve-54ff7cb8f5-wmv6p"
Jul 15 15:21:07.077293 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:07.077234    2571 generic.go:356] "Generic (PLEG): container finished" podID="4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc" containerID="19b469ba397dca2ddb64b48869d0756b7cae1298c4b96c18f60151d7198b64e1" exitCode=0
Jul 15 15:21:07.077703 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:07.077304    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-0c81d7/rate-test-model-0c81d7-kserve-54ff7cb8f5-wmv6p"
Jul 15 15:21:07.077703 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:07.077303    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0c81d7/rate-test-model-0c81d7-kserve-54ff7cb8f5-wmv6p" event={"ID":"4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc","Type":"ContainerDied","Data":"19b469ba397dca2ddb64b48869d0756b7cae1298c4b96c18f60151d7198b64e1"}
Jul 15 15:21:07.077703 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:07.077422    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-0c81d7/rate-test-model-0c81d7-kserve-54ff7cb8f5-wmv6p" event={"ID":"4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc","Type":"ContainerDied","Data":"a9e6893b1d262bc2d722ae2790438650fe64f60ac9af36c3f31d2b362854d6f9"}
Jul 15 15:21:07.077703 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:07.077445    2571 scope.go:117] "RemoveContainer" containerID="19b469ba397dca2ddb64b48869d0756b7cae1298c4b96c18f60151d7198b64e1"
Jul 15 15:21:07.079783 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:07.079746    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc-tls-certs\") pod \"4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc\" (UID: \"4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc\") "
Jul 15 15:21:07.079910 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:07.079816    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vns8v\" (UniqueName: \"kubernetes.io/projected/4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc-kube-api-access-vns8v\") pod \"4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc\" (UID: \"4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc\") "
Jul 15 15:21:07.079910 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:07.079865    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc-dshm\") pod \"4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc\" (UID: \"4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc\") "
Jul 15 15:21:07.080021 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:07.079959    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc-model-cache\") pod \"4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc\" (UID: \"4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc\") "
Jul 15 15:21:07.080021 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:07.079990    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc-home\") pod \"4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc\" (UID: \"4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc\") "
Jul 15 15:21:07.080122 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:07.080035    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc-tmp-dir\") pod \"4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc\" (UID: \"4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc\") "
Jul 15 15:21:07.080446 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:07.080221    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc-home" (OuterVolumeSpecName: "home") pod "4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc" (UID: "4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:21:07.080446 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:07.080220    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc-model-cache" (OuterVolumeSpecName: "model-cache") pod "4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc" (UID: "4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:21:07.080446 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:07.080405    2571 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc-model-cache\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 15:21:07.080446 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:07.080425    2571 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc-home\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 15:21:07.080712 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:07.080449    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc" (UID: "4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:21:07.082150 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:07.082119    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc-dshm" (OuterVolumeSpecName: "dshm") pod "4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc" (UID: "4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 15:21:07.082313 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:07.082289    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc" (UID: "4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 15:21:07.082959 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:07.082413    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc-kube-api-access-vns8v" (OuterVolumeSpecName: "kube-api-access-vns8v") pod "4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc" (UID: "4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc"). InnerVolumeSpecName "kube-api-access-vns8v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:21:07.091697 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:07.088530    2571 scope.go:117] "RemoveContainer" containerID="19b469ba397dca2ddb64b48869d0756b7cae1298c4b96c18f60151d7198b64e1"
Jul 15 15:21:07.092830 ip-10-0-140-61 kubenswrapper[2571]: E0715 15:21:07.092383    2571 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"19b469ba397dca2ddb64b48869d0756b7cae1298c4b96c18f60151d7198b64e1\": container with ID starting with 19b469ba397dca2ddb64b48869d0756b7cae1298c4b96c18f60151d7198b64e1 not found: ID does not exist" containerID="19b469ba397dca2ddb64b48869d0756b7cae1298c4b96c18f60151d7198b64e1"
Jul 15 15:21:07.092830 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:07.092428    2571 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"19b469ba397dca2ddb64b48869d0756b7cae1298c4b96c18f60151d7198b64e1"} err="failed to get container status \"19b469ba397dca2ddb64b48869d0756b7cae1298c4b96c18f60151d7198b64e1\": rpc error: code = NotFound desc = could not find container \"19b469ba397dca2ddb64b48869d0756b7cae1298c4b96c18f60151d7198b64e1\": container with ID starting with 19b469ba397dca2ddb64b48869d0756b7cae1298c4b96c18f60151d7198b64e1 not found: ID does not exist"
Jul 15 15:21:07.181471 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:07.181437    2571 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc-tls-certs\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 15:21:07.181471 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:07.181469    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vns8v\" (UniqueName: \"kubernetes.io/projected/4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc-kube-api-access-vns8v\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 15:21:07.181698 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:07.181480    2571 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc-dshm\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 15:21:07.181698 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:07.181512    2571 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc-tmp-dir\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 15:21:07.213829 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:07.213803    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7179-140050791855136"
Jul 15 15:21:07.237444 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:07.237419    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7179-140050791855136_2ab4336d-433a-4951-822e-e3433e04379c/test-curl-7179-140050791855136/0.log"
Jul 15 15:21:07.266833 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:07.266802    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7179-140050791855136"]
Jul 15 15:21:07.270778 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:07.270754    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7179-140050791855136"]
Jul 15 15:21:07.282786 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:07.282757    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9t9gm\" (UniqueName: \"kubernetes.io/projected/2ab4336d-433a-4951-822e-e3433e04379c-kube-api-access-9t9gm\") pod \"2ab4336d-433a-4951-822e-e3433e04379c\" (UID: \"2ab4336d-433a-4951-822e-e3433e04379c\") "
Jul 15 15:21:07.284713 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:07.284689    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2ab4336d-433a-4951-822e-e3433e04379c-kube-api-access-9t9gm" (OuterVolumeSpecName: "kube-api-access-9t9gm") pod "2ab4336d-433a-4951-822e-e3433e04379c" (UID: "2ab4336d-433a-4951-822e-e3433e04379c"). InnerVolumeSpecName "kube-api-access-9t9gm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:21:07.383983 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:07.383943    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9t9gm\" (UniqueName: \"kubernetes.io/projected/2ab4336d-433a-4951-822e-e3433e04379c-kube-api-access-9t9gm\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 15:21:07.391575 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:07.391548    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7179-140050791855136"]
Jul 15 15:21:07.391981 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:07.391964    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc" containerName="main"
Jul 15 15:21:07.392058 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:07.391984    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc" containerName="main"
Jul 15 15:21:07.392058 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:07.392007    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2ab4336d-433a-4951-822e-e3433e04379c" containerName="test-curl-7179-140050791855136"
Jul 15 15:21:07.392058 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:07.392017    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="2ab4336d-433a-4951-822e-e3433e04379c" containerName="test-curl-7179-140050791855136"
Jul 15 15:21:07.392210 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:07.392105    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="2ab4336d-433a-4951-822e-e3433e04379c" containerName="test-curl-7179-140050791855136"
Jul 15 15:21:07.392210 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:07.392119    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc" containerName="main"
Jul 15 15:21:07.395359 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:07.395341    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7179-140050791855136"
Jul 15 15:21:07.400570 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:07.400549    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-0c81d7/rate-test-model-0c81d7-kserve-54ff7cb8f5-wmv6p"]
Jul 15 15:21:07.405907 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:07.405882    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7179-140050791855136"]
Jul 15 15:21:07.408087 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:07.408067    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-0c81d7/rate-test-model-0c81d7-kserve-54ff7cb8f5-wmv6p"]
Jul 15 15:21:07.485206 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:07.485108    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpwbt\" (UniqueName: \"kubernetes.io/projected/b3fd04e8-91c1-4045-bb16-fbb7297aa90b-kube-api-access-xpwbt\") pod \"test-curl-7179-140050791855136\" (UID: \"b3fd04e8-91c1-4045-bb16-fbb7297aa90b\") " pod="opendatahub/test-curl-7179-140050791855136"
Jul 15 15:21:07.586039 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:07.585995    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpwbt\" (UniqueName: \"kubernetes.io/projected/b3fd04e8-91c1-4045-bb16-fbb7297aa90b-kube-api-access-xpwbt\") pod \"test-curl-7179-140050791855136\" (UID: \"b3fd04e8-91c1-4045-bb16-fbb7297aa90b\") " pod="opendatahub/test-curl-7179-140050791855136"
Jul 15 15:21:07.595826 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:07.595794    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpwbt\" (UniqueName: \"kubernetes.io/projected/b3fd04e8-91c1-4045-bb16-fbb7297aa90b-kube-api-access-xpwbt\") pod \"test-curl-7179-140050791855136\" (UID: \"b3fd04e8-91c1-4045-bb16-fbb7297aa90b\") " pod="opendatahub/test-curl-7179-140050791855136"
Jul 15 15:21:07.704854 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:07.704824    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7179-140050791855136"
Jul 15 15:21:07.839514 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:07.839487    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7179-140050791855136"]
Jul 15 15:21:07.841674 ip-10-0-140-61 kubenswrapper[2571]: W0715 15:21:07.841646    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb3fd04e8_91c1_4045_bb16_fbb7297aa90b.slice/crio-fcc84e3a447cb4ed7bdda5fa91304503dead259d09114a0da2693516288d6534 WatchSource:0}: Error finding container fcc84e3a447cb4ed7bdda5fa91304503dead259d09114a0da2693516288d6534: Status 404 returned error can't find the container with id fcc84e3a447cb4ed7bdda5fa91304503dead259d09114a0da2693516288d6534
Jul 15 15:21:08.084968 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:08.084935    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7179-140050791855136" event={"ID":"b3fd04e8-91c1-4045-bb16-fbb7297aa90b","Type":"ContainerStarted","Data":"fcc84e3a447cb4ed7bdda5fa91304503dead259d09114a0da2693516288d6534"}
Jul 15 15:21:08.086215 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:08.086195    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0216df6a9e0a62cb9556b19d8e0fc27f1b4843dd1e3f0f83dc4ec11f47fd7434"
Jul 15 15:21:08.086215 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:08.086204    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7179-140050791855136"
Jul 15 15:21:08.098261 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:08.098228    2571 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7179-140050791855136" oldPodUID="2ab4336d-433a-4951-822e-e3433e04379c" podUID="b3fd04e8-91c1-4045-bb16-fbb7297aa90b"
Jul 15 15:21:08.754081 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:08.754041    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2ab4336d-433a-4951-822e-e3433e04379c" path="/var/lib/kubelet/pods/2ab4336d-433a-4951-822e-e3433e04379c/volumes"
Jul 15 15:21:08.754560 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:08.754537    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc" path="/var/lib/kubelet/pods/4b553a4d-0261-4ee1-aebe-e5fa6a03d8bc/volumes"
Jul 15 15:21:09.092821 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:09.092788    2571 generic.go:356] "Generic (PLEG): container finished" podID="b3fd04e8-91c1-4045-bb16-fbb7297aa90b" containerID="77922cd630c09cd3c00b3d5644d8f6a0b371be3897cc94ce5ebf77399e83845f" exitCode=0
Jul 15 15:21:09.093207 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:09.092823    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7179-140050791855136" event={"ID":"b3fd04e8-91c1-4045-bb16-fbb7297aa90b","Type":"ContainerDied","Data":"77922cd630c09cd3c00b3d5644d8f6a0b371be3897cc94ce5ebf77399e83845f"}
Jul 15 15:21:10.234467 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:10.234439    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7179-140050791855136"
Jul 15 15:21:10.256608 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:10.256579    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7179-140050791855136_b3fd04e8-91c1-4045-bb16-fbb7297aa90b/test-curl-7179-140050791855136/0.log"
Jul 15 15:21:10.283166 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:10.283134    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7179-140050791855136"]
Jul 15 15:21:10.287678 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:10.287653    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7179-140050791855136"]
Jul 15 15:21:10.313830 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:10.313806    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xpwbt\" (UniqueName: \"kubernetes.io/projected/b3fd04e8-91c1-4045-bb16-fbb7297aa90b-kube-api-access-xpwbt\") pod \"b3fd04e8-91c1-4045-bb16-fbb7297aa90b\" (UID: \"b3fd04e8-91c1-4045-bb16-fbb7297aa90b\") "
Jul 15 15:21:10.315851 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:10.315824    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b3fd04e8-91c1-4045-bb16-fbb7297aa90b-kube-api-access-xpwbt" (OuterVolumeSpecName: "kube-api-access-xpwbt") pod "b3fd04e8-91c1-4045-bb16-fbb7297aa90b" (UID: "b3fd04e8-91c1-4045-bb16-fbb7297aa90b"). InnerVolumeSpecName "kube-api-access-xpwbt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:21:10.415177 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:10.415081    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xpwbt\" (UniqueName: \"kubernetes.io/projected/b3fd04e8-91c1-4045-bb16-fbb7297aa90b-kube-api-access-xpwbt\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 15:21:10.753594 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:10.753515    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b3fd04e8-91c1-4045-bb16-fbb7297aa90b" path="/var/lib/kubelet/pods/b3fd04e8-91c1-4045-bb16-fbb7297aa90b/volumes"
Jul 15 15:21:11.006616 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:11.006496    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:21:11.111222 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:11.111187    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7179-140050791855136"
Jul 15 15:21:11.111414 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:11.111188    2571 scope.go:117] "RemoveContainer" containerID="77922cd630c09cd3c00b3d5644d8f6a0b371be3897cc94ce5ebf77399e83845f"
Jul 15 15:21:11.111414 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:11.111370    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:21:20.992589 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:20.992550    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-0c81d7-86b8b6747c-ds7rl"]
Jul 15 15:21:20.993061 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:20.992805    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0c81d7-86b8b6747c-ds7rl" podUID="170f7805-0244-4305-a429-e1bc8ff54acb" containerName="maas-api" containerID="cri-o://7430718f33e40359798e5a2664fd2eeb6a986f1b69ccb6dcc5d32d71376e9088" gracePeriod=30
Jul 15 15:21:21.011618 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:21.011593    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:21:21.166065 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:21.166036    2571 generic.go:356] "Generic (PLEG): container finished" podID="170f7805-0244-4305-a429-e1bc8ff54acb" containerID="7430718f33e40359798e5a2664fd2eeb6a986f1b69ccb6dcc5d32d71376e9088" exitCode=0
Jul 15 15:21:21.166200 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:21.166105    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0c81d7-86b8b6747c-ds7rl" event={"ID":"170f7805-0244-4305-a429-e1bc8ff54acb","Type":"ContainerDied","Data":"7430718f33e40359798e5a2664fd2eeb6a986f1b69ccb6dcc5d32d71376e9088"}
Jul 15 15:21:21.243237 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:21.243178    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0c81d7-86b8b6747c-ds7rl"
Jul 15 15:21:21.420001 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:21.419970    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/170f7805-0244-4305-a429-e1bc8ff54acb-openshift-service-ca\") pod \"170f7805-0244-4305-a429-e1bc8ff54acb\" (UID: \"170f7805-0244-4305-a429-e1bc8ff54acb\") "
Jul 15 15:21:21.420173 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:21.420029    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fnjr9\" (UniqueName: \"kubernetes.io/projected/170f7805-0244-4305-a429-e1bc8ff54acb-kube-api-access-fnjr9\") pod \"170f7805-0244-4305-a429-e1bc8ff54acb\" (UID: \"170f7805-0244-4305-a429-e1bc8ff54acb\") "
Jul 15 15:21:21.420173 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:21.420062    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/170f7805-0244-4305-a429-e1bc8ff54acb-maas-api-tls\") pod \"170f7805-0244-4305-a429-e1bc8ff54acb\" (UID: \"170f7805-0244-4305-a429-e1bc8ff54acb\") "
Jul 15 15:21:21.420363 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:21.420340    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/170f7805-0244-4305-a429-e1bc8ff54acb-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "170f7805-0244-4305-a429-e1bc8ff54acb" (UID: "170f7805-0244-4305-a429-e1bc8ff54acb"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 15:21:21.422152 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:21.422129    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/170f7805-0244-4305-a429-e1bc8ff54acb-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "170f7805-0244-4305-a429-e1bc8ff54acb" (UID: "170f7805-0244-4305-a429-e1bc8ff54acb"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 15:21:21.422227 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:21.422142    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/170f7805-0244-4305-a429-e1bc8ff54acb-kube-api-access-fnjr9" (OuterVolumeSpecName: "kube-api-access-fnjr9") pod "170f7805-0244-4305-a429-e1bc8ff54acb" (UID: "170f7805-0244-4305-a429-e1bc8ff54acb"). InnerVolumeSpecName "kube-api-access-fnjr9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:21:21.521707 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:21.521627    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fnjr9\" (UniqueName: \"kubernetes.io/projected/170f7805-0244-4305-a429-e1bc8ff54acb-kube-api-access-fnjr9\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 15:21:21.521707 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:21.521652    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/170f7805-0244-4305-a429-e1bc8ff54acb-maas-api-tls\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 15:21:21.521707 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:21.521662    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/170f7805-0244-4305-a429-e1bc8ff54acb-openshift-service-ca\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 15:21:22.172677 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:22.172645    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0c81d7-86b8b6747c-ds7rl"
Jul 15 15:21:22.173120 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:22.172649    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-0c81d7-86b8b6747c-ds7rl" event={"ID":"170f7805-0244-4305-a429-e1bc8ff54acb","Type":"ContainerDied","Data":"4e6a4c51d817f3b2c93321787eef3c81e474664d5a48ead4119889a9bd2e8c20"}
Jul 15 15:21:22.173120 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:22.172774    2571 scope.go:117] "RemoveContainer" containerID="7430718f33e40359798e5a2664fd2eeb6a986f1b69ccb6dcc5d32d71376e9088"
Jul 15 15:21:22.198177 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:22.198151    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-0c81d7-86b8b6747c-ds7rl"]
Jul 15 15:21:22.203230 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:22.203206    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-0c81d7-86b8b6747c-ds7rl"]
Jul 15 15:21:22.753227 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:22.753192    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="170f7805-0244-4305-a429-e1bc8ff54acb" path="/var/lib/kubelet/pods/170f7805-0244-4305-a429-e1bc8ff54acb/volumes"
Jul 15 15:21:24.486119 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:24.486079    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 15:21:25.581403 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:25.581367    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:21:31.739384 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:31.739301    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:21:31.947516 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:31.947487    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:21:36.282561 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:36.282523    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:21:36.522109 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:36.522077    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:21:36.643052 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:36.643014    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b2aed6-bctkf"]
Jul 15 15:21:36.643416 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:36.643402    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="170f7805-0244-4305-a429-e1bc8ff54acb" containerName="maas-api"
Jul 15 15:21:36.643465 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:36.643418    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="170f7805-0244-4305-a429-e1bc8ff54acb" containerName="maas-api"
Jul 15 15:21:36.643465 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:36.643427    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3fd04e8-91c1-4045-bb16-fbb7297aa90b" containerName="test-curl-7179-140050791855136"
Jul 15 15:21:36.643465 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:36.643433    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3fd04e8-91c1-4045-bb16-fbb7297aa90b" containerName="test-curl-7179-140050791855136"
Jul 15 15:21:36.643565 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:36.643497    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="170f7805-0244-4305-a429-e1bc8ff54acb" containerName="maas-api"
Jul 15 15:21:36.643565 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:36.643504    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3fd04e8-91c1-4045-bb16-fbb7297aa90b" containerName="test-curl-7179-140050791855136"
Jul 15 15:21:36.648644 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:36.648624    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b2aed6-bctkf"
Jul 15 15:21:36.651318 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:36.651284    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-7kbgk\""
Jul 15 15:21:36.654550 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:36.654523    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b2aed6-bctkf"]
Jul 15 15:21:36.749995 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:36.749958    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/77ad539c-fee9-4f6d-871d-3b63db24630d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-b2aed6-bctkf\" (UID: \"77ad539c-fee9-4f6d-871d-3b63db24630d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b2aed6-bctkf"
Jul 15 15:21:36.850815 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:36.850776    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/77ad539c-fee9-4f6d-871d-3b63db24630d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-b2aed6-bctkf\" (UID: \"77ad539c-fee9-4f6d-871d-3b63db24630d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b2aed6-bctkf"
Jul 15 15:21:36.851454 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:36.851433    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/77ad539c-fee9-4f6d-871d-3b63db24630d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-b2aed6-bctkf\" (UID: \"77ad539c-fee9-4f6d-871d-3b63db24630d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b2aed6-bctkf"
Jul 15 15:21:36.959910 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:36.959816    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b2aed6-bctkf"
Jul 15 15:21:37.093686 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:37.093658    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b2aed6-bctkf"]
Jul 15 15:21:37.095381 ip-10-0-140-61 kubenswrapper[2571]: W0715 15:21:37.095334    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77ad539c_fee9_4f6d_871d_3b63db24630d.slice/crio-b458fd1fafb97b53bffaf8b4d8f3571ada4efdee5ffd6712eb3346d62dc9d068 WatchSource:0}: Error finding container b458fd1fafb97b53bffaf8b4d8f3571ada4efdee5ffd6712eb3346d62dc9d068: Status 404 returned error can't find the container with id b458fd1fafb97b53bffaf8b4d8f3571ada4efdee5ffd6712eb3346d62dc9d068
Jul 15 15:21:37.187748 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:37.187706    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:21:37.255422 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:37.255327    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b2aed6-bctkf" event={"ID":"77ad539c-fee9-4f6d-871d-3b63db24630d","Type":"ContainerStarted","Data":"b458fd1fafb97b53bffaf8b4d8f3571ada4efdee5ffd6712eb3346d62dc9d068"}
Jul 15 15:21:38.262255 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:38.262215    2571 generic.go:356] "Generic (PLEG): container finished" podID="77ad539c-fee9-4f6d-871d-3b63db24630d" containerID="f2a41606486bd58828734e0fb579973c08596b81e90a5d09e3a5f6558a92c866" exitCode=0
Jul 15 15:21:38.262666 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:38.262299    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b2aed6-bctkf" event={"ID":"77ad539c-fee9-4f6d-871d-3b63db24630d","Type":"ContainerDied","Data":"f2a41606486bd58828734e0fb579973c08596b81e90a5d09e3a5f6558a92c866"}
Jul 15 15:21:39.013086 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:39.013056    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:21:39.403010 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:39.402980    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b2aed6-bctkf"
Jul 15 15:21:39.470652 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:39.470607    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/77ad539c-fee9-4f6d-871d-3b63db24630d-maas-api-service-ca\") pod \"77ad539c-fee9-4f6d-871d-3b63db24630d\" (UID: \"77ad539c-fee9-4f6d-871d-3b63db24630d\") "
Jul 15 15:21:39.470975 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:39.470952    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/77ad539c-fee9-4f6d-871d-3b63db24630d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "77ad539c-fee9-4f6d-871d-3b63db24630d" (UID: "77ad539c-fee9-4f6d-871d-3b63db24630d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 15:21:39.572259 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:39.572228    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/77ad539c-fee9-4f6d-871d-3b63db24630d-maas-api-service-ca\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 15:21:40.273402 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:40.273363    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b2aed6-bctkf"
Jul 15 15:21:40.273600 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:40.273407    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-b2aed6-bctkf" event={"ID":"77ad539c-fee9-4f6d-871d-3b63db24630d","Type":"ContainerDied","Data":"b458fd1fafb97b53bffaf8b4d8f3571ada4efdee5ffd6712eb3346d62dc9d068"}
Jul 15 15:21:40.273600 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:40.273452    2571 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b458fd1fafb97b53bffaf8b4d8f3571ada4efdee5ffd6712eb3346d62dc9d068"
Jul 15 15:21:47.107596 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:47.107548    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b2aed6-b8f866497-fgd76"]
Jul 15 15:21:47.108097 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:47.107807    2571 kuberuntime_container.go:873] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b2aed6-b8f866497-fgd76" podUID="b1a58a8d-1fcc-4236-9801-a07dd74c2a6f" containerName="maas-api" containerID="cri-o://13df9e645f467368df882c50ef2f9498fdbbe29e2975c6fd6928bd33dbb50c75" gracePeriod=30
Jul 15 15:21:47.138512 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:47.138486    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:21:47.145673 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:47.145649    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b2aed6-29735475-2268g"]
Jul 15 15:21:47.149447 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:47.149427    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-b2aed6-29735475-2268g"]
Jul 15 15:21:47.316509 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:47.316477    2571 generic.go:356] "Generic (PLEG): container finished" podID="b1a58a8d-1fcc-4236-9801-a07dd74c2a6f" containerID="13df9e645f467368df882c50ef2f9498fdbbe29e2975c6fd6928bd33dbb50c75" exitCode=0
Jul 15 15:21:47.316658 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:47.316551    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b2aed6-b8f866497-fgd76" event={"ID":"b1a58a8d-1fcc-4236-9801-a07dd74c2a6f","Type":"ContainerDied","Data":"13df9e645f467368df882c50ef2f9498fdbbe29e2975c6fd6928bd33dbb50c75"}
Jul 15 15:21:47.365751 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:47.365690    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b2aed6-b8f866497-fgd76"
Jul 15 15:21:47.439828 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:47.439782    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pzqx5\" (UniqueName: \"kubernetes.io/projected/b1a58a8d-1fcc-4236-9801-a07dd74c2a6f-kube-api-access-pzqx5\") pod \"b1a58a8d-1fcc-4236-9801-a07dd74c2a6f\" (UID: \"b1a58a8d-1fcc-4236-9801-a07dd74c2a6f\") "
Jul 15 15:21:47.440011 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:47.439875    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1a58a8d-1fcc-4236-9801-a07dd74c2a6f-maas-api-tls\") pod \"b1a58a8d-1fcc-4236-9801-a07dd74c2a6f\" (UID: \"b1a58a8d-1fcc-4236-9801-a07dd74c2a6f\") "
Jul 15 15:21:47.440011 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:47.439968    2571 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1a58a8d-1fcc-4236-9801-a07dd74c2a6f-openshift-service-ca\") pod \"b1a58a8d-1fcc-4236-9801-a07dd74c2a6f\" (UID: \"b1a58a8d-1fcc-4236-9801-a07dd74c2a6f\") "
Jul 15 15:21:47.440382 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:47.440354    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b1a58a8d-1fcc-4236-9801-a07dd74c2a6f-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "b1a58a8d-1fcc-4236-9801-a07dd74c2a6f" (UID: "b1a58a8d-1fcc-4236-9801-a07dd74c2a6f"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 15:21:47.441932 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:47.441909    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b1a58a8d-1fcc-4236-9801-a07dd74c2a6f-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "b1a58a8d-1fcc-4236-9801-a07dd74c2a6f" (UID: "b1a58a8d-1fcc-4236-9801-a07dd74c2a6f"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 15:21:47.442026 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:47.442011    2571 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b1a58a8d-1fcc-4236-9801-a07dd74c2a6f-kube-api-access-pzqx5" (OuterVolumeSpecName: "kube-api-access-pzqx5") pod "b1a58a8d-1fcc-4236-9801-a07dd74c2a6f" (UID: "b1a58a8d-1fcc-4236-9801-a07dd74c2a6f"). InnerVolumeSpecName "kube-api-access-pzqx5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 15:21:47.541616 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:47.541580    2571 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/b1a58a8d-1fcc-4236-9801-a07dd74c2a6f-openshift-service-ca\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 15:21:47.541616 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:47.541612    2571 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pzqx5\" (UniqueName: \"kubernetes.io/projected/b1a58a8d-1fcc-4236-9801-a07dd74c2a6f-kube-api-access-pzqx5\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 15:21:47.541616 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:47.541621    2571 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/b1a58a8d-1fcc-4236-9801-a07dd74c2a6f-maas-api-tls\") on node \"ip-10-0-140-61.ec2.internal\" DevicePath \"\""
Jul 15 15:21:48.328214 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:48.328186    2571 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b2aed6-b8f866497-fgd76"
Jul 15 15:21:48.328214 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:48.328199    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-b2aed6-b8f866497-fgd76" event={"ID":"b1a58a8d-1fcc-4236-9801-a07dd74c2a6f","Type":"ContainerDied","Data":"65d23beddd4aab1c0d9ca2eb9c2535a8c7132808ad64d30130fd7c89311f52f6"}
Jul 15 15:21:48.328743 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:48.328302    2571 scope.go:117] "RemoveContainer" containerID="13df9e645f467368df882c50ef2f9498fdbbe29e2975c6fd6928bd33dbb50c75"
Jul 15 15:21:48.351190 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:48.351157    2571 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b2aed6-b8f866497-fgd76"]
Jul 15 15:21:48.355627 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:48.355600    2571 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-b2aed6-b8f866497-fgd76"]
Jul 15 15:21:48.615375 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:48.615300    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:21:48.752983 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:48.752938    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="746df728-064f-4816-b384-9f53b92bbee9" path="/var/lib/kubelet/pods/746df728-064f-4816-b384-9f53b92bbee9/volumes"
Jul 15 15:21:48.753414 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:48.753392    2571 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b1a58a8d-1fcc-4236-9801-a07dd74c2a6f" path="/var/lib/kubelet/pods/b1a58a8d-1fcc-4236-9801-a07dd74c2a6f/volumes"
Jul 15 15:21:50.190171 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:50.190140    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-fpcdh"]
Jul 15 15:21:50.437589 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:50.437562    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:21:51.734581 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:51.734547    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:21:57.828408 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:57.828375    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:21:57.929061 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:21:57.929025    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:22:02.419436 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:02.419392    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:22:02.809489 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:02.809457    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:22:09.161554 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:09.161525    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c6dcffcc7-hm86t_8f934a9f-b3fe-460c-94e8-6807e3fd915c/copy-manifests/0.log"
Jul 15 15:22:09.168585 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:09.168564    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c6dcffcc7-hm86t_8f934a9f-b3fe-460c-94e8-6807e3fd915c/manager/0.log"
Jul 15 15:22:09.892598 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:09.892566    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29735445-rp922_5e14df4c-1d0c-42b2-9354-0230b0656ecc/cleanup/0.log"
Jul 15 15:22:10.109685 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:10.109645    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29735475-vbszp_750ed856-4699-4fc8-ab4f-695f5b97d6bc/cleanup/0.log"
Jul 15 15:22:10.341053 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:10.341025    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-a418840f-2t5s7_bb6f0850-854e-46ff-8534-d9230bd40ec2/revoke-keys/0.log"
Jul 15 15:22:10.680286 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:10.680194    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-derive-9c3abd0e-khkhz_60b24b3f-51e7-494b-ba9c-88841ac4d3e6/revoke-keys/0.log"
Jul 15 15:22:10.902254 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:10.902224    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-b-1e3693-dltls_67bff24d-f114-4b6a-96d0-2abd12723f42/revoke-keys/0.log"
Jul 15 15:22:11.119348 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:11.119308    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-88acceda-xzhft_b0ef5eb5-aa2e-4fe3-baf7-2486d64b1f06/revoke-keys/0.log"
Jul 15 15:22:11.458621 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:11.458539    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-b-b2aed6-bctkf_77ad539c-fee9-4f6d-871d-3b63db24630d/revoke-keys/0.log"
Jul 15 15:22:13.130805 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:13.130774    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-jqk86_ec684fc0-49ba-4242-809c-604f814d226e/manager/0.log"
Jul 15 15:22:13.239890 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:13.239865    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-zdmzl_96e93437-f9c3-4102-9673-efebb4c4cdae/kuadrant-console-plugin/0.log"
Jul 15 15:22:13.591408 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:13.591380    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-fpcdh_3443d05e-3fe0-470e-9351-4ca696489616/limitador/0.log"
Jul 15 15:22:14.308541 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:14.308512    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85d556468c-f6s4p_74c720bd-3a70-401d-9c15-8927f2783589/kube-auth-proxy/0.log"
Jul 15 15:22:14.890973 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:14.890928    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6b5f9c7788-p9ls6_4b0ac431-4ca5-45b0-9779-26461b04b319/router/0.log"
Jul 15 15:22:15.466364 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:15.466336    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-fccvt_fd05fd7e-57cc-43f1-9b46-b524b56b14e4/main/0.log"
Jul 15 15:22:15.696986 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:15.696945    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-gdsjv_8cf78ce9-6c4c-46d5-a6a1-4dcae05b8f20/main/0.log"
Jul 15 15:22:21.164059 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:21.164026    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bqlw8/must-gather-l9ksx"]
Jul 15 15:22:21.164486 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:21.164450    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b1a58a8d-1fcc-4236-9801-a07dd74c2a6f" containerName="maas-api"
Jul 15 15:22:21.164486 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:21.164468    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="b1a58a8d-1fcc-4236-9801-a07dd74c2a6f" containerName="maas-api"
Jul 15 15:22:21.164486 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:21.164485    2571 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="77ad539c-fee9-4f6d-871d-3b63db24630d" containerName="revoke-keys"
Jul 15 15:22:21.164595 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:21.164491    2571 state_mem.go:107] "Deleted CPUSet assignment" podUID="77ad539c-fee9-4f6d-871d-3b63db24630d" containerName="revoke-keys"
Jul 15 15:22:21.164595 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:21.164561    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="b1a58a8d-1fcc-4236-9801-a07dd74c2a6f" containerName="maas-api"
Jul 15 15:22:21.164595 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:21.164571    2571 memory_manager.go:368] "RemoveStaleState removing state" podUID="77ad539c-fee9-4f6d-871d-3b63db24630d" containerName="revoke-keys"
Jul 15 15:22:21.167132 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:21.167117    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bqlw8/must-gather-l9ksx"
Jul 15 15:22:21.169622 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:21.169594    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bqlw8\"/\"openshift-service-ca.crt\""
Jul 15 15:22:21.169768 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:21.169658    2571 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-bqlw8\"/\"kube-root-ca.crt\""
Jul 15 15:22:21.169905 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:21.169890    2571 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-bqlw8\"/\"default-dockercfg-dd5lq\""
Jul 15 15:22:21.175043 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:21.175020    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bqlw8/must-gather-l9ksx"]
Jul 15 15:22:21.177637 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:21.177617    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:22:21.278571 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:21.278534    2571 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log" limit=1024
Jul 15 15:22:21.341133 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:21.341097    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a454db68-94a8-43ae-92a8-e5e70daff67a-must-gather-output\") pod \"must-gather-l9ksx\" (UID: \"a454db68-94a8-43ae-92a8-e5e70daff67a\") " pod="openshift-must-gather-bqlw8/must-gather-l9ksx"
Jul 15 15:22:21.341360 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:21.341179    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jpvzw\" (UniqueName: \"kubernetes.io/projected/a454db68-94a8-43ae-92a8-e5e70daff67a-kube-api-access-jpvzw\") pod \"must-gather-l9ksx\" (UID: \"a454db68-94a8-43ae-92a8-e5e70daff67a\") " pod="openshift-must-gather-bqlw8/must-gather-l9ksx"
Jul 15 15:22:21.441645 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:21.441552    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a454db68-94a8-43ae-92a8-e5e70daff67a-must-gather-output\") pod \"must-gather-l9ksx\" (UID: \"a454db68-94a8-43ae-92a8-e5e70daff67a\") " pod="openshift-must-gather-bqlw8/must-gather-l9ksx"
Jul 15 15:22:21.441645 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:21.441617    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jpvzw\" (UniqueName: \"kubernetes.io/projected/a454db68-94a8-43ae-92a8-e5e70daff67a-kube-api-access-jpvzw\") pod \"must-gather-l9ksx\" (UID: \"a454db68-94a8-43ae-92a8-e5e70daff67a\") " pod="openshift-must-gather-bqlw8/must-gather-l9ksx"
Jul 15 15:22:21.441939 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:21.441916    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/a454db68-94a8-43ae-92a8-e5e70daff67a-must-gather-output\") pod \"must-gather-l9ksx\" (UID: \"a454db68-94a8-43ae-92a8-e5e70daff67a\") " pod="openshift-must-gather-bqlw8/must-gather-l9ksx"
Jul 15 15:22:21.450223 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:21.450187    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jpvzw\" (UniqueName: \"kubernetes.io/projected/a454db68-94a8-43ae-92a8-e5e70daff67a-kube-api-access-jpvzw\") pod \"must-gather-l9ksx\" (UID: \"a454db68-94a8-43ae-92a8-e5e70daff67a\") " pod="openshift-must-gather-bqlw8/must-gather-l9ksx"
Jul 15 15:22:21.477083 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:21.477040    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bqlw8/must-gather-l9ksx"
Jul 15 15:22:21.608811 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:21.608783    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bqlw8/must-gather-l9ksx"]
Jul 15 15:22:21.611039 ip-10-0-140-61 kubenswrapper[2571]: W0715 15:22:21.611013    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda454db68_94a8_43ae_92a8_e5e70daff67a.slice/crio-66a3104d3584f68de7ea07694b1c9c6fd6f421445979749b9fdb9ee22e45d4f9 WatchSource:0}: Error finding container 66a3104d3584f68de7ea07694b1c9c6fd6f421445979749b9fdb9ee22e45d4f9: Status 404 returned error can't find the container with id 66a3104d3584f68de7ea07694b1c9c6fd6f421445979749b9fdb9ee22e45d4f9
Jul 15 15:22:22.503360 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:22.503320    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bqlw8/must-gather-l9ksx" event={"ID":"a454db68-94a8-43ae-92a8-e5e70daff67a","Type":"ContainerStarted","Data":"baa536f29121e308e029b05c54e4bda95244e496be7d1f0eea2ac9bde63e4b9d"}
Jul 15 15:22:22.503777 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:22.503377    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bqlw8/must-gather-l9ksx" event={"ID":"a454db68-94a8-43ae-92a8-e5e70daff67a","Type":"ContainerStarted","Data":"66a3104d3584f68de7ea07694b1c9c6fd6f421445979749b9fdb9ee22e45d4f9"}
Jul 15 15:22:23.513395 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:23.513352    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bqlw8/must-gather-l9ksx" event={"ID":"a454db68-94a8-43ae-92a8-e5e70daff67a","Type":"ContainerStarted","Data":"4225c7bc204ee3528173537f56b37c6230db1099de560c3cafa1d5c28ceb6a09"}
Jul 15 15:22:23.531857 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:23.531780    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bqlw8/must-gather-l9ksx" podStartSLOduration=1.7928615319999999 podStartE2EDuration="2.53175836s" totalImagesPullingTime="738.896828ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 15:22:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:22:23.531487691 +0000 UTC m=+2927.047305588" watchObservedRunningTime="2026-07-15 15:22:23.53175836 +0000 UTC m=+2927.047576233"
Jul 15 15:22:23.976150 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:23.976120    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-7b98l_4a14d87d-5fd3-40b7-b753-4758b15dd501/global-pull-secret-syncer/0.log"
Jul 15 15:22:24.100990 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:24.100956    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-42cjp_d1d4ca67-bb3b-4f02-a744-de494982cffa/konnectivity-agent/0.log"
Jul 15 15:22:24.208777 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:24.208744    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-61.ec2.internal_5c90a46431eae6b3cdd7f5745d0d2187/haproxy/0.log"
Jul 15 15:22:29.436889 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:29.436860    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-jqk86_ec684fc0-49ba-4242-809c-604f814d226e/manager/0.log"
Jul 15 15:22:29.472494 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:29.472465    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-console-plugin-66b5774985-zdmzl_96e93437-f9c3-4102-9673-efebb4c4cdae/kuadrant-console-plugin/0.log"
Jul 15 15:22:29.658183 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:29.658153    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-fpcdh_3443d05e-3fe0-470e-9351-4ca696489616/limitador/0.log"
Jul 15 15:22:31.692338 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:31.692232    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-fkhv2_247f8c50-953c-457c-b2f5-02830e0c499d/cluster-monitoring-operator/0.log"
Jul 15 15:22:31.861198 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:31.861137    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bjqrt_63c44b95-aa50-4c76-b4d4-4de11e252661/node-exporter/0.log"
Jul 15 15:22:31.884377 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:31.884329    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bjqrt_63c44b95-aa50-4c76-b4d4-4de11e252661/kube-rbac-proxy/0.log"
Jul 15 15:22:31.912423 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:31.912396    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-bjqrt_63c44b95-aa50-4c76-b4d4-4de11e252661/init-textfile/0.log"
Jul 15 15:22:32.225344 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:32.225310    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_50c44957-5c6a-45e6-b3c2-4b92bc516948/prometheus/0.log"
Jul 15 15:22:32.252284 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:32.252244    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_50c44957-5c6a-45e6-b3c2-4b92bc516948/config-reloader/0.log"
Jul 15 15:22:32.285082 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:32.285002    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_50c44957-5c6a-45e6-b3c2-4b92bc516948/thanos-sidecar/0.log"
Jul 15 15:22:32.310901 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:32.310868    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_50c44957-5c6a-45e6-b3c2-4b92bc516948/kube-rbac-proxy-web/0.log"
Jul 15 15:22:32.338748 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:32.338716    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_50c44957-5c6a-45e6-b3c2-4b92bc516948/kube-rbac-proxy/0.log"
Jul 15 15:22:32.367148 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:32.367116    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_50c44957-5c6a-45e6-b3c2-4b92bc516948/kube-rbac-proxy-thanos/0.log"
Jul 15 15:22:32.394412 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:32.394380    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_50c44957-5c6a-45e6-b3c2-4b92bc516948/init-config-reloader/0.log"
Jul 15 15:22:32.426955 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:32.426910    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-nwxjr_f87ee709-cbaa-4a04-b7cc-7d01381a9b73/prometheus-operator/0.log"
Jul 15 15:22:32.451622 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:32.451585    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-nwxjr_f87ee709-cbaa-4a04-b7cc-7d01381a9b73/kube-rbac-proxy/0.log"
Jul 15 15:22:33.925905 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:33.925879    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-npl5n_6d24461e-70ad-4e8d-8647-5277bed5a202/networking-console-plugin/0.log"
Jul 15 15:22:34.532015 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:34.531980    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-42mdh_0de0f3ad-e228-4c27-9b2c-de1a5844dcdb/console-operator/1.log"
Jul 15 15:22:34.540802 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:34.540754    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-42mdh_0de0f3ad-e228-4c27-9b2c-de1a5844dcdb/console-operator/2.log"
Jul 15 15:22:35.563526 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:35.563490    2571 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-bqlw8/perf-node-gather-daemonset-5m727"]
Jul 15 15:22:35.569604 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:35.569571    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bqlw8/perf-node-gather-daemonset-5m727"
Jul 15 15:22:35.576826 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:35.576787    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bqlw8/perf-node-gather-daemonset-5m727"]
Jul 15 15:22:35.697205 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:35.697164    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b096bacf-869b-4f3c-8a53-a39e3e4b08f7-proc\") pod \"perf-node-gather-daemonset-5m727\" (UID: \"b096bacf-869b-4f3c-8a53-a39e3e4b08f7\") " pod="openshift-must-gather-bqlw8/perf-node-gather-daemonset-5m727"
Jul 15 15:22:35.697758 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:35.697729    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wm8dj\" (UniqueName: \"kubernetes.io/projected/b096bacf-869b-4f3c-8a53-a39e3e4b08f7-kube-api-access-wm8dj\") pod \"perf-node-gather-daemonset-5m727\" (UID: \"b096bacf-869b-4f3c-8a53-a39e3e4b08f7\") " pod="openshift-must-gather-bqlw8/perf-node-gather-daemonset-5m727"
Jul 15 15:22:35.697953 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:35.697934    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b096bacf-869b-4f3c-8a53-a39e3e4b08f7-lib-modules\") pod \"perf-node-gather-daemonset-5m727\" (UID: \"b096bacf-869b-4f3c-8a53-a39e3e4b08f7\") " pod="openshift-must-gather-bqlw8/perf-node-gather-daemonset-5m727"
Jul 15 15:22:35.698125 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:35.698099    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b096bacf-869b-4f3c-8a53-a39e3e4b08f7-sys\") pod \"perf-node-gather-daemonset-5m727\" (UID: \"b096bacf-869b-4f3c-8a53-a39e3e4b08f7\") " pod="openshift-must-gather-bqlw8/perf-node-gather-daemonset-5m727"
Jul 15 15:22:35.698241 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:35.698159    2571 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b096bacf-869b-4f3c-8a53-a39e3e4b08f7-podres\") pod \"perf-node-gather-daemonset-5m727\" (UID: \"b096bacf-869b-4f3c-8a53-a39e3e4b08f7\") " pod="openshift-must-gather-bqlw8/perf-node-gather-daemonset-5m727"
Jul 15 15:22:35.748411 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:35.748379    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-cz5pq_b50812cf-7948-4c73-b6da-728813c52302/volume-data-source-validator/0.log"
Jul 15 15:22:35.798881 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:35.798841    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b096bacf-869b-4f3c-8a53-a39e3e4b08f7-lib-modules\") pod \"perf-node-gather-daemonset-5m727\" (UID: \"b096bacf-869b-4f3c-8a53-a39e3e4b08f7\") " pod="openshift-must-gather-bqlw8/perf-node-gather-daemonset-5m727"
Jul 15 15:22:35.799140 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:35.799120    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b096bacf-869b-4f3c-8a53-a39e3e4b08f7-sys\") pod \"perf-node-gather-daemonset-5m727\" (UID: \"b096bacf-869b-4f3c-8a53-a39e3e4b08f7\") " pod="openshift-must-gather-bqlw8/perf-node-gather-daemonset-5m727"
Jul 15 15:22:35.799296 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:35.799261    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b096bacf-869b-4f3c-8a53-a39e3e4b08f7-podres\") pod \"perf-node-gather-daemonset-5m727\" (UID: \"b096bacf-869b-4f3c-8a53-a39e3e4b08f7\") " pod="openshift-must-gather-bqlw8/perf-node-gather-daemonset-5m727"
Jul 15 15:22:35.799446 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:35.799407    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/b096bacf-869b-4f3c-8a53-a39e3e4b08f7-podres\") pod \"perf-node-gather-daemonset-5m727\" (UID: \"b096bacf-869b-4f3c-8a53-a39e3e4b08f7\") " pod="openshift-must-gather-bqlw8/perf-node-gather-daemonset-5m727"
Jul 15 15:22:35.799608 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:35.799054    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/b096bacf-869b-4f3c-8a53-a39e3e4b08f7-lib-modules\") pod \"perf-node-gather-daemonset-5m727\" (UID: \"b096bacf-869b-4f3c-8a53-a39e3e4b08f7\") " pod="openshift-must-gather-bqlw8/perf-node-gather-daemonset-5m727"
Jul 15 15:22:35.799698 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:35.799430    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b096bacf-869b-4f3c-8a53-a39e3e4b08f7-proc\") pod \"perf-node-gather-daemonset-5m727\" (UID: \"b096bacf-869b-4f3c-8a53-a39e3e4b08f7\") " pod="openshift-must-gather-bqlw8/perf-node-gather-daemonset-5m727"
Jul 15 15:22:35.799924 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:35.799907    2571 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wm8dj\" (UniqueName: \"kubernetes.io/projected/b096bacf-869b-4f3c-8a53-a39e3e4b08f7-kube-api-access-wm8dj\") pod \"perf-node-gather-daemonset-5m727\" (UID: \"b096bacf-869b-4f3c-8a53-a39e3e4b08f7\") " pod="openshift-must-gather-bqlw8/perf-node-gather-daemonset-5m727"
Jul 15 15:22:35.800056 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:35.799317    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/b096bacf-869b-4f3c-8a53-a39e3e4b08f7-sys\") pod \"perf-node-gather-daemonset-5m727\" (UID: \"b096bacf-869b-4f3c-8a53-a39e3e4b08f7\") " pod="openshift-must-gather-bqlw8/perf-node-gather-daemonset-5m727"
Jul 15 15:22:35.800137 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:35.799486    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/b096bacf-869b-4f3c-8a53-a39e3e4b08f7-proc\") pod \"perf-node-gather-daemonset-5m727\" (UID: \"b096bacf-869b-4f3c-8a53-a39e3e4b08f7\") " pod="openshift-must-gather-bqlw8/perf-node-gather-daemonset-5m727"
Jul 15 15:22:35.810566 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:35.810534    2571 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wm8dj\" (UniqueName: \"kubernetes.io/projected/b096bacf-869b-4f3c-8a53-a39e3e4b08f7-kube-api-access-wm8dj\") pod \"perf-node-gather-daemonset-5m727\" (UID: \"b096bacf-869b-4f3c-8a53-a39e3e4b08f7\") " pod="openshift-must-gather-bqlw8/perf-node-gather-daemonset-5m727"
Jul 15 15:22:35.884490 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:35.884406    2571 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-bqlw8/perf-node-gather-daemonset-5m727"
Jul 15 15:22:36.041089 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:36.041061    2571 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-bqlw8/perf-node-gather-daemonset-5m727"]
Jul 15 15:22:36.043469 ip-10-0-140-61 kubenswrapper[2571]: W0715 15:22:36.043434    2571 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podb096bacf_869b_4f3c_8a53_a39e3e4b08f7.slice/crio-b4b95e18641da3f3bbe4695a869fa9240e21ab5ddced3c9adb4213819e15df5b WatchSource:0}: Error finding container b4b95e18641da3f3bbe4695a869fa9240e21ab5ddced3c9adb4213819e15df5b: Status 404 returned error can't find the container with id b4b95e18641da3f3bbe4695a869fa9240e21ab5ddced3c9adb4213819e15df5b
Jul 15 15:22:36.610511 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:36.610464    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bqlw8/perf-node-gather-daemonset-5m727" event={"ID":"b096bacf-869b-4f3c-8a53-a39e3e4b08f7","Type":"ContainerStarted","Data":"70850ac6158fc968ad5dbdc6dbb67c6667a6bd1331d6e9460a1e661d06449bba"}
Jul 15 15:22:36.611008 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:36.610554    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-bqlw8/perf-node-gather-daemonset-5m727"
Jul 15 15:22:36.611008 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:36.610603    2571 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-bqlw8/perf-node-gather-daemonset-5m727" event={"ID":"b096bacf-869b-4f3c-8a53-a39e3e4b08f7","Type":"ContainerStarted","Data":"b4b95e18641da3f3bbe4695a869fa9240e21ab5ddced3c9adb4213819e15df5b"}
Jul 15 15:22:36.629036 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:36.628969    2571 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-bqlw8/perf-node-gather-daemonset-5m727" podStartSLOduration=1.6289485190000002 podStartE2EDuration="1.628948519s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 15:22:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 15:22:36.627481465 +0000 UTC m=+2940.143299357" watchObservedRunningTime="2026-07-15 15:22:36.628948519 +0000 UTC m=+2940.144766393"
Jul 15 15:22:36.973293 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:36.973207    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zmmq4_cd114550-c5d0-471c-83fb-b5203fcea02c/dns/0.log"
Jul 15 15:22:36.995347 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:36.995316    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-zmmq4_cd114550-c5d0-471c-83fb-b5203fcea02c/kube-rbac-proxy/0.log"
Jul 15 15:22:37.072286 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:37.072244    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-jw9j8_144a8b5d-13b7-4453-8bd5-963d4c7815c8/dns-node-resolver/0.log"
Jul 15 15:22:37.701563 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:37.701534    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-wvfhr_55343882-5974-45a9-b3e2-cfff9bec7863/node-ca/0.log"
Jul 15 15:22:38.201411 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:38.201383    2571 scope.go:117] "RemoveContainer" containerID="0d9f2de3b67924bc1229b36f611c0221319ee69c4aed0992811c5df6439a5524"
Jul 15 15:22:38.866008 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:38.865970    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85d556468c-f6s4p_74c720bd-3a70-401d-9c15-8927f2783589/kube-auth-proxy/0.log"
Jul 15 15:22:39.032426 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:39.032395    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6b5f9c7788-p9ls6_4b0ac431-4ca5-45b0-9779-26461b04b319/router/0.log"
Jul 15 15:22:39.825868 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:39.825837    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-t56m5_5943ec96-deb6-4e14-9d96-d5f71e12d6d5/serve-healthcheck-canary/0.log"
Jul 15 15:22:40.337805 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:40.337775    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-45c2z_48d450ff-8575-4187-b279-ed927e9fb854/insights-operator/0.log"
Jul 15 15:22:40.340142 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:40.340116    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-45c2z_48d450ff-8575-4187-b279-ed927e9fb854/insights-operator/1.log"
Jul 15 15:22:40.508607 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:40.508574    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rbdmg_ebcd9b8b-583f-482c-8fc2-534201772275/kube-rbac-proxy/0.log"
Jul 15 15:22:40.530736 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:40.530709    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rbdmg_ebcd9b8b-583f-482c-8fc2-534201772275/exporter/0.log"
Jul 15 15:22:40.558807 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:40.558758    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-rbdmg_ebcd9b8b-583f-482c-8fc2-534201772275/extractor/0.log"
Jul 15 15:22:42.627658 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:42.627629    2571 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-bqlw8/perf-node-gather-daemonset-5m727"
Jul 15 15:22:43.082570 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:43.082534    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c6dcffcc7-hm86t_8f934a9f-b3fe-460c-94e8-6807e3fd915c/manager/0.log"
Jul 15 15:22:43.104850 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:43.104823    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6c6dcffcc7-hm86t_8f934a9f-b3fe-460c-94e8-6807e3fd915c/copy-manifests/0.log"
Jul 15 15:22:44.487326 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:44.487209    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85d556468c-f6s4p_74c720bd-3a70-401d-9c15-8927f2783589/kube-auth-proxy/0.log"
Jul 15 15:22:44.612794 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:44.612766    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-68975544d6-qgxb9_6cbc15b1-cedc-4513-a9eb-942459eb40c9/manager/0.log"
Jul 15 15:22:44.622330 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:44.622300    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6b5f9c7788-p9ls6_4b0ac431-4ca5-45b0-9779-26461b04b319/router/0.log"
Jul 15 15:22:46.093183 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:46.093154    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85d556468c-f6s4p_74c720bd-3a70-401d-9c15-8927f2783589/kube-auth-proxy/0.log"
Jul 15 15:22:46.216586 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:46.216558    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-6b5f9c7788-p9ls6_4b0ac431-4ca5-45b0-9779-26461b04b319/router/0.log"
Jul 15 15:22:49.952789 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:49.952759    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-lz7p6_22e7cfb1-87e4-4936-bd2a-c0d127b6d3d7/migrator/0.log"
Jul 15 15:22:49.974156 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:49.974129    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7f59b54f6c-lz7p6_22e7cfb1-87e4-4936-bd2a-c0d127b6d3d7/graceful-termination/0.log"
Jul 15 15:22:50.349378 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:50.349341    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-69tjk_7ea4c3c6-6010-4578-bd63-02311a41af04/kube-storage-version-migrator-operator/1.log"
Jul 15 15:22:50.350372 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:50.350350    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-69tjk_7ea4c3c6-6010-4578-bd63-02311a41af04/kube-storage-version-migrator-operator/0.log"
Jul 15 15:22:51.455393 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:51.455365    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-5jrhz_2baab41c-7646-411f-acbd-f0eb28f82489/kube-multus/0.log"
Jul 15 15:22:51.686574 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:51.686544    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cs6zp_9f578de8-ae1f-4aa2-a034-0e029991f7e0/kube-multus-additional-cni-plugins/0.log"
Jul 15 15:22:51.708478 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:51.708400    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cs6zp_9f578de8-ae1f-4aa2-a034-0e029991f7e0/egress-router-binary-copy/0.log"
Jul 15 15:22:51.730261 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:51.730232    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cs6zp_9f578de8-ae1f-4aa2-a034-0e029991f7e0/cni-plugins/0.log"
Jul 15 15:22:51.750662 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:51.750634    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cs6zp_9f578de8-ae1f-4aa2-a034-0e029991f7e0/bond-cni-plugin/0.log"
Jul 15 15:22:51.771562 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:51.771534    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cs6zp_9f578de8-ae1f-4aa2-a034-0e029991f7e0/routeoverride-cni/0.log"
Jul 15 15:22:51.792832 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:51.792809    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cs6zp_9f578de8-ae1f-4aa2-a034-0e029991f7e0/whereabouts-cni-bincopy/0.log"
Jul 15 15:22:51.815211 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:51.815189    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-cs6zp_9f578de8-ae1f-4aa2-a034-0e029991f7e0/whereabouts-cni/0.log"
Jul 15 15:22:52.145715 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:52.145686    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-g49wp_eff6ee84-dee0-429b-9edc-df30874ebd31/network-metrics-daemon/0.log"
Jul 15 15:22:52.165742 ip-10-0-140-61 kubenswrapper[2571]: I0715 15:22:52.165718    2571 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-g49wp_eff6ee84-dee0-429b-9edc-df30874ebd31/kube-rbac-proxy/0.log"