Jul 20 13:01:33.396759 ip-10-0-141-182 systemd[1]: Starting Kubernetes Kubelet...
Jul 20 13:01:33.941424 ip-10-0-141-182 systemd[1]: Started Kubernetes Kubelet.
Jul 20 13:01:34.007409 ip-10-0-141-182 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 13:01:34.007409 ip-10-0-141-182 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 20 13:01:34.007409 ip-10-0-141-182 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 13:01:34.007409 ip-10-0-141-182 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 20 13:01:34.007409 ip-10-0-141-182 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 20 13:01:34.007409 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.861594    2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 20 13:01:34.007409 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868750    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 13:01:34.007409 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868761    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 13:01:34.007409 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868765    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 13:01:34.007409 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868768    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 13:01:34.007409 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868772    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 13:01:34.007409 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868775    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 13:01:34.007409 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868778    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 13:01:34.007409 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868781    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 13:01:34.008971 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868784    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 13:01:34.008971 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868787    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 13:01:34.008971 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868790    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 13:01:34.008971 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868792    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 13:01:34.008971 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868795    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 13:01:34.008971 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868798    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 13:01:34.008971 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868800    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 13:01:34.008971 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868804    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 13:01:34.008971 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868806    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 13:01:34.008971 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868809    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 13:01:34.008971 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868811    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 13:01:34.008971 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868814    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 13:01:34.008971 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868817    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 13:01:34.008971 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868819    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 13:01:34.008971 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868823    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 13:01:34.008971 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868826    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 13:01:34.008971 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868829    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 13:01:34.008971 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868831    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 13:01:34.008971 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868834    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 13:01:34.008971 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868836    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 13:01:34.010050 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868846    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 13:01:34.010050 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868849    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 13:01:34.010050 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868852    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 13:01:34.010050 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868854    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 13:01:34.010050 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868857    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 13:01:34.010050 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868860    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 13:01:34.010050 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868862    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 13:01:34.010050 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868865    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 13:01:34.010050 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868867    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 13:01:34.010050 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868870    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 13:01:34.010050 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868872    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 13:01:34.010050 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868875    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 13:01:34.010050 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868878    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 13:01:34.010050 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868881    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 13:01:34.010050 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868884    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 13:01:34.010050 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868886    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 13:01:34.010050 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868889    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 13:01:34.010050 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868892    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 13:01:34.010050 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868896    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 13:01:34.011214 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868898    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 13:01:34.011214 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868901    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 13:01:34.011214 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868903    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 13:01:34.011214 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868906    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 13:01:34.011214 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868909    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 13:01:34.011214 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868912    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 13:01:34.011214 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868915    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 13:01:34.011214 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868917    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 13:01:34.011214 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868920    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 13:01:34.011214 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868922    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 13:01:34.011214 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868925    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 13:01:34.011214 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868927    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 13:01:34.011214 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868930    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 13:01:34.011214 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868932    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 13:01:34.011214 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868935    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 13:01:34.011214 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868939    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 13:01:34.011214 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868943    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 13:01:34.011214 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868947    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 13:01:34.011214 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868950    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 13:01:34.011214 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868953    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 13:01:34.012155 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868955    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 13:01:34.012155 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868958    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 13:01:34.012155 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868960    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 13:01:34.012155 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868963    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 13:01:34.012155 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868966    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 13:01:34.012155 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868968    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 13:01:34.012155 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868971    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 13:01:34.012155 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868974    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 13:01:34.012155 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868977    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 13:01:34.012155 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868979    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 13:01:34.012155 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868985    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 13:01:34.012155 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868989    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 13:01:34.012155 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868993    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 13:01:34.012155 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868996    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 13:01:34.012155 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.868999    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 13:01:34.012155 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869002    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 13:01:34.012155 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869004    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 13:01:34.012155 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869007    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 13:01:34.012155 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869011    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 13:01:34.013349 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869014    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 13:01:34.013349 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869017    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 13:01:34.013349 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869020    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 13:01:34.013349 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869022    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 13:01:34.013349 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869025    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 13:01:34.013349 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869027    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 13:01:34.013349 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869030    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 13:01:34.013349 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869032    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 13:01:34.013349 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869035    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 13:01:34.013349 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869037    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 13:01:34.013349 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869040    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 13:01:34.013349 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869043    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 13:01:34.013349 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869045    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 13:01:34.013349 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869782    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 13:01:34.013349 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869789    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 13:01:34.013349 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869792    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 13:01:34.013349 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869797    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 13:01:34.013349 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869801    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 13:01:34.013349 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869804    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 13:01:34.013349 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869808    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 13:01:34.014289 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869810    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 13:01:34.014289 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869813    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 13:01:34.014289 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869816    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 13:01:34.014289 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869818    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 13:01:34.014289 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869821    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 13:01:34.014289 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869825    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 13:01:34.014289 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869829    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 13:01:34.014289 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869833    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 13:01:34.014289 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869835    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 13:01:34.014289 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869838    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 13:01:34.014289 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869841    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 13:01:34.014289 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869843    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 13:01:34.014289 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869846    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 13:01:34.014289 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869849    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 13:01:34.014289 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869852    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 13:01:34.014289 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869854    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 13:01:34.014289 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869857    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 13:01:34.014289 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869859    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 13:01:34.014289 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869862    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 13:01:34.015247 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869864    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 13:01:34.015247 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869867    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 13:01:34.015247 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869869    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 13:01:34.015247 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869872    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 13:01:34.015247 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869875    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 13:01:34.015247 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869877    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 13:01:34.015247 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869880    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 13:01:34.015247 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869884    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 13:01:34.015247 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869886    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 13:01:34.015247 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869889    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 13:01:34.015247 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869892    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 13:01:34.015247 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869894    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 13:01:34.015247 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869897    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 13:01:34.015247 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869900    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 13:01:34.015247 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869902    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 13:01:34.015247 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869905    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 13:01:34.015247 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869907    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 13:01:34.015247 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869910    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 13:01:34.015247 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869913    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 13:01:34.015247 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869915    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 13:01:34.016205 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869918    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 13:01:34.016205 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869920    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 13:01:34.016205 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869923    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 13:01:34.016205 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869925    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 13:01:34.016205 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869927    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 13:01:34.016205 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869930    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 13:01:34.016205 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869933    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 13:01:34.016205 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869935    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 13:01:34.016205 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869938    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 13:01:34.016205 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869941    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 13:01:34.016205 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869943    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 13:01:34.016205 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869945    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 13:01:34.016205 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869948    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 13:01:34.016205 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869950    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 13:01:34.016205 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869953    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 13:01:34.016205 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869955    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 13:01:34.016205 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869958    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 13:01:34.016205 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869960    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 13:01:34.016205 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869964    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 13:01:34.016205 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869966    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 13:01:34.017390 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869969    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 13:01:34.017390 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869971    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 13:01:34.017390 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869973    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 13:01:34.017390 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869976    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 13:01:34.017390 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869979    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 13:01:34.017390 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869981    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 13:01:34.017390 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869984    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 13:01:34.017390 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869987    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 13:01:34.017390 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869989    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 13:01:34.017390 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869992    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 13:01:34.017390 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869994    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 13:01:34.017390 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.869999    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 13:01:34.017390 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870002    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 13:01:34.017390 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870006    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 13:01:34.017390 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870009    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 13:01:34.017390 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870011    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 13:01:34.017390 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870014    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 13:01:34.017390 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870017    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 13:01:34.017390 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870020    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 13:01:34.017390 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870023    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 13:01:34.018280 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870026    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 13:01:34.018280 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870029    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 13:01:34.018280 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870032    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 13:01:34.018280 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870035    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 13:01:34.018280 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870038    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 13:01:34.018280 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870041    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 13:01:34.018280 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870044    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 13:01:34.018280 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870046    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 13:01:34.018280 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870049    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 13:01:34.018280 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870052    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 13:01:34.018280 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870055    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 13:01:34.018280 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870058    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 13:01:34.018280 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870061    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 13:01:34.018280 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870455    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 13:01:34.018280 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870461    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 13:01:34.018280 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870465    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 13:01:34.018280 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870469    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 13:01:34.018280 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870473    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 13:01:34.018280 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870476    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 13:01:34.019214 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870479    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 13:01:34.019214 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870482    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 13:01:34.019214 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870485    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 13:01:34.019214 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870488    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 13:01:34.019214 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870491    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 13:01:34.019214 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870494    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 13:01:34.019214 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870497    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 13:01:34.019214 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870500    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 13:01:34.019214 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870503    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 13:01:34.019214 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870506    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 13:01:34.019214 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870510    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 13:01:34.019214 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870512    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 13:01:34.019214 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870515    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 13:01:34.019214 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870520    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 13:01:34.019214 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870523    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 13:01:34.019214 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870525    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 13:01:34.019214 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870528    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 13:01:34.019214 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870531    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 13:01:34.019214 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870534    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 13:01:34.020159 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870536    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 13:01:34.020159 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870539    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 13:01:34.020159 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870541    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 13:01:34.020159 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870544    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 13:01:34.020159 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870546    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 13:01:34.020159 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870549    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 13:01:34.020159 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870552    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 13:01:34.020159 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870554    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 13:01:34.020159 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870557    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 13:01:34.020159 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870559    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 13:01:34.020159 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870562    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 13:01:34.020159 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870564    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 13:01:34.020159 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870567    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 13:01:34.020159 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870569    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 13:01:34.020159 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870572    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 13:01:34.020159 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870574    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 13:01:34.020159 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870577    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 13:01:34.020159 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870579    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 13:01:34.020159 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870582    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 13:01:34.020159 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870584    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 13:01:34.021112 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870587    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 13:01:34.021112 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870590    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 13:01:34.021112 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870593    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 13:01:34.021112 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870596    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 13:01:34.021112 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870598    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 13:01:34.021112 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870600    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 13:01:34.021112 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870604    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 13:01:34.021112 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870607    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 13:01:34.021112 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870610    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 13:01:34.021112 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870612    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 13:01:34.021112 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870616    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 13:01:34.021112 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870620    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 13:01:34.021112 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870623    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 13:01:34.021112 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870625    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 13:01:34.021112 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870628    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 13:01:34.021112 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870630    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 13:01:34.021112 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870633    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 13:01:34.021112 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870635    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 13:01:34.021112 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870638    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 13:01:34.021112 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870641    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 13:01:34.022066 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870643    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 13:01:34.022066 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870647    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 13:01:34.022066 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870650    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 13:01:34.022066 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870653    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 13:01:34.022066 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870655    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 13:01:34.022066 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870658    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 13:01:34.022066 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870660    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 13:01:34.022066 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870663    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 13:01:34.022066 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870665    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 13:01:34.022066 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870668    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 13:01:34.022066 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870670    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 13:01:34.022066 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870674    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 13:01:34.022066 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870677    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 13:01:34.022066 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870680    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 13:01:34.022066 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870682    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 13:01:34.022066 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870685    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 13:01:34.022066 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870687    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 13:01:34.022066 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870691    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 13:01:34.022066 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870696    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 13:01:34.022066 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870699    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 13:01:34.022998 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870702    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 13:01:34.022998 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870704    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 13:01:34.022998 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870707    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 13:01:34.022998 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870709    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 13:01:34.022998 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870712    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 13:01:34.022998 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870714    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 13:01:34.022998 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870717    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 13:01:34.022998 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870719    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 13:01:34.022998 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870722    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 13:01:34.022998 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870724    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 13:01:34.022998 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870727    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 13:01:34.022998 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870729    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 13:01:34.022998 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870732    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 13:01:34.022998 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.870735    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 13:01:34.022998 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.870804    2565 flags.go:64] FLAG: --address="0.0.0.0"
Jul 20 13:01:34.022998 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.870813    2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 20 13:01:34.022998 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.870822    2565 flags.go:64] FLAG: --anonymous-auth="true"
Jul 20 13:01:34.022998 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.870828    2565 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 20 13:01:34.022998 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.870834    2565 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 20 13:01:34.022998 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.870839    2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 20 13:01:34.022998 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.870846    2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 20 13:01:34.023938 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.870852    2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 20 13:01:34.023938 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.870856    2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 20 13:01:34.023938 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.870859    2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 20 13:01:34.023938 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.870863    2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 20 13:01:34.023938 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.870866    2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 20 13:01:34.023938 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.870870    2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 20 13:01:34.023938 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.870873    2565 flags.go:64] FLAG: --cgroup-root=""
Jul 20 13:01:34.023938 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.870876    2565 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 20 13:01:34.023938 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.870879    2565 flags.go:64] FLAG: --client-ca-file=""
Jul 20 13:01:34.023938 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.870883    2565 flags.go:64] FLAG: --cloud-provider="external"
Jul 20 13:01:34.023938 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.870886    2565 flags.go:64] FLAG: --cluster-dns="[]"
Jul 20 13:01:34.023938 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.870891    2565 flags.go:64] FLAG: --cluster-domain=""
Jul 20 13:01:34.023938 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.870894    2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 20 13:01:34.023938 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.870897    2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 20 13:01:34.023938 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.870900    2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 20 13:01:34.023938 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.870904    2565 flags.go:64] FLAG: --container-log-max-files="5"
Jul 20 13:01:34.023938 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.870908    2565 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 20 13:01:34.023938 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.870911    2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 20 13:01:34.023938 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.870915    2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 20 13:01:34.023938 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.870918    2565 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 20 13:01:34.023938 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.870921    2565 flags.go:64] FLAG: --contention-profiling="false"
Jul 20 13:01:34.023938 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.870924    2565 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 20 13:01:34.023938 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.870927    2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 20 13:01:34.023938 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.870930    2565 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 20 13:01:34.025116 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.870934    2565 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 20 13:01:34.025116 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.870938    2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 20 13:01:34.025116 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.870941    2565 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 20 13:01:34.025116 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.870944    2565 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 20 13:01:34.025116 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.870947    2565 flags.go:64] FLAG: --enable-load-reader="false"
Jul 20 13:01:34.025116 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.870950    2565 flags.go:64] FLAG: --enable-server="true"
Jul 20 13:01:34.025116 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.870953    2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 20 13:01:34.025116 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.870957    2565 flags.go:64] FLAG: --event-burst="100"
Jul 20 13:01:34.025116 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.870960    2565 flags.go:64] FLAG: --event-qps="50"
Jul 20 13:01:34.025116 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.870963    2565 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 20 13:01:34.025116 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.870966    2565 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 20 13:01:34.025116 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.870970    2565 flags.go:64] FLAG: --eviction-hard=""
Jul 20 13:01:34.025116 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.870973    2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 20 13:01:34.025116 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.870976    2565 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 20 13:01:34.025116 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.870980    2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 20 13:01:34.025116 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.870982    2565 flags.go:64] FLAG: --eviction-soft=""
Jul 20 13:01:34.025116 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.870986    2565 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 20 13:01:34.025116 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.870991    2565 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 20 13:01:34.025116 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.870993    2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 20 13:01:34.025116 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.870996    2565 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 20 13:01:34.025116 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.870999    2565 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 20 13:01:34.025116 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871002    2565 flags.go:64] FLAG: --fail-swap-on="true"
Jul 20 13:01:34.025116 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871005    2565 flags.go:64] FLAG: --feature-gates=""
Jul 20 13:01:34.025116 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871009    2565 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 20 13:01:34.025116 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871012    2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 20 13:01:34.026303 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871015    2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 20 13:01:34.026303 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871018    2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 20 13:01:34.026303 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871021    2565 flags.go:64] FLAG: --healthz-port="10248"
Jul 20 13:01:34.026303 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871023    2565 flags.go:64] FLAG: --help="false"
Jul 20 13:01:34.026303 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871026    2565 flags.go:64] FLAG: --hostname-override="ip-10-0-141-182.ec2.internal"
Jul 20 13:01:34.026303 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871029    2565 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 20 13:01:34.026303 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871032    2565 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 20 13:01:34.026303 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871036    2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 20 13:01:34.026303 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871040    2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 20 13:01:34.026303 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871044    2565 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 20 13:01:34.026303 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871046    2565 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 20 13:01:34.026303 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871049    2565 flags.go:64] FLAG: --image-service-endpoint=""
Jul 20 13:01:34.026303 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871052    2565 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 20 13:01:34.026303 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871055    2565 flags.go:64] FLAG: --kube-api-burst="100"
Jul 20 13:01:34.026303 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871058    2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 20 13:01:34.026303 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871061    2565 flags.go:64] FLAG: --kube-api-qps="50"
Jul 20 13:01:34.026303 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871064    2565 flags.go:64] FLAG: --kube-reserved=""
Jul 20 13:01:34.026303 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871066    2565 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 20 13:01:34.026303 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871069    2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 20 13:01:34.026303 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871072    2565 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 20 13:01:34.026303 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871075    2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 20 13:01:34.026303 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871077    2565 flags.go:64] FLAG: --lock-file=""
Jul 20 13:01:34.026303 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871085    2565 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 20 13:01:34.026303 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871088    2565 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 20 13:01:34.027743 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871093    2565 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 20 13:01:34.027743 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871098    2565 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 20 13:01:34.027743 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871102    2565 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 20 13:01:34.027743 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871105    2565 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 20 13:01:34.027743 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871108    2565 flags.go:64] FLAG: --logging-format="text"
Jul 20 13:01:34.027743 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871111    2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 20 13:01:34.027743 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871114    2565 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 20 13:01:34.027743 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871116    2565 flags.go:64] FLAG: --manifest-url=""
Jul 20 13:01:34.027743 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871119    2565 flags.go:64] FLAG: --manifest-url-header=""
Jul 20 13:01:34.027743 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871124    2565 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 20 13:01:34.027743 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871127    2565 flags.go:64] FLAG: --max-open-files="1000000"
Jul 20 13:01:34.027743 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871131    2565 flags.go:64] FLAG: --max-pods="110"
Jul 20 13:01:34.027743 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871134    2565 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 20 13:01:34.027743 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871137    2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 20 13:01:34.027743 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871139    2565 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 20 13:01:34.027743 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871144    2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 20 13:01:34.027743 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871146    2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 20 13:01:34.027743 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871149    2565 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 20 13:01:34.027743 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871152    2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 20 13:01:34.027743 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871160    2565 flags.go:64] FLAG: --node-status-max-images="50"
Jul 20 13:01:34.027743 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871164    2565 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 20 13:01:34.027743 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871167    2565 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 20 13:01:34.027743 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871170    2565 flags.go:64] FLAG: --pod-cidr=""
Jul 20 13:01:34.031449 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871172    2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:4017e99d76d7b91598d3a3430cd0eba6eda8b33653addd3838fdfe3cca69c5a0"
Jul 20 13:01:34.031449 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871178    2565 flags.go:64] FLAG: --pod-manifest-path=""
Jul 20 13:01:34.031449 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871180    2565 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 20 13:01:34.031449 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871183    2565 flags.go:64] FLAG: --pods-per-core="0"
Jul 20 13:01:34.031449 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871186    2565 flags.go:64] FLAG: --port="10250"
Jul 20 13:01:34.031449 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871189    2565 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 20 13:01:34.031449 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871192    2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-016de7de9ce804322"
Jul 20 13:01:34.031449 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871196    2565 flags.go:64] FLAG: --qos-reserved=""
Jul 20 13:01:34.031449 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871199    2565 flags.go:64] FLAG: --read-only-port="10255"
Jul 20 13:01:34.031449 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871202    2565 flags.go:64] FLAG: --register-node="true"
Jul 20 13:01:34.031449 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871207    2565 flags.go:64] FLAG: --register-with-taints=""
Jul 20 13:01:34.031449 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871210    2565 flags.go:64] FLAG: --registry-burst="10"
Jul 20 13:01:34.031449 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871213    2565 flags.go:64] FLAG: --registry-qps="5"
Jul 20 13:01:34.031449 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871216    2565 flags.go:64] FLAG: --reserved-cpus=""
Jul 20 13:01:34.031449 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871219    2565 flags.go:64] FLAG: --reserved-memory=""
Jul 20 13:01:34.031449 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871222    2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 20 13:01:34.031449 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871225    2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 20 13:01:34.031449 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871229    2565 flags.go:64] FLAG: --rotate-certificates="false"
Jul 20 13:01:34.031449 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871231    2565 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 20 13:01:34.031449 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871234    2565 flags.go:64] FLAG: --runonce="false"
Jul 20 13:01:34.031449 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871237    2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 20 13:01:34.031449 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871240    2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 20 13:01:34.031449 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871243    2565 flags.go:64] FLAG: --seccomp-default="false"
Jul 20 13:01:34.031449 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871246    2565 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 20 13:01:34.031449 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871250    2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 20 13:01:34.032718 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871253    2565 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 20 13:01:34.032718 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871256    2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 20 13:01:34.032718 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871259    2565 flags.go:64] FLAG: --storage-driver-password="root"
Jul 20 13:01:34.032718 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871262    2565 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 20 13:01:34.032718 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871265    2565 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 20 13:01:34.032718 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871268    2565 flags.go:64] FLAG: --storage-driver-user="root"
Jul 20 13:01:34.032718 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871270    2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 20 13:01:34.032718 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871274    2565 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 20 13:01:34.032718 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871276    2565 flags.go:64] FLAG: --system-cgroups=""
Jul 20 13:01:34.032718 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871279    2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 20 13:01:34.032718 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871284    2565 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 20 13:01:34.032718 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871287    2565 flags.go:64] FLAG: --tls-cert-file=""
Jul 20 13:01:34.032718 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871290    2565 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 20 13:01:34.032718 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871294    2565 flags.go:64] FLAG: --tls-min-version=""
Jul 20 13:01:34.032718 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871297    2565 flags.go:64] FLAG: --tls-private-key-file=""
Jul 20 13:01:34.032718 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871300    2565 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 20 13:01:34.032718 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871303    2565 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 20 13:01:34.032718 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871308    2565 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 20 13:01:34.032718 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871311    2565 flags.go:64] FLAG: --v="2"
Jul 20 13:01:34.032718 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871315    2565 flags.go:64] FLAG: --version="false"
Jul 20 13:01:34.032718 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871320    2565 flags.go:64] FLAG: --vmodule=""
Jul 20 13:01:34.032718 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871324    2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 20 13:01:34.032718 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.871327    2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 20 13:01:34.032718 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871459    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 13:01:34.032718 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871465    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 13:01:34.217801 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871468    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 13:01:34.217801 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871470    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 13:01:34.217801 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871473    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 13:01:34.217801 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871476    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 13:01:34.217801 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871479    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 13:01:34.217801 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871482    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 13:01:34.217801 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871486    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 13:01:34.217801 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871489    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 13:01:34.217801 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871491    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 13:01:34.217801 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871496    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 13:01:34.217801 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871500    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 13:01:34.217801 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871503    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 13:01:34.217801 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871505    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 13:01:34.217801 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871508    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 13:01:34.217801 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871511    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 13:01:34.217801 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871514    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 13:01:34.217801 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871517    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 13:01:34.217801 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871520    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 13:01:34.217801 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871523    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 13:01:34.232853 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871525    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 13:01:34.232853 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871528    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 13:01:34.232853 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871531    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 13:01:34.232853 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871533    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 13:01:34.232853 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871536    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 13:01:34.232853 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871540    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 13:01:34.232853 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871543    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 13:01:34.232853 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871545    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 13:01:34.232853 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871548    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 13:01:34.232853 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871550    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 13:01:34.232853 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871553    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 13:01:34.232853 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871556    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 13:01:34.232853 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871558    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 13:01:34.232853 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871561    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 13:01:34.232853 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871563    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 13:01:34.232853 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871566    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 13:01:34.232853 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871568    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 13:01:34.232853 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871571    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 13:01:34.232853 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871574    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 13:01:34.232853 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871577    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 13:01:34.233595 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871580    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 13:01:34.233595 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871582    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 13:01:34.233595 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871585    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 13:01:34.233595 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871587    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 13:01:34.233595 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871590    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 13:01:34.233595 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871592    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 13:01:34.233595 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871595    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 13:01:34.233595 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871597    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 13:01:34.233595 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871600    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 13:01:34.233595 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871602    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 13:01:34.233595 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871605    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 13:01:34.233595 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871607    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 13:01:34.233595 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871610    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 13:01:34.233595 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871613    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 13:01:34.233595 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871615    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 13:01:34.233595 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871618    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 13:01:34.233595 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871620    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 13:01:34.233595 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871624    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 13:01:34.233595 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871627    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 13:01:34.233595 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871630    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 13:01:34.234276 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871632    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 13:01:34.234276 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871635    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 13:01:34.234276 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871637    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 13:01:34.234276 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871640    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 13:01:34.234276 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871642    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 13:01:34.234276 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871645    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 13:01:34.234276 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871648    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 13:01:34.234276 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871651    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 13:01:34.234276 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871655    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 13:01:34.234276 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871658    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 13:01:34.234276 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871661    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 13:01:34.234276 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871665    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 13:01:34.234276 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871668    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 13:01:34.234276 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871670    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 13:01:34.234276 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871673    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 13:01:34.234276 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871675    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 13:01:34.234276 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871678    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 13:01:34.234276 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871680    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 13:01:34.234276 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871683    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 13:01:34.234883 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871685    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 13:01:34.234883 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871688    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 13:01:34.234883 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871691    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 13:01:34.234883 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871693    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 13:01:34.234883 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871696    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 13:01:34.234883 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871699    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 13:01:34.234883 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871701    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 13:01:34.234883 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871704    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 13:01:34.234883 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871708    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 13:01:34.234883 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871711    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 13:01:34.234883 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871716    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 13:01:34.234883 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871719    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 13:01:34.234883 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871722    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 13:01:34.234883 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871725    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 13:01:34.234883 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871728    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 13:01:34.234883 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871731    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 13:01:34.234883 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871733    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 13:01:34.234883 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871736    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 13:01:34.234883 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.871738    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 13:01:34.235507 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.872448    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 13:01:34.235507 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.879274    2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 20 13:01:34.235507 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.879290    2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 20 13:01:34.235507 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.879306    2565 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 20 13:01:34.235507 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.879315    2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 20 13:01:34.235507 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879385    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 13:01:34.235507 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879391    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 13:01:34.235507 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879394    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 13:01:34.235507 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879397    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 13:01:34.235507 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879401    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 13:01:34.235507 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879403    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 13:01:34.235507 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879406    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 13:01:34.235507 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879409    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 13:01:34.235507 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879412    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 13:01:34.235507 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879415    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 13:01:34.236014 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879418    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 13:01:34.236014 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879420    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 13:01:34.236014 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879423    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 13:01:34.236014 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879426    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 13:01:34.236014 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879428    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 13:01:34.236014 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879431    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 13:01:34.236014 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879434    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 13:01:34.236014 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879437    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 13:01:34.236014 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879440    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 13:01:34.236014 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879443    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 13:01:34.236014 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879446    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 13:01:34.236014 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879449    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 13:01:34.236014 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879451    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 13:01:34.236014 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879453    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 13:01:34.236014 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879456    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 13:01:34.236014 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879459    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 13:01:34.236014 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879462    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 13:01:34.236014 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879465    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 13:01:34.236014 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879467    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 13:01:34.236014 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879470    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 13:01:34.236687 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879473    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 13:01:34.236687 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879476    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 13:01:34.236687 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879479    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 13:01:34.236687 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879481    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 13:01:34.236687 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879484    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 13:01:34.236687 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879487    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 13:01:34.236687 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879490    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 13:01:34.236687 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879492    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 13:01:34.236687 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879495    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 13:01:34.236687 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879499    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 13:01:34.236687 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879502    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 13:01:34.236687 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879505    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 13:01:34.236687 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879508    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 13:01:34.236687 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879510    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 13:01:34.236687 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879513    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 13:01:34.236687 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879515    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 13:01:34.236687 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879518    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 13:01:34.236687 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879521    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 13:01:34.236687 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879523    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 13:01:34.236687 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879526    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 13:01:34.237276 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879528    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 13:01:34.237276 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879531    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 13:01:34.237276 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879534    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 13:01:34.237276 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879537    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 13:01:34.237276 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879539    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 13:01:34.237276 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879542    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 13:01:34.237276 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879544    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 13:01:34.237276 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879547    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 13:01:34.237276 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879550    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 13:01:34.237276 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879552    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 13:01:34.237276 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879555    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 13:01:34.237276 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879557    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 13:01:34.237276 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879560    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 13:01:34.237276 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879563    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 13:01:34.237276 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879565    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 13:01:34.237276 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879568    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 13:01:34.237276 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879571    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 13:01:34.237276 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879574    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 13:01:34.237276 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879577    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 13:01:34.237916 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879579    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 13:01:34.237916 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879582    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 13:01:34.237916 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879585    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 13:01:34.237916 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879588    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 13:01:34.237916 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879592    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 13:01:34.237916 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879596    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 13:01:34.237916 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879598    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 13:01:34.237916 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879601    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 13:01:34.237916 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879604    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 13:01:34.237916 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879606    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 13:01:34.237916 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879609    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 13:01:34.237916 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879612    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 13:01:34.237916 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879614    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 13:01:34.237916 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879617    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 13:01:34.237916 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879619    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 13:01:34.237916 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879622    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 13:01:34.237916 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879624    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 13:01:34.237916 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879627    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 13:01:34.237916 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879630    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 13:01:34.238502 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879633    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 13:01:34.238502 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879636    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 13:01:34.238502 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879639    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 13:01:34.238502 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879641    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 13:01:34.238502 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879644    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 13:01:34.238502 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879648    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 13:01:34.238502 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879652    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 13:01:34.238502 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879655    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 13:01:34.238502 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879658    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 13:01:34.238502 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879661    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 13:01:34.238502 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879678    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 13:01:34.238502 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.879684    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 13:01:34.238502 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879799    2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 20 13:01:34.238502 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879803    2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 20 13:01:34.238981 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879806    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 20 13:01:34.238981 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879809    2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 20 13:01:34.238981 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879812    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 20 13:01:34.238981 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879815    2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 20 13:01:34.238981 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879818    2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 20 13:01:34.238981 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879821    2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 20 13:01:34.238981 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879823    2565 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 20 13:01:34.238981 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879826    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 20 13:01:34.238981 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879828    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 20 13:01:34.238981 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879831    2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 20 13:01:34.238981 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879835    2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 20 13:01:34.238981 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879839    2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 20 13:01:34.238981 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879842    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 20 13:01:34.238981 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879845    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 20 13:01:34.238981 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879850    2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 20 13:01:34.238981 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879854    2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 20 13:01:34.238981 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879858    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 20 13:01:34.238981 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879862    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 20 13:01:34.238981 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879864    2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 20 13:01:34.239560 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879867    2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 20 13:01:34.239560 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879870    2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 20 13:01:34.239560 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879872    2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 20 13:01:34.239560 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879875    2565 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 20 13:01:34.239560 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879877    2565 feature_gate.go:328] unrecognized feature gate: Example
Jul 20 13:01:34.239560 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879881    2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 20 13:01:34.239560 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879884    2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 20 13:01:34.239560 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879887    2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 20 13:01:34.239560 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879889    2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 20 13:01:34.239560 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879892    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 20 13:01:34.239560 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879895    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 20 13:01:34.239560 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879897    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 20 13:01:34.239560 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879900    2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 20 13:01:34.239560 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879902    2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 20 13:01:34.239560 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879905    2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 20 13:01:34.239560 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879908    2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 20 13:01:34.239560 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879910    2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 20 13:01:34.239560 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879913    2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 20 13:01:34.239560 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879915    2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 20 13:01:34.239560 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879918    2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 20 13:01:34.240182 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879920    2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 20 13:01:34.240182 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879922    2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 20 13:01:34.240182 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879925    2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 20 13:01:34.240182 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879927    2565 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 20 13:01:34.240182 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879930    2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 20 13:01:34.240182 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879932    2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 20 13:01:34.240182 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879935    2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 20 13:01:34.240182 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879938    2565 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 20 13:01:34.240182 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879941    2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 20 13:01:34.240182 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879943    2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 20 13:01:34.240182 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879946    2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 20 13:01:34.240182 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879949    2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 20 13:01:34.240182 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879952    2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 20 13:01:34.240182 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879954    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 20 13:01:34.240182 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879957    2565 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 20 13:01:34.240182 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879959    2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 20 13:01:34.240182 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879962    2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 20 13:01:34.240182 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879967    2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 20 13:01:34.240182 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879969    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 20 13:01:34.240182 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879972    2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 20 13:01:34.240790 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879975    2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 20 13:01:34.240790 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879977    2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 20 13:01:34.240790 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879979    2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 20 13:01:34.240790 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879982    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 20 13:01:34.240790 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879984    2565 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 20 13:01:34.240790 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879987    2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 20 13:01:34.240790 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879989    2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 20 13:01:34.240790 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879992    2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 20 13:01:34.240790 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879994    2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 20 13:01:34.240790 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.879997    2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 20 13:01:34.240790 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.880000    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 20 13:01:34.240790 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.880002    2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 20 13:01:34.240790 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.880005    2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 20 13:01:34.240790 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.880007    2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 20 13:01:34.240790 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.880010    2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 20 13:01:34.240790 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.880012    2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 20 13:01:34.240790 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.880015    2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 20 13:01:34.240790 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.880017    2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 20 13:01:34.240790 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.880020    2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 20 13:01:34.240790 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.880026    2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 20 13:01:34.241414 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.880028    2565 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 20 13:01:34.241414 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.880031    2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 20 13:01:34.241414 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.880033    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 20 13:01:34.241414 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.880036    2565 feature_gate.go:328] unrecognized feature gate: Example2
Jul 20 13:01:34.241414 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.880039    2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 20 13:01:34.241414 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.880041    2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 20 13:01:34.241414 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.880044    2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 20 13:01:34.241414 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.880047    2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 20 13:01:34.241414 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.880050    2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 20 13:01:34.241414 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.880054    2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 20 13:01:34.241414 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.880057    2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 20 13:01:34.241414 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.880060    2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 20 13:01:34.241414 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.880063    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 20 13:01:34.241414 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.880065    2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 20 13:01:34.241414 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.880068    2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 20 13:01:34.241414 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.880071    2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 20 13:01:34.241414 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.880074    2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 20 13:01:34.241414 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:33.880076    2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 20 13:01:34.242015 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.880081    2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 20 13:01:34.242015 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.880184    2565 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 20 13:01:34.242015 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.882483    2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 20 13:01:34.242015 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.885461    2565 server.go:1019] "Starting client certificate rotation"
Jul 20 13:01:34.242015 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.885557    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 20 13:01:34.242015 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.885605    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 20 13:01:34.242015 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.887999    2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 20 13:01:34.242015 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.889206    2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 20 13:01:34.242015 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.902300    2565 log.go:25] "Validated CRI v1 runtime API"
Jul 20 13:01:34.242015 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.905071    2565 log.go:25] "Validated CRI v1 image API"
Jul 20 13:01:34.242015 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.908207    2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 20 13:01:34.242015 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.910638    2565 fs.go:135] Filesystem UUIDs: map[5e718d5e-87fa-4540-bc9e-e66e0c8bb6fe:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 7de1505a-dc45-4cd5-b55b-8c0d38038029:/dev/nvme0n1p4]
Jul 20 13:01:34.242467 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.910656    2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 20 13:01:34.242545 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.918799    2565 manager.go:216] Machine: {Timestamp:2026-07-20 13:01:33.918283623 +0000 UTC m=+0.387815748 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3155838 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23140e70051db863758fa686db3d57 SystemUUID:ec23140e-7005-1db8-6375-8fa686db3d57 BootID:4cb8bb4d-0d6c-4416-acdb-617fd10f95ae Filesystems:[{Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:fc:76:13:70:e3 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:fc:76:13:70:e3 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:52:e5:3e:20:3c:95 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 20 13:01:34.242545 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.918905    2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 20 13:01:34.242545 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.919012    2565 manager.go:232] Version: {KernelVersion:5.14.0-570.128.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260715-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 20 13:01:34.242545 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.922270    2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 20 13:01:34.242545 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.922300    2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-141-182.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 20 13:01:34.242545 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.923644    2565 topology_manager.go:138] "Creating topology manager with none policy"
Jul 20 13:01:34.242545 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.923655    2565 container_manager_linux.go:309] "Creating device plugin manager"
Jul 20 13:01:34.242545 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.923664    2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 20 13:01:34.242888 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.924481    2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 20 13:01:34.242888 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.925635    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 20 13:01:34.242888 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.926105    2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 20 13:01:34.242888 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.928885    2565 state_mem.go:36] "Initialized new in-memory state store"
Jul 20 13:01:34.242888 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.929005    2565 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 20 13:01:34.242888 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.929037    2565 kubelet.go:486] "Attempting to sync node with API server"
Jul 20 13:01:34.242888 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.929052    2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 20 13:01:34.242888 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.929064    2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 20 13:01:34.242888 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.929073    2565 kubelet.go:398] "Adding apiserver pod source"
Jul 20 13:01:34.242888 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.929083    2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 20 13:01:34.242888 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.929454    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 20 13:01:34.242888 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.929472    2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 20 13:01:34.242888 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.931741    2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 20 13:01:34.242888 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.933642    2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 20 13:01:34.242888 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.933671    2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 20 13:01:34.242888 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.936173    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 20 13:01:34.242888 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.936191    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 20 13:01:34.242888 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.936198    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 20 13:01:34.242888 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.936207    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 20 13:01:34.242888 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.936217    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 20 13:01:34.242888 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.936223    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 20 13:01:34.242888 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.936232    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 20 13:01:34.242888 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.936238    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 20 13:01:34.242888 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.936244    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 20 13:01:34.242888 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.936250    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 20 13:01:34.242888 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.936267    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 20 13:01:34.242888 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.936272    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 20 13:01:34.242888 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:33.936826    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-141-182.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 20 13:01:34.242888 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:33.936853    2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 20 13:01:34.242888 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.937165    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 20 13:01:34.242888 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.937176    2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 20 13:01:34.242888 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.940406    2565 server.go:1268] "Started kubelet"
Jul 20 13:01:34.242888 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.940492    2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 20 13:01:34.242888 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.940577    2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-141-182.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 20 13:01:34.242888 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.940687    2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 20 13:01:34.242888 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.941178    2565 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 20 13:01:34.242888 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.942689    2565 server.go:310] "Adding debug handlers to kubelet server"
Jul 20 13:01:34.242888 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.942778    2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 20 13:01:34.242888 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.942869    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8tvtb"
Jul 20 13:01:34.436208 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.949976    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-8tvtb"
Jul 20 13:01:34.436208 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:33.950451    2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-141-182.ec2.internal.18c40109cc5a8b7e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-141-182.ec2.internal,UID:ip-10-0-141-182.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-141-182.ec2.internal,},FirstTimestamp:2026-07-20 13:01:33.940378494 +0000 UTC m=+0.409910613,LastTimestamp:2026-07-20 13:01:33.940378494 +0000 UTC m=+0.409910613,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-141-182.ec2.internal,}"
Jul 20 13:01:34.436208 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.951471    2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 20 13:01:34.436208 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.951489    2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 20 13:01:34.436208 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:33.951605    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-182.ec2.internal\" not found"
Jul 20 13:01:34.436208 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.952037    2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 20 13:01:34.436208 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.952038    2565 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 20 13:01:34.436208 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.952066    2565 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 20 13:01:34.436208 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.952155    2565 reconstruct.go:97] "Volume reconstruction finished"
Jul 20 13:01:34.436208 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.952163    2565 reconciler.go:29] "Reconciler: start to sync state"
Jul 20 13:01:34.436208 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:33.955764    2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 20 13:01:34.436208 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.956086    2565 factory.go:55] Registering systemd factory
Jul 20 13:01:34.436208 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.956101    2565 factory.go:223] Registration of the systemd container factory successfully
Jul 20 13:01:34.436208 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.956332    2565 factory.go:153] Registering CRI-O factory
Jul 20 13:01:34.436208 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.956348    2565 factory.go:223] Registration of the crio container factory successfully
Jul 20 13:01:34.436208 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.956411    2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 20 13:01:34.436208 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.956429    2565 factory.go:103] Registering Raw factory
Jul 20 13:01:34.436208 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.956440    2565 manager.go:1196] Started watching for new ooms in manager
Jul 20 13:01:34.436208 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.956876    2565 manager.go:349] Starting recovery of all containers
Jul 20 13:01:34.436208 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.961121    2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 13:01:34.436208 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:33.964364    2565 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-141-182.ec2.internal\" not found" node="ip-10-0-141-182.ec2.internal"
Jul 20 13:01:34.436208 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.968079    2565 manager.go:354] Recovery completed
Jul 20 13:01:34.436208 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.972897    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 13:01:34.436208 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.975119    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-182.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 13:01:34.436208 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.975153    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-182.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 13:01:34.436208 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.975164    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-182.ec2.internal" event="NodeHasSufficientPID"
Jul 20 13:01:34.436208 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.975699    2565 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 20 13:01:34.436208 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.975713    2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 20 13:01:34.436208 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.975733    2565 state_mem.go:36] "Initialized new in-memory state store"
Jul 20 13:01:34.436208 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.975747    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 13:01:34.436208 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.976906    2565 policy_none.go:49] "None policy: Start"
Jul 20 13:01:34.436208 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.976921    2565 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 20 13:01:34.436208 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.976935    2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 20 13:01:34.436208 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.976955    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-182.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 13:01:34.436208 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.976992    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-182.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 13:01:34.437944 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.977011    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-182.ec2.internal" event="NodeHasSufficientPID"
Jul 20 13:01:34.437944 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:33.977959    2565 policy_none.go:47] "Start"
Jul 20 13:01:34.437944 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:34.051785    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-182.ec2.internal\" not found"
Jul 20 13:01:34.437944 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:34.076030    2565 manager.go:337] "Starting Device Plugin manager"
Jul 20 13:01:34.437944 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:34.076070    2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 20 13:01:34.437944 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:34.076081    2565 server.go:87] "Starting device plugin registration server"
Jul 20 13:01:34.437944 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:34.076381    2565 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 20 13:01:34.437944 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:34.076393    2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 20 13:01:34.437944 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:34.076590    2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 20 13:01:34.437944 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:34.076667    2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 20 13:01:34.437944 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:34.076677    2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 20 13:01:34.437944 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:34.077198    2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 20 13:01:34.437944 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:34.077243    2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-141-182.ec2.internal\" not found"
Jul 20 13:01:34.437944 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:34.139355    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 20 13:01:34.437944 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:34.140698    2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 20 13:01:34.437944 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:34.140740    2565 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 20 13:01:34.437944 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:34.140766    2565 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 20 13:01:34.437944 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:34.140818    2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 20 13:01:34.437944 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:34.143149    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 13:01:34.437944 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:34.176534    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 13:01:34.437944 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:34.177391    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-182.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 13:01:34.437944 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:34.177426    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-182.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 13:01:34.437944 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:34.177440    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-182.ec2.internal" event="NodeHasSufficientPID"
Jul 20 13:01:34.437944 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:34.177465    2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-141-182.ec2.internal"
Jul 20 13:01:34.437944 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:34.190060    2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-141-182.ec2.internal"
Jul 20 13:01:34.437944 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:34.190079    2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-141-182.ec2.internal\": node \"ip-10-0-141-182.ec2.internal\" not found"
Jul 20 13:01:34.437944 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:34.206843    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-182.ec2.internal\" not found"
Jul 20 13:01:34.437944 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:34.243185    2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-182.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-141-182.ec2.internal"]
Jul 20 13:01:34.437944 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:34.244046    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 13:01:34.437944 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:34.245377    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-182.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 13:01:34.437944 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:34.245413    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-182.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 13:01:34.437944 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:34.245436    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-182.ec2.internal" event="NodeHasSufficientPID"
Jul 20 13:01:34.437944 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:34.246887    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 13:01:34.437944 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:34.246980    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-182.ec2.internal"
Jul 20 13:01:34.437944 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:34.247020    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 13:01:34.437944 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:34.248335    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-182.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 13:01:34.437944 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:34.248469    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-182.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 13:01:34.440001 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:34.248480    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-182.ec2.internal" event="NodeHasSufficientPID"
Jul 20 13:01:34.440001 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:34.248771    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-182.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 13:01:34.440001 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:34.248793    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-182.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 13:01:34.440001 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:34.248803    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-182.ec2.internal" event="NodeHasSufficientPID"
Jul 20 13:01:34.440001 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:34.250388    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-182.ec2.internal"
Jul 20 13:01:34.440001 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:34.250413    2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 20 13:01:34.440001 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:34.251969    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-182.ec2.internal" event="NodeHasSufficientMemory"
Jul 20 13:01:34.440001 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:34.251991    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-182.ec2.internal" event="NodeHasNoDiskPressure"
Jul 20 13:01:34.440001 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:34.252005    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-182.ec2.internal" event="NodeHasSufficientPID"
Jul 20 13:01:34.440001 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:34.253379    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3cbdd8dc17b46b583decda50ce1bde1d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-182.ec2.internal\" (UID: \"3cbdd8dc17b46b583decda50ce1bde1d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-182.ec2.internal"
Jul 20 13:01:34.440001 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:34.253424    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3cbdd8dc17b46b583decda50ce1bde1d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-182.ec2.internal\" (UID: \"3cbdd8dc17b46b583decda50ce1bde1d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-182.ec2.internal"
Jul 20 13:01:34.440001 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:34.253456    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b9336d48ae54902b2478c38cf3608a5e-config\") pod \"kube-apiserver-proxy-ip-10-0-141-182.ec2.internal\" (UID: \"b9336d48ae54902b2478c38cf3608a5e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-182.ec2.internal"
Jul 20 13:01:34.440001 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:34.279216    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-182.ec2.internal\" not found" node="ip-10-0-141-182.ec2.internal"
Jul 20 13:01:34.440001 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:34.284021    2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-141-182.ec2.internal\" not found" node="ip-10-0-141-182.ec2.internal"
Jul 20 13:01:34.440001 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:34.307968    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-182.ec2.internal\" not found"
Jul 20 13:01:34.440001 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:34.354153    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3cbdd8dc17b46b583decda50ce1bde1d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-182.ec2.internal\" (UID: \"3cbdd8dc17b46b583decda50ce1bde1d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-182.ec2.internal"
Jul 20 13:01:34.440001 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:34.354193    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3cbdd8dc17b46b583decda50ce1bde1d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-182.ec2.internal\" (UID: \"3cbdd8dc17b46b583decda50ce1bde1d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-182.ec2.internal"
Jul 20 13:01:34.440001 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:34.354212    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b9336d48ae54902b2478c38cf3608a5e-config\") pod \"kube-apiserver-proxy-ip-10-0-141-182.ec2.internal\" (UID: \"b9336d48ae54902b2478c38cf3608a5e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-182.ec2.internal"
Jul 20 13:01:34.440001 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:34.354258    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b9336d48ae54902b2478c38cf3608a5e-config\") pod \"kube-apiserver-proxy-ip-10-0-141-182.ec2.internal\" (UID: \"b9336d48ae54902b2478c38cf3608a5e\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-141-182.ec2.internal"
Jul 20 13:01:34.440001 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:34.354257    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/3cbdd8dc17b46b583decda50ce1bde1d-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-141-182.ec2.internal\" (UID: \"3cbdd8dc17b46b583decda50ce1bde1d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-182.ec2.internal"
Jul 20 13:01:34.440692 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:34.354260    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3cbdd8dc17b46b583decda50ce1bde1d-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-141-182.ec2.internal\" (UID: \"3cbdd8dc17b46b583decda50ce1bde1d\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-182.ec2.internal"
Jul 20 13:01:34.440692 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:34.408897    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-182.ec2.internal\" not found"
Jul 20 13:01:34.612673 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:34.513316    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-182.ec2.internal\" not found"
Jul 20 13:01:34.612673 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:34.583118    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-182.ec2.internal"
Jul 20 13:01:34.612673 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:34.587213    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-182.ec2.internal"
Jul 20 13:01:34.613921 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:34.613473    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-182.ec2.internal\" not found"
Jul 20 13:01:34.817617 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:34.717700    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-182.ec2.internal\" not found"
Jul 20 13:01:34.818266 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:34.818107    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-182.ec2.internal\" not found"
Jul 20 13:01:35.009175 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:34.845044    2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 13:01:35.009175 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:34.882769    2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 20 13:01:35.009175 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:34.882915    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 20 13:01:35.009175 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:34.882951    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 20 13:01:35.009175 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:34.882969    2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 20 13:01:35.009175 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:34.920517    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-182.ec2.internal\" not found"
Jul 20 13:01:35.009175 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:34.954293    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-19 12:56:34 +0000 UTC" deadline="2028-03-25 15:48:00.467397546 +0000 UTC"
Jul 20 13:01:35.009175 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:34.954316    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14738h46m25.51308402s"
Jul 20 13:01:35.164647 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:35.020726    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-182.ec2.internal\" not found"
Jul 20 13:01:35.164647 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:35.121124    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-182.ec2.internal\" not found"
Jul 20 13:01:35.291259 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:35.221241    2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-141-182.ec2.internal\" not found"
Jul 20 13:01:35.291259 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:35.247629    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3cbdd8dc17b46b583decda50ce1bde1d.slice/crio-e34c5750773cc67829d6a6900ebd544836e4d34d9fab36c83a48118465a58c59 WatchSource:0}: Error finding container e34c5750773cc67829d6a6900ebd544836e4d34d9fab36c83a48118465a58c59: Status 404 returned error can't find the container with id e34c5750773cc67829d6a6900ebd544836e4d34d9fab36c83a48118465a58c59
Jul 20 13:01:35.291259 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:35.248100    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9336d48ae54902b2478c38cf3608a5e.slice/crio-be717479ae65533f79bd29d4e1accff3cdf99c2a5e333032ff247e2de8ec0f53 WatchSource:0}: Error finding container be717479ae65533f79bd29d4e1accff3cdf99c2a5e333032ff247e2de8ec0f53: Status 404 returned error can't find the container with id be717479ae65533f79bd29d4e1accff3cdf99c2a5e333032ff247e2de8ec0f53
Jul 20 13:01:35.291259 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.254104    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 13:01:35.463869 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.311517    2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 13:01:35.463869 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.353061    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-182.ec2.internal"
Jul 20 13:01:35.463869 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.365672    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 20 13:01:35.463869 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.367197    2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-182.ec2.internal"
Jul 20 13:01:35.463869 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.377128    2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 20 13:01:35.960648 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.814734    2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 13:01:35.960648 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.931272    2565 apiserver.go:52] "Watching apiserver"
Jul 20 13:01:35.960648 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.943862    2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 20 13:01:35.960648 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.944425    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-tbfs8","kube-system/konnectivity-agent-7mhbt","kube-system/kube-apiserver-proxy-ip-10-0-141-182.ec2.internal","openshift-multus/multus-additional-cni-plugins-g47kp","openshift-network-diagnostics/network-check-target-8vjqm","openshift-network-operator/iptables-alerter-s8tlk","openshift-ovn-kubernetes/ovnkube-node-w6z5r","kube-system/global-pull-secret-syncer-bjz6v","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkb7v","openshift-cluster-node-tuning-operator/tuned-nhsgz","openshift-dns/node-resolver-lsrxw","openshift-image-registry/node-ca-dcnn2","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-182.ec2.internal","openshift-multus/multus-rlmj7"]
Jul 20 13:01:35.960648 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.947222    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r"
Jul 20 13:01:35.960648 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.950896    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 20 13:01:35.960648 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.950915    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lsrxw"
Jul 20 13:01:35.960648 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.950954    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 20 13:01:35.960648 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.951676    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 20 13:01:35.960648 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.951805    2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 20 13:01:35.960648 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.952610    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-xxmq2\""
Jul 20 13:01:35.960648 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.952611    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 20 13:01:35.960648 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.953357    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rlmj7"
Jul 20 13:01:35.960648 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.955018    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-mp8gl\""
Jul 20 13:01:35.960648 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.955517    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 20 13:01:35.960648 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.956243    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 20 13:01:35.960648 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.956550    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 20 13:01:35.960648 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.956574    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 20 13:01:35.960648 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.956760    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 20 13:01:35.960648 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.958302    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 20 13:01:35.960648 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.958554    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 20 13:01:35.960648 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.958623    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 20 13:01:35.960648 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.960443    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-g47kp"
Jul 20 13:01:36.048042 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.984032    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f0284f8d-ac61-43c0-9502-6b0b8e61d7ac-log-socket\") pod \"ovnkube-node-w6z5r\" (UID: \"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r"
Jul 20 13:01:36.048042 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.984066    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0284f8d-ac61-43c0-9502-6b0b8e61d7ac-host-kubelet\") pod \"ovnkube-node-w6z5r\" (UID: \"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r"
Jul 20 13:01:36.048042 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.984092    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f0284f8d-ac61-43c0-9502-6b0b8e61d7ac-systemd-units\") pod \"ovnkube-node-w6z5r\" (UID: \"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r"
Jul 20 13:01:36.048042 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.984117    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f0284f8d-ac61-43c0-9502-6b0b8e61d7ac-var-lib-openvswitch\") pod \"ovnkube-node-w6z5r\" (UID: \"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r"
Jul 20 13:01:36.048042 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.984142    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f0284f8d-ac61-43c0-9502-6b0b8e61d7ac-run-openvswitch\") pod \"ovnkube-node-w6z5r\" (UID: \"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r"
Jul 20 13:01:36.048042 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.984156    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-7qrsr\""
Jul 20 13:01:36.048042 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.984164    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f0284f8d-ac61-43c0-9502-6b0b8e61d7ac-host-cni-bin\") pod \"ovnkube-node-w6z5r\" (UID: \"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r"
Jul 20 13:01:36.048042 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.984210    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/002d1aca-ffaa-4461-8906-6816cdfe6274-multus-socket-dir-parent\") pod \"multus-rlmj7\" (UID: \"002d1aca-ffaa-4461-8906-6816cdfe6274\") " pod="openshift-multus/multus-rlmj7"
Jul 20 13:01:36.048042 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.984235    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0284f8d-ac61-43c0-9502-6b0b8e61d7ac-host-run-ovn-kubernetes\") pod \"ovnkube-node-w6z5r\" (UID: \"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r"
Jul 20 13:01:36.048042 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.984261    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0284f8d-ac61-43c0-9502-6b0b8e61d7ac-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-w6z5r\" (UID: \"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r"
Jul 20 13:01:36.048042 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.984284    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f0284f8d-ac61-43c0-9502-6b0b8e61d7ac-ovnkube-config\") pod \"ovnkube-node-w6z5r\" (UID: \"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r"
Jul 20 13:01:36.048042 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.984305    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f0284f8d-ac61-43c0-9502-6b0b8e61d7ac-env-overrides\") pod \"ovnkube-node-w6z5r\" (UID: \"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r"
Jul 20 13:01:36.048042 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.984374    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/002d1aca-ffaa-4461-8906-6816cdfe6274-multus-cni-dir\") pod \"multus-rlmj7\" (UID: \"002d1aca-ffaa-4461-8906-6816cdfe6274\") " pod="openshift-multus/multus-rlmj7"
Jul 20 13:01:36.048042 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.984411    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/002d1aca-ffaa-4461-8906-6816cdfe6274-os-release\") pod \"multus-rlmj7\" (UID: \"002d1aca-ffaa-4461-8906-6816cdfe6274\") " pod="openshift-multus/multus-rlmj7"
Jul 20 13:01:36.049926 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.984454    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/002d1aca-ffaa-4461-8906-6816cdfe6274-host-var-lib-kubelet\") pod \"multus-rlmj7\" (UID: \"002d1aca-ffaa-4461-8906-6816cdfe6274\") " pod="openshift-multus/multus-rlmj7"
Jul 20 13:01:36.049926 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.984490    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f0284f8d-ac61-43c0-9502-6b0b8e61d7ac-run-systemd\") pod \"ovnkube-node-w6z5r\" (UID: \"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r"
Jul 20 13:01:36.049926 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.984516    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/002d1aca-ffaa-4461-8906-6816cdfe6274-cni-binary-copy\") pod \"multus-rlmj7\" (UID: \"002d1aca-ffaa-4461-8906-6816cdfe6274\") " pod="openshift-multus/multus-rlmj7"
Jul 20 13:01:36.049926 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.984539    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/002d1aca-ffaa-4461-8906-6816cdfe6274-hostroot\") pod \"multus-rlmj7\" (UID: \"002d1aca-ffaa-4461-8906-6816cdfe6274\") " pod="openshift-multus/multus-rlmj7"
Jul 20 13:01:36.049926 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.984564    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f0284f8d-ac61-43c0-9502-6b0b8e61d7ac-host-run-netns\") pod \"ovnkube-node-w6z5r\" (UID: \"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r"
Jul 20 13:01:36.049926 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.984588    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f0284f8d-ac61-43c0-9502-6b0b8e61d7ac-node-log\") pod \"ovnkube-node-w6z5r\" (UID: \"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r"
Jul 20 13:01:36.049926 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.984613    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf9a432f-9b17-467c-826d-50f1ce4cfd7c-tmp-dir\") pod \"node-resolver-lsrxw\" (UID: \"bf9a432f-9b17-467c-826d-50f1ce4cfd7c\") " pod="openshift-dns/node-resolver-lsrxw"
Jul 20 13:01:36.049926 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.984653    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/002d1aca-ffaa-4461-8906-6816cdfe6274-host-run-multus-certs\") pod \"multus-rlmj7\" (UID: \"002d1aca-ffaa-4461-8906-6816cdfe6274\") " pod="openshift-multus/multus-rlmj7"
Jul 20 13:01:36.049926 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.984679    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/002d1aca-ffaa-4461-8906-6816cdfe6274-etc-kubernetes\") pod \"multus-rlmj7\" (UID: \"002d1aca-ffaa-4461-8906-6816cdfe6274\") " pod="openshift-multus/multus-rlmj7"
Jul 20 13:01:36.049926 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.984702    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f0284f8d-ac61-43c0-9502-6b0b8e61d7ac-ovnkube-script-lib\") pod \"ovnkube-node-w6z5r\" (UID: \"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r"
Jul 20 13:01:36.049926 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.984726    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bf9a432f-9b17-467c-826d-50f1ce4cfd7c-hosts-file\") pod \"node-resolver-lsrxw\" (UID: \"bf9a432f-9b17-467c-826d-50f1ce4cfd7c\") " pod="openshift-dns/node-resolver-lsrxw"
Jul 20 13:01:36.049926 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.984749    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f0284f8d-ac61-43c0-9502-6b0b8e61d7ac-host-slash\") pod \"ovnkube-node-w6z5r\" (UID: \"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r"
Jul 20 13:01:36.049926 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.984774    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f0284f8d-ac61-43c0-9502-6b0b8e61d7ac-run-ovn\") pod \"ovnkube-node-w6z5r\" (UID: \"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r"
Jul 20 13:01:36.049926 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.984800    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f0284f8d-ac61-43c0-9502-6b0b8e61d7ac-ovn-node-metrics-cert\") pod \"ovnkube-node-w6z5r\" (UID: \"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r"
Jul 20 13:01:36.050854 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.984827    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/002d1aca-ffaa-4461-8906-6816cdfe6274-host-var-lib-cni-multus\") pod \"multus-rlmj7\" (UID: \"002d1aca-ffaa-4461-8906-6816cdfe6274\") " pod="openshift-multus/multus-rlmj7"
Jul 20 13:01:36.050854 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.984852    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q6m4n\" (UniqueName: \"kubernetes.io/projected/002d1aca-ffaa-4461-8906-6816cdfe6274-kube-api-access-q6m4n\") pod \"multus-rlmj7\" (UID: \"002d1aca-ffaa-4461-8906-6816cdfe6274\") " pod="openshift-multus/multus-rlmj7"
Jul 20 13:01:36.050854 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.984876    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f0284f8d-ac61-43c0-9502-6b0b8e61d7ac-etc-openvswitch\") pod \"ovnkube-node-w6z5r\" (UID: \"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r"
Jul 20 13:01:36.050854 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.984902    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/002d1aca-ffaa-4461-8906-6816cdfe6274-host-run-k8s-cni-cncf-io\") pod \"multus-rlmj7\" (UID: \"002d1aca-ffaa-4461-8906-6816cdfe6274\") " pod="openshift-multus/multus-rlmj7"
Jul 20 13:01:36.050854 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.984993    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/002d1aca-ffaa-4461-8906-6816cdfe6274-host-var-lib-cni-bin\") pod \"multus-rlmj7\" (UID: \"002d1aca-ffaa-4461-8906-6816cdfe6274\") " pod="openshift-multus/multus-rlmj7"
Jul 20 13:01:36.050854 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.985027    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/002d1aca-ffaa-4461-8906-6816cdfe6274-multus-conf-dir\") pod \"multus-rlmj7\" (UID: \"002d1aca-ffaa-4461-8906-6816cdfe6274\") " pod="openshift-multus/multus-rlmj7"
Jul 20 13:01:36.050854 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.985052    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/002d1aca-ffaa-4461-8906-6816cdfe6274-multus-daemon-config\") pod \"multus-rlmj7\" (UID: \"002d1aca-ffaa-4461-8906-6816cdfe6274\") " pod="openshift-multus/multus-rlmj7"
Jul 20 13:01:36.050854 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.985084    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mv4nv\" (UniqueName: \"kubernetes.io/projected/f0284f8d-ac61-43c0-9502-6b0b8e61d7ac-kube-api-access-mv4nv\") pod \"ovnkube-node-w6z5r\" (UID: \"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r"
Jul 20 13:01:36.050854 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.985110    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/002d1aca-ffaa-4461-8906-6816cdfe6274-system-cni-dir\") pod \"multus-rlmj7\" (UID: \"002d1aca-ffaa-4461-8906-6816cdfe6274\") " pod="openshift-multus/multus-rlmj7"
Jul 20 13:01:36.050854 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.985138    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/002d1aca-ffaa-4461-8906-6816cdfe6274-cnibin\") pod \"multus-rlmj7\" (UID: \"002d1aca-ffaa-4461-8906-6816cdfe6274\") " pod="openshift-multus/multus-rlmj7"
Jul 20 13:01:36.050854 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.985165    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f0284f8d-ac61-43c0-9502-6b0b8e61d7ac-host-cni-netd\") pod \"ovnkube-node-w6z5r\" (UID: \"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r"
Jul 20 13:01:36.050854 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.985191    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hjt9l\" (UniqueName: \"kubernetes.io/projected/bf9a432f-9b17-467c-826d-50f1ce4cfd7c-kube-api-access-hjt9l\") pod \"node-resolver-lsrxw\" (UID: \"bf9a432f-9b17-467c-826d-50f1ce4cfd7c\") " pod="openshift-dns/node-resolver-lsrxw"
Jul 20 13:01:36.050854 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.985217    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/002d1aca-ffaa-4461-8906-6816cdfe6274-host-run-netns\") pod \"multus-rlmj7\" (UID: \"002d1aca-ffaa-4461-8906-6816cdfe6274\") " pod="openshift-multus/multus-rlmj7"
Jul 20 13:01:36.050854 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.986223    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vjqm"
Jul 20 13:01:36.122519 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:35.986314    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vjqm" podUID="6b89bab8-ce68-4a47-8922-7983e250b5c7"
Jul 20 13:01:36.122519 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.987205    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 20 13:01:36.122519 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.987228    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-cc5jg\""
Jul 20 13:01:36.122519 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.987491    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 20 13:01:36.122519 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.989818    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-s8tlk"
Jul 20 13:01:36.122519 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.990828    2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 20 13:01:36.122519 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.991002    2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-hv4ft"
Jul 20 13:01:36.122519 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.992450    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkb7v"
Jul 20 13:01:36.122519 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.994624    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 20 13:01:36.122519 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.994661    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 20 13:01:36.122519 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.994722    2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-hv4ft"
Jul 20 13:01:36.122519 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.994929    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 20 13:01:36.122519 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.995089    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-s54h4\""
Jul 20 13:01:36.122519 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.995158    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 20 13:01:36.122519 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.995755    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bjz6v"
Jul 20 13:01:36.122519 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:35.995820    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bjz6v" podUID="52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d"
Jul 20 13:01:36.122519 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.996308    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-572bd\""
Jul 20 13:01:36.122519 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.996507    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 20 13:01:36.122519 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.996617    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 20 13:01:36.122519 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:35.999160    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7mhbt"
Jul 20 13:01:36.122519 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.002638    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nhsgz"
Jul 20 13:01:36.122519 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.002742    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-ms8mh\""
Jul 20 13:01:36.122519 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.003080    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 20 13:01:36.122519 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.003419    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 20 13:01:36.122519 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.004715    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbfs8"
Jul 20 13:01:36.122519 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:36.004785    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbfs8" podUID="81f8fe49-b58b-4eb9-8322-547266b00f73"
Jul 20 13:01:36.124225 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.005636    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-gtcxh\""
Jul 20 13:01:36.124225 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.005841    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 20 13:01:36.124225 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.005927    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 20 13:01:36.124225 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.008674    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dcnn2"
Jul 20 13:01:36.124225 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.013011    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 20 13:01:36.124225 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.013280    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-dmqz2\""
Jul 20 13:01:36.124225 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.013491    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 20 13:01:36.124225 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.013689    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 20 13:01:36.124225 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.053625    2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 20 13:01:36.124225 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.123145    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f0284f8d-ac61-43c0-9502-6b0b8e61d7ac-var-lib-openvswitch\") pod \"ovnkube-node-w6z5r\" (UID: \"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r"
Jul 20 13:01:36.124225 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.123184    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f0284f8d-ac61-43c0-9502-6b0b8e61d7ac-run-openvswitch\") pod \"ovnkube-node-w6z5r\" (UID: \"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r"
Jul 20 13:01:36.124225 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.123214    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/002d1aca-ffaa-4461-8906-6816cdfe6274-etc-kubernetes\") pod \"multus-rlmj7\" (UID: \"002d1aca-ffaa-4461-8906-6816cdfe6274\") " pod="openshift-multus/multus-rlmj7"
Jul 20 13:01:36.124225 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.123242    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zccgv\" (UniqueName: \"kubernetes.io/projected/f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d-kube-api-access-zccgv\") pod \"tuned-nhsgz\" (UID: \"f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d\") " pod="openshift-cluster-node-tuning-operator/tuned-nhsgz"
Jul 20 13:01:36.124225 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.123266    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4ad79612-15fd-48a7-a9cc-33f53c58ca69-system-cni-dir\") pod \"multus-additional-cni-plugins-g47kp\" (UID: \"4ad79612-15fd-48a7-a9cc-33f53c58ca69\") " pod="openshift-multus/multus-additional-cni-plugins-g47kp"
Jul 20 13:01:36.124225 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.123290    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f0284f8d-ac61-43c0-9502-6b0b8e61d7ac-ovnkube-config\") pod \"ovnkube-node-w6z5r\" (UID: \"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r"
Jul 20 13:01:36.124225 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.123313    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/002d1aca-ffaa-4461-8906-6816cdfe6274-multus-cni-dir\") pod \"multus-rlmj7\" (UID: \"002d1aca-ffaa-4461-8906-6816cdfe6274\") " pod="openshift-multus/multus-rlmj7"
Jul 20 13:01:36.124225 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.123334    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/002d1aca-ffaa-4461-8906-6816cdfe6274-os-release\") pod \"multus-rlmj7\" (UID: \"002d1aca-ffaa-4461-8906-6816cdfe6274\") " pod="openshift-multus/multus-rlmj7"
Jul 20 13:01:36.124225 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.123356    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/002d1aca-ffaa-4461-8906-6816cdfe6274-hostroot\") pod \"multus-rlmj7\" (UID: \"002d1aca-ffaa-4461-8906-6816cdfe6274\") " pod="openshift-multus/multus-rlmj7"
Jul 20 13:01:36.124225 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.123368    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/002d1aca-ffaa-4461-8906-6816cdfe6274-etc-kubernetes\") pod \"multus-rlmj7\" (UID: \"002d1aca-ffaa-4461-8906-6816cdfe6274\") " pod="openshift-multus/multus-rlmj7"
Jul 20 13:01:36.125412 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.123461    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f0284f8d-ac61-43c0-9502-6b0b8e61d7ac-var-lib-openvswitch\") pod \"ovnkube-node-w6z5r\" (UID: \"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r"
Jul 20 13:01:36.125412 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.123504    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f0284f8d-ac61-43c0-9502-6b0b8e61d7ac-run-openvswitch\") pod \"ovnkube-node-w6z5r\" (UID: \"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r"
Jul 20 13:01:36.125412 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.123697    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/002d1aca-ffaa-4461-8906-6816cdfe6274-multus-cni-dir\") pod \"multus-rlmj7\" (UID: \"002d1aca-ffaa-4461-8906-6816cdfe6274\") " pod="openshift-multus/multus-rlmj7"
Jul 20 13:01:36.125412 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.123766    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/002d1aca-ffaa-4461-8906-6816cdfe6274-os-release\") pod \"multus-rlmj7\" (UID: \"002d1aca-ffaa-4461-8906-6816cdfe6274\") " pod="openshift-multus/multus-rlmj7"
Jul 20 13:01:36.125412 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.123802    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/002d1aca-ffaa-4461-8906-6816cdfe6274-hostroot\") pod \"multus-rlmj7\" (UID: \"002d1aca-ffaa-4461-8906-6816cdfe6274\") " pod="openshift-multus/multus-rlmj7"
Jul 20 13:01:36.125412 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.123379    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/84be7850-b3b8-49a2-899f-5d16ab5a0de4-konnectivity-ca\") pod \"konnectivity-agent-7mhbt\" (UID: \"84be7850-b3b8-49a2-899f-5d16ab5a0de4\") " pod="kube-system/konnectivity-agent-7mhbt"
Jul 20 13:01:36.125412 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.123837    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f0284f8d-ac61-43c0-9502-6b0b8e61d7ac-run-systemd\") pod \"ovnkube-node-w6z5r\" (UID: \"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r"
Jul 20 13:01:36.125412 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.123863    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9km99\" (UniqueName: \"kubernetes.io/projected/6b89bab8-ce68-4a47-8922-7983e250b5c7-kube-api-access-9km99\") pod \"network-check-target-8vjqm\" (UID: \"6b89bab8-ce68-4a47-8922-7983e250b5c7\") " pod="openshift-network-diagnostics/network-check-target-8vjqm"
Jul 20 13:01:36.125412 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.123888    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d-etc-kubernetes\") pod \"tuned-nhsgz\" (UID: \"f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d\") " pod="openshift-cluster-node-tuning-operator/tuned-nhsgz"
Jul 20 13:01:36.125412 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.124073    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/f0284f8d-ac61-43c0-9502-6b0b8e61d7ac-ovnkube-config\") pod \"ovnkube-node-w6z5r\" (UID: \"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r"
Jul 20 13:01:36.125412 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.124596    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f0284f8d-ac61-43c0-9502-6b0b8e61d7ac-node-log\") pod \"ovnkube-node-w6z5r\" (UID: \"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r"
Jul 20 13:01:36.125412 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.124641    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d-original-pull-secret\") pod \"global-pull-secret-syncer-bjz6v\" (UID: \"52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d\") " pod="kube-system/global-pull-secret-syncer-bjz6v"
Jul 20 13:01:36.125412 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.124670    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4f76ce36-97e3-4eb9-b591-ff1c7b5d02f8-iptables-alerter-script\") pod \"iptables-alerter-s8tlk\" (UID: \"4f76ce36-97e3-4eb9-b591-ff1c7b5d02f8\") " pod="openshift-network-operator/iptables-alerter-s8tlk"
Jul 20 13:01:36.125412 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.124699    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f0284f8d-ac61-43c0-9502-6b0b8e61d7ac-run-ovn\") pod \"ovnkube-node-w6z5r\" (UID: \"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r"
Jul 20 13:01:36.126715 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.124726    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/002d1aca-ffaa-4461-8906-6816cdfe6274-host-var-lib-cni-multus\") pod \"multus-rlmj7\" (UID: \"002d1aca-ffaa-4461-8906-6816cdfe6274\") " pod="openshift-multus/multus-rlmj7"
Jul 20 13:01:36.126715 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.124755    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q6m4n\" (UniqueName: \"kubernetes.io/projected/002d1aca-ffaa-4461-8906-6816cdfe6274-kube-api-access-q6m4n\") pod \"multus-rlmj7\" (UID: \"002d1aca-ffaa-4461-8906-6816cdfe6274\") " pod="openshift-multus/multus-rlmj7"
Jul 20 13:01:36.126715 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.124779    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2e3cfb74-ae63-457e-abb7-fc0e5f459dbb-serviceca\") pod \"node-ca-dcnn2\" (UID: \"2e3cfb74-ae63-457e-abb7-fc0e5f459dbb\") " pod="openshift-image-registry/node-ca-dcnn2"
Jul 20 13:01:36.126715 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.124803    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f0284f8d-ac61-43c0-9502-6b0b8e61d7ac-etc-openvswitch\") pod \"ovnkube-node-w6z5r\" (UID: \"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r"
Jul 20 13:01:36.126715 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.124820    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/f0284f8d-ac61-43c0-9502-6b0b8e61d7ac-run-systemd\") pod \"ovnkube-node-w6z5r\" (UID: \"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r"
Jul 20 13:01:36.126715 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.124829    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/002d1aca-ffaa-4461-8906-6816cdfe6274-host-run-k8s-cni-cncf-io\") pod \"multus-rlmj7\" (UID: \"002d1aca-ffaa-4461-8906-6816cdfe6274\") " pod="openshift-multus/multus-rlmj7"
Jul 20 13:01:36.126715 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.125227    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/002d1aca-ffaa-4461-8906-6816cdfe6274-host-var-lib-cni-bin\") pod \"multus-rlmj7\" (UID: \"002d1aca-ffaa-4461-8906-6816cdfe6274\") " pod="openshift-multus/multus-rlmj7"
Jul 20 13:01:36.126715 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.124865    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/002d1aca-ffaa-4461-8906-6816cdfe6274-host-run-k8s-cni-cncf-io\") pod \"multus-rlmj7\" (UID: \"002d1aca-ffaa-4461-8906-6816cdfe6274\") " pod="openshift-multus/multus-rlmj7"
Jul 20 13:01:36.126715 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.125261    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/644b7e3b-af11-4d30-9fff-aaf8a83319bf-socket-dir\") pod \"aws-ebs-csi-driver-node-zkb7v\" (UID: \"644b7e3b-af11-4d30-9fff-aaf8a83319bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkb7v"
Jul 20 13:01:36.126715 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.125014    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/002d1aca-ffaa-4461-8906-6816cdfe6274-host-var-lib-cni-multus\") pod \"multus-rlmj7\" (UID: \"002d1aca-ffaa-4461-8906-6816cdfe6274\") " pod="openshift-multus/multus-rlmj7"
Jul 20 13:01:36.126715 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.124945    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/f0284f8d-ac61-43c0-9502-6b0b8e61d7ac-node-log\") pod \"ovnkube-node-w6z5r\" (UID: \"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r"
Jul 20 13:01:36.126715 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.124986    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/f0284f8d-ac61-43c0-9502-6b0b8e61d7ac-run-ovn\") pod \"ovnkube-node-w6z5r\" (UID: \"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r"
Jul 20 13:01:36.126715 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.125303    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/002d1aca-ffaa-4461-8906-6816cdfe6274-host-var-lib-cni-bin\") pod \"multus-rlmj7\" (UID: \"002d1aca-ffaa-4461-8906-6816cdfe6274\") " pod="openshift-multus/multus-rlmj7"
Jul 20 13:01:36.126715 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.125026    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/f0284f8d-ac61-43c0-9502-6b0b8e61d7ac-etc-openvswitch\") pod \"ovnkube-node-w6z5r\" (UID: \"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r"
Jul 20 13:01:36.126715 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.125355    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d-etc-sysctl-d\") pod \"tuned-nhsgz\" (UID: \"f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d\") " pod="openshift-cluster-node-tuning-operator/tuned-nhsgz"
Jul 20 13:01:36.128111 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.125384    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d-etc-systemd\") pod \"tuned-nhsgz\" (UID: \"f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d\") " pod="openshift-cluster-node-tuning-operator/tuned-nhsgz"
Jul 20 13:01:36.128111 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.125418    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4ad79612-15fd-48a7-a9cc-33f53c58ca69-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g47kp\" (UID: \"4ad79612-15fd-48a7-a9cc-33f53c58ca69\") " pod="openshift-multus/multus-additional-cni-plugins-g47kp"
Jul 20 13:01:36.128111 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.125459    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/002d1aca-ffaa-4461-8906-6816cdfe6274-cnibin\") pod \"multus-rlmj7\" (UID: \"002d1aca-ffaa-4461-8906-6816cdfe6274\") " pod="openshift-multus/multus-rlmj7"
Jul 20 13:01:36.128111 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.125484    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d-dbus\") pod \"global-pull-secret-syncer-bjz6v\" (UID: \"52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d\") " pod="kube-system/global-pull-secret-syncer-bjz6v"
Jul 20 13:01:36.128111 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.125539    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/002d1aca-ffaa-4461-8906-6816cdfe6274-cnibin\") pod \"multus-rlmj7\" (UID: \"002d1aca-ffaa-4461-8906-6816cdfe6274\") " pod="openshift-multus/multus-rlmj7"
Jul 20 13:01:36.128111 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.125576    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/84be7850-b3b8-49a2-899f-5d16ab5a0de4-agent-certs\") pod \"konnectivity-agent-7mhbt\" (UID: \"84be7850-b3b8-49a2-899f-5d16ab5a0de4\") " pod="kube-system/konnectivity-agent-7mhbt"
Jul 20 13:01:36.128111 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.125626    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d-etc-sysconfig\") pod \"tuned-nhsgz\" (UID: \"f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d\") " pod="openshift-cluster-node-tuning-operator/tuned-nhsgz"
Jul 20 13:01:36.128111 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.125650    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2e3cfb74-ae63-457e-abb7-fc0e5f459dbb-host\") pod \"node-ca-dcnn2\" (UID: \"2e3cfb74-ae63-457e-abb7-fc0e5f459dbb\") " pod="openshift-image-registry/node-ca-dcnn2"
Jul 20 13:01:36.128111 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.125671    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4ad79612-15fd-48a7-a9cc-33f53c58ca69-cnibin\") pod \"multus-additional-cni-plugins-g47kp\" (UID: \"4ad79612-15fd-48a7-a9cc-33f53c58ca69\") " pod="openshift-multus/multus-additional-cni-plugins-g47kp"
Jul 20 13:01:36.128111 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.125700    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4ad79612-15fd-48a7-a9cc-33f53c58ca69-os-release\") pod \"multus-additional-cni-plugins-g47kp\" (UID: \"4ad79612-15fd-48a7-a9cc-33f53c58ca69\") " pod="openshift-multus/multus-additional-cni-plugins-g47kp"
Jul 20 13:01:36.128111 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.125727    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f0284f8d-ac61-43c0-9502-6b0b8e61d7ac-host-cni-netd\") pod \"ovnkube-node-w6z5r\" (UID: \"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r"
Jul 20 13:01:36.128111 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.125748    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/002d1aca-ffaa-4461-8906-6816cdfe6274-host-run-netns\") pod \"multus-rlmj7\" (UID: \"002d1aca-ffaa-4461-8906-6816cdfe6274\") " pod="openshift-multus/multus-rlmj7"
Jul 20 13:01:36.128111 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.125770    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d-kubelet-config\") pod \"global-pull-secret-syncer-bjz6v\" (UID: \"52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d\") " pod="kube-system/global-pull-secret-syncer-bjz6v"
Jul 20 13:01:36.128111 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.125792    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d-var-lib-kubelet\") pod \"tuned-nhsgz\" (UID: \"f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d\") " pod="openshift-cluster-node-tuning-operator/tuned-nhsgz"
Jul 20 13:01:36.129306 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.125812    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d-etc-tuned\") pod \"tuned-nhsgz\" (UID: \"f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d\") " pod="openshift-cluster-node-tuning-operator/tuned-nhsgz"
Jul 20 13:01:36.129306 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.125836    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4ad79612-15fd-48a7-a9cc-33f53c58ca69-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g47kp\" (UID: \"4ad79612-15fd-48a7-a9cc-33f53c58ca69\") " pod="openshift-multus/multus-additional-cni-plugins-g47kp"
Jul 20 13:01:36.129306 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.125858    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f0284f8d-ac61-43c0-9502-6b0b8e61d7ac-log-socket\") pod \"ovnkube-node-w6z5r\" (UID: \"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r"
Jul 20 13:01:36.129306 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.125863    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/002d1aca-ffaa-4461-8906-6816cdfe6274-host-run-netns\") pod \"multus-rlmj7\" (UID: \"002d1aca-ffaa-4461-8906-6816cdfe6274\") " pod="openshift-multus/multus-rlmj7"
Jul 20 13:01:36.129306 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.125812    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/f0284f8d-ac61-43c0-9502-6b0b8e61d7ac-host-cni-netd\") pod \"ovnkube-node-w6z5r\" (UID: \"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r"
Jul 20 13:01:36.129306 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.125881    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f0284f8d-ac61-43c0-9502-6b0b8e61d7ac-systemd-units\") pod \"ovnkube-node-w6z5r\" (UID: \"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r"
Jul 20 13:01:36.129306 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.125917    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/f0284f8d-ac61-43c0-9502-6b0b8e61d7ac-systemd-units\") pod \"ovnkube-node-w6z5r\" (UID: \"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r"
Jul 20 13:01:36.129306 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.125968    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/f0284f8d-ac61-43c0-9502-6b0b8e61d7ac-log-socket\") pod \"ovnkube-node-w6z5r\" (UID: \"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r"
Jul 20 13:01:36.129306 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.127844    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f0284f8d-ac61-43c0-9502-6b0b8e61d7ac-host-cni-bin\") pod \"ovnkube-node-w6z5r\" (UID: \"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r"
Jul 20 13:01:36.135231 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.125921    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/f0284f8d-ac61-43c0-9502-6b0b8e61d7ac-host-cni-bin\") pod \"ovnkube-node-w6z5r\" (UID: \"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r"
Jul 20 13:01:36.135231 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.135163    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/002d1aca-ffaa-4461-8906-6816cdfe6274-multus-socket-dir-parent\") pod \"multus-rlmj7\" (UID: \"002d1aca-ffaa-4461-8906-6816cdfe6274\") " pod="openshift-multus/multus-rlmj7"
Jul 20 13:01:36.135231 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.135195    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/002d1aca-ffaa-4461-8906-6816cdfe6274-host-run-multus-certs\") pod \"multus-rlmj7\" (UID: \"002d1aca-ffaa-4461-8906-6816cdfe6274\") " pod="openshift-multus/multus-rlmj7"
Jul 20 13:01:36.135596 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.135228    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vdgx6\" (UniqueName: \"kubernetes.io/projected/81f8fe49-b58b-4eb9-8322-547266b00f73-kube-api-access-vdgx6\") pod \"network-metrics-daemon-tbfs8\" (UID: \"81f8fe49-b58b-4eb9-8322-547266b00f73\") " pod="openshift-multus/network-metrics-daemon-tbfs8"
Jul 20 13:01:36.135596 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.135261    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d-etc-modprobe-d\") pod \"tuned-nhsgz\" (UID: \"f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d\") " pod="openshift-cluster-node-tuning-operator/tuned-nhsgz"
Jul 20 13:01:36.135596 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.135293    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0284f8d-ac61-43c0-9502-6b0b8e61d7ac-host-run-ovn-kubernetes\") pod \"ovnkube-node-w6z5r\" (UID: \"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r"
Jul 20 13:01:36.135596 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.135320    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0284f8d-ac61-43c0-9502-6b0b8e61d7ac-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-w6z5r\" (UID: \"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r"
Jul 20 13:01:36.135596 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.135349    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f0284f8d-ac61-43c0-9502-6b0b8e61d7ac-env-overrides\") pod \"ovnkube-node-w6z5r\" (UID: \"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r"
Jul 20 13:01:36.135596 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.135377    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/002d1aca-ffaa-4461-8906-6816cdfe6274-host-var-lib-kubelet\") pod \"multus-rlmj7\" (UID: \"002d1aca-ffaa-4461-8906-6816cdfe6274\") " pod="openshift-multus/multus-rlmj7"
Jul 20 13:01:36.135596 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.135402    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d-sys\") pod \"tuned-nhsgz\" (UID: \"f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d\") " pod="openshift-cluster-node-tuning-operator/tuned-nhsgz"
Jul 20 13:01:36.135596 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.135446    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4ad79612-15fd-48a7-a9cc-33f53c58ca69-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g47kp\" (UID: \"4ad79612-15fd-48a7-a9cc-33f53c58ca69\") " pod="openshift-multus/multus-additional-cni-plugins-g47kp"
Jul 20 13:01:36.135596 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.135477    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/002d1aca-ffaa-4461-8906-6816cdfe6274-cni-binary-copy\") pod \"multus-rlmj7\" (UID: \"002d1aca-ffaa-4461-8906-6816cdfe6274\") " pod="openshift-multus/multus-rlmj7"
Jul 20 13:01:36.135596 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.135503    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/81f8fe49-b58b-4eb9-8322-547266b00f73-metrics-certs\") pod \"network-metrics-daemon-tbfs8\" (UID: \"81f8fe49-b58b-4eb9-8322-547266b00f73\") " pod="openshift-multus/network-metrics-daemon-tbfs8"
Jul 20 13:01:36.135596 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.135530    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/644b7e3b-af11-4d30-9fff-aaf8a83319bf-device-dir\") pod \"aws-ebs-csi-driver-node-zkb7v\" (UID: \"644b7e3b-af11-4d30-9fff-aaf8a83319bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkb7v"
Jul 20 13:01:36.135596 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.135556    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d-etc-sysctl-conf\") pod \"tuned-nhsgz\" (UID: \"f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d\") " pod="openshift-cluster-node-tuning-operator/tuned-nhsgz"
Jul 20 13:01:36.135596 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.135592    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vkg98\" (UniqueName: \"kubernetes.io/projected/4ad79612-15fd-48a7-a9cc-33f53c58ca69-kube-api-access-vkg98\") pod \"multus-additional-cni-plugins-g47kp\" (UID: \"4ad79612-15fd-48a7-a9cc-33f53c58ca69\") " pod="openshift-multus/multus-additional-cni-plugins-g47kp"
Jul 20 13:01:36.136351 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.135622    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f0284f8d-ac61-43c0-9502-6b0b8e61d7ac-host-run-netns\") pod \"ovnkube-node-w6z5r\" (UID: \"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r"
Jul 20 13:01:36.136351 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.135652    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf9a432f-9b17-467c-826d-50f1ce4cfd7c-tmp-dir\") pod \"node-resolver-lsrxw\" (UID: \"bf9a432f-9b17-467c-826d-50f1ce4cfd7c\") " pod="openshift-dns/node-resolver-lsrxw"
Jul 20 13:01:36.136351 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.135693    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d-lib-modules\") pod \"tuned-nhsgz\" (UID: \"f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d\") " pod="openshift-cluster-node-tuning-operator/tuned-nhsgz"
Jul 20 13:01:36.136351 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.135724    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f0284f8d-ac61-43c0-9502-6b0b8e61d7ac-ovnkube-script-lib\") pod \"ovnkube-node-w6z5r\" (UID: \"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r"
Jul 20 13:01:36.136351 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.135753    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bf9a432f-9b17-467c-826d-50f1ce4cfd7c-hosts-file\") pod \"node-resolver-lsrxw\" (UID: \"bf9a432f-9b17-467c-826d-50f1ce4cfd7c\") " pod="openshift-dns/node-resolver-lsrxw"
Jul 20 13:01:36.136351 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.135782    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f0284f8d-ac61-43c0-9502-6b0b8e61d7ac-host-slash\") pod \"ovnkube-node-w6z5r\" (UID: \"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r"
Jul 20 13:01:36.136351 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.135808    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f0284f8d-ac61-43c0-9502-6b0b8e61d7ac-ovn-node-metrics-cert\") pod \"ovnkube-node-w6z5r\" (UID: \"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r"
Jul 20 13:01:36.136351 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.135837    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/644b7e3b-af11-4d30-9fff-aaf8a83319bf-etc-selinux\") pod \"aws-ebs-csi-driver-node-zkb7v\" (UID: \"644b7e3b-af11-4d30-9fff-aaf8a83319bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkb7v"
Jul 20 13:01:36.136351 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.135879    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/644b7e3b-af11-4d30-9fff-aaf8a83319bf-sys-fs\") pod \"aws-ebs-csi-driver-node-zkb7v\" (UID: \"644b7e3b-af11-4d30-9fff-aaf8a83319bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkb7v"
Jul 20 13:01:36.136351 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.135906    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d-run\") pod \"tuned-nhsgz\" (UID: \"f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d\") " pod="openshift-cluster-node-tuning-operator/tuned-nhsgz"
Jul 20 13:01:36.136351 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.135934    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4ad79612-15fd-48a7-a9cc-33f53c58ca69-cni-binary-copy\") pod \"multus-additional-cni-plugins-g47kp\" (UID: \"4ad79612-15fd-48a7-a9cc-33f53c58ca69\") " pod="openshift-multus/multus-additional-cni-plugins-g47kp"
Jul 20 13:01:36.136351 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.135965    2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 20 13:01:36.136980 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.136824    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/002d1aca-ffaa-4461-8906-6816cdfe6274-multus-socket-dir-parent\") pod \"multus-rlmj7\" (UID: \"002d1aca-ffaa-4461-8906-6816cdfe6274\") " pod="openshift-multus/multus-rlmj7"
Jul 20 13:01:36.136980 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.136870    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/002d1aca-ffaa-4461-8906-6816cdfe6274-host-run-multus-certs\") pod \"multus-rlmj7\" (UID: \"002d1aca-ffaa-4461-8906-6816cdfe6274\") " pod="openshift-multus/multus-rlmj7"
Jul 20 13:01:36.136980 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.136919    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0284f8d-ac61-43c0-9502-6b0b8e61d7ac-host-run-ovn-kubernetes\") pod \"ovnkube-node-w6z5r\" (UID: \"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r"
Jul 20 13:01:36.136980 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.136957    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f0284f8d-ac61-43c0-9502-6b0b8e61d7ac-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-w6z5r\" (UID: \"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r"
Jul 20 13:01:36.137359 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.137340    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/f0284f8d-ac61-43c0-9502-6b0b8e61d7ac-env-overrides\") pod \"ovnkube-node-w6z5r\" (UID: \"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r"
Jul 20 13:01:36.137414 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.137396    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/002d1aca-ffaa-4461-8906-6816cdfe6274-host-var-lib-kubelet\") pod \"multus-rlmj7\" (UID: \"002d1aca-ffaa-4461-8906-6816cdfe6274\") " pod="openshift-multus/multus-rlmj7"
Jul 20 13:01:36.142652 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.137863    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/002d1aca-ffaa-4461-8906-6816cdfe6274-cni-binary-copy\") pod \"multus-rlmj7\" (UID: \"002d1aca-ffaa-4461-8906-6816cdfe6274\") " pod="openshift-multus/multus-rlmj7"
Jul 20 13:01:36.142652 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.138377    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/bf9a432f-9b17-467c-826d-50f1ce4cfd7c-hosts-file\") pod \"node-resolver-lsrxw\" (UID: \"bf9a432f-9b17-467c-826d-50f1ce4cfd7c\") " pod="openshift-dns/node-resolver-lsrxw"
Jul 20 13:01:36.142652 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.138447    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/f0284f8d-ac61-43c0-9502-6b0b8e61d7ac-host-run-netns\") pod \"ovnkube-node-w6z5r\" (UID: \"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r"
Jul 20 13:01:36.142652 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.138691    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bf9a432f-9b17-467c-826d-50f1ce4cfd7c-tmp-dir\") pod \"node-resolver-lsrxw\" (UID: \"bf9a432f-9b17-467c-826d-50f1ce4cfd7c\") " pod="openshift-dns/node-resolver-lsrxw"
Jul 20 13:01:36.142652 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.139232    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/f0284f8d-ac61-43c0-9502-6b0b8e61d7ac-host-slash\") pod \"ovnkube-node-w6z5r\" (UID: \"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r"
Jul 20 13:01:36.142652 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.140916    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/002d1aca-ffaa-4461-8906-6816cdfe6274-multus-conf-dir\") pod \"multus-rlmj7\" (UID: \"002d1aca-ffaa-4461-8906-6816cdfe6274\") " pod="openshift-multus/multus-rlmj7"
Jul 20 13:01:36.143159 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.143092    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/f0284f8d-ac61-43c0-9502-6b0b8e61d7ac-ovnkube-script-lib\") pod \"ovnkube-node-w6z5r\" (UID: \"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r"
Jul 20 13:01:36.143733 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.143636    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/f0284f8d-ac61-43c0-9502-6b0b8e61d7ac-ovn-node-metrics-cert\") pod \"ovnkube-node-w6z5r\" (UID: \"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r"
Jul 20 13:01:36.143933 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.143909    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/002d1aca-ffaa-4461-8906-6816cdfe6274-multus-conf-dir\") pod \"multus-rlmj7\" (UID: \"002d1aca-ffaa-4461-8906-6816cdfe6274\") " pod="openshift-multus/multus-rlmj7"
Jul 20 13:01:36.144051 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.143956    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/002d1aca-ffaa-4461-8906-6816cdfe6274-multus-daemon-config\") pod \"multus-rlmj7\" (UID: \"002d1aca-ffaa-4461-8906-6816cdfe6274\") " pod="openshift-multus/multus-rlmj7"
Jul 20 13:01:36.144051 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.143988    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d-host\") pod \"tuned-nhsgz\" (UID: \"f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d\") " pod="openshift-cluster-node-tuning-operator/tuned-nhsgz"
Jul 20 13:01:36.144051 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.144025    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4f76ce36-97e3-4eb9-b591-ff1c7b5d02f8-host-slash\") pod \"iptables-alerter-s8tlk\" (UID: \"4f76ce36-97e3-4eb9-b591-ff1c7b5d02f8\") " pod="openshift-network-operator/iptables-alerter-s8tlk"
Jul 20 13:01:36.144237 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.144052    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mv4nv\" (UniqueName: \"kubernetes.io/projected/f0284f8d-ac61-43c0-9502-6b0b8e61d7ac-kube-api-access-mv4nv\") pod \"ovnkube-node-w6z5r\" (UID: \"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r"
Jul 20 13:01:36.144237 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.144078    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/002d1aca-ffaa-4461-8906-6816cdfe6274-system-cni-dir\") pod \"multus-rlmj7\" (UID: \"002d1aca-ffaa-4461-8906-6816cdfe6274\") " pod="openshift-multus/multus-rlmj7"
Jul 20 13:01:36.144237 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.144101    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d-tmp\") pod \"tuned-nhsgz\" (UID: \"f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d\") " pod="openshift-cluster-node-tuning-operator/tuned-nhsgz"
Jul 20 13:01:36.144237 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.144126    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hjt9l\" (UniqueName: \"kubernetes.io/projected/bf9a432f-9b17-467c-826d-50f1ce4cfd7c-kube-api-access-hjt9l\") pod \"node-resolver-lsrxw\" (UID: \"bf9a432f-9b17-467c-826d-50f1ce4cfd7c\") " pod="openshift-dns/node-resolver-lsrxw"
Jul 20 13:01:36.144237 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.144151    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/644b7e3b-af11-4d30-9fff-aaf8a83319bf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zkb7v\" (UID: \"644b7e3b-af11-4d30-9fff-aaf8a83319bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkb7v"
Jul 20 13:01:36.144237 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.144177    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/644b7e3b-af11-4d30-9fff-aaf8a83319bf-registration-dir\") pod \"aws-ebs-csi-driver-node-zkb7v\" (UID: \"644b7e3b-af11-4d30-9fff-aaf8a83319bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkb7v"
Jul 20 13:01:36.144237 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.144204    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vqmwh\" (UniqueName: \"kubernetes.io/projected/644b7e3b-af11-4d30-9fff-aaf8a83319bf-kube-api-access-vqmwh\") pod \"aws-ebs-csi-driver-node-zkb7v\" (UID: \"644b7e3b-af11-4d30-9fff-aaf8a83319bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkb7v"
Jul 20 13:01:36.144237 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.144230    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4nvc\" (UniqueName: \"kubernetes.io/projected/2e3cfb74-ae63-457e-abb7-fc0e5f459dbb-kube-api-access-d4nvc\") pod \"node-ca-dcnn2\" (UID: \"2e3cfb74-ae63-457e-abb7-fc0e5f459dbb\") " pod="openshift-image-registry/node-ca-dcnn2"
Jul 20 13:01:36.144679 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.144260    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8qx5r\" (UniqueName: \"kubernetes.io/projected/4f76ce36-97e3-4eb9-b591-ff1c7b5d02f8-kube-api-access-8qx5r\") pod \"iptables-alerter-s8tlk\" (UID: \"4f76ce36-97e3-4eb9-b591-ff1c7b5d02f8\") " pod="openshift-network-operator/iptables-alerter-s8tlk"
Jul 20 13:01:36.144679 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.144290    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0284f8d-ac61-43c0-9502-6b0b8e61d7ac-host-kubelet\") pod \"ovnkube-node-w6z5r\" (UID: \"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r"
Jul 20 13:01:36.144679 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.144388    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/f0284f8d-ac61-43c0-9502-6b0b8e61d7ac-host-kubelet\") pod \"ovnkube-node-w6z5r\" (UID: \"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r"
Jul 20 13:01:36.144679 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.144479    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/002d1aca-ffaa-4461-8906-6816cdfe6274-multus-daemon-config\") pod \"multus-rlmj7\" (UID: \"002d1aca-ffaa-4461-8906-6816cdfe6274\") " pod="openshift-multus/multus-rlmj7"
Jul 20 13:01:36.148212 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.147891    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/002d1aca-ffaa-4461-8906-6816cdfe6274-system-cni-dir\") pod \"multus-rlmj7\" (UID: \"002d1aca-ffaa-4461-8906-6816cdfe6274\") " pod="openshift-multus/multus-rlmj7"
Jul 20 13:01:36.150981 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.150960    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q6m4n\" (UniqueName: \"kubernetes.io/projected/002d1aca-ffaa-4461-8906-6816cdfe6274-kube-api-access-q6m4n\") pod \"multus-rlmj7\" (UID: \"002d1aca-ffaa-4461-8906-6816cdfe6274\") " pod="openshift-multus/multus-rlmj7"
Jul 20 13:01:36.160686 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.160533    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-182.ec2.internal" event={"ID":"3cbdd8dc17b46b583decda50ce1bde1d","Type":"ContainerStarted","Data":"e34c5750773cc67829d6a6900ebd544836e4d34d9fab36c83a48118465a58c59"}
Jul 20 13:01:36.161180 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.161156    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hjt9l\" (UniqueName: \"kubernetes.io/projected/bf9a432f-9b17-467c-826d-50f1ce4cfd7c-kube-api-access-hjt9l\") pod \"node-resolver-lsrxw\" (UID: \"bf9a432f-9b17-467c-826d-50f1ce4cfd7c\") " pod="openshift-dns/node-resolver-lsrxw"
Jul 20 13:01:36.162258 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.162231    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-182.ec2.internal" event={"ID":"b9336d48ae54902b2478c38cf3608a5e","Type":"ContainerStarted","Data":"be717479ae65533f79bd29d4e1accff3cdf99c2a5e333032ff247e2de8ec0f53"}
Jul 20 13:01:36.169715 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.169671    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mv4nv\" (UniqueName: \"kubernetes.io/projected/f0284f8d-ac61-43c0-9502-6b0b8e61d7ac-kube-api-access-mv4nv\") pod \"ovnkube-node-w6z5r\" (UID: \"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac\") " pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r"
Jul 20 13:01:36.241017 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.240980    2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 13:01:36.244777 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.244746    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d-original-pull-secret\") pod \"global-pull-secret-syncer-bjz6v\" (UID: \"52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d\") " pod="kube-system/global-pull-secret-syncer-bjz6v"
Jul 20 13:01:36.244777 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.244789    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4f76ce36-97e3-4eb9-b591-ff1c7b5d02f8-iptables-alerter-script\") pod \"iptables-alerter-s8tlk\" (UID: \"4f76ce36-97e3-4eb9-b591-ff1c7b5d02f8\") " pod="openshift-network-operator/iptables-alerter-s8tlk"
Jul 20 13:01:36.245007 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.244820    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2e3cfb74-ae63-457e-abb7-fc0e5f459dbb-serviceca\") pod \"node-ca-dcnn2\" (UID: \"2e3cfb74-ae63-457e-abb7-fc0e5f459dbb\") " pod="openshift-image-registry/node-ca-dcnn2"
Jul 20 13:01:36.245007 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.244851    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/644b7e3b-af11-4d30-9fff-aaf8a83319bf-socket-dir\") pod \"aws-ebs-csi-driver-node-zkb7v\" (UID: \"644b7e3b-af11-4d30-9fff-aaf8a83319bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkb7v"
Jul 20 13:01:36.245007 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.244877    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d-etc-sysctl-d\") pod \"tuned-nhsgz\" (UID: \"f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d\") " pod="openshift-cluster-node-tuning-operator/tuned-nhsgz"
Jul 20 13:01:36.245007 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.244903    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d-etc-systemd\") pod \"tuned-nhsgz\" (UID: \"f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d\") " pod="openshift-cluster-node-tuning-operator/tuned-nhsgz"
Jul 20 13:01:36.245007 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.244927    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4ad79612-15fd-48a7-a9cc-33f53c58ca69-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g47kp\" (UID: \"4ad79612-15fd-48a7-a9cc-33f53c58ca69\") " pod="openshift-multus/multus-additional-cni-plugins-g47kp"
Jul 20 13:01:36.245007 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.244952    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d-dbus\") pod \"global-pull-secret-syncer-bjz6v\" (UID: \"52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d\") " pod="kube-system/global-pull-secret-syncer-bjz6v"
Jul 20 13:01:36.245007 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.244979    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/84be7850-b3b8-49a2-899f-5d16ab5a0de4-agent-certs\") pod \"konnectivity-agent-7mhbt\" (UID: \"84be7850-b3b8-49a2-899f-5d16ab5a0de4\") " pod="kube-system/konnectivity-agent-7mhbt"
Jul 20 13:01:36.245007 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.245004    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d-etc-sysconfig\") pod \"tuned-nhsgz\" (UID: \"f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d\") " pod="openshift-cluster-node-tuning-operator/tuned-nhsgz"
Jul 20 13:01:36.245447 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.245028    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2e3cfb74-ae63-457e-abb7-fc0e5f459dbb-host\") pod \"node-ca-dcnn2\" (UID: \"2e3cfb74-ae63-457e-abb7-fc0e5f459dbb\") " pod="openshift-image-registry/node-ca-dcnn2"
Jul 20 13:01:36.245447 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.245055    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4ad79612-15fd-48a7-a9cc-33f53c58ca69-cnibin\") pod \"multus-additional-cni-plugins-g47kp\" (UID: \"4ad79612-15fd-48a7-a9cc-33f53c58ca69\") " pod="openshift-multus/multus-additional-cni-plugins-g47kp"
Jul 20 13:01:36.245447 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.245080    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4ad79612-15fd-48a7-a9cc-33f53c58ca69-os-release\") pod \"multus-additional-cni-plugins-g47kp\" (UID: \"4ad79612-15fd-48a7-a9cc-33f53c58ca69\") " pod="openshift-multus/multus-additional-cni-plugins-g47kp"
Jul 20 13:01:36.245447 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.245110    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d-kubelet-config\") pod \"global-pull-secret-syncer-bjz6v\" (UID: \"52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d\") " pod="kube-system/global-pull-secret-syncer-bjz6v"
Jul 20 13:01:36.245447 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.245134    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d-var-lib-kubelet\") pod \"tuned-nhsgz\" (UID: \"f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d\") " pod="openshift-cluster-node-tuning-operator/tuned-nhsgz"
Jul 20 13:01:36.245447 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.245158    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d-etc-tuned\") pod \"tuned-nhsgz\" (UID: \"f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d\") " pod="openshift-cluster-node-tuning-operator/tuned-nhsgz"
Jul 20 13:01:36.245447 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.245183    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4ad79612-15fd-48a7-a9cc-33f53c58ca69-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g47kp\" (UID: \"4ad79612-15fd-48a7-a9cc-33f53c58ca69\") " pod="openshift-multus/multus-additional-cni-plugins-g47kp"
Jul 20 13:01:36.245447 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.245217    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vdgx6\" (UniqueName: \"kubernetes.io/projected/81f8fe49-b58b-4eb9-8322-547266b00f73-kube-api-access-vdgx6\") pod \"network-metrics-daemon-tbfs8\" (UID: \"81f8fe49-b58b-4eb9-8322-547266b00f73\") " pod="openshift-multus/network-metrics-daemon-tbfs8"
Jul 20 13:01:36.245447 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.245241    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d-etc-modprobe-d\") pod \"tuned-nhsgz\" (UID: \"f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d\") " pod="openshift-cluster-node-tuning-operator/tuned-nhsgz"
Jul 20 13:01:36.245447 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.245271    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d-sys\") pod \"tuned-nhsgz\" (UID: \"f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d\") " pod="openshift-cluster-node-tuning-operator/tuned-nhsgz"
Jul 20 13:01:36.245447 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.245297    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4ad79612-15fd-48a7-a9cc-33f53c58ca69-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g47kp\" (UID: \"4ad79612-15fd-48a7-a9cc-33f53c58ca69\") " pod="openshift-multus/multus-additional-cni-plugins-g47kp"
Jul 20 13:01:36.245447 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.245324    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/81f8fe49-b58b-4eb9-8322-547266b00f73-metrics-certs\") pod \"network-metrics-daemon-tbfs8\" (UID: \"81f8fe49-b58b-4eb9-8322-547266b00f73\") " pod="openshift-multus/network-metrics-daemon-tbfs8"
Jul 20 13:01:36.245447 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.245352    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/644b7e3b-af11-4d30-9fff-aaf8a83319bf-device-dir\") pod \"aws-ebs-csi-driver-node-zkb7v\" (UID: \"644b7e3b-af11-4d30-9fff-aaf8a83319bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkb7v"
Jul 20 13:01:36.245447 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.245378    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d-etc-sysctl-conf\") pod \"tuned-nhsgz\" (UID: \"f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d\") " pod="openshift-cluster-node-tuning-operator/tuned-nhsgz"
Jul 20 13:01:36.246152 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.245401    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vkg98\" (UniqueName: \"kubernetes.io/projected/4ad79612-15fd-48a7-a9cc-33f53c58ca69-kube-api-access-vkg98\") pod \"multus-additional-cni-plugins-g47kp\" (UID: \"4ad79612-15fd-48a7-a9cc-33f53c58ca69\") " pod="openshift-multus/multus-additional-cni-plugins-g47kp"
Jul 20 13:01:36.246152 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.245452    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d-lib-modules\") pod \"tuned-nhsgz\" (UID: \"f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d\") " pod="openshift-cluster-node-tuning-operator/tuned-nhsgz"
Jul 20 13:01:36.246152 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.245482    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/644b7e3b-af11-4d30-9fff-aaf8a83319bf-etc-selinux\") pod \"aws-ebs-csi-driver-node-zkb7v\" (UID: \"644b7e3b-af11-4d30-9fff-aaf8a83319bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkb7v"
Jul 20 13:01:36.246152 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.245506    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/644b7e3b-af11-4d30-9fff-aaf8a83319bf-sys-fs\") pod \"aws-ebs-csi-driver-node-zkb7v\" (UID: \"644b7e3b-af11-4d30-9fff-aaf8a83319bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkb7v"
Jul 20 13:01:36.246152 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.245529    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d-run\") pod \"tuned-nhsgz\" (UID: \"f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d\") " pod="openshift-cluster-node-tuning-operator/tuned-nhsgz"
Jul 20 13:01:36.246152 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.245558    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4ad79612-15fd-48a7-a9cc-33f53c58ca69-cni-binary-copy\") pod \"multus-additional-cni-plugins-g47kp\" (UID: \"4ad79612-15fd-48a7-a9cc-33f53c58ca69\") " pod="openshift-multus/multus-additional-cni-plugins-g47kp"
Jul 20 13:01:36.246152 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.245587    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d-host\") pod \"tuned-nhsgz\" (UID: \"f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d\") " pod="openshift-cluster-node-tuning-operator/tuned-nhsgz"
Jul 20 13:01:36.246152 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.245611    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4f76ce36-97e3-4eb9-b591-ff1c7b5d02f8-host-slash\") pod \"iptables-alerter-s8tlk\" (UID: \"4f76ce36-97e3-4eb9-b591-ff1c7b5d02f8\") " pod="openshift-network-operator/iptables-alerter-s8tlk"
Jul 20 13:01:36.246152 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.245638    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d-tmp\") pod \"tuned-nhsgz\" (UID: \"f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d\") " pod="openshift-cluster-node-tuning-operator/tuned-nhsgz"
Jul 20 13:01:36.246152 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.245666    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/644b7e3b-af11-4d30-9fff-aaf8a83319bf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zkb7v\" (UID: \"644b7e3b-af11-4d30-9fff-aaf8a83319bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkb7v"
Jul 20 13:01:36.246152 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.245696    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/644b7e3b-af11-4d30-9fff-aaf8a83319bf-registration-dir\") pod \"aws-ebs-csi-driver-node-zkb7v\" (UID: \"644b7e3b-af11-4d30-9fff-aaf8a83319bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkb7v"
Jul 20 13:01:36.246152 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.245724    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vqmwh\" (UniqueName: \"kubernetes.io/projected/644b7e3b-af11-4d30-9fff-aaf8a83319bf-kube-api-access-vqmwh\") pod \"aws-ebs-csi-driver-node-zkb7v\" (UID: \"644b7e3b-af11-4d30-9fff-aaf8a83319bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkb7v"
Jul 20 13:01:36.246152 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.245752    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4nvc\" (UniqueName: \"kubernetes.io/projected/2e3cfb74-ae63-457e-abb7-fc0e5f459dbb-kube-api-access-d4nvc\") pod \"node-ca-dcnn2\" (UID: \"2e3cfb74-ae63-457e-abb7-fc0e5f459dbb\") " pod="openshift-image-registry/node-ca-dcnn2"
Jul 20 13:01:36.246152 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.245779    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8qx5r\" (UniqueName: \"kubernetes.io/projected/4f76ce36-97e3-4eb9-b591-ff1c7b5d02f8-kube-api-access-8qx5r\") pod \"iptables-alerter-s8tlk\" (UID: \"4f76ce36-97e3-4eb9-b591-ff1c7b5d02f8\") " pod="openshift-network-operator/iptables-alerter-s8tlk"
Jul 20 13:01:36.246916 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.245810    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zccgv\" (UniqueName: \"kubernetes.io/projected/f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d-kube-api-access-zccgv\") pod \"tuned-nhsgz\" (UID: \"f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d\") " pod="openshift-cluster-node-tuning-operator/tuned-nhsgz"
Jul 20 13:01:36.246916 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.245836    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4ad79612-15fd-48a7-a9cc-33f53c58ca69-system-cni-dir\") pod \"multus-additional-cni-plugins-g47kp\" (UID: \"4ad79612-15fd-48a7-a9cc-33f53c58ca69\") " pod="openshift-multus/multus-additional-cni-plugins-g47kp"
Jul 20 13:01:36.246916 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.245869    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/84be7850-b3b8-49a2-899f-5d16ab5a0de4-konnectivity-ca\") pod \"konnectivity-agent-7mhbt\" (UID: \"84be7850-b3b8-49a2-899f-5d16ab5a0de4\") " pod="kube-system/konnectivity-agent-7mhbt"
Jul 20 13:01:36.246916 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.245896    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9km99\" (UniqueName: \"kubernetes.io/projected/6b89bab8-ce68-4a47-8922-7983e250b5c7-kube-api-access-9km99\") pod \"network-check-target-8vjqm\" (UID: \"6b89bab8-ce68-4a47-8922-7983e250b5c7\") " pod="openshift-network-diagnostics/network-check-target-8vjqm"
Jul 20 13:01:36.246916 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.245922    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d-etc-kubernetes\") pod \"tuned-nhsgz\" (UID: \"f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d\") " pod="openshift-cluster-node-tuning-operator/tuned-nhsgz"
Jul 20 13:01:36.246916 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.246036    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d-etc-kubernetes\") pod \"tuned-nhsgz\" (UID: \"f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d\") " pod="openshift-cluster-node-tuning-operator/tuned-nhsgz"
Jul 20 13:01:36.246916 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.246087    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d-dbus\") pod \"global-pull-secret-syncer-bjz6v\" (UID: \"52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d\") " pod="kube-system/global-pull-secret-syncer-bjz6v"
Jul 20 13:01:36.246916 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.246163    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/644b7e3b-af11-4d30-9fff-aaf8a83319bf-socket-dir\") pod \"aws-ebs-csi-driver-node-zkb7v\" (UID: \"644b7e3b-af11-4d30-9fff-aaf8a83319bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkb7v"
Jul 20 13:01:36.246916 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.246216    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/4ad79612-15fd-48a7-a9cc-33f53c58ca69-tuning-conf-dir\") pod \"multus-additional-cni-plugins-g47kp\" (UID: \"4ad79612-15fd-48a7-a9cc-33f53c58ca69\") " pod="openshift-multus/multus-additional-cni-plugins-g47kp"
Jul 20 13:01:36.246916 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.246272    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d-etc-sysctl-d\") pod \"tuned-nhsgz\" (UID: \"f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d\") " pod="openshift-cluster-node-tuning-operator/tuned-nhsgz"
Jul 20 13:01:36.246916 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:36.246301    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 13:01:36.246916 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.246333    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d-etc-systemd\") pod \"tuned-nhsgz\" (UID: \"f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d\") " pod="openshift-cluster-node-tuning-operator/tuned-nhsgz"
Jul 20 13:01:36.246916 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:36.246428    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d-original-pull-secret podName:52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d nodeName:}" failed. No retries permitted until 2026-07-20 13:01:36.746364168 +0000 UTC m=+3.215896268 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d-original-pull-secret") pod "global-pull-secret-syncer-bjz6v" (UID: "52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d") : object "kube-system"/"original-pull-secret" not registered
Jul 20 13:01:36.246916 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.246604    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d-etc-modprobe-d\") pod \"tuned-nhsgz\" (UID: \"f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d\") " pod="openshift-cluster-node-tuning-operator/tuned-nhsgz"
Jul 20 13:01:36.247636 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.246666    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d-sys\") pod \"tuned-nhsgz\" (UID: \"f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d\") " pod="openshift-cluster-node-tuning-operator/tuned-nhsgz"
Jul 20 13:01:36.247636 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:36.246752    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 13:01:36.247636 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:36.246799    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81f8fe49-b58b-4eb9-8322-547266b00f73-metrics-certs podName:81f8fe49-b58b-4eb9-8322-547266b00f73 nodeName:}" failed. No retries permitted until 2026-07-20 13:01:36.746782747 +0000 UTC m=+3.216314849 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/81f8fe49-b58b-4eb9-8322-547266b00f73-metrics-certs") pod "network-metrics-daemon-tbfs8" (UID: "81f8fe49-b58b-4eb9-8322-547266b00f73") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 13:01:36.247636 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.246848    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/644b7e3b-af11-4d30-9fff-aaf8a83319bf-device-dir\") pod \"aws-ebs-csi-driver-node-zkb7v\" (UID: \"644b7e3b-af11-4d30-9fff-aaf8a83319bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkb7v"
Jul 20 13:01:36.247636 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.246949    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/4ad79612-15fd-48a7-a9cc-33f53c58ca69-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-g47kp\" (UID: \"4ad79612-15fd-48a7-a9cc-33f53c58ca69\") " pod="openshift-multus/multus-additional-cni-plugins-g47kp"
Jul 20 13:01:36.247636 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.247018    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d-etc-sysctl-conf\") pod \"tuned-nhsgz\" (UID: \"f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d\") " pod="openshift-cluster-node-tuning-operator/tuned-nhsgz"
Jul 20 13:01:36.247636 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.247027    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/4ad79612-15fd-48a7-a9cc-33f53c58ca69-cnibin\") pod \"multus-additional-cni-plugins-g47kp\" (UID: \"4ad79612-15fd-48a7-a9cc-33f53c58ca69\") " pod="openshift-multus/multus-additional-cni-plugins-g47kp"
Jul 20 13:01:36.247636 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.247308    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/4f76ce36-97e3-4eb9-b591-ff1c7b5d02f8-iptables-alerter-script\") pod \"iptables-alerter-s8tlk\" (UID: \"4f76ce36-97e3-4eb9-b591-ff1c7b5d02f8\") " pod="openshift-network-operator/iptables-alerter-s8tlk"
Jul 20 13:01:36.247636 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.247331    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d-lib-modules\") pod \"tuned-nhsgz\" (UID: \"f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d\") " pod="openshift-cluster-node-tuning-operator/tuned-nhsgz"
Jul 20 13:01:36.247636 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.247427    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/644b7e3b-af11-4d30-9fff-aaf8a83319bf-etc-selinux\") pod \"aws-ebs-csi-driver-node-zkb7v\" (UID: \"644b7e3b-af11-4d30-9fff-aaf8a83319bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkb7v"
Jul 20 13:01:36.247636 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.247457    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d-etc-sysconfig\") pod \"tuned-nhsgz\" (UID: \"f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d\") " pod="openshift-cluster-node-tuning-operator/tuned-nhsgz"
Jul 20 13:01:36.247636 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.247517    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d-run\") pod \"tuned-nhsgz\" (UID: \"f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d\") " pod="openshift-cluster-node-tuning-operator/tuned-nhsgz"
Jul 20 13:01:36.247636 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.247523    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/4ad79612-15fd-48a7-a9cc-33f53c58ca69-os-release\") pod \"multus-additional-cni-plugins-g47kp\" (UID: \"4ad79612-15fd-48a7-a9cc-33f53c58ca69\") " pod="openshift-multus/multus-additional-cni-plugins-g47kp"
Jul 20 13:01:36.247636 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.247578    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d-kubelet-config\") pod \"global-pull-secret-syncer-bjz6v\" (UID: \"52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d\") " pod="kube-system/global-pull-secret-syncer-bjz6v"
Jul 20 13:01:36.248501 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.247612    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d-var-lib-kubelet\") pod \"tuned-nhsgz\" (UID: \"f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d\") " pod="openshift-cluster-node-tuning-operator/tuned-nhsgz"
Jul 20 13:01:36.248501 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.247815    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d-host\") pod \"tuned-nhsgz\" (UID: \"f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d\") " pod="openshift-cluster-node-tuning-operator/tuned-nhsgz"
Jul 20 13:01:36.248501 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.247847    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4f76ce36-97e3-4eb9-b591-ff1c7b5d02f8-host-slash\") pod \"iptables-alerter-s8tlk\" (UID: \"4f76ce36-97e3-4eb9-b591-ff1c7b5d02f8\") " pod="openshift-network-operator/iptables-alerter-s8tlk"
Jul 20 13:01:36.248501 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.247877    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/4ad79612-15fd-48a7-a9cc-33f53c58ca69-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-g47kp\" (UID: \"4ad79612-15fd-48a7-a9cc-33f53c58ca69\") " pod="openshift-multus/multus-additional-cni-plugins-g47kp"
Jul 20 13:01:36.248501 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.247968    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/644b7e3b-af11-4d30-9fff-aaf8a83319bf-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zkb7v\" (UID: \"644b7e3b-af11-4d30-9fff-aaf8a83319bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkb7v"
Jul 20 13:01:36.248501 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.247985    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/2e3cfb74-ae63-457e-abb7-fc0e5f459dbb-serviceca\") pod \"node-ca-dcnn2\" (UID: \"2e3cfb74-ae63-457e-abb7-fc0e5f459dbb\") " pod="openshift-image-registry/node-ca-dcnn2"
Jul 20 13:01:36.248501 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.247992    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/4ad79612-15fd-48a7-a9cc-33f53c58ca69-cni-binary-copy\") pod \"multus-additional-cni-plugins-g47kp\" (UID: \"4ad79612-15fd-48a7-a9cc-33f53c58ca69\") " pod="openshift-multus/multus-additional-cni-plugins-g47kp"
Jul 20 13:01:36.248501 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.248027    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/2e3cfb74-ae63-457e-abb7-fc0e5f459dbb-host\") pod \"node-ca-dcnn2\" (UID: \"2e3cfb74-ae63-457e-abb7-fc0e5f459dbb\") " pod="openshift-image-registry/node-ca-dcnn2"
Jul 20 13:01:36.248501 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.248156    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/644b7e3b-af11-4d30-9fff-aaf8a83319bf-sys-fs\") pod \"aws-ebs-csi-driver-node-zkb7v\" (UID: \"644b7e3b-af11-4d30-9fff-aaf8a83319bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkb7v"
Jul 20 13:01:36.248501 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.248216    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/4ad79612-15fd-48a7-a9cc-33f53c58ca69-system-cni-dir\") pod \"multus-additional-cni-plugins-g47kp\" (UID: \"4ad79612-15fd-48a7-a9cc-33f53c58ca69\") " pod="openshift-multus/multus-additional-cni-plugins-g47kp"
Jul 20 13:01:36.248501 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.248238    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/644b7e3b-af11-4d30-9fff-aaf8a83319bf-registration-dir\") pod \"aws-ebs-csi-driver-node-zkb7v\" (UID: \"644b7e3b-af11-4d30-9fff-aaf8a83319bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkb7v"
Jul 20 13:01:36.249559 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.249480    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d-etc-tuned\") pod \"tuned-nhsgz\" (UID: \"f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d\") " pod="openshift-cluster-node-tuning-operator/tuned-nhsgz"
Jul 20 13:01:36.249760 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.249734    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/84be7850-b3b8-49a2-899f-5d16ab5a0de4-konnectivity-ca\") pod \"konnectivity-agent-7mhbt\" (UID: \"84be7850-b3b8-49a2-899f-5d16ab5a0de4\") " pod="kube-system/konnectivity-agent-7mhbt"
Jul 20 13:01:36.250669 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.250645    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d-tmp\") pod \"tuned-nhsgz\" (UID: \"f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d\") " pod="openshift-cluster-node-tuning-operator/tuned-nhsgz"
Jul 20 13:01:36.251856 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.251814    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/84be7850-b3b8-49a2-899f-5d16ab5a0de4-agent-certs\") pod \"konnectivity-agent-7mhbt\" (UID: \"84be7850-b3b8-49a2-899f-5d16ab5a0de4\") " pod="kube-system/konnectivity-agent-7mhbt"
Jul 20 13:01:36.260182 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:36.260146    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 13:01:36.260182 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:36.260185    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 13:01:36.260356 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:36.260203    2565 projected.go:196] Error preparing data for projected volume kube-api-access-9km99 for pod openshift-network-diagnostics/network-check-target-8vjqm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 13:01:36.260449 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:36.260400    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b89bab8-ce68-4a47-8922-7983e250b5c7-kube-api-access-9km99 podName:6b89bab8-ce68-4a47-8922-7983e250b5c7 nodeName:}" failed. No retries permitted until 2026-07-20 13:01:36.760361148 +0000 UTC m=+3.229893282 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-9km99" (UniqueName: "kubernetes.io/projected/6b89bab8-ce68-4a47-8922-7983e250b5c7-kube-api-access-9km99") pod "network-check-target-8vjqm" (UID: "6b89bab8-ce68-4a47-8922-7983e250b5c7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 13:01:36.265204 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.265177    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8qx5r\" (UniqueName: \"kubernetes.io/projected/4f76ce36-97e3-4eb9-b591-ff1c7b5d02f8-kube-api-access-8qx5r\") pod \"iptables-alerter-s8tlk\" (UID: \"4f76ce36-97e3-4eb9-b591-ff1c7b5d02f8\") " pod="openshift-network-operator/iptables-alerter-s8tlk"
Jul 20 13:01:36.265747 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.265720    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4nvc\" (UniqueName: \"kubernetes.io/projected/2e3cfb74-ae63-457e-abb7-fc0e5f459dbb-kube-api-access-d4nvc\") pod \"node-ca-dcnn2\" (UID: \"2e3cfb74-ae63-457e-abb7-fc0e5f459dbb\") " pod="openshift-image-registry/node-ca-dcnn2"
Jul 20 13:01:36.266420 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.266381    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vqmwh\" (UniqueName: \"kubernetes.io/projected/644b7e3b-af11-4d30-9fff-aaf8a83319bf-kube-api-access-vqmwh\") pod \"aws-ebs-csi-driver-node-zkb7v\" (UID: \"644b7e3b-af11-4d30-9fff-aaf8a83319bf\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkb7v"
Jul 20 13:01:36.267036 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.267012    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vdgx6\" (UniqueName: \"kubernetes.io/projected/81f8fe49-b58b-4eb9-8322-547266b00f73-kube-api-access-vdgx6\") pod \"network-metrics-daemon-tbfs8\" (UID: \"81f8fe49-b58b-4eb9-8322-547266b00f73\") " pod="openshift-multus/network-metrics-daemon-tbfs8"
Jul 20 13:01:36.267963 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.267907    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zccgv\" (UniqueName: \"kubernetes.io/projected/f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d-kube-api-access-zccgv\") pod \"tuned-nhsgz\" (UID: \"f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d\") " pod="openshift-cluster-node-tuning-operator/tuned-nhsgz"
Jul 20 13:01:36.268710 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.268679    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vkg98\" (UniqueName: \"kubernetes.io/projected/4ad79612-15fd-48a7-a9cc-33f53c58ca69-kube-api-access-vkg98\") pod \"multus-additional-cni-plugins-g47kp\" (UID: \"4ad79612-15fd-48a7-a9cc-33f53c58ca69\") " pod="openshift-multus/multus-additional-cni-plugins-g47kp"
Jul 20 13:01:36.289372 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.289346    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r"
Jul 20 13:01:36.300872 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.300815    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lsrxw"
Jul 20 13:01:36.311889 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:36.311851    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbf9a432f_9b17_467c_826d_50f1ce4cfd7c.slice/crio-46570323a2a5ff5f4b2281909adb548eeaaaee7ef9de8dacd04b285e5a4812af WatchSource:0}: Error finding container 46570323a2a5ff5f4b2281909adb548eeaaaee7ef9de8dacd04b285e5a4812af: Status 404 returned error can't find the container with id 46570323a2a5ff5f4b2281909adb548eeaaaee7ef9de8dacd04b285e5a4812af
Jul 20 13:01:36.312986 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.312817    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-rlmj7"
Jul 20 13:01:36.326243 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:36.326213    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod002d1aca_ffaa_4461_8906_6816cdfe6274.slice/crio-f8d78173fe1e331cd3fe25b6f5da7b5e0b48bc582f5db3ce3de68f2389d1cb71 WatchSource:0}: Error finding container f8d78173fe1e331cd3fe25b6f5da7b5e0b48bc582f5db3ce3de68f2389d1cb71: Status 404 returned error can't find the container with id f8d78173fe1e331cd3fe25b6f5da7b5e0b48bc582f5db3ce3de68f2389d1cb71
Jul 20 13:01:36.327499 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.327475    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-g47kp"
Jul 20 13:01:36.341509 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:36.341481    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4ad79612_15fd_48a7_a9cc_33f53c58ca69.slice/crio-d27890d69acf82b948e04905947bbeb01304440f5f541c0208405a7aa0fac0e2 WatchSource:0}: Error finding container d27890d69acf82b948e04905947bbeb01304440f5f541c0208405a7aa0fac0e2: Status 404 returned error can't find the container with id d27890d69acf82b948e04905947bbeb01304440f5f541c0208405a7aa0fac0e2
Jul 20 13:01:36.349078 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.349056    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-s8tlk"
Jul 20 13:01:36.358650 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.358496    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkb7v"
Jul 20 13:01:36.358884 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:36.358850    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f76ce36_97e3_4eb9_b591_ff1c7b5d02f8.slice/crio-174e3f32adea4c0c332a20849ef182c9f518719637078ed161da4534c347a6d4 WatchSource:0}: Error finding container 174e3f32adea4c0c332a20849ef182c9f518719637078ed161da4534c347a6d4: Status 404 returned error can't find the container with id 174e3f32adea4c0c332a20849ef182c9f518719637078ed161da4534c347a6d4
Jul 20 13:01:36.369207 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:36.369174    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod644b7e3b_af11_4d30_9fff_aaf8a83319bf.slice/crio-0b8cf5dc48e9f4eb16d4fd2b88eb989d0ee315966d94040afc2abbfa519a2f36 WatchSource:0}: Error finding container 0b8cf5dc48e9f4eb16d4fd2b88eb989d0ee315966d94040afc2abbfa519a2f36: Status 404 returned error can't find the container with id 0b8cf5dc48e9f4eb16d4fd2b88eb989d0ee315966d94040afc2abbfa519a2f36
Jul 20 13:01:36.436188 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.435970    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-7mhbt"
Jul 20 13:01:36.461828 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.461790    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-nhsgz"
Jul 20 13:01:36.476733 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.476705    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-dcnn2"
Jul 20 13:01:36.559040 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.558949    2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 20 13:01:36.750902 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.750870    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/81f8fe49-b58b-4eb9-8322-547266b00f73-metrics-certs\") pod \"network-metrics-daemon-tbfs8\" (UID: \"81f8fe49-b58b-4eb9-8322-547266b00f73\") " pod="openshift-multus/network-metrics-daemon-tbfs8"
Jul 20 13:01:36.751098 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.750940    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d-original-pull-secret\") pod \"global-pull-secret-syncer-bjz6v\" (UID: \"52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d\") " pod="kube-system/global-pull-secret-syncer-bjz6v"
Jul 20 13:01:36.751098 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:36.751032    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 13:01:36.751098 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:36.751090    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 13:01:36.751225 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:36.751103    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81f8fe49-b58b-4eb9-8322-547266b00f73-metrics-certs podName:81f8fe49-b58b-4eb9-8322-547266b00f73 nodeName:}" failed. No retries permitted until 2026-07-20 13:01:37.751087351 +0000 UTC m=+4.220619449 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/81f8fe49-b58b-4eb9-8322-547266b00f73-metrics-certs") pod "network-metrics-daemon-tbfs8" (UID: "81f8fe49-b58b-4eb9-8322-547266b00f73") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 13:01:36.751225 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:36.751147    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d-original-pull-secret podName:52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d nodeName:}" failed. No retries permitted until 2026-07-20 13:01:37.751132573 +0000 UTC m=+4.220664687 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d-original-pull-secret") pod "global-pull-secret-syncer-bjz6v" (UID: "52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d") : object "kube-system"/"original-pull-secret" not registered
Jul 20 13:01:36.851477 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.851360    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9km99\" (UniqueName: \"kubernetes.io/projected/6b89bab8-ce68-4a47-8922-7983e250b5c7-kube-api-access-9km99\") pod \"network-check-target-8vjqm\" (UID: \"6b89bab8-ce68-4a47-8922-7983e250b5c7\") " pod="openshift-network-diagnostics/network-check-target-8vjqm"
Jul 20 13:01:36.851638 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:36.851557    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 13:01:36.851638 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:36.851583    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 13:01:36.851638 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:36.851594    2565 projected.go:196] Error preparing data for projected volume kube-api-access-9km99 for pod openshift-network-diagnostics/network-check-target-8vjqm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 13:01:36.851813 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:36.851652    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b89bab8-ce68-4a47-8922-7983e250b5c7-kube-api-access-9km99 podName:6b89bab8-ce68-4a47-8922-7983e250b5c7 nodeName:}" failed. No retries permitted until 2026-07-20 13:01:37.851637018 +0000 UTC m=+4.321169134 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-9km99" (UniqueName: "kubernetes.io/projected/6b89bab8-ce68-4a47-8922-7983e250b5c7-kube-api-access-9km99") pod "network-check-target-8vjqm" (UID: "6b89bab8-ce68-4a47-8922-7983e250b5c7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 13:01:36.998067 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.997978    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 12:56:36 +0000 UTC" deadline="2028-03-23 23:46:23.476745695 +0000 UTC"
Jul 20 13:01:36.998067 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:36.998057    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14698h44m46.478691591s"
Jul 20 13:01:37.166820 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:37.166734    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lsrxw" event={"ID":"bf9a432f-9b17-467c-826d-50f1ce4cfd7c","Type":"ContainerStarted","Data":"46570323a2a5ff5f4b2281909adb548eeaaaee7ef9de8dacd04b285e5a4812af"}
Jul 20 13:01:37.168884 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:37.168834    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r" event={"ID":"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac","Type":"ContainerStarted","Data":"b99c9032c23f4a16d6ac71c31cbca93db0594dbaf9c11639eb406893eca7182c"}
Jul 20 13:01:37.170485 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:37.170384    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkb7v" event={"ID":"644b7e3b-af11-4d30-9fff-aaf8a83319bf","Type":"ContainerStarted","Data":"0b8cf5dc48e9f4eb16d4fd2b88eb989d0ee315966d94040afc2abbfa519a2f36"}
Jul 20 13:01:37.172357 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:37.172281    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-s8tlk" event={"ID":"4f76ce36-97e3-4eb9-b591-ff1c7b5d02f8","Type":"ContainerStarted","Data":"174e3f32adea4c0c332a20849ef182c9f518719637078ed161da4534c347a6d4"}
Jul 20 13:01:37.173845 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:37.173818    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g47kp" event={"ID":"4ad79612-15fd-48a7-a9cc-33f53c58ca69","Type":"ContainerStarted","Data":"d27890d69acf82b948e04905947bbeb01304440f5f541c0208405a7aa0fac0e2"}
Jul 20 13:01:37.176853 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:37.176827    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rlmj7" event={"ID":"002d1aca-ffaa-4461-8906-6816cdfe6274","Type":"ContainerStarted","Data":"f8d78173fe1e331cd3fe25b6f5da7b5e0b48bc582f5db3ce3de68f2389d1cb71"}
Jul 20 13:01:37.760094 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:37.759641    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/81f8fe49-b58b-4eb9-8322-547266b00f73-metrics-certs\") pod \"network-metrics-daemon-tbfs8\" (UID: \"81f8fe49-b58b-4eb9-8322-547266b00f73\") " pod="openshift-multus/network-metrics-daemon-tbfs8"
Jul 20 13:01:37.760094 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:37.759734    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d-original-pull-secret\") pod \"global-pull-secret-syncer-bjz6v\" (UID: \"52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d\") " pod="kube-system/global-pull-secret-syncer-bjz6v"
Jul 20 13:01:37.760094 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:37.759879    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 13:01:37.760094 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:37.759947    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d-original-pull-secret podName:52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d nodeName:}" failed. No retries permitted until 2026-07-20 13:01:39.759926358 +0000 UTC m=+6.229458460 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d-original-pull-secret") pod "global-pull-secret-syncer-bjz6v" (UID: "52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d") : object "kube-system"/"original-pull-secret" not registered
Jul 20 13:01:37.760094 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:37.760036    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 13:01:37.760094 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:37.760074    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81f8fe49-b58b-4eb9-8322-547266b00f73-metrics-certs podName:81f8fe49-b58b-4eb9-8322-547266b00f73 nodeName:}" failed. No retries permitted until 2026-07-20 13:01:39.760061782 +0000 UTC m=+6.229593898 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/81f8fe49-b58b-4eb9-8322-547266b00f73-metrics-certs") pod "network-metrics-daemon-tbfs8" (UID: "81f8fe49-b58b-4eb9-8322-547266b00f73") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 13:01:37.772646 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:37.772611    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6bb58e8_ae96_42cc_88d8_33bf8dde3c0d.slice/crio-7eb6b0021dcd3aac39a999c230033c90e4094c1aca8cc1456b8cba777c965f79 WatchSource:0}: Error finding container 7eb6b0021dcd3aac39a999c230033c90e4094c1aca8cc1456b8cba777c965f79: Status 404 returned error can't find the container with id 7eb6b0021dcd3aac39a999c230033c90e4094c1aca8cc1456b8cba777c965f79
Jul 20 13:01:37.774565 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:37.774346    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod84be7850_b3b8_49a2_899f_5d16ab5a0de4.slice/crio-534e64d286bcc5cffda2960a8c1b125e6ee8ae4f6c96fba2fce47c75716d8866 WatchSource:0}: Error finding container 534e64d286bcc5cffda2960a8c1b125e6ee8ae4f6c96fba2fce47c75716d8866: Status 404 returned error can't find the container with id 534e64d286bcc5cffda2960a8c1b125e6ee8ae4f6c96fba2fce47c75716d8866
Jul 20 13:01:37.803478 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:01:37.802873    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e3cfb74_ae63_457e_abb7_fc0e5f459dbb.slice/crio-3a454f014228311a390104bce71095be9d87cdbc5722ec7a8b2d9b7c63ec2fa1 WatchSource:0}: Error finding container 3a454f014228311a390104bce71095be9d87cdbc5722ec7a8b2d9b7c63ec2fa1: Status 404 returned error can't find the container with id 3a454f014228311a390104bce71095be9d87cdbc5722ec7a8b2d9b7c63ec2fa1
Jul 20 13:01:37.861058 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:37.860873    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9km99\" (UniqueName: \"kubernetes.io/projected/6b89bab8-ce68-4a47-8922-7983e250b5c7-kube-api-access-9km99\") pod \"network-check-target-8vjqm\" (UID: \"6b89bab8-ce68-4a47-8922-7983e250b5c7\") " pod="openshift-network-diagnostics/network-check-target-8vjqm"
Jul 20 13:01:37.861163 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:37.861098    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 13:01:37.861163 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:37.861125    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 13:01:37.861163 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:37.861141    2565 projected.go:196] Error preparing data for projected volume kube-api-access-9km99 for pod openshift-network-diagnostics/network-check-target-8vjqm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 13:01:37.861320 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:37.861210    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b89bab8-ce68-4a47-8922-7983e250b5c7-kube-api-access-9km99 podName:6b89bab8-ce68-4a47-8922-7983e250b5c7 nodeName:}" failed. No retries permitted until 2026-07-20 13:01:39.861188986 +0000 UTC m=+6.330721103 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-9km99" (UniqueName: "kubernetes.io/projected/6b89bab8-ce68-4a47-8922-7983e250b5c7-kube-api-access-9km99") pod "network-check-target-8vjqm" (UID: "6b89bab8-ce68-4a47-8922-7983e250b5c7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 13:01:37.998348 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:37.998269    2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-19 12:56:36 +0000 UTC" deadline="2028-01-17 00:15:24.257622926 +0000 UTC"
Jul 20 13:01:37.998348 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:37.998324    2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13091h13m46.259302591s"
Jul 20 13:01:38.144818 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:38.144724    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vjqm"
Jul 20 13:01:38.144991 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:38.144863    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vjqm" podUID="6b89bab8-ce68-4a47-8922-7983e250b5c7"
Jul 20 13:01:38.145655 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:38.145285    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bjz6v"
Jul 20 13:01:38.145655 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:38.145396    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bjz6v" podUID="52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d"
Jul 20 13:01:38.145655 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:38.145485    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbfs8"
Jul 20 13:01:38.145655 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:38.145574    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbfs8" podUID="81f8fe49-b58b-4eb9-8322-547266b00f73"
Jul 20 13:01:38.194871 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:38.194759    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dcnn2" event={"ID":"2e3cfb74-ae63-457e-abb7-fc0e5f459dbb","Type":"ContainerStarted","Data":"3a454f014228311a390104bce71095be9d87cdbc5722ec7a8b2d9b7c63ec2fa1"}
Jul 20 13:01:38.203749 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:38.203716    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nhsgz" event={"ID":"f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d","Type":"ContainerStarted","Data":"7eb6b0021dcd3aac39a999c230033c90e4094c1aca8cc1456b8cba777c965f79"}
Jul 20 13:01:38.209786 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:38.209751    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-182.ec2.internal" event={"ID":"b9336d48ae54902b2478c38cf3608a5e","Type":"ContainerStarted","Data":"e7cbdc7ce2eea408a76caa0e45be8fa823ee36a3f9d7cd59e23aa76cdfa0ba44"}
Jul 20 13:01:38.214995 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:38.214202    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7mhbt" event={"ID":"84be7850-b3b8-49a2-899f-5d16ab5a0de4","Type":"ContainerStarted","Data":"534e64d286bcc5cffda2960a8c1b125e6ee8ae4f6c96fba2fce47c75716d8866"}
Jul 20 13:01:38.227178 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:38.227129    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-141-182.ec2.internal" podStartSLOduration=3.227110622 podStartE2EDuration="3.227110622s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 13:01:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:01:38.226150924 +0000 UTC m=+4.695683065" watchObservedRunningTime="2026-07-20 13:01:38.227110622 +0000 UTC m=+4.696642741"
Jul 20 13:01:39.226826 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:39.226784    2565 generic.go:356] "Generic (PLEG): container finished" podID="3cbdd8dc17b46b583decda50ce1bde1d" containerID="f29a4474f0a9550cecede3dbcd9584525f76d403245f43c6dc735d0526087244" exitCode=0
Jul 20 13:01:39.227793 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:39.227764    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-182.ec2.internal" event={"ID":"3cbdd8dc17b46b583decda50ce1bde1d","Type":"ContainerDied","Data":"f29a4474f0a9550cecede3dbcd9584525f76d403245f43c6dc735d0526087244"}
Jul 20 13:01:39.778680 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:39.778634    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d-original-pull-secret\") pod \"global-pull-secret-syncer-bjz6v\" (UID: \"52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d\") " pod="kube-system/global-pull-secret-syncer-bjz6v"
Jul 20 13:01:39.778892 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:39.778723    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/81f8fe49-b58b-4eb9-8322-547266b00f73-metrics-certs\") pod \"network-metrics-daemon-tbfs8\" (UID: \"81f8fe49-b58b-4eb9-8322-547266b00f73\") " pod="openshift-multus/network-metrics-daemon-tbfs8"
Jul 20 13:01:39.778892 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:39.778871    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 13:01:39.779028 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:39.778950    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81f8fe49-b58b-4eb9-8322-547266b00f73-metrics-certs podName:81f8fe49-b58b-4eb9-8322-547266b00f73 nodeName:}" failed. No retries permitted until 2026-07-20 13:01:43.778928568 +0000 UTC m=+10.248460670 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/81f8fe49-b58b-4eb9-8322-547266b00f73-metrics-certs") pod "network-metrics-daemon-tbfs8" (UID: "81f8fe49-b58b-4eb9-8322-547266b00f73") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 13:01:39.779387 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:39.779366    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 13:01:39.779534 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:39.779427    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d-original-pull-secret podName:52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d nodeName:}" failed. No retries permitted until 2026-07-20 13:01:43.779411902 +0000 UTC m=+10.248944015 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d-original-pull-secret") pod "global-pull-secret-syncer-bjz6v" (UID: "52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d") : object "kube-system"/"original-pull-secret" not registered
Jul 20 13:01:39.879978 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:39.879931    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9km99\" (UniqueName: \"kubernetes.io/projected/6b89bab8-ce68-4a47-8922-7983e250b5c7-kube-api-access-9km99\") pod \"network-check-target-8vjqm\" (UID: \"6b89bab8-ce68-4a47-8922-7983e250b5c7\") " pod="openshift-network-diagnostics/network-check-target-8vjqm"
Jul 20 13:01:39.880175 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:39.880132    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 13:01:39.880175 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:39.880152    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 13:01:39.880175 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:39.880166    2565 projected.go:196] Error preparing data for projected volume kube-api-access-9km99 for pod openshift-network-diagnostics/network-check-target-8vjqm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 13:01:39.880352 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:39.880235    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b89bab8-ce68-4a47-8922-7983e250b5c7-kube-api-access-9km99 podName:6b89bab8-ce68-4a47-8922-7983e250b5c7 nodeName:}" failed. No retries permitted until 2026-07-20 13:01:43.880216376 +0000 UTC m=+10.349748478 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-9km99" (UniqueName: "kubernetes.io/projected/6b89bab8-ce68-4a47-8922-7983e250b5c7-kube-api-access-9km99") pod "network-check-target-8vjqm" (UID: "6b89bab8-ce68-4a47-8922-7983e250b5c7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 13:01:40.141513 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:40.141423    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bjz6v"
Jul 20 13:01:40.141686 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:40.141607    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bjz6v" podUID="52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d"
Jul 20 13:01:40.141746 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:40.141712    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbfs8"
Jul 20 13:01:40.141853 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:40.141812    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbfs8" podUID="81f8fe49-b58b-4eb9-8322-547266b00f73"
Jul 20 13:01:40.142063 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:40.142038    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vjqm"
Jul 20 13:01:40.142165 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:40.142143    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vjqm" podUID="6b89bab8-ce68-4a47-8922-7983e250b5c7"
Jul 20 13:01:42.142386 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:42.142292    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vjqm"
Jul 20 13:01:42.142856 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:42.142292    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bjz6v"
Jul 20 13:01:42.142856 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:42.142446    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbfs8"
Jul 20 13:01:42.142856 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:42.142438    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vjqm" podUID="6b89bab8-ce68-4a47-8922-7983e250b5c7"
Jul 20 13:01:42.142856 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:42.142562    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bjz6v" podUID="52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d"
Jul 20 13:01:42.142856 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:42.142672    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbfs8" podUID="81f8fe49-b58b-4eb9-8322-547266b00f73"
Jul 20 13:01:43.812074 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:43.812022    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d-original-pull-secret\") pod \"global-pull-secret-syncer-bjz6v\" (UID: \"52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d\") " pod="kube-system/global-pull-secret-syncer-bjz6v"
Jul 20 13:01:43.812558 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:43.812097    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/81f8fe49-b58b-4eb9-8322-547266b00f73-metrics-certs\") pod \"network-metrics-daemon-tbfs8\" (UID: \"81f8fe49-b58b-4eb9-8322-547266b00f73\") " pod="openshift-multus/network-metrics-daemon-tbfs8"
Jul 20 13:01:43.812558 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:43.812200    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 13:01:43.812558 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:43.812224    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 13:01:43.812558 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:43.812282    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81f8fe49-b58b-4eb9-8322-547266b00f73-metrics-certs podName:81f8fe49-b58b-4eb9-8322-547266b00f73 nodeName:}" failed. No retries permitted until 2026-07-20 13:01:51.81226184 +0000 UTC m=+18.281793940 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/81f8fe49-b58b-4eb9-8322-547266b00f73-metrics-certs") pod "network-metrics-daemon-tbfs8" (UID: "81f8fe49-b58b-4eb9-8322-547266b00f73") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 13:01:43.812558 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:43.812302    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d-original-pull-secret podName:52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d nodeName:}" failed. No retries permitted until 2026-07-20 13:01:51.812291222 +0000 UTC m=+18.281823325 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d-original-pull-secret") pod "global-pull-secret-syncer-bjz6v" (UID: "52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d") : object "kube-system"/"original-pull-secret" not registered
Jul 20 13:01:43.912898 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:43.912834    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9km99\" (UniqueName: \"kubernetes.io/projected/6b89bab8-ce68-4a47-8922-7983e250b5c7-kube-api-access-9km99\") pod \"network-check-target-8vjqm\" (UID: \"6b89bab8-ce68-4a47-8922-7983e250b5c7\") " pod="openshift-network-diagnostics/network-check-target-8vjqm"
Jul 20 13:01:43.913065 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:43.912987    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 13:01:43.913065 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:43.913014    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 13:01:43.913065 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:43.913030    2565 projected.go:196] Error preparing data for projected volume kube-api-access-9km99 for pod openshift-network-diagnostics/network-check-target-8vjqm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 13:01:43.913248 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:43.913095    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b89bab8-ce68-4a47-8922-7983e250b5c7-kube-api-access-9km99 podName:6b89bab8-ce68-4a47-8922-7983e250b5c7 nodeName:}" failed. No retries permitted until 2026-07-20 13:01:51.9130766 +0000 UTC m=+18.382608701 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-9km99" (UniqueName: "kubernetes.io/projected/6b89bab8-ce68-4a47-8922-7983e250b5c7-kube-api-access-9km99") pod "network-check-target-8vjqm" (UID: "6b89bab8-ce68-4a47-8922-7983e250b5c7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 13:01:44.142571 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:44.142021    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbfs8"
Jul 20 13:01:44.142571 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:44.142047    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vjqm"
Jul 20 13:01:44.142571 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:44.142021    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bjz6v"
Jul 20 13:01:44.142571 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:44.142142    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbfs8" podUID="81f8fe49-b58b-4eb9-8322-547266b00f73"
Jul 20 13:01:44.142571 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:44.142205    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bjz6v" podUID="52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d"
Jul 20 13:01:44.142571 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:44.142265    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vjqm" podUID="6b89bab8-ce68-4a47-8922-7983e250b5c7"
Jul 20 13:01:45.242212 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:45.242164    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkb7v" event={"ID":"644b7e3b-af11-4d30-9fff-aaf8a83319bf","Type":"ContainerStarted","Data":"707cb63409045c3ac1bd67e4dd9dd941773c1c9116e4c93a818d510b2781db77"}
Jul 20 13:01:45.244413 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:45.244308    2565 generic.go:356] "Generic (PLEG): container finished" podID="4ad79612-15fd-48a7-a9cc-33f53c58ca69" containerID="e7eb9026dd3268d29358975ee6f159668917bc82d51ae9031ea90130ce871b7e" exitCode=0
Jul 20 13:01:45.244556 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:45.244405    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g47kp" event={"ID":"4ad79612-15fd-48a7-a9cc-33f53c58ca69","Type":"ContainerDied","Data":"e7eb9026dd3268d29358975ee6f159668917bc82d51ae9031ea90130ce871b7e"}
Jul 20 13:01:45.246397 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:45.246352    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lsrxw" event={"ID":"bf9a432f-9b17-467c-826d-50f1ce4cfd7c","Type":"ContainerStarted","Data":"12f223d52c6a5affde4c7f27e4a8fc879a8da809c6fec3058f0d4180c2674442"}
Jul 20 13:01:45.248297 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:45.248271    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-7mhbt" event={"ID":"84be7850-b3b8-49a2-899f-5d16ab5a0de4","Type":"ContainerStarted","Data":"3e910d7252f9dc229fb21073292dbce5f73e10b6ffedcc3db385f7479713969b"}
Jul 20 13:01:45.250525 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:45.250492    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-dcnn2" event={"ID":"2e3cfb74-ae63-457e-abb7-fc0e5f459dbb","Type":"ContainerStarted","Data":"81299667de84d9b68788469d1289a60b04da803d83df6fa14a852d8adb42522e"}
Jul 20 13:01:45.253635 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:45.253602    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-182.ec2.internal" event={"ID":"3cbdd8dc17b46b583decda50ce1bde1d","Type":"ContainerStarted","Data":"4949f09c93671d05556846a7f98451f7f9ab06625eae3f08e256fedaeacb7309"}
Jul 20 13:01:45.310427 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:45.310348    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-lsrxw" podStartSLOduration=2.7694093889999998 podStartE2EDuration="11.310329127s" totalImagesPullingTime="8.540919738s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 13:01:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:01:45.310295113 +0000 UTC m=+11.779827234" watchObservedRunningTime="2026-07-20 13:01:45.310329127 +0000 UTC m=+11.779861247"
Jul 20 13:01:45.310606 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:45.310470    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-dcnn2" podStartSLOduration=4.208963985 podStartE2EDuration="11.310461035s" totalImagesPullingTime="7.10149705s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 13:01:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:01:45.294482522 +0000 UTC m=+11.764014642" watchObservedRunningTime="2026-07-20 13:01:45.310461035 +0000 UTC m=+11.779993156"
Jul 20 13:01:45.346862 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:45.346810    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-141-182.ec2.internal" podStartSLOduration=10.346789163 podStartE2EDuration="10.346789163s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 13:01:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:01:45.346313491 +0000 UTC m=+11.815845611" watchObservedRunningTime="2026-07-20 13:01:45.346789163 +0000 UTC m=+11.816321283"
Jul 20 13:01:45.347048 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:45.346984    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-7mhbt" podStartSLOduration=4.284921093 podStartE2EDuration="11.346972268s" totalImagesPullingTime="7.062051175s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:01:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:01:45.327912014 +0000 UTC m=+11.797444127" watchObservedRunningTime="2026-07-20 13:01:45.346972268 +0000 UTC m=+11.816504388"
Jul 20 13:01:46.141698 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:46.141664    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bjz6v"
Jul 20 13:01:46.141869 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:46.141802    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bjz6v" podUID="52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d"
Jul 20 13:01:46.142317 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:46.142284    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbfs8"
Jul 20 13:01:46.142456 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:46.142419    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbfs8" podUID="81f8fe49-b58b-4eb9-8322-547266b00f73"
Jul 20 13:01:46.142579 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:46.142562    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vjqm"
Jul 20 13:01:46.142662 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:46.142644    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vjqm" podUID="6b89bab8-ce68-4a47-8922-7983e250b5c7"
Jul 20 13:01:47.261599 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:47.261064    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-s8tlk" event={"ID":"4f76ce36-97e3-4eb9-b591-ff1c7b5d02f8","Type":"ContainerStarted","Data":"808699d4c55862a8d582f5485f2d4ade2d4b44fa2f0682852a7cb9ebc421ca73"}
Jul 20 13:01:47.279127 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:47.279071    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-s8tlk" podStartSLOduration=4.74979165 podStartE2EDuration="13.279050507s" totalImagesPullingTime="8.529258857s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 13:01:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:01:47.278479357 +0000 UTC m=+13.748011499" watchObservedRunningTime="2026-07-20 13:01:47.279050507 +0000 UTC m=+13.748582627"
Jul 20 13:01:47.735051 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:47.734961    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-7mhbt"
Jul 20 13:01:47.735991 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:47.735809    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-7mhbt"
Jul 20 13:01:48.141647 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:48.141561    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vjqm"
Jul 20 13:01:48.141798 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:48.141689    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbfs8"
Jul 20 13:01:48.141798 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:48.141695    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vjqm" podUID="6b89bab8-ce68-4a47-8922-7983e250b5c7"
Jul 20 13:01:48.141798 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:48.141578    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bjz6v"
Jul 20 13:01:48.141916 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:48.141813    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbfs8" podUID="81f8fe49-b58b-4eb9-8322-547266b00f73"
Jul 20 13:01:48.141916 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:48.141900    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bjz6v" podUID="52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d"
Jul 20 13:01:48.263341 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:48.263248    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-7mhbt"
Jul 20 13:01:48.263847 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:48.263827    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-7mhbt"
Jul 20 13:01:50.141838 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:50.141803    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bjz6v"
Jul 20 13:01:50.142533 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:50.141816    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbfs8"
Jul 20 13:01:50.142533 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:50.141944    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bjz6v" podUID="52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d"
Jul 20 13:01:50.142533 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:50.141999    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vjqm"
Jul 20 13:01:50.142533 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:50.142091    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbfs8" podUID="81f8fe49-b58b-4eb9-8322-547266b00f73"
Jul 20 13:01:50.142533 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:50.142161    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vjqm" podUID="6b89bab8-ce68-4a47-8922-7983e250b5c7"
Jul 20 13:01:51.879616 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:51.879567    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d-original-pull-secret\") pod \"global-pull-secret-syncer-bjz6v\" (UID: \"52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d\") " pod="kube-system/global-pull-secret-syncer-bjz6v"
Jul 20 13:01:51.880213 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:51.879660    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/81f8fe49-b58b-4eb9-8322-547266b00f73-metrics-certs\") pod \"network-metrics-daemon-tbfs8\" (UID: \"81f8fe49-b58b-4eb9-8322-547266b00f73\") " pod="openshift-multus/network-metrics-daemon-tbfs8"
Jul 20 13:01:51.880213 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:51.879734    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 13:01:51.880213 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:51.879759    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 13:01:51.880213 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:51.879810    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d-original-pull-secret podName:52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d nodeName:}" failed. No retries permitted until 2026-07-20 13:02:07.8797932 +0000 UTC m=+34.349325301 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d-original-pull-secret") pod "global-pull-secret-syncer-bjz6v" (UID: "52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d") : object "kube-system"/"original-pull-secret" not registered
Jul 20 13:01:51.880213 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:51.879828    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81f8fe49-b58b-4eb9-8322-547266b00f73-metrics-certs podName:81f8fe49-b58b-4eb9-8322-547266b00f73 nodeName:}" failed. No retries permitted until 2026-07-20 13:02:07.879819518 +0000 UTC m=+34.349351614 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/81f8fe49-b58b-4eb9-8322-547266b00f73-metrics-certs") pod "network-metrics-daemon-tbfs8" (UID: "81f8fe49-b58b-4eb9-8322-547266b00f73") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 13:01:51.980812 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:51.980770    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9km99\" (UniqueName: \"kubernetes.io/projected/6b89bab8-ce68-4a47-8922-7983e250b5c7-kube-api-access-9km99\") pod \"network-check-target-8vjqm\" (UID: \"6b89bab8-ce68-4a47-8922-7983e250b5c7\") " pod="openshift-network-diagnostics/network-check-target-8vjqm"
Jul 20 13:01:51.980973 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:51.980932    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 13:01:51.980973 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:51.980952    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 13:01:51.980973 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:51.980963    2565 projected.go:196] Error preparing data for projected volume kube-api-access-9km99 for pod openshift-network-diagnostics/network-check-target-8vjqm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 13:01:51.981066 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:51.981013    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b89bab8-ce68-4a47-8922-7983e250b5c7-kube-api-access-9km99 podName:6b89bab8-ce68-4a47-8922-7983e250b5c7 nodeName:}" failed. No retries permitted until 2026-07-20 13:02:07.981000244 +0000 UTC m=+34.450532345 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-9km99" (UniqueName: "kubernetes.io/projected/6b89bab8-ce68-4a47-8922-7983e250b5c7-kube-api-access-9km99") pod "network-check-target-8vjqm" (UID: "6b89bab8-ce68-4a47-8922-7983e250b5c7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 13:01:52.141061 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:52.140976    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vjqm"
Jul 20 13:01:52.141215 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:52.140976    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bjz6v"
Jul 20 13:01:52.141215 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:52.141091    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vjqm" podUID="6b89bab8-ce68-4a47-8922-7983e250b5c7"
Jul 20 13:01:52.141215 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:52.141107    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbfs8"
Jul 20 13:01:52.141391 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:52.141217    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bjz6v" podUID="52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d"
Jul 20 13:01:52.141391 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:52.141327    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbfs8" podUID="81f8fe49-b58b-4eb9-8322-547266b00f73"
Jul 20 13:01:54.142441 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:54.142401    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vjqm"
Jul 20 13:01:54.143017 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:54.142499    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vjqm" podUID="6b89bab8-ce68-4a47-8922-7983e250b5c7"
Jul 20 13:01:54.143017 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:54.142613    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbfs8"
Jul 20 13:01:54.143017 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:54.142725    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbfs8" podUID="81f8fe49-b58b-4eb9-8322-547266b00f73"
Jul 20 13:01:54.143017 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:54.142758    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bjz6v"
Jul 20 13:01:54.143017 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:54.142824    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bjz6v" podUID="52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d"
Jul 20 13:01:56.141532 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:56.141495    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bjz6v"
Jul 20 13:01:56.142091 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:56.141495    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vjqm"
Jul 20 13:01:56.142091 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:56.141629    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bjz6v" podUID="52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d"
Jul 20 13:01:56.142091 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:56.141504    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbfs8"
Jul 20 13:01:56.142091 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:56.141749    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vjqm" podUID="6b89bab8-ce68-4a47-8922-7983e250b5c7"
Jul 20 13:01:56.142091 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:56.141867    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbfs8" podUID="81f8fe49-b58b-4eb9-8322-547266b00f73"
Jul 20 13:01:58.141670 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:58.141632    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bjz6v"
Jul 20 13:01:58.142216 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:58.141641    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbfs8"
Jul 20 13:01:58.142216 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:58.141762    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bjz6v" podUID="52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d"
Jul 20 13:01:58.142216 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:58.141773    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vjqm"
Jul 20 13:01:58.142216 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:58.141879    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbfs8" podUID="81f8fe49-b58b-4eb9-8322-547266b00f73"
Jul 20 13:01:58.142216 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:01:58.141966    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vjqm" podUID="6b89bab8-ce68-4a47-8922-7983e250b5c7"
Jul 20 13:01:59.033798 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:59.033759    2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 20 13:01:59.140089 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:59.140005    2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-20T13:01:59.033778492Z","UUID":"745cc4d6-c684-4220-8369-9edb8ccf42e4","Handler":null,"Name":"","Endpoint":""}
Jul 20 13:01:59.141461 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:59.141440    2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 20 13:01:59.141544 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:59.141489    2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 20 13:01:59.286593 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:59.286563    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkb7v" event={"ID":"644b7e3b-af11-4d30-9fff-aaf8a83319bf","Type":"ContainerStarted","Data":"292ea3810e3e66382a65115c4a253fb7af7c617f875855335b794855c4b30e4d"}
Jul 20 13:01:59.288151 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:59.288126    2565 generic.go:356] "Generic (PLEG): container finished" podID="4ad79612-15fd-48a7-a9cc-33f53c58ca69" containerID="56c65109fcb2ebbafe4cd2686434f51389e6fc06be41a121255a0ed0584570ec" exitCode=0
Jul 20 13:01:59.288247 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:59.288211    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g47kp" event={"ID":"4ad79612-15fd-48a7-a9cc-33f53c58ca69","Type":"ContainerDied","Data":"56c65109fcb2ebbafe4cd2686434f51389e6fc06be41a121255a0ed0584570ec"}
Jul 20 13:01:59.289656 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:59.289633    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-rlmj7" event={"ID":"002d1aca-ffaa-4461-8906-6816cdfe6274","Type":"ContainerStarted","Data":"bfc6a3b2ce0a774fb09d27a453d57a8dbdbc9aaeb1dc6f9be4cf2da3a8f58ee6"}
Jul 20 13:01:59.291818 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:59.291776    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r" event={"ID":"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac","Type":"ContainerStarted","Data":"d137644c44500d9e5e094d2d21de26796b00f57cec4858fa9985bedef2900486"}
Jul 20 13:01:59.291924 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:59.291892    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r" event={"ID":"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac","Type":"ContainerStarted","Data":"d0c64e4e17a216fce40d1c7a1108ebb79dfd4ab58c50cd4d4c3fc043c7612d12"}
Jul 20 13:01:59.292001 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:59.291951    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r" event={"ID":"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac","Type":"ContainerStarted","Data":"27b6eac7e58c9cb97d2048def37d9b122b4b2a0dec27ff381c3518e15147c1db"}
Jul 20 13:01:59.293181 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:59.293161    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-nhsgz" event={"ID":"f6bb58e8-ae96-42cc-88d8-33bf8dde3c0d","Type":"ContainerStarted","Data":"0add9cb0ae9b860d870e0791c7451acf2128c5831f2dab4f6965d1df719e5798"}
Jul 20 13:01:59.331310 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:59.331263    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-rlmj7" podStartSLOduration=2.738368015 podStartE2EDuration="25.331246646s" totalImagesPullingTime="22.592878631s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 13:01:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:01:59.330562067 +0000 UTC m=+25.800094183" watchObservedRunningTime="2026-07-20 13:01:59.331246646 +0000 UTC m=+25.800778762"
Jul 20 13:01:59.349014 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:01:59.348979    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-nhsgz" podStartSLOduration=4.213636945 podStartE2EDuration="25.348949412s" totalImagesPullingTime="21.135312467s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 13:01:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:01:59.348541075 +0000 UTC m=+25.818073194" watchObservedRunningTime="2026-07-20 13:01:59.348949412 +0000 UTC m=+25.818481534"
Jul 20 13:02:00.141177 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:00.141140    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bjz6v"
Jul 20 13:02:00.141177 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:00.141154    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbfs8"
Jul 20 13:02:00.141177 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:00.141167    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vjqm"
Jul 20 13:02:00.141588 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:00.141245    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bjz6v" podUID="52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d"
Jul 20 13:02:00.141588 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:00.141304    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbfs8" podUID="81f8fe49-b58b-4eb9-8322-547266b00f73"
Jul 20 13:02:00.141588 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:00.141395    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vjqm" podUID="6b89bab8-ce68-4a47-8922-7983e250b5c7"
Jul 20 13:02:00.298601 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:00.298565    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r" event={"ID":"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac","Type":"ContainerStarted","Data":"86e1aa7703e08f965e038a5e2cc3aca1dd9fc0b80fc8f89a2647d167676090ed"}
Jul 20 13:02:00.299042 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:00.298644    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r" event={"ID":"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac","Type":"ContainerStarted","Data":"6fcd26cff29748b1e1119933be660e7cf872bfad626fa987ce7252a49d546dce"}
Jul 20 13:02:00.299042 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:00.298676    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r" event={"ID":"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac","Type":"ContainerStarted","Data":"23c989596e7109654027c5b5f49208a66a1c753d6729831a1ebad9d519c3db6c"}
Jul 20 13:02:01.302713 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:01.302676    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkb7v" event={"ID":"644b7e3b-af11-4d30-9fff-aaf8a83319bf","Type":"ContainerStarted","Data":"01d89c9fe085e5a074605f626ce774e13591cd83e080652aafd7d26fe5e8a55a"}
Jul 20 13:02:01.304758 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:01.304728    2565 generic.go:356] "Generic (PLEG): container finished" podID="4ad79612-15fd-48a7-a9cc-33f53c58ca69" containerID="3a2beec45d4cad55e78ee2c9dbf7bd918db392f571095bac0039f942868c33f1" exitCode=0
Jul 20 13:02:01.304872 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:01.304774    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g47kp" event={"ID":"4ad79612-15fd-48a7-a9cc-33f53c58ca69","Type":"ContainerDied","Data":"3a2beec45d4cad55e78ee2c9dbf7bd918db392f571095bac0039f942868c33f1"}
Jul 20 13:02:01.324383 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:01.322880    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zkb7v" podStartSLOduration=3.685888607 podStartE2EDuration="27.322861506s" totalImagesPullingTime="23.636972899s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 13:01:34 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:02:01.322134871 +0000 UTC m=+27.791666987" watchObservedRunningTime="2026-07-20 13:02:01.322861506 +0000 UTC m=+27.792393626"
Jul 20 13:02:02.141445 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:02.141410    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vjqm"
Jul 20 13:02:02.141445 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:02.141430    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbfs8"
Jul 20 13:02:02.141681 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:02.141410    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bjz6v"
Jul 20 13:02:02.141681 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:02.141530    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vjqm" podUID="6b89bab8-ce68-4a47-8922-7983e250b5c7"
Jul 20 13:02:02.141681 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:02.141606    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bjz6v" podUID="52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d"
Jul 20 13:02:02.141827 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:02.141705    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbfs8" podUID="81f8fe49-b58b-4eb9-8322-547266b00f73"
Jul 20 13:02:02.310006 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:02.309970    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r" event={"ID":"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac","Type":"ContainerStarted","Data":"e6a0173f3e5fc31b50368c4754fb5e99945a5903a57d02f9ce6497147007a49f"}
Jul 20 13:02:04.145165 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:04.144922    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bjz6v"
Jul 20 13:02:04.145165 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:04.144998    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbfs8"
Jul 20 13:02:04.145662 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:04.145160    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bjz6v" podUID="52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d"
Jul 20 13:02:04.145662 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:04.145014    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vjqm"
Jul 20 13:02:04.145662 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:04.145266    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbfs8" podUID="81f8fe49-b58b-4eb9-8322-547266b00f73"
Jul 20 13:02:04.145662 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:04.145372    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vjqm" podUID="6b89bab8-ce68-4a47-8922-7983e250b5c7"
Jul 20 13:02:04.317066 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:04.317020    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r" event={"ID":"f0284f8d-ac61-43c0-9502-6b0b8e61d7ac","Type":"ContainerStarted","Data":"e21d33771a17ce12afcca74548ef9232b2835a8d98c075b583fb74c75e05640b"}
Jul 20 13:02:04.317334 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:04.317306    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r"
Jul 20 13:02:04.317467 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:04.317400    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r"
Jul 20 13:02:04.332926 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:04.332905    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r"
Jul 20 13:02:04.345247 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:04.345207    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r" podStartSLOduration=7.667291037 podStartE2EDuration="30.345196244s" totalImagesPullingTime="22.677905207s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 13:01:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:02:04.344766823 +0000 UTC m=+30.814298941" watchObservedRunningTime="2026-07-20 13:02:04.345196244 +0000 UTC m=+30.814728380"
Jul 20 13:02:05.322305 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:05.322277    2565 generic.go:356] "Generic (PLEG): container finished" podID="4ad79612-15fd-48a7-a9cc-33f53c58ca69" containerID="8c25f38ff77fffebd7e238d44d4b5bcf87ef991e4b3318323bc0657f3e7eb3f8" exitCode=0
Jul 20 13:02:05.322654 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:05.322336    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g47kp" event={"ID":"4ad79612-15fd-48a7-a9cc-33f53c58ca69","Type":"ContainerDied","Data":"8c25f38ff77fffebd7e238d44d4b5bcf87ef991e4b3318323bc0657f3e7eb3f8"}
Jul 20 13:02:05.322835 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:05.322807    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r"
Jul 20 13:02:05.336793 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:05.336773    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r"
Jul 20 13:02:05.767234 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:05.767195    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tbfs8"]
Jul 20 13:02:05.767435 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:05.767392    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbfs8"
Jul 20 13:02:05.767530 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:05.767501    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbfs8" podUID="81f8fe49-b58b-4eb9-8322-547266b00f73"
Jul 20 13:02:05.767924 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:05.767903    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bjz6v"]
Jul 20 13:02:05.768014 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:05.768000    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bjz6v"
Jul 20 13:02:05.768114 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:05.768097    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bjz6v" podUID="52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d"
Jul 20 13:02:05.779414 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:05.779337    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8vjqm"]
Jul 20 13:02:05.779506 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:05.779446    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vjqm"
Jul 20 13:02:05.779562 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:05.779536    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vjqm" podUID="6b89bab8-ce68-4a47-8922-7983e250b5c7"
Jul 20 13:02:07.141725 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:07.141513    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vjqm"
Jul 20 13:02:07.142166 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:07.141533    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbfs8"
Jul 20 13:02:07.142166 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:07.141817    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vjqm" podUID="6b89bab8-ce68-4a47-8922-7983e250b5c7"
Jul 20 13:02:07.142166 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:07.142034    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbfs8" podUID="81f8fe49-b58b-4eb9-8322-547266b00f73"
Jul 20 13:02:07.894502 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:07.894461    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d-original-pull-secret\") pod \"global-pull-secret-syncer-bjz6v\" (UID: \"52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d\") " pod="kube-system/global-pull-secret-syncer-bjz6v"
Jul 20 13:02:07.894674 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:07.894523    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/81f8fe49-b58b-4eb9-8322-547266b00f73-metrics-certs\") pod \"network-metrics-daemon-tbfs8\" (UID: \"81f8fe49-b58b-4eb9-8322-547266b00f73\") " pod="openshift-multus/network-metrics-daemon-tbfs8"
Jul 20 13:02:07.894674 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:07.894626    2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 20 13:02:07.894811 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:07.894708    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d-original-pull-secret podName:52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d nodeName:}" failed. No retries permitted until 2026-07-20 13:02:39.894677441 +0000 UTC m=+66.364209553 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d-original-pull-secret") pod "global-pull-secret-syncer-bjz6v" (UID: "52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d") : object "kube-system"/"original-pull-secret" not registered
Jul 20 13:02:07.894811 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:07.894631    2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 13:02:07.894918 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:07.894807    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/81f8fe49-b58b-4eb9-8322-547266b00f73-metrics-certs podName:81f8fe49-b58b-4eb9-8322-547266b00f73 nodeName:}" failed. No retries permitted until 2026-07-20 13:02:39.894782931 +0000 UTC m=+66.364315029 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/81f8fe49-b58b-4eb9-8322-547266b00f73-metrics-certs") pod "network-metrics-daemon-tbfs8" (UID: "81f8fe49-b58b-4eb9-8322-547266b00f73") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 20 13:02:07.994869 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:07.994835    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9km99\" (UniqueName: \"kubernetes.io/projected/6b89bab8-ce68-4a47-8922-7983e250b5c7-kube-api-access-9km99\") pod \"network-check-target-8vjqm\" (UID: \"6b89bab8-ce68-4a47-8922-7983e250b5c7\") " pod="openshift-network-diagnostics/network-check-target-8vjqm"
Jul 20 13:02:07.995060 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:07.994990    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 20 13:02:07.995060 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:07.995008    2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 20 13:02:07.995060 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:07.995018    2565 projected.go:196] Error preparing data for projected volume kube-api-access-9km99 for pod openshift-network-diagnostics/network-check-target-8vjqm: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 13:02:07.995227 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:07.995076    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6b89bab8-ce68-4a47-8922-7983e250b5c7-kube-api-access-9km99 podName:6b89bab8-ce68-4a47-8922-7983e250b5c7 nodeName:}" failed. No retries permitted until 2026-07-20 13:02:39.995060126 +0000 UTC m=+66.464592222 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-9km99" (UniqueName: "kubernetes.io/projected/6b89bab8-ce68-4a47-8922-7983e250b5c7-kube-api-access-9km99") pod "network-check-target-8vjqm" (UID: "6b89bab8-ce68-4a47-8922-7983e250b5c7") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 20 13:02:08.141621 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:08.141588    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bjz6v"
Jul 20 13:02:08.141774 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:08.141717    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bjz6v" podUID="52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d"
Jul 20 13:02:09.141842 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:09.141803    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vjqm"
Jul 20 13:02:09.142348 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:09.141813    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbfs8"
Jul 20 13:02:09.142348 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:09.141940    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vjqm" podUID="6b89bab8-ce68-4a47-8922-7983e250b5c7"
Jul 20 13:02:09.142348 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:09.142026    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbfs8" podUID="81f8fe49-b58b-4eb9-8322-547266b00f73"
Jul 20 13:02:10.141149 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:10.141112    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bjz6v"
Jul 20 13:02:10.141310 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:10.141239    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-bjz6v" podUID="52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d"
Jul 20 13:02:10.337796 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:10.337762    2565 generic.go:356] "Generic (PLEG): container finished" podID="4ad79612-15fd-48a7-a9cc-33f53c58ca69" containerID="b7230b2be6cd0a480f2393906ec8542a13958eee1c7d72e2bab10c1d0e4ed261" exitCode=0
Jul 20 13:02:10.337796 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:10.337800    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g47kp" event={"ID":"4ad79612-15fd-48a7-a9cc-33f53c58ca69","Type":"ContainerDied","Data":"b7230b2be6cd0a480f2393906ec8542a13958eee1c7d72e2bab10c1d0e4ed261"}
Jul 20 13:02:11.140957 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:11.140928    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vjqm"
Jul 20 13:02:11.141107 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:11.141024    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-8vjqm" podUID="6b89bab8-ce68-4a47-8922-7983e250b5c7"
Jul 20 13:02:11.141107 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:11.141088    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbfs8"
Jul 20 13:02:11.141199 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:11.141180    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-tbfs8" podUID="81f8fe49-b58b-4eb9-8322-547266b00f73"
Jul 20 13:02:11.343423 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:11.343392    2565 generic.go:356] "Generic (PLEG): container finished" podID="4ad79612-15fd-48a7-a9cc-33f53c58ca69" containerID="07edefd381651b549d64f6f7f517654138b80739e27975a5b6b671e387f3e342" exitCode=0
Jul 20 13:02:11.343760 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:11.343461    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g47kp" event={"ID":"4ad79612-15fd-48a7-a9cc-33f53c58ca69","Type":"ContainerDied","Data":"07edefd381651b549d64f6f7f517654138b80739e27975a5b6b671e387f3e342"}
Jul 20 13:02:11.826649 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:11.826577    2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-141-182.ec2.internal" event="NodeReady"
Jul 20 13:02:11.826779 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:11.826704    2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 20 13:02:11.882305 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:11.882271    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-78cc7648f6-2kdpx"]
Jul 20 13:02:11.893784 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:11.893763    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78cc7648f6-2kdpx"
Jul 20 13:02:11.899465 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:11.899441    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\""
Jul 20 13:02:11.899586 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:11.899444    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\""
Jul 20 13:02:11.899586 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:11.899452    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-tpf8d\""
Jul 20 13:02:11.899799 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:11.899784    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\""
Jul 20 13:02:11.905864 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:11.905841    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-78cc7648f6-2kdpx"]
Jul 20 13:02:11.905967 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:11.905920    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\""
Jul 20 13:02:11.908311 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:11.908290    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-dnpn2"]
Jul 20 13:02:11.922122 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:11.922101    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-ng67n"]
Jul 20 13:02:11.922233 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:11.922218    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dnpn2"
Jul 20 13:02:11.925069 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:11.925042    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 20 13:02:11.925289 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:11.925269    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-6btvh\""
Jul 20 13:02:11.925763 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:11.925476    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 20 13:02:11.925763 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:11.925496    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 20 13:02:11.934409 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:11.934390    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dnpn2"]
Jul 20 13:02:11.934489 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:11.934424    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ng67n"]
Jul 20 13:02:11.934489 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:11.934436    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ng67n"
Jul 20 13:02:11.936985 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:11.936969    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 20 13:02:11.937081 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:11.936994    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 20 13:02:11.937235 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:11.937221    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hjf8r\""
Jul 20 13:02:12.022341 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:12.022306    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f34def21-0566-4ce0-9754-25777f418798-ca-trust-extracted\") pod \"image-registry-78cc7648f6-2kdpx\" (UID: \"f34def21-0566-4ce0-9754-25777f418798\") " pod="openshift-image-registry/image-registry-78cc7648f6-2kdpx"
Jul 20 13:02:12.022341 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:12.022339    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f34def21-0566-4ce0-9754-25777f418798-bound-sa-token\") pod \"image-registry-78cc7648f6-2kdpx\" (UID: \"f34def21-0566-4ce0-9754-25777f418798\") " pod="openshift-image-registry/image-registry-78cc7648f6-2kdpx"
Jul 20 13:02:12.022570 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:12.022434    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f34def21-0566-4ce0-9754-25777f418798-registry-certificates\") pod \"image-registry-78cc7648f6-2kdpx\" (UID: \"f34def21-0566-4ce0-9754-25777f418798\") " pod="openshift-image-registry/image-registry-78cc7648f6-2kdpx"
Jul 20 13:02:12.022570 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:12.022471    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slnl6\" (UniqueName: \"kubernetes.io/projected/f34def21-0566-4ce0-9754-25777f418798-kube-api-access-slnl6\") pod \"image-registry-78cc7648f6-2kdpx\" (UID: \"f34def21-0566-4ce0-9754-25777f418798\") " pod="openshift-image-registry/image-registry-78cc7648f6-2kdpx"
Jul 20 13:02:12.022570 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:12.022527    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0156bad2-0fcf-4d37-b346-ff5f28f2890c-metrics-tls\") pod \"dns-default-ng67n\" (UID: \"0156bad2-0fcf-4d37-b346-ff5f28f2890c\") " pod="openshift-dns/dns-default-ng67n"
Jul 20 13:02:12.022570 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:12.022552    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f34def21-0566-4ce0-9754-25777f418798-image-registry-private-configuration\") pod \"image-registry-78cc7648f6-2kdpx\" (UID: \"f34def21-0566-4ce0-9754-25777f418798\") " pod="openshift-image-registry/image-registry-78cc7648f6-2kdpx"
Jul 20 13:02:12.022752 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:12.022576    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f34def21-0566-4ce0-9754-25777f418798-trusted-ca\") pod \"image-registry-78cc7648f6-2kdpx\" (UID: \"f34def21-0566-4ce0-9754-25777f418798\") " pod="openshift-image-registry/image-registry-78cc7648f6-2kdpx"
Jul 20 13:02:12.022752 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:12.022592    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/67795910-26cd-41e8-9c3d-a55eb900657e-cert\") pod \"ingress-canary-dnpn2\" (UID: \"67795910-26cd-41e8-9c3d-a55eb900657e\") " pod="openshift-ingress-canary/ingress-canary-dnpn2"
Jul 20 13:02:12.022752 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:12.022613    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrfn6\" (UniqueName: \"kubernetes.io/projected/0156bad2-0fcf-4d37-b346-ff5f28f2890c-kube-api-access-lrfn6\") pod \"dns-default-ng67n\" (UID: \"0156bad2-0fcf-4d37-b346-ff5f28f2890c\") " pod="openshift-dns/dns-default-ng67n"
Jul 20 13:02:12.022752 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:12.022677    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9krm9\" (UniqueName: \"kubernetes.io/projected/67795910-26cd-41e8-9c3d-a55eb900657e-kube-api-access-9krm9\") pod \"ingress-canary-dnpn2\" (UID: \"67795910-26cd-41e8-9c3d-a55eb900657e\") " pod="openshift-ingress-canary/ingress-canary-dnpn2"
Jul 20 13:02:12.022752 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:12.022711    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0156bad2-0fcf-4d37-b346-ff5f28f2890c-config-volume\") pod \"dns-default-ng67n\" (UID: \"0156bad2-0fcf-4d37-b346-ff5f28f2890c\") " pod="openshift-dns/dns-default-ng67n"
Jul 20 13:02:12.022952 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:12.022749    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f34def21-0566-4ce0-9754-25777f418798-registry-tls\") pod \"image-registry-78cc7648f6-2kdpx\" (UID: \"f34def21-0566-4ce0-9754-25777f418798\") " pod="openshift-image-registry/image-registry-78cc7648f6-2kdpx"
Jul 20 13:02:12.022952 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:12.022785    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f34def21-0566-4ce0-9754-25777f418798-installation-pull-secrets\") pod \"image-registry-78cc7648f6-2kdpx\" (UID: \"f34def21-0566-4ce0-9754-25777f418798\") " pod="openshift-image-registry/image-registry-78cc7648f6-2kdpx"
Jul 20 13:02:12.022952 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:12.022816    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0156bad2-0fcf-4d37-b346-ff5f28f2890c-tmp-dir\") pod \"dns-default-ng67n\" (UID: \"0156bad2-0fcf-4d37-b346-ff5f28f2890c\") " pod="openshift-dns/dns-default-ng67n"
Jul 20 13:02:12.123722 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:12.123626    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/67795910-26cd-41e8-9c3d-a55eb900657e-cert\") pod \"ingress-canary-dnpn2\" (UID: \"67795910-26cd-41e8-9c3d-a55eb900657e\") " pod="openshift-ingress-canary/ingress-canary-dnpn2"
Jul 20 13:02:12.123923 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:12.123766    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrfn6\" (UniqueName: \"kubernetes.io/projected/0156bad2-0fcf-4d37-b346-ff5f28f2890c-kube-api-access-lrfn6\") pod \"dns-default-ng67n\" (UID: \"0156bad2-0fcf-4d37-b346-ff5f28f2890c\") " pod="openshift-dns/dns-default-ng67n"
Jul 20 13:02:12.123923 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:12.123800    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9krm9\" (UniqueName: \"kubernetes.io/projected/67795910-26cd-41e8-9c3d-a55eb900657e-kube-api-access-9krm9\") pod \"ingress-canary-dnpn2\" (UID: \"67795910-26cd-41e8-9c3d-a55eb900657e\") " pod="openshift-ingress-canary/ingress-canary-dnpn2"
Jul 20 13:02:12.123923 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:12.123825    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0156bad2-0fcf-4d37-b346-ff5f28f2890c-config-volume\") pod \"dns-default-ng67n\" (UID: \"0156bad2-0fcf-4d37-b346-ff5f28f2890c\") " pod="openshift-dns/dns-default-ng67n"
Jul 20 13:02:12.123923 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:12.123857    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f34def21-0566-4ce0-9754-25777f418798-registry-tls\") pod \"image-registry-78cc7648f6-2kdpx\" (UID: \"f34def21-0566-4ce0-9754-25777f418798\") " pod="openshift-image-registry/image-registry-78cc7648f6-2kdpx"
Jul 20 13:02:12.123923 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:12.123889    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f34def21-0566-4ce0-9754-25777f418798-installation-pull-secrets\") pod \"image-registry-78cc7648f6-2kdpx\" (UID: \"f34def21-0566-4ce0-9754-25777f418798\") " pod="openshift-image-registry/image-registry-78cc7648f6-2kdpx"
Jul 20 13:02:12.124176 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:12.123923    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0156bad2-0fcf-4d37-b346-ff5f28f2890c-tmp-dir\") pod \"dns-default-ng67n\" (UID: \"0156bad2-0fcf-4d37-b346-ff5f28f2890c\") " pod="openshift-dns/dns-default-ng67n"
Jul 20 13:02:12.124176 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:12.123966    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f34def21-0566-4ce0-9754-25777f418798-ca-trust-extracted\") pod \"image-registry-78cc7648f6-2kdpx\" (UID: \"f34def21-0566-4ce0-9754-25777f418798\") " pod="openshift-image-registry/image-registry-78cc7648f6-2kdpx"
Jul 20 13:02:12.124176 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:12.123997    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f34def21-0566-4ce0-9754-25777f418798-bound-sa-token\") pod \"image-registry-78cc7648f6-2kdpx\" (UID: \"f34def21-0566-4ce0-9754-25777f418798\") " pod="openshift-image-registry/image-registry-78cc7648f6-2kdpx"
Jul 20 13:02:12.124176 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:12.124004    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 13:02:12.124176 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:12.124027    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78cc7648f6-2kdpx: secret "image-registry-tls" not found
Jul 20 13:02:12.124176 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:12.124041    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f34def21-0566-4ce0-9754-25777f418798-registry-certificates\") pod \"image-registry-78cc7648f6-2kdpx\" (UID: \"f34def21-0566-4ce0-9754-25777f418798\") " pod="openshift-image-registry/image-registry-78cc7648f6-2kdpx"
Jul 20 13:02:12.124176 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:12.124070    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slnl6\" (UniqueName: \"kubernetes.io/projected/f34def21-0566-4ce0-9754-25777f418798-kube-api-access-slnl6\") pod \"image-registry-78cc7648f6-2kdpx\" (UID: \"f34def21-0566-4ce0-9754-25777f418798\") " pod="openshift-image-registry/image-registry-78cc7648f6-2kdpx"
Jul 20 13:02:12.124176 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:12.124152    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0156bad2-0fcf-4d37-b346-ff5f28f2890c-metrics-tls\") pod \"dns-default-ng67n\" (UID: \"0156bad2-0fcf-4d37-b346-ff5f28f2890c\") " pod="openshift-dns/dns-default-ng67n"
Jul 20 13:02:12.124614 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:12.124183    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f34def21-0566-4ce0-9754-25777f418798-image-registry-private-configuration\") pod \"image-registry-78cc7648f6-2kdpx\" (UID: \"f34def21-0566-4ce0-9754-25777f418798\") " pod="openshift-image-registry/image-registry-78cc7648f6-2kdpx"
Jul 20 13:02:12.124614 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:12.124228    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f34def21-0566-4ce0-9754-25777f418798-registry-tls podName:f34def21-0566-4ce0-9754-25777f418798 nodeName:}" failed. No retries permitted until 2026-07-20 13:02:12.624204015 +0000 UTC m=+39.093736116 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f34def21-0566-4ce0-9754-25777f418798-registry-tls") pod "image-registry-78cc7648f6-2kdpx" (UID: "f34def21-0566-4ce0-9754-25777f418798") : secret "image-registry-tls" not found
Jul 20 13:02:12.124614 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:12.124264    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f34def21-0566-4ce0-9754-25777f418798-trusted-ca\") pod \"image-registry-78cc7648f6-2kdpx\" (UID: \"f34def21-0566-4ce0-9754-25777f418798\") " pod="openshift-image-registry/image-registry-78cc7648f6-2kdpx"
Jul 20 13:02:12.124614 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:12.124350    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/0156bad2-0fcf-4d37-b346-ff5f28f2890c-tmp-dir\") pod \"dns-default-ng67n\" (UID: \"0156bad2-0fcf-4d37-b346-ff5f28f2890c\") " pod="openshift-dns/dns-default-ng67n"
Jul 20 13:02:12.124614 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:12.124597    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/0156bad2-0fcf-4d37-b346-ff5f28f2890c-config-volume\") pod \"dns-default-ng67n\" (UID: \"0156bad2-0fcf-4d37-b346-ff5f28f2890c\") " pod="openshift-dns/dns-default-ng67n"
Jul 20 13:02:12.124844 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:12.124705    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 13:02:12.124844 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:12.124756    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0156bad2-0fcf-4d37-b346-ff5f28f2890c-metrics-tls podName:0156bad2-0fcf-4d37-b346-ff5f28f2890c nodeName:}" failed. No retries permitted until 2026-07-20 13:02:12.624738953 +0000 UTC m=+39.094271062 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0156bad2-0fcf-4d37-b346-ff5f28f2890c-metrics-tls") pod "dns-default-ng67n" (UID: "0156bad2-0fcf-4d37-b346-ff5f28f2890c") : secret "dns-default-metrics-tls" not found
Jul 20 13:02:12.124844 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:12.124771    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f34def21-0566-4ce0-9754-25777f418798-registry-certificates\") pod \"image-registry-78cc7648f6-2kdpx\" (UID: \"f34def21-0566-4ce0-9754-25777f418798\") " pod="openshift-image-registry/image-registry-78cc7648f6-2kdpx"
Jul 20 13:02:12.124988 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:12.124889    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f34def21-0566-4ce0-9754-25777f418798-ca-trust-extracted\") pod \"image-registry-78cc7648f6-2kdpx\" (UID: \"f34def21-0566-4ce0-9754-25777f418798\") " pod="openshift-image-registry/image-registry-78cc7648f6-2kdpx"
Jul 20 13:02:12.125209 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:12.125189    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f34def21-0566-4ce0-9754-25777f418798-trusted-ca\") pod \"image-registry-78cc7648f6-2kdpx\" (UID: \"f34def21-0566-4ce0-9754-25777f418798\") " pod="openshift-image-registry/image-registry-78cc7648f6-2kdpx"
Jul 20 13:02:12.128228 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:12.128097    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f34def21-0566-4ce0-9754-25777f418798-installation-pull-secrets\") pod \"image-registry-78cc7648f6-2kdpx\" (UID: \"f34def21-0566-4ce0-9754-25777f418798\") " pod="openshift-image-registry/image-registry-78cc7648f6-2kdpx"
Jul 20 13:02:12.128334 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:12.128108    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/67795910-26cd-41e8-9c3d-a55eb900657e-cert\") pod \"ingress-canary-dnpn2\" (UID: \"67795910-26cd-41e8-9c3d-a55eb900657e\") " pod="openshift-ingress-canary/ingress-canary-dnpn2"
Jul 20 13:02:12.128334 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:12.128113    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f34def21-0566-4ce0-9754-25777f418798-image-registry-private-configuration\") pod \"image-registry-78cc7648f6-2kdpx\" (UID: \"f34def21-0566-4ce0-9754-25777f418798\") " pod="openshift-image-registry/image-registry-78cc7648f6-2kdpx"
Jul 20 13:02:12.133298 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:12.133270    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-slnl6\" (UniqueName: \"kubernetes.io/projected/f34def21-0566-4ce0-9754-25777f418798-kube-api-access-slnl6\") pod \"image-registry-78cc7648f6-2kdpx\" (UID: \"f34def21-0566-4ce0-9754-25777f418798\") " pod="openshift-image-registry/image-registry-78cc7648f6-2kdpx"
Jul 20 13:02:12.133501 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:12.133452    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9krm9\" (UniqueName: \"kubernetes.io/projected/67795910-26cd-41e8-9c3d-a55eb900657e-kube-api-access-9krm9\") pod \"ingress-canary-dnpn2\" (UID: \"67795910-26cd-41e8-9c3d-a55eb900657e\") " pod="openshift-ingress-canary/ingress-canary-dnpn2"
Jul 20 13:02:12.133885 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:12.133865    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrfn6\" (UniqueName: \"kubernetes.io/projected/0156bad2-0fcf-4d37-b346-ff5f28f2890c-kube-api-access-lrfn6\") pod \"dns-default-ng67n\" (UID: \"0156bad2-0fcf-4d37-b346-ff5f28f2890c\") " pod="openshift-dns/dns-default-ng67n"
Jul 20 13:02:12.134075 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:12.134055    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f34def21-0566-4ce0-9754-25777f418798-bound-sa-token\") pod \"image-registry-78cc7648f6-2kdpx\" (UID: \"f34def21-0566-4ce0-9754-25777f418798\") " pod="openshift-image-registry/image-registry-78cc7648f6-2kdpx"
Jul 20 13:02:12.141486 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:12.141468    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bjz6v"
Jul 20 13:02:12.145273 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:12.145254    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 20 13:02:12.231978 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:12.231956    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-dnpn2"
Jul 20 13:02:12.351955 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:12.351731    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-g47kp" event={"ID":"4ad79612-15fd-48a7-a9cc-33f53c58ca69","Type":"ContainerStarted","Data":"934a7083357bc07875eb14ff341d49402988d721a889e8e1595f72416def1672"}
Jul 20 13:02:12.374599 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:12.374465    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-g47kp" podStartSLOduration=6.9397176080000005 podStartE2EDuration="38.374448216s" totalImagesPullingTime="31.434730608s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 13:01:34 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:02:12.373175313 +0000 UTC m=+38.842707432" watchObservedRunningTime="2026-07-20 13:02:12.374448216 +0000 UTC m=+38.843980334"
Jul 20 13:02:12.407858 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:12.407832    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-dnpn2"]
Jul 20 13:02:12.412034 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:02:12.412002    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67795910_26cd_41e8_9c3d_a55eb900657e.slice/crio-8bc36c65c328635ebc3847510fe341e16b1a8778e3c84954a33fa59802365a5f WatchSource:0}: Error finding container 8bc36c65c328635ebc3847510fe341e16b1a8778e3c84954a33fa59802365a5f: Status 404 returned error can't find the container with id 8bc36c65c328635ebc3847510fe341e16b1a8778e3c84954a33fa59802365a5f
Jul 20 13:02:12.531426 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:12.531386    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:12.608676 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:12.608641    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:12.627845 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:12.627781    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0156bad2-0fcf-4d37-b346-ff5f28f2890c-metrics-tls\") pod \"dns-default-ng67n\" (UID: \"0156bad2-0fcf-4d37-b346-ff5f28f2890c\") " pod="openshift-dns/dns-default-ng67n"
Jul 20 13:02:12.627845 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:12.627826    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f34def21-0566-4ce0-9754-25777f418798-registry-tls\") pod \"image-registry-78cc7648f6-2kdpx\" (UID: \"f34def21-0566-4ce0-9754-25777f418798\") " pod="openshift-image-registry/image-registry-78cc7648f6-2kdpx"
Jul 20 13:02:12.628026 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:12.627921    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 13:02:12.628026 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:12.627959    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 13:02:12.628026 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:12.627973    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78cc7648f6-2kdpx: secret "image-registry-tls" not found
Jul 20 13:02:12.628026 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:12.627977    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0156bad2-0fcf-4d37-b346-ff5f28f2890c-metrics-tls podName:0156bad2-0fcf-4d37-b346-ff5f28f2890c nodeName:}" failed. No retries permitted until 2026-07-20 13:02:13.627962681 +0000 UTC m=+40.097494778 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0156bad2-0fcf-4d37-b346-ff5f28f2890c-metrics-tls") pod "dns-default-ng67n" (UID: "0156bad2-0fcf-4d37-b346-ff5f28f2890c") : secret "dns-default-metrics-tls" not found
Jul 20 13:02:12.628171 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:12.628031    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f34def21-0566-4ce0-9754-25777f418798-registry-tls podName:f34def21-0566-4ce0-9754-25777f418798 nodeName:}" failed. No retries permitted until 2026-07-20 13:02:13.628014465 +0000 UTC m=+40.097546566 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f34def21-0566-4ce0-9754-25777f418798-registry-tls") pod "image-registry-78cc7648f6-2kdpx" (UID: "f34def21-0566-4ce0-9754-25777f418798") : secret "image-registry-tls" not found
Jul 20 13:02:13.141253 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:13.141221    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vjqm"
Jul 20 13:02:13.141456 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:13.141224    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbfs8"
Jul 20 13:02:13.144301 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:13.144279    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 20 13:02:13.144474 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:13.144458    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 20 13:02:13.145654 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:13.145628    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 20 13:02:13.145784 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:13.145672    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-m99kw\""
Jul 20 13:02:13.145784 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:13.145674    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dbwl5\""
Jul 20 13:02:13.355407 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:13.355377    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dnpn2" event={"ID":"67795910-26cd-41e8-9c3d-a55eb900657e","Type":"ContainerStarted","Data":"8bc36c65c328635ebc3847510fe341e16b1a8778e3c84954a33fa59802365a5f"}
Jul 20 13:02:13.636555 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:13.636518    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f34def21-0566-4ce0-9754-25777f418798-registry-tls\") pod \"image-registry-78cc7648f6-2kdpx\" (UID: \"f34def21-0566-4ce0-9754-25777f418798\") " pod="openshift-image-registry/image-registry-78cc7648f6-2kdpx"
Jul 20 13:02:13.636706 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:13.636613    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0156bad2-0fcf-4d37-b346-ff5f28f2890c-metrics-tls\") pod \"dns-default-ng67n\" (UID: \"0156bad2-0fcf-4d37-b346-ff5f28f2890c\") " pod="openshift-dns/dns-default-ng67n"
Jul 20 13:02:13.636706 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:13.636675    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 13:02:13.636706 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:13.636695    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78cc7648f6-2kdpx: secret "image-registry-tls" not found
Jul 20 13:02:13.636806 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:13.636711    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 13:02:13.636806 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:13.636748    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f34def21-0566-4ce0-9754-25777f418798-registry-tls podName:f34def21-0566-4ce0-9754-25777f418798 nodeName:}" failed. No retries permitted until 2026-07-20 13:02:15.636733162 +0000 UTC m=+42.106265258 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f34def21-0566-4ce0-9754-25777f418798-registry-tls") pod "image-registry-78cc7648f6-2kdpx" (UID: "f34def21-0566-4ce0-9754-25777f418798") : secret "image-registry-tls" not found
Jul 20 13:02:13.636806 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:13.636760    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0156bad2-0fcf-4d37-b346-ff5f28f2890c-metrics-tls podName:0156bad2-0fcf-4d37-b346-ff5f28f2890c nodeName:}" failed. No retries permitted until 2026-07-20 13:02:15.636754752 +0000 UTC m=+42.106286849 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0156bad2-0fcf-4d37-b346-ff5f28f2890c-metrics-tls") pod "dns-default-ng67n" (UID: "0156bad2-0fcf-4d37-b346-ff5f28f2890c") : secret "dns-default-metrics-tls" not found
Jul 20 13:02:15.371702 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:15.371516    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:15.469296 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:15.469264    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:15.651584 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:15.651545    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0156bad2-0fcf-4d37-b346-ff5f28f2890c-metrics-tls\") pod \"dns-default-ng67n\" (UID: \"0156bad2-0fcf-4d37-b346-ff5f28f2890c\") " pod="openshift-dns/dns-default-ng67n"
Jul 20 13:02:15.651764 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:15.651597    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f34def21-0566-4ce0-9754-25777f418798-registry-tls\") pod \"image-registry-78cc7648f6-2kdpx\" (UID: \"f34def21-0566-4ce0-9754-25777f418798\") " pod="openshift-image-registry/image-registry-78cc7648f6-2kdpx"
Jul 20 13:02:15.651764 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:15.651671    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 13:02:15.651764 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:15.651694    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 13:02:15.651764 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:15.651705    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78cc7648f6-2kdpx: secret "image-registry-tls" not found
Jul 20 13:02:15.651764 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:15.651739    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0156bad2-0fcf-4d37-b346-ff5f28f2890c-metrics-tls podName:0156bad2-0fcf-4d37-b346-ff5f28f2890c nodeName:}" failed. No retries permitted until 2026-07-20 13:02:19.651721569 +0000 UTC m=+46.121253670 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0156bad2-0fcf-4d37-b346-ff5f28f2890c-metrics-tls") pod "dns-default-ng67n" (UID: "0156bad2-0fcf-4d37-b346-ff5f28f2890c") : secret "dns-default-metrics-tls" not found
Jul 20 13:02:15.651764 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:15.651753    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f34def21-0566-4ce0-9754-25777f418798-registry-tls podName:f34def21-0566-4ce0-9754-25777f418798 nodeName:}" failed. No retries permitted until 2026-07-20 13:02:19.651746879 +0000 UTC m=+46.121278976 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f34def21-0566-4ce0-9754-25777f418798-registry-tls") pod "image-registry-78cc7648f6-2kdpx" (UID: "f34def21-0566-4ce0-9754-25777f418798") : secret "image-registry-tls" not found
Jul 20 13:02:16.284115 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:16.284073    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:16.371656 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:16.371593    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:16.614400 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:16.614369    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-c4l5l"]
Jul 20 13:02:16.630038 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:16.630009    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-c4l5l"
Jul 20 13:02:16.634039 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:16.634002    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 20 13:02:16.634209 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:16.634193    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rdx8c\""
Jul 20 13:02:16.635844 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:16.635345    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 20 13:02:16.635844 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:16.635369    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 20 13:02:16.635844 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:16.635446    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 20 13:02:16.638656 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:16.638260    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-c4l5l"]
Jul 20 13:02:16.760959 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:16.760922    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0a8fb30e-8f10-43ba-8934-017ae9f76a57-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c4l5l\" (UID: \"0a8fb30e-8f10-43ba-8934-017ae9f76a57\") " pod="openshift-insights/insights-runtime-extractor-c4l5l"
Jul 20 13:02:16.761154 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:16.760971    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0a8fb30e-8f10-43ba-8934-017ae9f76a57-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c4l5l\" (UID: \"0a8fb30e-8f10-43ba-8934-017ae9f76a57\") " pod="openshift-insights/insights-runtime-extractor-c4l5l"
Jul 20 13:02:16.761154 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:16.761012    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0a8fb30e-8f10-43ba-8934-017ae9f76a57-crio-socket\") pod \"insights-runtime-extractor-c4l5l\" (UID: \"0a8fb30e-8f10-43ba-8934-017ae9f76a57\") " pod="openshift-insights/insights-runtime-extractor-c4l5l"
Jul 20 13:02:16.761154 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:16.761036    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0a8fb30e-8f10-43ba-8934-017ae9f76a57-data-volume\") pod \"insights-runtime-extractor-c4l5l\" (UID: \"0a8fb30e-8f10-43ba-8934-017ae9f76a57\") " pod="openshift-insights/insights-runtime-extractor-c4l5l"
Jul 20 13:02:16.761154 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:16.761101    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b96np\" (UniqueName: \"kubernetes.io/projected/0a8fb30e-8f10-43ba-8934-017ae9f76a57-kube-api-access-b96np\") pod \"insights-runtime-extractor-c4l5l\" (UID: \"0a8fb30e-8f10-43ba-8934-017ae9f76a57\") " pod="openshift-insights/insights-runtime-extractor-c4l5l"
Jul 20 13:02:16.861729 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:16.861695    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0a8fb30e-8f10-43ba-8934-017ae9f76a57-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c4l5l\" (UID: \"0a8fb30e-8f10-43ba-8934-017ae9f76a57\") " pod="openshift-insights/insights-runtime-extractor-c4l5l"
Jul 20 13:02:16.861729 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:16.861734    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0a8fb30e-8f10-43ba-8934-017ae9f76a57-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c4l5l\" (UID: \"0a8fb30e-8f10-43ba-8934-017ae9f76a57\") " pod="openshift-insights/insights-runtime-extractor-c4l5l"
Jul 20 13:02:16.861941 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:16.861761    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0a8fb30e-8f10-43ba-8934-017ae9f76a57-crio-socket\") pod \"insights-runtime-extractor-c4l5l\" (UID: \"0a8fb30e-8f10-43ba-8934-017ae9f76a57\") " pod="openshift-insights/insights-runtime-extractor-c4l5l"
Jul 20 13:02:16.861941 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:16.861781    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0a8fb30e-8f10-43ba-8934-017ae9f76a57-data-volume\") pod \"insights-runtime-extractor-c4l5l\" (UID: \"0a8fb30e-8f10-43ba-8934-017ae9f76a57\") " pod="openshift-insights/insights-runtime-extractor-c4l5l"
Jul 20 13:02:16.861941 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:16.861841    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 13:02:16.861941 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:16.861862    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 13:02:16.861941 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:16.861913    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a8fb30e-8f10-43ba-8934-017ae9f76a57-insights-runtime-extractor-tls podName:0a8fb30e-8f10-43ba-8934-017ae9f76a57 nodeName:}" failed. No retries permitted until 2026-07-20 13:02:17.36189425 +0000 UTC m=+43.831426361 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0a8fb30e-8f10-43ba-8934-017ae9f76a57-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c4l5l" (UID: "0a8fb30e-8f10-43ba-8934-017ae9f76a57") : secret "insights-runtime-extractor-tls" not found
Jul 20 13:02:16.862291 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:16.861957    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b96np\" (UniqueName: \"kubernetes.io/projected/0a8fb30e-8f10-43ba-8934-017ae9f76a57-kube-api-access-b96np\") pod \"insights-runtime-extractor-c4l5l\" (UID: \"0a8fb30e-8f10-43ba-8934-017ae9f76a57\") " pod="openshift-insights/insights-runtime-extractor-c4l5l"
Jul 20 13:02:16.862291 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:16.861978    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0a8fb30e-8f10-43ba-8934-017ae9f76a57-kube-rbac-proxy-cm podName:0a8fb30e-8f10-43ba-8934-017ae9f76a57 nodeName:}" failed. No retries permitted until 2026-07-20 13:02:17.361956968 +0000 UTC m=+43.831489086 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0a8fb30e-8f10-43ba-8934-017ae9f76a57-kube-rbac-proxy-cm") pod "insights-runtime-extractor-c4l5l" (UID: "0a8fb30e-8f10-43ba-8934-017ae9f76a57") : configmap "kube-rbac-proxy" not found
Jul 20 13:02:16.862291 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:16.861995    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/0a8fb30e-8f10-43ba-8934-017ae9f76a57-crio-socket\") pod \"insights-runtime-extractor-c4l5l\" (UID: \"0a8fb30e-8f10-43ba-8934-017ae9f76a57\") " pod="openshift-insights/insights-runtime-extractor-c4l5l"
Jul 20 13:02:16.862291 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:16.862085    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/0a8fb30e-8f10-43ba-8934-017ae9f76a57-data-volume\") pod \"insights-runtime-extractor-c4l5l\" (UID: \"0a8fb30e-8f10-43ba-8934-017ae9f76a57\") " pod="openshift-insights/insights-runtime-extractor-c4l5l"
Jul 20 13:02:16.873885 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:16.873821    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b96np\" (UniqueName: \"kubernetes.io/projected/0a8fb30e-8f10-43ba-8934-017ae9f76a57-kube-api-access-b96np\") pod \"insights-runtime-extractor-c4l5l\" (UID: \"0a8fb30e-8f10-43ba-8934-017ae9f76a57\") " pod="openshift-insights/insights-runtime-extractor-c4l5l"
Jul 20 13:02:17.365694 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:17.365660    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0a8fb30e-8f10-43ba-8934-017ae9f76a57-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c4l5l\" (UID: \"0a8fb30e-8f10-43ba-8934-017ae9f76a57\") " pod="openshift-insights/insights-runtime-extractor-c4l5l"
Jul 20 13:02:17.365872 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:17.365794    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0a8fb30e-8f10-43ba-8934-017ae9f76a57-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c4l5l\" (UID: \"0a8fb30e-8f10-43ba-8934-017ae9f76a57\") " pod="openshift-insights/insights-runtime-extractor-c4l5l"
Jul 20 13:02:17.365872 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:17.365825    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 13:02:17.365872 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:17.365868    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 13:02:17.366033 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:17.365889    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a8fb30e-8f10-43ba-8934-017ae9f76a57-insights-runtime-extractor-tls podName:0a8fb30e-8f10-43ba-8934-017ae9f76a57 nodeName:}" failed. No retries permitted until 2026-07-20 13:02:18.36587029 +0000 UTC m=+44.835402402 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0a8fb30e-8f10-43ba-8934-017ae9f76a57-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c4l5l" (UID: "0a8fb30e-8f10-43ba-8934-017ae9f76a57") : secret "insights-runtime-extractor-tls" not found
Jul 20 13:02:17.366033 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:17.365908    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0a8fb30e-8f10-43ba-8934-017ae9f76a57-kube-rbac-proxy-cm podName:0a8fb30e-8f10-43ba-8934-017ae9f76a57 nodeName:}" failed. No retries permitted until 2026-07-20 13:02:18.365897781 +0000 UTC m=+44.835429891 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0a8fb30e-8f10-43ba-8934-017ae9f76a57-kube-rbac-proxy-cm") pod "insights-runtime-extractor-c4l5l" (UID: "0a8fb30e-8f10-43ba-8934-017ae9f76a57") : configmap "kube-rbac-proxy" not found
Jul 20 13:02:17.745601 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:17.745523    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-m2zc7"]
Jul 20 13:02:17.806467 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:17.806434    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-m2zc7"]
Jul 20 13:02:17.806637 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:17.806558    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-m2zc7"
Jul 20 13:02:17.809475 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:17.809433    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 20 13:02:17.809475 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:17.809433    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 20 13:02:17.810464 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:17.810438    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-rrbjq\""
Jul 20 13:02:17.969954 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:17.969916    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-df4dz\" (UniqueName: \"kubernetes.io/projected/db55a6a8-d13a-4569-b4ca-9012509b899f-kube-api-access-df4dz\") pod \"migrator-7cc9c7ffd7-m2zc7\" (UID: \"db55a6a8-d13a-4569-b4ca-9012509b899f\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-m2zc7"
Jul 20 13:02:18.070840 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:18.070766    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-df4dz\" (UniqueName: \"kubernetes.io/projected/db55a6a8-d13a-4569-b4ca-9012509b899f-kube-api-access-df4dz\") pod \"migrator-7cc9c7ffd7-m2zc7\" (UID: \"db55a6a8-d13a-4569-b4ca-9012509b899f\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-m2zc7"
Jul 20 13:02:18.079807 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:18.079771    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-df4dz\" (UniqueName: \"kubernetes.io/projected/db55a6a8-d13a-4569-b4ca-9012509b899f-kube-api-access-df4dz\") pod \"migrator-7cc9c7ffd7-m2zc7\" (UID: \"db55a6a8-d13a-4569-b4ca-9012509b899f\") " pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-m2zc7"
Jul 20 13:02:18.117268 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:18.117237    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-m2zc7"
Jul 20 13:02:18.248642 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:18.248610    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-m2zc7"]
Jul 20 13:02:18.373235 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:18.373206    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0a8fb30e-8f10-43ba-8934-017ae9f76a57-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c4l5l\" (UID: \"0a8fb30e-8f10-43ba-8934-017ae9f76a57\") " pod="openshift-insights/insights-runtime-extractor-c4l5l"
Jul 20 13:02:18.373427 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:18.373245    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0a8fb30e-8f10-43ba-8934-017ae9f76a57-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c4l5l\" (UID: \"0a8fb30e-8f10-43ba-8934-017ae9f76a57\") " pod="openshift-insights/insights-runtime-extractor-c4l5l"
Jul 20 13:02:18.373427 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:18.373342    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 13:02:18.373427 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:18.373425    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0a8fb30e-8f10-43ba-8934-017ae9f76a57-kube-rbac-proxy-cm podName:0a8fb30e-8f10-43ba-8934-017ae9f76a57 nodeName:}" failed. No retries permitted until 2026-07-20 13:02:20.37340967 +0000 UTC m=+46.842941767 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0a8fb30e-8f10-43ba-8934-017ae9f76a57-kube-rbac-proxy-cm") pod "insights-runtime-extractor-c4l5l" (UID: "0a8fb30e-8f10-43ba-8934-017ae9f76a57") : configmap "kube-rbac-proxy" not found
Jul 20 13:02:18.373544 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:18.373349    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 13:02:18.373544 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:18.373496    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a8fb30e-8f10-43ba-8934-017ae9f76a57-insights-runtime-extractor-tls podName:0a8fb30e-8f10-43ba-8934-017ae9f76a57 nodeName:}" failed. No retries permitted until 2026-07-20 13:02:20.37348204 +0000 UTC m=+46.843014137 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0a8fb30e-8f10-43ba-8934-017ae9f76a57-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c4l5l" (UID: "0a8fb30e-8f10-43ba-8934-017ae9f76a57") : secret "insights-runtime-extractor-tls" not found
Jul 20 13:02:18.383962 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:18.383944    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lsrxw_bf9a432f-9b17-467c-826d-50f1ce4cfd7c/dns-node-resolver/0.log"
Jul 20 13:02:18.443411 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:02:18.443370    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb55a6a8_d13a_4569_b4ca_9012509b899f.slice/crio-e8e11a65e546d269ca665ddea9bf02a76547589ceeed7a6876532b021ed29986 WatchSource:0}: Error finding container e8e11a65e546d269ca665ddea9bf02a76547589ceeed7a6876532b021ed29986: Status 404 returned error can't find the container with id e8e11a65e546d269ca665ddea9bf02a76547589ceeed7a6876532b021ed29986
Jul 20 13:02:19.184873 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:19.184842    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dcnn2_2e3cfb74-ae63-457e-abb7-fc0e5f459dbb/node-ca/0.log"
Jul 20 13:02:19.371096 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:19.371059    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-m2zc7" event={"ID":"db55a6a8-d13a-4569-b4ca-9012509b899f","Type":"ContainerStarted","Data":"e8e11a65e546d269ca665ddea9bf02a76547589ceeed7a6876532b021ed29986"}
Jul 20 13:02:19.372340 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:19.372318    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-dnpn2" event={"ID":"67795910-26cd-41e8-9c3d-a55eb900657e","Type":"ContainerStarted","Data":"73570a2f7930bfd3821dbba01df89bae0c49d4e30069c1552b03f307cd084349"}
Jul 20 13:02:19.389811 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:19.389770    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-dnpn2" podStartSLOduration=2.329432546 podStartE2EDuration="8.389758066s" totalImagesPullingTime="6.06032552s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:02:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:02:19.389088253 +0000 UTC m=+45.858620372" watchObservedRunningTime="2026-07-20 13:02:19.389758066 +0000 UTC m=+45.859290184"
Jul 20 13:02:19.574952 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:19.574858    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:19.624682 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:19.624643    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:19.683180 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:19.683145    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f34def21-0566-4ce0-9754-25777f418798-registry-tls\") pod \"image-registry-78cc7648f6-2kdpx\" (UID: \"f34def21-0566-4ce0-9754-25777f418798\") " pod="openshift-image-registry/image-registry-78cc7648f6-2kdpx"
Jul 20 13:02:19.683384 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:19.683264    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0156bad2-0fcf-4d37-b346-ff5f28f2890c-metrics-tls\") pod \"dns-default-ng67n\" (UID: \"0156bad2-0fcf-4d37-b346-ff5f28f2890c\") " pod="openshift-dns/dns-default-ng67n"
Jul 20 13:02:19.683384 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:19.683295    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 13:02:19.683384 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:19.683319    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78cc7648f6-2kdpx: secret "image-registry-tls" not found
Jul 20 13:02:19.683534 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:19.683388    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 13:02:19.683534 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:19.683432    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f34def21-0566-4ce0-9754-25777f418798-registry-tls podName:f34def21-0566-4ce0-9754-25777f418798 nodeName:}" failed. No retries permitted until 2026-07-20 13:02:27.683410545 +0000 UTC m=+54.152942648 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f34def21-0566-4ce0-9754-25777f418798-registry-tls") pod "image-registry-78cc7648f6-2kdpx" (UID: "f34def21-0566-4ce0-9754-25777f418798") : secret "image-registry-tls" not found
Jul 20 13:02:19.683534 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:19.683455    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0156bad2-0fcf-4d37-b346-ff5f28f2890c-metrics-tls podName:0156bad2-0fcf-4d37-b346-ff5f28f2890c nodeName:}" failed. No retries permitted until 2026-07-20 13:02:27.683443036 +0000 UTC m=+54.152975138 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0156bad2-0fcf-4d37-b346-ff5f28f2890c-metrics-tls") pod "dns-default-ng67n" (UID: "0156bad2-0fcf-4d37-b346-ff5f28f2890c") : secret "dns-default-metrics-tls" not found
Jul 20 13:02:19.772067 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:19.772032    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-58598695f7-2vjvw"]
Jul 20 13:02:19.789621 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:19.789598    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-2vjvw"]
Jul 20 13:02:19.789780 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:19.789686    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-2vjvw"
Jul 20 13:02:19.790994 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:19.790970    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:19.792393 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:19.792352    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\""
Jul 20 13:02:19.792501 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:19.792371    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-5c2pl\""
Jul 20 13:02:19.792501 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:19.792467    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\""
Jul 20 13:02:19.793678 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:19.793660    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\""
Jul 20 13:02:19.793736 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:19.793703    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\""
Jul 20 13:02:19.842960 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:19.842907    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:19.885132 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:19.885098    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/177b93f0-5ddb-4af0-aeab-2f31e1b1231c-signing-key\") pod \"service-ca-58598695f7-2vjvw\" (UID: \"177b93f0-5ddb-4af0-aeab-2f31e1b1231c\") " pod="openshift-service-ca/service-ca-58598695f7-2vjvw"
Jul 20 13:02:19.885276 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:19.885182    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/177b93f0-5ddb-4af0-aeab-2f31e1b1231c-signing-cabundle\") pod \"service-ca-58598695f7-2vjvw\" (UID: \"177b93f0-5ddb-4af0-aeab-2f31e1b1231c\") " pod="openshift-service-ca/service-ca-58598695f7-2vjvw"
Jul 20 13:02:19.885276 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:19.885203    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkntl\" (UniqueName: \"kubernetes.io/projected/177b93f0-5ddb-4af0-aeab-2f31e1b1231c-kube-api-access-mkntl\") pod \"service-ca-58598695f7-2vjvw\" (UID: \"177b93f0-5ddb-4af0-aeab-2f31e1b1231c\") " pod="openshift-service-ca/service-ca-58598695f7-2vjvw"
Jul 20 13:02:19.985610 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:19.985572    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/177b93f0-5ddb-4af0-aeab-2f31e1b1231c-signing-key\") pod \"service-ca-58598695f7-2vjvw\" (UID: \"177b93f0-5ddb-4af0-aeab-2f31e1b1231c\") " pod="openshift-service-ca/service-ca-58598695f7-2vjvw"
Jul 20 13:02:19.985817 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:19.985632    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/177b93f0-5ddb-4af0-aeab-2f31e1b1231c-signing-cabundle\") pod \"service-ca-58598695f7-2vjvw\" (UID: \"177b93f0-5ddb-4af0-aeab-2f31e1b1231c\") " pod="openshift-service-ca/service-ca-58598695f7-2vjvw"
Jul 20 13:02:19.985817 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:19.985653    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkntl\" (UniqueName: \"kubernetes.io/projected/177b93f0-5ddb-4af0-aeab-2f31e1b1231c-kube-api-access-mkntl\") pod \"service-ca-58598695f7-2vjvw\" (UID: \"177b93f0-5ddb-4af0-aeab-2f31e1b1231c\") " pod="openshift-service-ca/service-ca-58598695f7-2vjvw"
Jul 20 13:02:19.985817 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:19.985784    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dnpn2_67795910-26cd-41e8-9c3d-a55eb900657e/serve-healthcheck-canary/0.log"
Jul 20 13:02:19.986389 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:19.986351    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/177b93f0-5ddb-4af0-aeab-2f31e1b1231c-signing-cabundle\") pod \"service-ca-58598695f7-2vjvw\" (UID: \"177b93f0-5ddb-4af0-aeab-2f31e1b1231c\") " pod="openshift-service-ca/service-ca-58598695f7-2vjvw"
Jul 20 13:02:19.987945 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:19.987923    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/177b93f0-5ddb-4af0-aeab-2f31e1b1231c-signing-key\") pod \"service-ca-58598695f7-2vjvw\" (UID: \"177b93f0-5ddb-4af0-aeab-2f31e1b1231c\") " pod="openshift-service-ca/service-ca-58598695f7-2vjvw"
Jul 20 13:02:19.994722 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:19.994703    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkntl\" (UniqueName: \"kubernetes.io/projected/177b93f0-5ddb-4af0-aeab-2f31e1b1231c-kube-api-access-mkntl\") pod \"service-ca-58598695f7-2vjvw\" (UID: \"177b93f0-5ddb-4af0-aeab-2f31e1b1231c\") " pod="openshift-service-ca/service-ca-58598695f7-2vjvw"
Jul 20 13:02:19.999559 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:19.999536    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:20.099193 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:20.099118    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-58598695f7-2vjvw"
Jul 20 13:02:20.241663 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:20.241636    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-58598695f7-2vjvw"]
Jul 20 13:02:20.244139 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:02:20.244116    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod177b93f0_5ddb_4af0_aeab_2f31e1b1231c.slice/crio-00b9bd43b6593843cbd7dbf169ad6507aed39c72614af549e4df81a297888425 WatchSource:0}: Error finding container 00b9bd43b6593843cbd7dbf169ad6507aed39c72614af549e4df81a297888425: Status 404 returned error can't find the container with id 00b9bd43b6593843cbd7dbf169ad6507aed39c72614af549e4df81a297888425
Jul 20 13:02:20.375950 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:20.375922    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-2vjvw" event={"ID":"177b93f0-5ddb-4af0-aeab-2f31e1b1231c","Type":"ContainerStarted","Data":"00b9bd43b6593843cbd7dbf169ad6507aed39c72614af549e4df81a297888425"}
Jul 20 13:02:20.377514 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:20.377487    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-m2zc7" event={"ID":"db55a6a8-d13a-4569-b4ca-9012509b899f","Type":"ContainerStarted","Data":"98d64cf29a4e3827269b0cde29d210ea26af966f4317ee09a5be12f41337a1dc"}
Jul 20 13:02:20.390076 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:20.390056    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0a8fb30e-8f10-43ba-8934-017ae9f76a57-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c4l5l\" (UID: \"0a8fb30e-8f10-43ba-8934-017ae9f76a57\") " pod="openshift-insights/insights-runtime-extractor-c4l5l"
Jul 20 13:02:20.390159 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:20.390093    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0a8fb30e-8f10-43ba-8934-017ae9f76a57-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c4l5l\" (UID: \"0a8fb30e-8f10-43ba-8934-017ae9f76a57\") " pod="openshift-insights/insights-runtime-extractor-c4l5l"
Jul 20 13:02:20.390211 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:20.390198    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 13:02:20.390261 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:20.390209    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 13:02:20.390261 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:20.390253    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a8fb30e-8f10-43ba-8934-017ae9f76a57-insights-runtime-extractor-tls podName:0a8fb30e-8f10-43ba-8934-017ae9f76a57 nodeName:}" failed. No retries permitted until 2026-07-20 13:02:24.390240549 +0000 UTC m=+50.859772645 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0a8fb30e-8f10-43ba-8934-017ae9f76a57-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c4l5l" (UID: "0a8fb30e-8f10-43ba-8934-017ae9f76a57") : secret "insights-runtime-extractor-tls" not found
Jul 20 13:02:20.390344 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:20.390265    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0a8fb30e-8f10-43ba-8934-017ae9f76a57-kube-rbac-proxy-cm podName:0a8fb30e-8f10-43ba-8934-017ae9f76a57 nodeName:}" failed. No retries permitted until 2026-07-20 13:02:24.390258583 +0000 UTC m=+50.859790680 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0a8fb30e-8f10-43ba-8934-017ae9f76a57-kube-rbac-proxy-cm") pod "insights-runtime-extractor-c4l5l" (UID: "0a8fb30e-8f10-43ba-8934-017ae9f76a57") : configmap "kube-rbac-proxy" not found
Jul 20 13:02:20.626623 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:20.626541    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:21.382405 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:21.382350    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-m2zc7" event={"ID":"db55a6a8-d13a-4569-b4ca-9012509b899f","Type":"ContainerStarted","Data":"c3963c9e0432141f0969a9a6e6d3fa6bcf52c699740cf33c9fa8934888a1947f"}
Jul 20 13:02:21.399031 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:21.398977    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-7cc9c7ffd7-m2zc7" podStartSLOduration=2.738165216 podStartE2EDuration="4.398956686s" totalImagesPullingTime="1.66079147s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:02:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:02:21.398392241 +0000 UTC m=+47.867924393" watchObservedRunningTime="2026-07-20 13:02:21.398956686 +0000 UTC m=+47.868488806"
Jul 20 13:02:23.389292 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:23.389255    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-58598695f7-2vjvw" event={"ID":"177b93f0-5ddb-4af0-aeab-2f31e1b1231c","Type":"ContainerStarted","Data":"0567f849200790b5dd05d6b2862e3d6f32f015d0330c48f39ba50c4edb285fd2"}
Jul 20 13:02:23.405967 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:23.405912    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-58598695f7-2vjvw" podStartSLOduration=2.054812258 podStartE2EDuration="4.405892806s" totalImagesPullingTime="2.351080548s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:02:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:02:23.405641822 +0000 UTC m=+49.875173983" watchObservedRunningTime="2026-07-20 13:02:23.405892806 +0000 UTC m=+49.875424926"
Jul 20 13:02:23.840009 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:23.839933    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:24.428039 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:24.427830    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0a8fb30e-8f10-43ba-8934-017ae9f76a57-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c4l5l\" (UID: \"0a8fb30e-8f10-43ba-8934-017ae9f76a57\") " pod="openshift-insights/insights-runtime-extractor-c4l5l"
Jul 20 13:02:24.428039 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:24.427978    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 13:02:24.428039 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:24.427987    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0a8fb30e-8f10-43ba-8934-017ae9f76a57-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c4l5l\" (UID: \"0a8fb30e-8f10-43ba-8934-017ae9f76a57\") " pod="openshift-insights/insights-runtime-extractor-c4l5l"
Jul 20 13:02:24.428618 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:24.428049    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a8fb30e-8f10-43ba-8934-017ae9f76a57-insights-runtime-extractor-tls podName:0a8fb30e-8f10-43ba-8934-017ae9f76a57 nodeName:}" failed. No retries permitted until 2026-07-20 13:02:32.428028143 +0000 UTC m=+58.897560245 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0a8fb30e-8f10-43ba-8934-017ae9f76a57-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c4l5l" (UID: "0a8fb30e-8f10-43ba-8934-017ae9f76a57") : secret "insights-runtime-extractor-tls" not found
Jul 20 13:02:24.428618 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:24.428121    2565 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 20 13:02:24.428618 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:24.428194    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/0a8fb30e-8f10-43ba-8934-017ae9f76a57-kube-rbac-proxy-cm podName:0a8fb30e-8f10-43ba-8934-017ae9f76a57 nodeName:}" failed. No retries permitted until 2026-07-20 13:02:32.428163935 +0000 UTC m=+58.897696035 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/0a8fb30e-8f10-43ba-8934-017ae9f76a57-kube-rbac-proxy-cm") pod "insights-runtime-extractor-c4l5l" (UID: "0a8fb30e-8f10-43ba-8934-017ae9f76a57") : configmap "kube-rbac-proxy" not found
Jul 20 13:02:27.282410 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:27.282351    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:27.337149 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:27.337119    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:27.479081 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:27.479036    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:27.753123 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:27.753080    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0156bad2-0fcf-4d37-b346-ff5f28f2890c-metrics-tls\") pod \"dns-default-ng67n\" (UID: \"0156bad2-0fcf-4d37-b346-ff5f28f2890c\") " pod="openshift-dns/dns-default-ng67n"
Jul 20 13:02:27.753391 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:27.753147    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f34def21-0566-4ce0-9754-25777f418798-registry-tls\") pod \"image-registry-78cc7648f6-2kdpx\" (UID: \"f34def21-0566-4ce0-9754-25777f418798\") " pod="openshift-image-registry/image-registry-78cc7648f6-2kdpx"
Jul 20 13:02:27.753391 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:27.753262    2565 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 20 13:02:27.753391 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:27.753274    2565 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found
Jul 20 13:02:27.753391 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:27.753287    2565 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-78cc7648f6-2kdpx: secret "image-registry-tls" not found
Jul 20 13:02:27.753391 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:27.753342    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0156bad2-0fcf-4d37-b346-ff5f28f2890c-metrics-tls podName:0156bad2-0fcf-4d37-b346-ff5f28f2890c nodeName:}" failed. No retries permitted until 2026-07-20 13:02:43.753319819 +0000 UTC m=+70.222851924 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/0156bad2-0fcf-4d37-b346-ff5f28f2890c-metrics-tls") pod "dns-default-ng67n" (UID: "0156bad2-0fcf-4d37-b346-ff5f28f2890c") : secret "dns-default-metrics-tls" not found
Jul 20 13:02:27.753391 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:27.753379    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/f34def21-0566-4ce0-9754-25777f418798-registry-tls podName:f34def21-0566-4ce0-9754-25777f418798 nodeName:}" failed. No retries permitted until 2026-07-20 13:02:43.753352682 +0000 UTC m=+70.222884784 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/f34def21-0566-4ce0-9754-25777f418798-registry-tls") pod "image-registry-78cc7648f6-2kdpx" (UID: "f34def21-0566-4ce0-9754-25777f418798") : secret "image-registry-tls" not found
Jul 20 13:02:28.060762 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:28.060660    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:28.109309 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:28.109238    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:28.468759 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:28.468716    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:28.571181 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:28.571136    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:28.671869 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:28.671831    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:29.077776 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:29.077729    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:29.275974 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:29.275946    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:29.336731 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:29.336637    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:29.480839 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:29.480793    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:29.581989 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:29.581937    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:29.681709 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:29.681669    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:29.782861 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:29.782828    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:30.467548 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:30.467510    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:30.876582 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:30.876550    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:31.079973 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:31.079918    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:31.285591 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:31.285509    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:31.653587 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:31.653545    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:31.710417 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:31.710388    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:32.274893 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:32.274858    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:32.492496 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:32.492464    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0a8fb30e-8f10-43ba-8934-017ae9f76a57-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c4l5l\" (UID: \"0a8fb30e-8f10-43ba-8934-017ae9f76a57\") " pod="openshift-insights/insights-runtime-extractor-c4l5l"
Jul 20 13:02:32.492652 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:32.492505    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0a8fb30e-8f10-43ba-8934-017ae9f76a57-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c4l5l\" (UID: \"0a8fb30e-8f10-43ba-8934-017ae9f76a57\") " pod="openshift-insights/insights-runtime-extractor-c4l5l"
Jul 20 13:02:32.492652 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:32.492617    2565 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 20 13:02:32.492726 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:32.492687    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0a8fb30e-8f10-43ba-8934-017ae9f76a57-insights-runtime-extractor-tls podName:0a8fb30e-8f10-43ba-8934-017ae9f76a57 nodeName:}" failed. No retries permitted until 2026-07-20 13:02:48.492668827 +0000 UTC m=+74.962200925 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/0a8fb30e-8f10-43ba-8934-017ae9f76a57-insights-runtime-extractor-tls") pod "insights-runtime-extractor-c4l5l" (UID: "0a8fb30e-8f10-43ba-8934-017ae9f76a57") : secret "insights-runtime-extractor-tls" not found
Jul 20 13:02:32.493076 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:32.493059    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/0a8fb30e-8f10-43ba-8934-017ae9f76a57-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-c4l5l\" (UID: \"0a8fb30e-8f10-43ba-8934-017ae9f76a57\") " pod="openshift-insights/insights-runtime-extractor-c4l5l"
Jul 20 13:02:32.673212 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:32.673177    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:32.847304 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:32.847267    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:32.902190 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:32.902161    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:33.274609 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:33.274575    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:33.872451 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:33.872414    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:34.068107 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:34.068068    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:34.126613 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:34.126539    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:34.272091 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:34.272059    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:34.477653 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:34.477569    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:34.784535 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:34.784453    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:34.875615 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:34.875579    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:34.927781 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:34.927741    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:35.071651 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:35.071544    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:35.124658 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:35.124627    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:35.253663 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:35.253628    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:35.356467 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:35.356431    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:35.458508 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:35.458456    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:35.683480 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:35.683404    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:35.735743 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:35.735708    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:35.888209 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:35.888174    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:35.941658 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:35.941591    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:36.664542 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:36.664505    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:36.765395 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:36.765340    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:36.868533 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:36.868499    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:37.337739 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:37.337711    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-w6z5r"
Jul 20 13:02:37.684940 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:37.684906    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:37.732825 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:37.732794    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:39.433224 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.433190    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f5bdf789d-7zjjr"]
Jul 20 13:02:39.440599 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.440573    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-56c6db7d5b-6nqrs"]
Jul 20 13:02:39.440766 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.440698    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f5bdf789d-7zjjr"
Jul 20 13:02:39.442850 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.442832    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56c6db7d5b-6nqrs"
Jul 20 13:02:39.445156 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.445137    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-hub-kubeconfig\""
Jul 20 13:02:39.445326 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.445154    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 20 13:02:39.445326 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.445244    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 20 13:02:39.445326 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.445258    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"managed-serviceaccount-dockercfg-mh6bj\""
Jul 20 13:02:39.445522 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.445408    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"work-manager-hub-kubeconfig\""
Jul 20 13:02:39.445522 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.445408    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 20 13:02:39.450116 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.450092    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f5bdf789d-7zjjr"]
Jul 20 13:02:39.451388 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.451335    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-78cc7648f6-2kdpx"]
Jul 20 13:02:39.451570 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:39.451548    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context canceled" pod="openshift-image-registry/image-registry-78cc7648f6-2kdpx" podUID="f34def21-0566-4ce0-9754-25777f418798"
Jul 20 13:02:39.456430 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.456407    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-56c6db7d5b-6nqrs"]
Jul 20 13:02:39.501233 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.501204    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:39.536879 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.536852    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-5bc67dcd46-hdrtd"]
Jul 20 13:02:39.539765 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.539750    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-hdrtd"
Jul 20 13:02:39.542000 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.541971    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-6vnq5"]
Jul 20 13:02:39.542436 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.542416    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-sv2v5\""
Jul 20 13:02:39.542535 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.542484    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 20 13:02:39.542600 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.542533    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 20 13:02:39.549079 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.549058    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-764fd46654-nbjvw"]
Jul 20 13:02:39.549298 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.549194    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-6vnq5"
Jul 20 13:02:39.551444 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.551421    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/24f9e644-f9f2-4835-8ddc-1e1dd106fc80-tmp\") pod \"klusterlet-addon-workmgr-56c6db7d5b-6nqrs\" (UID: \"24f9e644-f9f2-4835-8ddc-1e1dd106fc80\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56c6db7d5b-6nqrs"
Jul 20 13:02:39.551535 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.551460    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/24f9e644-f9f2-4835-8ddc-1e1dd106fc80-klusterlet-config\") pod \"klusterlet-addon-workmgr-56c6db7d5b-6nqrs\" (UID: \"24f9e644-f9f2-4835-8ddc-1e1dd106fc80\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56c6db7d5b-6nqrs"
Jul 20 13:02:39.551535 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.551500    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrn6q\" (UniqueName: \"kubernetes.io/projected/24f9e644-f9f2-4835-8ddc-1e1dd106fc80-kube-api-access-lrn6q\") pod \"klusterlet-addon-workmgr-56c6db7d5b-6nqrs\" (UID: \"24f9e644-f9f2-4835-8ddc-1e1dd106fc80\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56c6db7d5b-6nqrs"
Jul 20 13:02:39.551640 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.551566    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c17de745-ff27-4f5b-b8c3-1067960a873a-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-f5bdf789d-7zjjr\" (UID: \"c17de745-ff27-4f5b-b8c3-1067960a873a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f5bdf789d-7zjjr"
Jul 20 13:02:39.551703 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.551685    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7fjd\" (UniqueName: \"kubernetes.io/projected/c17de745-ff27-4f5b-b8c3-1067960a873a-kube-api-access-z7fjd\") pod \"managed-serviceaccount-addon-agent-f5bdf789d-7zjjr\" (UID: \"c17de745-ff27-4f5b-b8c3-1067960a873a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f5bdf789d-7zjjr"
Jul 20 13:02:39.552319 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.552299    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-764fd46654-nbjvw"
Jul 20 13:02:39.554678 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.554659    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\""
Jul 20 13:02:39.555165 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.555148    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-bqqsl\""
Jul 20 13:02:39.555420 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.555404    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\""
Jul 20 13:02:39.564741 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.564716    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-hdrtd"]
Jul 20 13:02:39.565702 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.565676    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-6vnq5"]
Jul 20 13:02:39.566525 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.566504    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-764fd46654-nbjvw"]
Jul 20 13:02:39.603640 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.603606    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:39.652609 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.652578    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/78ce2a9b-e1a5-4df6-be68-ca04931668b0-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-6vnq5\" (UID: \"78ce2a9b-e1a5-4df6-be68-ca04931668b0\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-6vnq5"
Jul 20 13:02:39.652716 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.652622    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e0063734-fb88-4cdd-a12a-0961449f8e66-image-registry-private-configuration\") pod \"image-registry-764fd46654-nbjvw\" (UID: \"e0063734-fb88-4cdd-a12a-0961449f8e66\") " pod="openshift-image-registry/image-registry-764fd46654-nbjvw"
Jul 20 13:02:39.652716 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.652652    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e0063734-fb88-4cdd-a12a-0961449f8e66-trusted-ca\") pod \"image-registry-764fd46654-nbjvw\" (UID: \"e0063734-fb88-4cdd-a12a-0961449f8e66\") " pod="openshift-image-registry/image-registry-764fd46654-nbjvw"
Jul 20 13:02:39.652784 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.652728    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e0063734-fb88-4cdd-a12a-0961449f8e66-registry-certificates\") pod \"image-registry-764fd46654-nbjvw\" (UID: \"e0063734-fb88-4cdd-a12a-0961449f8e66\") " pod="openshift-image-registry/image-registry-764fd46654-nbjvw"
Jul 20 13:02:39.652784 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.652758    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e0063734-fb88-4cdd-a12a-0961449f8e66-bound-sa-token\") pod \"image-registry-764fd46654-nbjvw\" (UID: \"e0063734-fb88-4cdd-a12a-0961449f8e66\") " pod="openshift-image-registry/image-registry-764fd46654-nbjvw"
Jul 20 13:02:39.652784 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.652780    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bkxx\" (UniqueName: \"kubernetes.io/projected/e0063734-fb88-4cdd-a12a-0961449f8e66-kube-api-access-6bkxx\") pod \"image-registry-764fd46654-nbjvw\" (UID: \"e0063734-fb88-4cdd-a12a-0961449f8e66\") " pod="openshift-image-registry/image-registry-764fd46654-nbjvw"
Jul 20 13:02:39.652919 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.652815    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e0063734-fb88-4cdd-a12a-0961449f8e66-installation-pull-secrets\") pod \"image-registry-764fd46654-nbjvw\" (UID: \"e0063734-fb88-4cdd-a12a-0961449f8e66\") " pod="openshift-image-registry/image-registry-764fd46654-nbjvw"
Jul 20 13:02:39.652919 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.652836    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-26g7n\" (UniqueName: \"kubernetes.io/projected/57b69627-e508-4aeb-aaec-8e1b461801bd-kube-api-access-26g7n\") pod \"downloads-5bc67dcd46-hdrtd\" (UID: \"57b69627-e508-4aeb-aaec-8e1b461801bd\") " pod="openshift-console/downloads-5bc67dcd46-hdrtd"
Jul 20 13:02:39.652919 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.652859    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7fjd\" (UniqueName: \"kubernetes.io/projected/c17de745-ff27-4f5b-b8c3-1067960a873a-kube-api-access-z7fjd\") pod \"managed-serviceaccount-addon-agent-f5bdf789d-7zjjr\" (UID: \"c17de745-ff27-4f5b-b8c3-1067960a873a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f5bdf789d-7zjjr"
Jul 20 13:02:39.652919 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.652895    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e0063734-fb88-4cdd-a12a-0961449f8e66-registry-tls\") pod \"image-registry-764fd46654-nbjvw\" (UID: \"e0063734-fb88-4cdd-a12a-0961449f8e66\") " pod="openshift-image-registry/image-registry-764fd46654-nbjvw"
Jul 20 13:02:39.653067 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.652935    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/24f9e644-f9f2-4835-8ddc-1e1dd106fc80-tmp\") pod \"klusterlet-addon-workmgr-56c6db7d5b-6nqrs\" (UID: \"24f9e644-f9f2-4835-8ddc-1e1dd106fc80\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56c6db7d5b-6nqrs"
Jul 20 13:02:39.653067 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.652964    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/24f9e644-f9f2-4835-8ddc-1e1dd106fc80-klusterlet-config\") pod \"klusterlet-addon-workmgr-56c6db7d5b-6nqrs\" (UID: \"24f9e644-f9f2-4835-8ddc-1e1dd106fc80\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56c6db7d5b-6nqrs"
Jul 20 13:02:39.653067 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.653002    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrn6q\" (UniqueName: \"kubernetes.io/projected/24f9e644-f9f2-4835-8ddc-1e1dd106fc80-kube-api-access-lrn6q\") pod \"klusterlet-addon-workmgr-56c6db7d5b-6nqrs\" (UID: \"24f9e644-f9f2-4835-8ddc-1e1dd106fc80\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56c6db7d5b-6nqrs"
Jul 20 13:02:39.653067 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.653031    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/78ce2a9b-e1a5-4df6-be68-ca04931668b0-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-6vnq5\" (UID: \"78ce2a9b-e1a5-4df6-be68-ca04931668b0\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-6vnq5"
Jul 20 13:02:39.653067 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.653064    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c17de745-ff27-4f5b-b8c3-1067960a873a-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-f5bdf789d-7zjjr\" (UID: \"c17de745-ff27-4f5b-b8c3-1067960a873a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f5bdf789d-7zjjr"
Jul 20 13:02:39.653319 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.653095    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e0063734-fb88-4cdd-a12a-0961449f8e66-ca-trust-extracted\") pod \"image-registry-764fd46654-nbjvw\" (UID: \"e0063734-fb88-4cdd-a12a-0961449f8e66\") " pod="openshift-image-registry/image-registry-764fd46654-nbjvw"
Jul 20 13:02:39.653319 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.653288    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/24f9e644-f9f2-4835-8ddc-1e1dd106fc80-tmp\") pod \"klusterlet-addon-workmgr-56c6db7d5b-6nqrs\" (UID: \"24f9e644-f9f2-4835-8ddc-1e1dd106fc80\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56c6db7d5b-6nqrs"
Jul 20 13:02:39.655447 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.655427    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"klusterlet-config\" (UniqueName: \"kubernetes.io/secret/24f9e644-f9f2-4835-8ddc-1e1dd106fc80-klusterlet-config\") pod \"klusterlet-addon-workmgr-56c6db7d5b-6nqrs\" (UID: \"24f9e644-f9f2-4835-8ddc-1e1dd106fc80\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56c6db7d5b-6nqrs"
Jul 20 13:02:39.655714 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.655692    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c17de745-ff27-4f5b-b8c3-1067960a873a-hub-kubeconfig\") pod \"managed-serviceaccount-addon-agent-f5bdf789d-7zjjr\" (UID: \"c17de745-ff27-4f5b-b8c3-1067960a873a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f5bdf789d-7zjjr"
Jul 20 13:02:39.678290 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.678270    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7fjd\" (UniqueName: \"kubernetes.io/projected/c17de745-ff27-4f5b-b8c3-1067960a873a-kube-api-access-z7fjd\") pod \"managed-serviceaccount-addon-agent-f5bdf789d-7zjjr\" (UID: \"c17de745-ff27-4f5b-b8c3-1067960a873a\") " pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f5bdf789d-7zjjr"
Jul 20 13:02:39.680321 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.680296    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrn6q\" (UniqueName: \"kubernetes.io/projected/24f9e644-f9f2-4835-8ddc-1e1dd106fc80-kube-api-access-lrn6q\") pod \"klusterlet-addon-workmgr-56c6db7d5b-6nqrs\" (UID: \"24f9e644-f9f2-4835-8ddc-1e1dd106fc80\") " pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56c6db7d5b-6nqrs"
Jul 20 13:02:39.747125 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.747037    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:39.754044 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.754016    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e0063734-fb88-4cdd-a12a-0961449f8e66-registry-certificates\") pod \"image-registry-764fd46654-nbjvw\" (UID: \"e0063734-fb88-4cdd-a12a-0961449f8e66\") " pod="openshift-image-registry/image-registry-764fd46654-nbjvw"
Jul 20 13:02:39.754168 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.754052    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e0063734-fb88-4cdd-a12a-0961449f8e66-bound-sa-token\") pod \"image-registry-764fd46654-nbjvw\" (UID: \"e0063734-fb88-4cdd-a12a-0961449f8e66\") " pod="openshift-image-registry/image-registry-764fd46654-nbjvw"
Jul 20 13:02:39.754168 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.754078    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bkxx\" (UniqueName: \"kubernetes.io/projected/e0063734-fb88-4cdd-a12a-0961449f8e66-kube-api-access-6bkxx\") pod \"image-registry-764fd46654-nbjvw\" (UID: \"e0063734-fb88-4cdd-a12a-0961449f8e66\") " pod="openshift-image-registry/image-registry-764fd46654-nbjvw"
Jul 20 13:02:39.754168 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.754114    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e0063734-fb88-4cdd-a12a-0961449f8e66-installation-pull-secrets\") pod \"image-registry-764fd46654-nbjvw\" (UID: \"e0063734-fb88-4cdd-a12a-0961449f8e66\") " pod="openshift-image-registry/image-registry-764fd46654-nbjvw"
Jul 20 13:02:39.754168 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.754139    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-26g7n\" (UniqueName: \"kubernetes.io/projected/57b69627-e508-4aeb-aaec-8e1b461801bd-kube-api-access-26g7n\") pod \"downloads-5bc67dcd46-hdrtd\" (UID: \"57b69627-e508-4aeb-aaec-8e1b461801bd\") " pod="openshift-console/downloads-5bc67dcd46-hdrtd"
Jul 20 13:02:39.754405 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.754171    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e0063734-fb88-4cdd-a12a-0961449f8e66-registry-tls\") pod \"image-registry-764fd46654-nbjvw\" (UID: \"e0063734-fb88-4cdd-a12a-0961449f8e66\") " pod="openshift-image-registry/image-registry-764fd46654-nbjvw"
Jul 20 13:02:39.754405 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.754236    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/78ce2a9b-e1a5-4df6-be68-ca04931668b0-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-6vnq5\" (UID: \"78ce2a9b-e1a5-4df6-be68-ca04931668b0\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-6vnq5"
Jul 20 13:02:39.754405 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.754276    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e0063734-fb88-4cdd-a12a-0961449f8e66-ca-trust-extracted\") pod \"image-registry-764fd46654-nbjvw\" (UID: \"e0063734-fb88-4cdd-a12a-0961449f8e66\") " pod="openshift-image-registry/image-registry-764fd46654-nbjvw"
Jul 20 13:02:39.754405 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.754317    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/78ce2a9b-e1a5-4df6-be68-ca04931668b0-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-6vnq5\" (UID: \"78ce2a9b-e1a5-4df6-be68-ca04931668b0\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-6vnq5"
Jul 20 13:02:39.754405 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.754386    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e0063734-fb88-4cdd-a12a-0961449f8e66-image-registry-private-configuration\") pod \"image-registry-764fd46654-nbjvw\" (UID: \"e0063734-fb88-4cdd-a12a-0961449f8e66\") " pod="openshift-image-registry/image-registry-764fd46654-nbjvw"
Jul 20 13:02:39.754659 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.754417    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e0063734-fb88-4cdd-a12a-0961449f8e66-trusted-ca\") pod \"image-registry-764fd46654-nbjvw\" (UID: \"e0063734-fb88-4cdd-a12a-0961449f8e66\") " pod="openshift-image-registry/image-registry-764fd46654-nbjvw"
Jul 20 13:02:39.754712 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.754682    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/e0063734-fb88-4cdd-a12a-0961449f8e66-ca-trust-extracted\") pod \"image-registry-764fd46654-nbjvw\" (UID: \"e0063734-fb88-4cdd-a12a-0961449f8e66\") " pod="openshift-image-registry/image-registry-764fd46654-nbjvw"
Jul 20 13:02:39.755074 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.755050    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/78ce2a9b-e1a5-4df6-be68-ca04931668b0-nginx-conf\") pod \"networking-console-plugin-7bc7489cb5-6vnq5\" (UID: \"78ce2a9b-e1a5-4df6-be68-ca04931668b0\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-6vnq5"
Jul 20 13:02:39.755256 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.755070    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/e0063734-fb88-4cdd-a12a-0961449f8e66-registry-certificates\") pod \"image-registry-764fd46654-nbjvw\" (UID: \"e0063734-fb88-4cdd-a12a-0961449f8e66\") " pod="openshift-image-registry/image-registry-764fd46654-nbjvw"
Jul 20 13:02:39.755256 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.755244    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f5bdf789d-7zjjr"
Jul 20 13:02:39.755683 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.755658    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/e0063734-fb88-4cdd-a12a-0961449f8e66-trusted-ca\") pod \"image-registry-764fd46654-nbjvw\" (UID: \"e0063734-fb88-4cdd-a12a-0961449f8e66\") " pod="openshift-image-registry/image-registry-764fd46654-nbjvw"
Jul 20 13:02:39.756879 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.756850    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/e0063734-fb88-4cdd-a12a-0961449f8e66-installation-pull-secrets\") pod \"image-registry-764fd46654-nbjvw\" (UID: \"e0063734-fb88-4cdd-a12a-0961449f8e66\") " pod="openshift-image-registry/image-registry-764fd46654-nbjvw"
Jul 20 13:02:39.756980 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.756922    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/e0063734-fb88-4cdd-a12a-0961449f8e66-registry-tls\") pod \"image-registry-764fd46654-nbjvw\" (UID: \"e0063734-fb88-4cdd-a12a-0961449f8e66\") " pod="openshift-image-registry/image-registry-764fd46654-nbjvw"
Jul 20 13:02:39.756980 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.756925    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/78ce2a9b-e1a5-4df6-be68-ca04931668b0-networking-console-plugin-cert\") pod \"networking-console-plugin-7bc7489cb5-6vnq5\" (UID: \"78ce2a9b-e1a5-4df6-be68-ca04931668b0\") " pod="openshift-network-console/networking-console-plugin-7bc7489cb5-6vnq5"
Jul 20 13:02:39.757087 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.757002    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/e0063734-fb88-4cdd-a12a-0961449f8e66-image-registry-private-configuration\") pod \"image-registry-764fd46654-nbjvw\" (UID: \"e0063734-fb88-4cdd-a12a-0961449f8e66\") " pod="openshift-image-registry/image-registry-764fd46654-nbjvw"
Jul 20 13:02:39.762114 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.762042    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56c6db7d5b-6nqrs"
Jul 20 13:02:39.764717 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.764693    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/e0063734-fb88-4cdd-a12a-0961449f8e66-bound-sa-token\") pod \"image-registry-764fd46654-nbjvw\" (UID: \"e0063734-fb88-4cdd-a12a-0961449f8e66\") " pod="openshift-image-registry/image-registry-764fd46654-nbjvw"
Jul 20 13:02:39.765227 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.765207    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bkxx\" (UniqueName: \"kubernetes.io/projected/e0063734-fb88-4cdd-a12a-0961449f8e66-kube-api-access-6bkxx\") pod \"image-registry-764fd46654-nbjvw\" (UID: \"e0063734-fb88-4cdd-a12a-0961449f8e66\") " pod="openshift-image-registry/image-registry-764fd46654-nbjvw"
Jul 20 13:02:39.766227 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.766207    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-26g7n\" (UniqueName: \"kubernetes.io/projected/57b69627-e508-4aeb-aaec-8e1b461801bd-kube-api-access-26g7n\") pod \"downloads-5bc67dcd46-hdrtd\" (UID: \"57b69627-e508-4aeb-aaec-8e1b461801bd\") " pod="openshift-console/downloads-5bc67dcd46-hdrtd"
Jul 20 13:02:39.819196 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.819120    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:39.852664 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.852484    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-5bc67dcd46-hdrtd"
Jul 20 13:02:39.859666 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.859634    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-6vnq5"
Jul 20 13:02:39.869493 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.869460    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-tpf8d\""
Jul 20 13:02:39.875327 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.875307    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-764fd46654-nbjvw"
Jul 20 13:02:39.901085 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.901057    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f5bdf789d-7zjjr"]
Jul 20 13:02:39.903733 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.903711    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:39.910874 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:02:39.910846    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc17de745_ff27_4f5b_b8c3_1067960a873a.slice/crio-aee861c3c9b7da2f86cdb7a633818c17cea83ff26d18fdb2f2248b36d5cb456e WatchSource:0}: Error finding container aee861c3c9b7da2f86cdb7a633818c17cea83ff26d18fdb2f2248b36d5cb456e: Status 404 returned error can't find the container with id aee861c3c9b7da2f86cdb7a633818c17cea83ff26d18fdb2f2248b36d5cb456e
Jul 20 13:02:39.924446 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.924424    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/klusterlet-addon-workmgr-56c6db7d5b-6nqrs"]
Jul 20 13:02:39.929571 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:02:39.928998    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24f9e644_f9f2_4835_8ddc_1e1dd106fc80.slice/crio-8f7df5b0cc28e8c4fea5528701631e8b98b597718618dd22991b9ded7f5ffd4f WatchSource:0}: Error finding container 8f7df5b0cc28e8c4fea5528701631e8b98b597718618dd22991b9ded7f5ffd4f: Status 404 returned error can't find the container with id 8f7df5b0cc28e8c4fea5528701631e8b98b597718618dd22991b9ded7f5ffd4f
Jul 20 13:02:39.957578 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.957534    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d-original-pull-secret\") pod \"global-pull-secret-syncer-bjz6v\" (UID: \"52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d\") " pod="kube-system/global-pull-secret-syncer-bjz6v"
Jul 20 13:02:39.957811 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.957797    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/81f8fe49-b58b-4eb9-8322-547266b00f73-metrics-certs\") pod \"network-metrics-daemon-tbfs8\" (UID: \"81f8fe49-b58b-4eb9-8322-547266b00f73\") " pod="openshift-multus/network-metrics-daemon-tbfs8"
Jul 20 13:02:39.962027 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.961996    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 20 13:02:39.962430 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.962024    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 20 13:02:39.973183 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.973123    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d-original-pull-secret\") pod \"global-pull-secret-syncer-bjz6v\" (UID: \"52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d\") " pod="kube-system/global-pull-secret-syncer-bjz6v"
Jul 20 13:02:39.973677 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:39.973617    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/81f8fe49-b58b-4eb9-8322-547266b00f73-metrics-certs\") pod \"network-metrics-daemon-tbfs8\" (UID: \"81f8fe49-b58b-4eb9-8322-547266b00f73\") " pod="openshift-multus/network-metrics-daemon-tbfs8"
Jul 20 13:02:40.038869 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:40.037971    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-5bc67dcd46-hdrtd"]
Jul 20 13:02:40.040657 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:02:40.040631    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57b69627_e508_4aeb_aaec_8e1b461801bd.slice/crio-7cbdab218f3dc498124ca1aab296b942fb816b1196f7e1e1edd36012f9368f38 WatchSource:0}: Error finding container 7cbdab218f3dc498124ca1aab296b942fb816b1196f7e1e1edd36012f9368f38: Status 404 returned error can't find the container with id 7cbdab218f3dc498124ca1aab296b942fb816b1196f7e1e1edd36012f9368f38
Jul 20 13:02:40.048559 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:40.048513    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-7bc7489cb5-6vnq5"]
Jul 20 13:02:40.050503 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:02:40.050478    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod78ce2a9b_e1a5_4df6_be68_ca04931668b0.slice/crio-920ebbef869cea8ea8b46c5411eeb8e19917eafb52351f43d34efb0d9734e24e WatchSource:0}: Error finding container 920ebbef869cea8ea8b46c5411eeb8e19917eafb52351f43d34efb0d9734e24e: Status 404 returned error can't find the container with id 920ebbef869cea8ea8b46c5411eeb8e19917eafb52351f43d34efb0d9734e24e
Jul 20 13:02:40.052588 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:40.052568    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-bjz6v"
Jul 20 13:02:40.059446 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:40.059424    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9km99\" (UniqueName: \"kubernetes.io/projected/6b89bab8-ce68-4a47-8922-7983e250b5c7-kube-api-access-9km99\") pod \"network-check-target-8vjqm\" (UID: \"6b89bab8-ce68-4a47-8922-7983e250b5c7\") " pod="openshift-network-diagnostics/network-check-target-8vjqm"
Jul 20 13:02:40.064254 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:40.064236    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 20 13:02:40.069564 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:40.069548    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-764fd46654-nbjvw"]
Jul 20 13:02:40.071727 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:02:40.071706    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0063734_fb88_4cdd_a12a_0961449f8e66.slice/crio-3e969455aac1dae4823324cabf39034d8564ab953feac04f6791d796d3a9cabe WatchSource:0}: Error finding container 3e969455aac1dae4823324cabf39034d8564ab953feac04f6791d796d3a9cabe: Status 404 returned error can't find the container with id 3e969455aac1dae4823324cabf39034d8564ab953feac04f6791d796d3a9cabe
Jul 20 13:02:40.071967 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:40.071950    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 20 13:02:40.082417 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:40.082399    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9km99\" (UniqueName: \"kubernetes.io/projected/6b89bab8-ce68-4a47-8922-7983e250b5c7-kube-api-access-9km99\") pod \"network-check-target-8vjqm\" (UID: \"6b89bab8-ce68-4a47-8922-7983e250b5c7\") " pod="openshift-network-diagnostics/network-check-target-8vjqm"
Jul 20 13:02:40.153714 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:40.153690    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-m99kw\""
Jul 20 13:02:40.158429 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:40.158274    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dbwl5\""
Jul 20 13:02:40.161445 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:40.161423    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-8vjqm"
Jul 20 13:02:40.166410 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:40.166391    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-tbfs8"
Jul 20 13:02:40.200877 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:40.200853    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-bjz6v"]
Jul 20 13:02:40.203630 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:02:40.203606    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52b5f0c9_be3d_4f5e_b48c_0ca9b220b03d.slice/crio-80ce54e001dddf3d2d782059dc26815c4a5b3c70a4ab1b94ba2fa2bb29d6a484 WatchSource:0}: Error finding container 80ce54e001dddf3d2d782059dc26815c4a5b3c70a4ab1b94ba2fa2bb29d6a484: Status 404 returned error can't find the container with id 80ce54e001dddf3d2d782059dc26815c4a5b3c70a4ab1b94ba2fa2bb29d6a484
Jul 20 13:02:40.312940 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:40.312770    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-8vjqm"]
Jul 20 13:02:40.315584 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:02:40.315544    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6b89bab8_ce68_4a47_8922_7983e250b5c7.slice/crio-243d934e4d8f958405b48bae47f652894a6751d42dab7f0412ee800eb0c65210 WatchSource:0}: Error finding container 243d934e4d8f958405b48bae47f652894a6751d42dab7f0412ee800eb0c65210: Status 404 returned error can't find the container with id 243d934e4d8f958405b48bae47f652894a6751d42dab7f0412ee800eb0c65210
Jul 20 13:02:40.333331 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:40.333298    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-tbfs8"]
Jul 20 13:02:40.336106 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:02:40.336082    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod81f8fe49_b58b_4eb9_8322_547266b00f73.slice/crio-9472287b6db7f8c0b7d95dc35df254b50b5efa175b31a8ef4d2cdad95018872e WatchSource:0}: Error finding container 9472287b6db7f8c0b7d95dc35df254b50b5efa175b31a8ef4d2cdad95018872e: Status 404 returned error can't find the container with id 9472287b6db7f8c0b7d95dc35df254b50b5efa175b31a8ef4d2cdad95018872e
Jul 20 13:02:40.437662 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:40.437627    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bjz6v" event={"ID":"52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d","Type":"ContainerStarted","Data":"80ce54e001dddf3d2d782059dc26815c4a5b3c70a4ab1b94ba2fa2bb29d6a484"}
Jul 20 13:02:40.438811 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:40.438780    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tbfs8" event={"ID":"81f8fe49-b58b-4eb9-8322-547266b00f73","Type":"ContainerStarted","Data":"9472287b6db7f8c0b7d95dc35df254b50b5efa175b31a8ef4d2cdad95018872e"}
Jul 20 13:02:40.439986 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:40.439959    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8vjqm" event={"ID":"6b89bab8-ce68-4a47-8922-7983e250b5c7","Type":"ContainerStarted","Data":"243d934e4d8f958405b48bae47f652894a6751d42dab7f0412ee800eb0c65210"}
Jul 20 13:02:40.441505 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:40.441479    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-764fd46654-nbjvw" event={"ID":"e0063734-fb88-4cdd-a12a-0961449f8e66","Type":"ContainerStarted","Data":"63a189a96437f958a666a21ce433d7c9f2a0516da36c6da3bfd3f26804e66960"}
Jul 20 13:02:40.441608 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:40.441522    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-764fd46654-nbjvw" event={"ID":"e0063734-fb88-4cdd-a12a-0961449f8e66","Type":"ContainerStarted","Data":"3e969455aac1dae4823324cabf39034d8564ab953feac04f6791d796d3a9cabe"}
Jul 20 13:02:40.441608 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:40.441579    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-764fd46654-nbjvw"
Jul 20 13:02:40.442679 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:40.442659    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-6vnq5" event={"ID":"78ce2a9b-e1a5-4df6-be68-ca04931668b0","Type":"ContainerStarted","Data":"920ebbef869cea8ea8b46c5411eeb8e19917eafb52351f43d34efb0d9734e24e"}
Jul 20 13:02:40.443693 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:40.443669    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-hdrtd" event={"ID":"57b69627-e508-4aeb-aaec-8e1b461801bd","Type":"ContainerStarted","Data":"7cbdab218f3dc498124ca1aab296b942fb816b1196f7e1e1edd36012f9368f38"}
Jul 20 13:02:40.444759 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:40.444741    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56c6db7d5b-6nqrs" event={"ID":"24f9e644-f9f2-4835-8ddc-1e1dd106fc80","Type":"ContainerStarted","Data":"8f7df5b0cc28e8c4fea5528701631e8b98b597718618dd22991b9ded7f5ffd4f"}
Jul 20 13:02:40.445893 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:40.445867    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f5bdf789d-7zjjr" event={"ID":"c17de745-ff27-4f5b-b8c3-1067960a873a","Type":"ContainerStarted","Data":"aee861c3c9b7da2f86cdb7a633818c17cea83ff26d18fdb2f2248b36d5cb456e"}
Jul 20 13:02:40.445976 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:40.445909    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78cc7648f6-2kdpx"
Jul 20 13:02:40.461575 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:40.461526    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-764fd46654-nbjvw" podStartSLOduration=1.461509894 podStartE2EDuration="1.461509894s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:02:39 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:02:40.461117635 +0000 UTC m=+66.930649754" watchObservedRunningTime="2026-07-20 13:02:40.461509894 +0000 UTC m=+66.931042014"
Jul 20 13:02:40.470703 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:40.470680    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78cc7648f6-2kdpx"
Jul 20 13:02:40.563328 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:40.563244    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f34def21-0566-4ce0-9754-25777f418798-bound-sa-token\") pod \"f34def21-0566-4ce0-9754-25777f418798\" (UID: \"f34def21-0566-4ce0-9754-25777f418798\") "
Jul 20 13:02:40.563608 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:40.563580    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-slnl6\" (UniqueName: \"kubernetes.io/projected/f34def21-0566-4ce0-9754-25777f418798-kube-api-access-slnl6\") pod \"f34def21-0566-4ce0-9754-25777f418798\" (UID: \"f34def21-0566-4ce0-9754-25777f418798\") "
Jul 20 13:02:40.563728 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:40.563665    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f34def21-0566-4ce0-9754-25777f418798-registry-certificates\") pod \"f34def21-0566-4ce0-9754-25777f418798\" (UID: \"f34def21-0566-4ce0-9754-25777f418798\") "
Jul 20 13:02:40.563728 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:40.563688    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f34def21-0566-4ce0-9754-25777f418798-ca-trust-extracted\") pod \"f34def21-0566-4ce0-9754-25777f418798\" (UID: \"f34def21-0566-4ce0-9754-25777f418798\") "
Jul 20 13:02:40.563728 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:40.563728    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f34def21-0566-4ce0-9754-25777f418798-installation-pull-secrets\") pod \"f34def21-0566-4ce0-9754-25777f418798\" (UID: \"f34def21-0566-4ce0-9754-25777f418798\") "
Jul 20 13:02:40.563900 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:40.563758    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f34def21-0566-4ce0-9754-25777f418798-image-registry-private-configuration\") pod \"f34def21-0566-4ce0-9754-25777f418798\" (UID: \"f34def21-0566-4ce0-9754-25777f418798\") "
Jul 20 13:02:40.564021 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:40.563995    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f34def21-0566-4ce0-9754-25777f418798-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "f34def21-0566-4ce0-9754-25777f418798" (UID: "f34def21-0566-4ce0-9754-25777f418798"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:02:40.564283 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:40.564258    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f34def21-0566-4ce0-9754-25777f418798-trusted-ca\") pod \"f34def21-0566-4ce0-9754-25777f418798\" (UID: \"f34def21-0566-4ce0-9754-25777f418798\") "
Jul 20 13:02:40.564283 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:40.564268    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f34def21-0566-4ce0-9754-25777f418798-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "f34def21-0566-4ce0-9754-25777f418798" (UID: "f34def21-0566-4ce0-9754-25777f418798"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:02:40.564600 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:40.564574    2565 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/f34def21-0566-4ce0-9754-25777f418798-registry-certificates\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:02:40.564600 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:40.564599    2565 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/f34def21-0566-4ce0-9754-25777f418798-ca-trust-extracted\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:02:40.564948 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:40.564921    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f34def21-0566-4ce0-9754-25777f418798-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "f34def21-0566-4ce0-9754-25777f418798" (UID: "f34def21-0566-4ce0-9754-25777f418798"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:02:40.566147 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:40.566096    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f34def21-0566-4ce0-9754-25777f418798-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "f34def21-0566-4ce0-9754-25777f418798" (UID: "f34def21-0566-4ce0-9754-25777f418798"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:02:40.566488 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:40.566461    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f34def21-0566-4ce0-9754-25777f418798-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "f34def21-0566-4ce0-9754-25777f418798" (UID: "f34def21-0566-4ce0-9754-25777f418798"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 13:02:40.566563 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:40.566506    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f34def21-0566-4ce0-9754-25777f418798-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "f34def21-0566-4ce0-9754-25777f418798" (UID: "f34def21-0566-4ce0-9754-25777f418798"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 13:02:40.566844 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:40.566821    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f34def21-0566-4ce0-9754-25777f418798-kube-api-access-slnl6" (OuterVolumeSpecName: "kube-api-access-slnl6") pod "f34def21-0566-4ce0-9754-25777f418798" (UID: "f34def21-0566-4ce0-9754-25777f418798"). InnerVolumeSpecName "kube-api-access-slnl6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:02:40.665769 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:40.665662    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/f34def21-0566-4ce0-9754-25777f418798-trusted-ca\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:02:40.665769 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:40.665696    2565 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f34def21-0566-4ce0-9754-25777f418798-bound-sa-token\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:02:40.665769 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:40.665710    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-slnl6\" (UniqueName: \"kubernetes.io/projected/f34def21-0566-4ce0-9754-25777f418798-kube-api-access-slnl6\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:02:40.665769 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:40.665726    2565 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/f34def21-0566-4ce0-9754-25777f418798-installation-pull-secrets\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:02:40.665769 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:40.665741    2565 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/f34def21-0566-4ce0-9754-25777f418798-image-registry-private-configuration\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:02:40.817566 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:40.817486    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:40.875206 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:40.875078    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:41.154923 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:41.154851    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:41.451609 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:41.450982    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-78cc7648f6-2kdpx"
Jul 20 13:02:41.489297 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:41.489013    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-78cc7648f6-2kdpx"]
Jul 20 13:02:41.491099 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:41.490956    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-78cc7648f6-2kdpx"]
Jul 20 13:02:41.576201 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:41.574491    2565 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/f34def21-0566-4ce0-9754-25777f418798-registry-tls\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:02:42.146938 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:42.146902    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f34def21-0566-4ce0-9754-25777f418798" path="/var/lib/kubelet/pods/f34def21-0566-4ce0-9754-25777f418798/volumes"
Jul 20 13:02:43.783532 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:43.783494    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:43.795196 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:43.795165    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0156bad2-0fcf-4d37-b346-ff5f28f2890c-metrics-tls\") pod \"dns-default-ng67n\" (UID: \"0156bad2-0fcf-4d37-b346-ff5f28f2890c\") " pod="openshift-dns/dns-default-ng67n"
Jul 20 13:02:43.798104 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:43.798051    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/0156bad2-0fcf-4d37-b346-ff5f28f2890c-metrics-tls\") pod \"dns-default-ng67n\" (UID: \"0156bad2-0fcf-4d37-b346-ff5f28f2890c\") " pod="openshift-dns/dns-default-ng67n"
Jul 20 13:02:43.842530 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:43.842434    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:44.045217 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:44.044942    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hjf8r\""
Jul 20 13:02:44.052656 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:44.052306    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ng67n"
Jul 20 13:02:47.094788 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:47.094707    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:47.382438 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:47.382397    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:47.483245 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:47.483207    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:47.542745 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:47.542711    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:47.742574 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:47.742487    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:48.538371 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:48.538334    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0a8fb30e-8f10-43ba-8934-017ae9f76a57-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c4l5l\" (UID: \"0a8fb30e-8f10-43ba-8934-017ae9f76a57\") " pod="openshift-insights/insights-runtime-extractor-c4l5l"
Jul 20 13:02:48.541287 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:48.541260    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/0a8fb30e-8f10-43ba-8934-017ae9f76a57-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-c4l5l\" (UID: \"0a8fb30e-8f10-43ba-8934-017ae9f76a57\") " pod="openshift-insights/insights-runtime-extractor-c4l5l"
Jul 20 13:02:48.747455 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:48.746272    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-rdx8c\""
Jul 20 13:02:48.754836 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:48.753906    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-c4l5l"
Jul 20 13:02:48.782737 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:48.782383    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ng67n"]
Jul 20 13:02:48.957089 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:48.956996    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-c4l5l"]
Jul 20 13:02:48.960523 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:02:48.960475    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a8fb30e_8f10_43ba_8934_017ae9f76a57.slice/crio-2d127ee18cd093250c60b919989ba35797bdb266e21edfca6434569d5e34aa5e WatchSource:0}: Error finding container 2d127ee18cd093250c60b919989ba35797bdb266e21edfca6434569d5e34aa5e: Status 404 returned error can't find the container with id 2d127ee18cd093250c60b919989ba35797bdb266e21edfca6434569d5e34aa5e
Jul 20 13:02:49.488937 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:49.488896    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tbfs8" event={"ID":"81f8fe49-b58b-4eb9-8322-547266b00f73","Type":"ContainerStarted","Data":"cc2d97e01a1ad24467c534aadf2a6ceca038f3868d1f1b18697f69f7d7cc4c8d"}
Jul 20 13:02:49.489128 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:49.488983    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-tbfs8" event={"ID":"81f8fe49-b58b-4eb9-8322-547266b00f73","Type":"ContainerStarted","Data":"98deeb659e16afa516cbdc62fa4599803a2f25986dd36af25261a1fd070da5b1"}
Jul 20 13:02:49.490952 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:49.490923    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-8vjqm" event={"ID":"6b89bab8-ce68-4a47-8922-7983e250b5c7","Type":"ContainerStarted","Data":"52bcb65e9db3b039f153efe8b96284e3a9bbb744dd41fe2413f25fdb717d4e6b"}
Jul 20 13:02:49.491082 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:49.491000    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-8vjqm"
Jul 20 13:02:49.492674 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:49.492649    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c4l5l" event={"ID":"0a8fb30e-8f10-43ba-8934-017ae9f76a57","Type":"ContainerStarted","Data":"2d127ee18cd093250c60b919989ba35797bdb266e21edfca6434569d5e34aa5e"}
Jul 20 13:02:49.494448 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:49.494423    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-6vnq5" event={"ID":"78ce2a9b-e1a5-4df6-be68-ca04931668b0","Type":"ContainerStarted","Data":"ff50de44eadcb530fa36e8cf986d1324bfa7d3b09b5c0eb6c10352e24e327fa0"}
Jul 20 13:02:49.496194 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:49.496170    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56c6db7d5b-6nqrs" event={"ID":"24f9e644-f9f2-4835-8ddc-1e1dd106fc80","Type":"ContainerStarted","Data":"4479ca1aa86c39fbf745ec00288401036303855e35c8a73a7718f2c3c1b6a144"}
Jul 20 13:02:49.496461 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:49.496421    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56c6db7d5b-6nqrs"
Jul 20 13:02:49.498129 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:49.498092    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56c6db7d5b-6nqrs"
Jul 20 13:02:49.498398 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:49.498335    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f5bdf789d-7zjjr" event={"ID":"c17de745-ff27-4f5b-b8c3-1067960a873a","Type":"ContainerStarted","Data":"6d4159caa595f3485719ca9018406096cbc5a51e1b1107e47e9b3586e1922a97"}
Jul 20 13:02:49.500933 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:49.500907    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-bjz6v" event={"ID":"52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d","Type":"ContainerStarted","Data":"6b4451bb363fb1722bd69f80d619106e235a93db6f24ed868402f2b637cacf42"}
Jul 20 13:02:49.502193 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:49.502168    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ng67n" event={"ID":"0156bad2-0fcf-4d37-b346-ff5f28f2890c","Type":"ContainerStarted","Data":"07ad3c15342f5928bac76d35d01ae7621d0bfdc6ab7e7e426716be57c2e4c720"}
Jul 20 13:02:49.507622 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:49.507572    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-tbfs8" podStartSLOduration=69.199690236 podStartE2EDuration="1m15.507556673s" totalImagesPullingTime="6.307866437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:01:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:02:49.506697176 +0000 UTC m=+75.976229312" watchObservedRunningTime="2026-07-20 13:02:49.507556673 +0000 UTC m=+75.977088795"
Jul 20 13:02:49.522443 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:49.522397    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-8vjqm" podStartSLOduration=67.189083627 podStartE2EDuration="1m15.522386227s" totalImagesPullingTime="8.3333026s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:01:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:02:49.522166577 +0000 UTC m=+75.991698720" watchObservedRunningTime="2026-07-20 13:02:49.522386227 +0000 UTC m=+75.991918406"
Jul 20 13:02:49.561141 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:49.561065    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/managed-serviceaccount-addon-agent-f5bdf789d-7zjjr" podStartSLOduration=1.870079337 podStartE2EDuration="10.561045317s" totalImagesPullingTime="8.69096598s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:02:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:02:49.540102293 +0000 UTC m=+76.009634409" watchObservedRunningTime="2026-07-20 13:02:49.561045317 +0000 UTC m=+76.030577431"
Jul 20 13:02:49.561588 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:49.561299    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-7bc7489cb5-6vnq5" podStartSLOduration=1.951410807 podStartE2EDuration="10.561289897s" totalImagesPullingTime="8.60987909s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:02:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:02:49.56013444 +0000 UTC m=+76.029666590" watchObservedRunningTime="2026-07-20 13:02:49.561289897 +0000 UTC m=+76.030822019"
Jul 20 13:02:49.587682 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:49.587631    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/klusterlet-addon-workmgr-56c6db7d5b-6nqrs" podStartSLOduration=1.917294069 podStartE2EDuration="10.587616642s" totalImagesPullingTime="8.670322573s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:02:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:02:49.58703838 +0000 UTC m=+76.056570500" watchObservedRunningTime="2026-07-20 13:02:49.587616642 +0000 UTC m=+76.057148760"
Jul 20 13:02:49.609406 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:49.609337    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-bjz6v" podStartSLOduration=67.134671172 podStartE2EDuration="1m15.609323636s" totalImagesPullingTime="8.474652464s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 13:01:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:02:49.608505535 +0000 UTC m=+76.078037680" watchObservedRunningTime="2026-07-20 13:02:49.609323636 +0000 UTC m=+76.078855754"
Jul 20 13:02:49.627875 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:49.627842    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:49.678404 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:49.678347    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:49.732300 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:49.732265    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:49.784724 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:49.784636    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:49.847797 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:49.847767    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:50.507794 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:50.507172    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ng67n" event={"ID":"0156bad2-0fcf-4d37-b346-ff5f28f2890c","Type":"ContainerStarted","Data":"8460ba4b0f84710125b5c7ac00b65f893fb1a6d57f930cd732eb50923a0aeca0"}
Jul 20 13:02:51.513749 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:51.513707    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ng67n" event={"ID":"0156bad2-0fcf-4d37-b346-ff5f28f2890c","Type":"ContainerStarted","Data":"3d53fac1e7a58c5ff582e22f1ff9f7c3cd18e7eaa9d421743a14c0f2803c25c1"}
Jul 20 13:02:51.532723 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:51.532666    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-ng67n" podStartSLOduration=38.922073694 podStartE2EDuration="40.532647593s" totalImagesPullingTime="1.610573899s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:02:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:02:51.531259496 +0000 UTC m=+78.000791639" watchObservedRunningTime="2026-07-20 13:02:51.532647593 +0000 UTC m=+78.002179715"
Jul 20 13:02:52.518518 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:52.518450    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-ng67n"
Jul 20 13:02:52.574092 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:52.574026    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:52.633021 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:52.632986    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:53.182161 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:53.182107    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:53.428680 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:53.428641    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:53.530895 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:53.530808    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:53.585819 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:53.585784    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:55.688641 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:55.688485    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:56.682602 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:56.682570    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:58.721754 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:58.721719    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:58.931773 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:58.931686    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:58.981674 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:58.981587    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-qx9vr"]
Jul 20 13:02:59.009306 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:59.009092    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:59.025481 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:59.025458    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qx9vr"
Jul 20 13:02:59.028510 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:59.028483    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 20 13:02:59.028627 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:59.028490    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 20 13:02:59.029017 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:59.028838    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 20 13:02:59.029017 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:59.028865    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6kdv7\""
Jul 20 13:02:59.030643 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:59.030524    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 20 13:02:59.030643 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:59.030608    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 20 13:02:59.031122 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:59.030968    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 20 13:02:59.129233 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:59.129100    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9abbe951-1217-4b84-9adc-eb7acd175e15-metrics-client-ca\") pod \"node-exporter-qx9vr\" (UID: \"9abbe951-1217-4b84-9adc-eb7acd175e15\") " pod="openshift-monitoring/node-exporter-qx9vr"
Jul 20 13:02:59.129657 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:59.129581    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9abbe951-1217-4b84-9adc-eb7acd175e15-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qx9vr\" (UID: \"9abbe951-1217-4b84-9adc-eb7acd175e15\") " pod="openshift-monitoring/node-exporter-qx9vr"
Jul 20 13:02:59.130170 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:59.129807    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hcc8k\" (UniqueName: \"kubernetes.io/projected/9abbe951-1217-4b84-9adc-eb7acd175e15-kube-api-access-hcc8k\") pod \"node-exporter-qx9vr\" (UID: \"9abbe951-1217-4b84-9adc-eb7acd175e15\") " pod="openshift-monitoring/node-exporter-qx9vr"
Jul 20 13:02:59.130170 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:59.129844    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9abbe951-1217-4b84-9adc-eb7acd175e15-sys\") pod \"node-exporter-qx9vr\" (UID: \"9abbe951-1217-4b84-9adc-eb7acd175e15\") " pod="openshift-monitoring/node-exporter-qx9vr"
Jul 20 13:02:59.130170 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:59.129869    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9abbe951-1217-4b84-9adc-eb7acd175e15-root\") pod \"node-exporter-qx9vr\" (UID: \"9abbe951-1217-4b84-9adc-eb7acd175e15\") " pod="openshift-monitoring/node-exporter-qx9vr"
Jul 20 13:02:59.130170 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:59.129904    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9abbe951-1217-4b84-9adc-eb7acd175e15-node-exporter-tls\") pod \"node-exporter-qx9vr\" (UID: \"9abbe951-1217-4b84-9adc-eb7acd175e15\") " pod="openshift-monitoring/node-exporter-qx9vr"
Jul 20 13:02:59.130170 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:59.129976    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9abbe951-1217-4b84-9adc-eb7acd175e15-node-exporter-textfile\") pod \"node-exporter-qx9vr\" (UID: \"9abbe951-1217-4b84-9adc-eb7acd175e15\") " pod="openshift-monitoring/node-exporter-qx9vr"
Jul 20 13:02:59.130170 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:59.130011    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9abbe951-1217-4b84-9adc-eb7acd175e15-node-exporter-wtmp\") pod \"node-exporter-qx9vr\" (UID: \"9abbe951-1217-4b84-9adc-eb7acd175e15\") " pod="openshift-monitoring/node-exporter-qx9vr"
Jul 20 13:02:59.130170 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:59.130042    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9abbe951-1217-4b84-9adc-eb7acd175e15-node-exporter-accelerators-collector-config\") pod \"node-exporter-qx9vr\" (UID: \"9abbe951-1217-4b84-9adc-eb7acd175e15\") " pod="openshift-monitoring/node-exporter-qx9vr"
Jul 20 13:02:59.159588 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:59.159547    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:59.230850 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:59.230816    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9abbe951-1217-4b84-9adc-eb7acd175e15-node-exporter-textfile\") pod \"node-exporter-qx9vr\" (UID: \"9abbe951-1217-4b84-9adc-eb7acd175e15\") " pod="openshift-monitoring/node-exporter-qx9vr"
Jul 20 13:02:59.231101 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:59.230865    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9abbe951-1217-4b84-9adc-eb7acd175e15-node-exporter-wtmp\") pod \"node-exporter-qx9vr\" (UID: \"9abbe951-1217-4b84-9adc-eb7acd175e15\") " pod="openshift-monitoring/node-exporter-qx9vr"
Jul 20 13:02:59.231101 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:59.230898    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9abbe951-1217-4b84-9adc-eb7acd175e15-node-exporter-accelerators-collector-config\") pod \"node-exporter-qx9vr\" (UID: \"9abbe951-1217-4b84-9adc-eb7acd175e15\") " pod="openshift-monitoring/node-exporter-qx9vr"
Jul 20 13:02:59.231101 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:59.230930    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9abbe951-1217-4b84-9adc-eb7acd175e15-metrics-client-ca\") pod \"node-exporter-qx9vr\" (UID: \"9abbe951-1217-4b84-9adc-eb7acd175e15\") " pod="openshift-monitoring/node-exporter-qx9vr"
Jul 20 13:02:59.231101 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:59.230960    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9abbe951-1217-4b84-9adc-eb7acd175e15-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qx9vr\" (UID: \"9abbe951-1217-4b84-9adc-eb7acd175e15\") " pod="openshift-monitoring/node-exporter-qx9vr"
Jul 20 13:02:59.231101 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:59.230993    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hcc8k\" (UniqueName: \"kubernetes.io/projected/9abbe951-1217-4b84-9adc-eb7acd175e15-kube-api-access-hcc8k\") pod \"node-exporter-qx9vr\" (UID: \"9abbe951-1217-4b84-9adc-eb7acd175e15\") " pod="openshift-monitoring/node-exporter-qx9vr"
Jul 20 13:02:59.231101 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:59.231018    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9abbe951-1217-4b84-9adc-eb7acd175e15-sys\") pod \"node-exporter-qx9vr\" (UID: \"9abbe951-1217-4b84-9adc-eb7acd175e15\") " pod="openshift-monitoring/node-exporter-qx9vr"
Jul 20 13:02:59.231101 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:59.231040    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9abbe951-1217-4b84-9adc-eb7acd175e15-root\") pod \"node-exporter-qx9vr\" (UID: \"9abbe951-1217-4b84-9adc-eb7acd175e15\") " pod="openshift-monitoring/node-exporter-qx9vr"
Jul 20 13:02:59.231101 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:59.231072    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9abbe951-1217-4b84-9adc-eb7acd175e15-node-exporter-tls\") pod \"node-exporter-qx9vr\" (UID: \"9abbe951-1217-4b84-9adc-eb7acd175e15\") " pod="openshift-monitoring/node-exporter-qx9vr"
Jul 20 13:02:59.231533 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:59.231227    2565 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 20 13:02:59.231533 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:59.231305    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9abbe951-1217-4b84-9adc-eb7acd175e15-node-exporter-tls podName:9abbe951-1217-4b84-9adc-eb7acd175e15 nodeName:}" failed. No retries permitted until 2026-07-20 13:02:59.731283493 +0000 UTC m=+86.200815597 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/9abbe951-1217-4b84-9adc-eb7acd175e15-node-exporter-tls") pod "node-exporter-qx9vr" (UID: "9abbe951-1217-4b84-9adc-eb7acd175e15") : secret "node-exporter-tls" not found
Jul 20 13:02:59.233351 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:59.231763    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/9abbe951-1217-4b84-9adc-eb7acd175e15-root\") pod \"node-exporter-qx9vr\" (UID: \"9abbe951-1217-4b84-9adc-eb7acd175e15\") " pod="openshift-monitoring/node-exporter-qx9vr"
Jul 20 13:02:59.233351 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:59.231763    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/9abbe951-1217-4b84-9adc-eb7acd175e15-sys\") pod \"node-exporter-qx9vr\" (UID: \"9abbe951-1217-4b84-9adc-eb7acd175e15\") " pod="openshift-monitoring/node-exporter-qx9vr"
Jul 20 13:02:59.233351 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:59.231921    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/9abbe951-1217-4b84-9adc-eb7acd175e15-node-exporter-wtmp\") pod \"node-exporter-qx9vr\" (UID: \"9abbe951-1217-4b84-9adc-eb7acd175e15\") " pod="openshift-monitoring/node-exporter-qx9vr"
Jul 20 13:02:59.233351 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:59.232196    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/9abbe951-1217-4b84-9adc-eb7acd175e15-node-exporter-textfile\") pod \"node-exporter-qx9vr\" (UID: \"9abbe951-1217-4b84-9adc-eb7acd175e15\") " pod="openshift-monitoring/node-exporter-qx9vr"
Jul 20 13:02:59.233351 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:59.232827    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/9abbe951-1217-4b84-9adc-eb7acd175e15-node-exporter-accelerators-collector-config\") pod \"node-exporter-qx9vr\" (UID: \"9abbe951-1217-4b84-9adc-eb7acd175e15\") " pod="openshift-monitoring/node-exporter-qx9vr"
Jul 20 13:02:59.233351 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:59.233185    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/9abbe951-1217-4b84-9adc-eb7acd175e15-metrics-client-ca\") pod \"node-exporter-qx9vr\" (UID: \"9abbe951-1217-4b84-9adc-eb7acd175e15\") " pod="openshift-monitoring/node-exporter-qx9vr"
Jul 20 13:02:59.235187 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:59.234808    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/9abbe951-1217-4b84-9adc-eb7acd175e15-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-qx9vr\" (UID: \"9abbe951-1217-4b84-9adc-eb7acd175e15\") " pod="openshift-monitoring/node-exporter-qx9vr"
Jul 20 13:02:59.243510 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:59.243487    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hcc8k\" (UniqueName: \"kubernetes.io/projected/9abbe951-1217-4b84-9adc-eb7acd175e15-kube-api-access-hcc8k\") pod \"node-exporter-qx9vr\" (UID: \"9abbe951-1217-4b84-9adc-eb7acd175e15\") " pod="openshift-monitoring/node-exporter-qx9vr"
Jul 20 13:02:59.261496 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:59.261463    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:59.359730 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:59.359695    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:02:59.735262 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:59.735207    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9abbe951-1217-4b84-9adc-eb7acd175e15-node-exporter-tls\") pod \"node-exporter-qx9vr\" (UID: \"9abbe951-1217-4b84-9adc-eb7acd175e15\") " pod="openshift-monitoring/node-exporter-qx9vr"
Jul 20 13:02:59.735743 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:59.735460    2565 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found
Jul 20 13:02:59.735743 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:02:59.735532    2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/9abbe951-1217-4b84-9adc-eb7acd175e15-node-exporter-tls podName:9abbe951-1217-4b84-9adc-eb7acd175e15 nodeName:}" failed. No retries permitted until 2026-07-20 13:03:00.735512234 +0000 UTC m=+87.205044348 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/9abbe951-1217-4b84-9adc-eb7acd175e15-node-exporter-tls") pod "node-exporter-qx9vr" (UID: "9abbe951-1217-4b84-9adc-eb7acd175e15") : secret "node-exporter-tls" not found
Jul 20 13:02:59.881565 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:59.881513    2565 patch_prober.go:28] interesting pod/image-registry-764fd46654-nbjvw container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]}
Jul 20 13:02:59.881747 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:02:59.881576    2565 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-764fd46654-nbjvw" podUID="e0063734-fb88-4cdd-a12a-0961449f8e66" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 20 13:03:00.745154 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:00.745117    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9abbe951-1217-4b84-9adc-eb7acd175e15-node-exporter-tls\") pod \"node-exporter-qx9vr\" (UID: \"9abbe951-1217-4b84-9adc-eb7acd175e15\") " pod="openshift-monitoring/node-exporter-qx9vr"
Jul 20 13:03:00.747837 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:00.747810    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/9abbe951-1217-4b84-9adc-eb7acd175e15-node-exporter-tls\") pod \"node-exporter-qx9vr\" (UID: \"9abbe951-1217-4b84-9adc-eb7acd175e15\") " pod="openshift-monitoring/node-exporter-qx9vr"
Jul 20 13:03:00.837869 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:00.837833    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-qx9vr"
Jul 20 13:03:01.455532 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:01.455498    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-764fd46654-nbjvw"
Jul 20 13:03:01.987883 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:01.987849    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:03:02.036329 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:02.036292    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:03:02.115078 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:02.115046    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:03:02.210842 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:02.210812    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:03:02.525106 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:02.525072    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-ng67n"
Jul 20 13:03:02.613592 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:02.613561    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:03:02.714556 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:02.714517    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:03:02.765410 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:02.765379    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:03:03.306611 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:03:03.306571    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9abbe951_1217_4b84_9adc_eb7acd175e15.slice/crio-7c713eebc3b071d8c42a39e5f487d94e8fd41c727aaa4888a8a005000a8b966d WatchSource:0}: Error finding container 7c713eebc3b071d8c42a39e5f487d94e8fd41c727aaa4888a8a005000a8b966d: Status 404 returned error can't find the container with id 7c713eebc3b071d8c42a39e5f487d94e8fd41c727aaa4888a8a005000a8b966d
Jul 20 13:03:03.563121 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:03.563034    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qx9vr" event={"ID":"9abbe951-1217-4b84-9adc-eb7acd175e15","Type":"ContainerStarted","Data":"7c713eebc3b071d8c42a39e5f487d94e8fd41c727aaa4888a8a005000a8b966d"}
Jul 20 13:03:03.564647 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:03.564618    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c4l5l" event={"ID":"0a8fb30e-8f10-43ba-8934-017ae9f76a57","Type":"ContainerStarted","Data":"c3e7bfed205d78b321c30620d2825e0ee6de09b306ba9764601294d6f9682488"}
Jul 20 13:03:03.566266 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:03.566242    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-5bc67dcd46-hdrtd" event={"ID":"57b69627-e508-4aeb-aaec-8e1b461801bd","Type":"ContainerStarted","Data":"795ee865e7af8bf65c128faecc47c2912bb6f620863d60484add4297d1eb2777"}
Jul 20 13:03:03.566550 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:03.566481    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-5bc67dcd46-hdrtd"
Jul 20 13:03:03.578161 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:03.578137    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-5bc67dcd46-hdrtd"
Jul 20 13:03:03.587598 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:03.587557    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-5bc67dcd46-hdrtd" podStartSLOduration=1.32779641 podStartE2EDuration="24.587542752s" totalImagesPullingTime="23.259746342s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:02:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:03:03.585580701 +0000 UTC m=+90.055112841" watchObservedRunningTime="2026-07-20 13:03:03.587542752 +0000 UTC m=+90.057074872"
Jul 20 13:03:03.752301 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:03.752266    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:03:03.818112 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:03.818031    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:03:03.931638 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:03.931599    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:03:04.032886 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:04.032821    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:03:04.087712 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:04.087634    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:03:04.477593 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:04.477551    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:03:04.529006 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:04.528970    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:03:05.288111 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:05.288073    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:03:05.513708 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:05.513671    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7ddf5dd989-qdhpw"]
Jul 20 13:03:05.535599 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:05.535571    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7ddf5dd989-qdhpw"]
Jul 20 13:03:05.535757 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:05.535693    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7ddf5dd989-qdhpw"
Jul 20 13:03:05.538864 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:05.538796    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 20 13:03:05.540205 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:05.540130    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-wvqlb\""
Jul 20 13:03:05.540205 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:05.540178    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 20 13:03:05.540383 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:05.540228    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 20 13:03:05.540452 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:05.540435    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 20 13:03:05.540516 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:05.540183    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 20 13:03:05.551108 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:05.551083    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 20 13:03:05.580275 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:05.580235    2565 generic.go:356] "Generic (PLEG): container finished" podID="9abbe951-1217-4b84-9adc-eb7acd175e15" containerID="68b118437f72cd12f91387189e0fbce478261b14da9e869290daa22f306a152f" exitCode=0
Jul 20 13:03:05.580471 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:05.580339    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qx9vr" event={"ID":"9abbe951-1217-4b84-9adc-eb7acd175e15","Type":"ContainerDied","Data":"68b118437f72cd12f91387189e0fbce478261b14da9e869290daa22f306a152f"}
Jul 20 13:03:05.685284 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:05.685249    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9c107b77-265a-4cb2-bbcc-54a9c6369b71-console-config\") pod \"console-7ddf5dd989-qdhpw\" (UID: \"9c107b77-265a-4cb2-bbcc-54a9c6369b71\") " pod="openshift-console/console-7ddf5dd989-qdhpw"
Jul 20 13:03:05.685481 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:05.685318    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9c107b77-265a-4cb2-bbcc-54a9c6369b71-console-serving-cert\") pod \"console-7ddf5dd989-qdhpw\" (UID: \"9c107b77-265a-4cb2-bbcc-54a9c6369b71\") " pod="openshift-console/console-7ddf5dd989-qdhpw"
Jul 20 13:03:05.685481 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:05.685392    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c107b77-265a-4cb2-bbcc-54a9c6369b71-trusted-ca-bundle\") pod \"console-7ddf5dd989-qdhpw\" (UID: \"9c107b77-265a-4cb2-bbcc-54a9c6369b71\") " pod="openshift-console/console-7ddf5dd989-qdhpw"
Jul 20 13:03:05.685609 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:05.685506    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9c107b77-265a-4cb2-bbcc-54a9c6369b71-console-oauth-config\") pod \"console-7ddf5dd989-qdhpw\" (UID: \"9c107b77-265a-4cb2-bbcc-54a9c6369b71\") " pod="openshift-console/console-7ddf5dd989-qdhpw"
Jul 20 13:03:05.685609 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:05.685539    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tngl5\" (UniqueName: \"kubernetes.io/projected/9c107b77-265a-4cb2-bbcc-54a9c6369b71-kube-api-access-tngl5\") pod \"console-7ddf5dd989-qdhpw\" (UID: \"9c107b77-265a-4cb2-bbcc-54a9c6369b71\") " pod="openshift-console/console-7ddf5dd989-qdhpw"
Jul 20 13:03:05.685609 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:05.685566    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9c107b77-265a-4cb2-bbcc-54a9c6369b71-service-ca\") pod \"console-7ddf5dd989-qdhpw\" (UID: \"9c107b77-265a-4cb2-bbcc-54a9c6369b71\") " pod="openshift-console/console-7ddf5dd989-qdhpw"
Jul 20 13:03:05.685609 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:05.685591    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9c107b77-265a-4cb2-bbcc-54a9c6369b71-oauth-serving-cert\") pod \"console-7ddf5dd989-qdhpw\" (UID: \"9c107b77-265a-4cb2-bbcc-54a9c6369b71\") " pod="openshift-console/console-7ddf5dd989-qdhpw"
Jul 20 13:03:05.786744 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:05.786712    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c107b77-265a-4cb2-bbcc-54a9c6369b71-trusted-ca-bundle\") pod \"console-7ddf5dd989-qdhpw\" (UID: \"9c107b77-265a-4cb2-bbcc-54a9c6369b71\") " pod="openshift-console/console-7ddf5dd989-qdhpw"
Jul 20 13:03:05.786863 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:05.786795    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9c107b77-265a-4cb2-bbcc-54a9c6369b71-console-oauth-config\") pod \"console-7ddf5dd989-qdhpw\" (UID: \"9c107b77-265a-4cb2-bbcc-54a9c6369b71\") " pod="openshift-console/console-7ddf5dd989-qdhpw"
Jul 20 13:03:05.786863 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:05.786826    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tngl5\" (UniqueName: \"kubernetes.io/projected/9c107b77-265a-4cb2-bbcc-54a9c6369b71-kube-api-access-tngl5\") pod \"console-7ddf5dd989-qdhpw\" (UID: \"9c107b77-265a-4cb2-bbcc-54a9c6369b71\") " pod="openshift-console/console-7ddf5dd989-qdhpw"
Jul 20 13:03:05.786863 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:05.786851    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9c107b77-265a-4cb2-bbcc-54a9c6369b71-service-ca\") pod \"console-7ddf5dd989-qdhpw\" (UID: \"9c107b77-265a-4cb2-bbcc-54a9c6369b71\") " pod="openshift-console/console-7ddf5dd989-qdhpw"
Jul 20 13:03:05.787024 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:05.786879    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9c107b77-265a-4cb2-bbcc-54a9c6369b71-oauth-serving-cert\") pod \"console-7ddf5dd989-qdhpw\" (UID: \"9c107b77-265a-4cb2-bbcc-54a9c6369b71\") " pod="openshift-console/console-7ddf5dd989-qdhpw"
Jul 20 13:03:05.787024 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:05.786916    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9c107b77-265a-4cb2-bbcc-54a9c6369b71-console-config\") pod \"console-7ddf5dd989-qdhpw\" (UID: \"9c107b77-265a-4cb2-bbcc-54a9c6369b71\") " pod="openshift-console/console-7ddf5dd989-qdhpw"
Jul 20 13:03:05.787024 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:05.786956    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9c107b77-265a-4cb2-bbcc-54a9c6369b71-console-serving-cert\") pod \"console-7ddf5dd989-qdhpw\" (UID: \"9c107b77-265a-4cb2-bbcc-54a9c6369b71\") " pod="openshift-console/console-7ddf5dd989-qdhpw"
Jul 20 13:03:05.787802 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:05.787771    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9c107b77-265a-4cb2-bbcc-54a9c6369b71-oauth-serving-cert\") pod \"console-7ddf5dd989-qdhpw\" (UID: \"9c107b77-265a-4cb2-bbcc-54a9c6369b71\") " pod="openshift-console/console-7ddf5dd989-qdhpw"
Jul 20 13:03:05.787915 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:05.787867    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c107b77-265a-4cb2-bbcc-54a9c6369b71-trusted-ca-bundle\") pod \"console-7ddf5dd989-qdhpw\" (UID: \"9c107b77-265a-4cb2-bbcc-54a9c6369b71\") " pod="openshift-console/console-7ddf5dd989-qdhpw"
Jul 20 13:03:05.788038 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:05.788013    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9c107b77-265a-4cb2-bbcc-54a9c6369b71-console-config\") pod \"console-7ddf5dd989-qdhpw\" (UID: \"9c107b77-265a-4cb2-bbcc-54a9c6369b71\") " pod="openshift-console/console-7ddf5dd989-qdhpw"
Jul 20 13:03:05.788956 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:05.788834    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9c107b77-265a-4cb2-bbcc-54a9c6369b71-service-ca\") pod \"console-7ddf5dd989-qdhpw\" (UID: \"9c107b77-265a-4cb2-bbcc-54a9c6369b71\") " pod="openshift-console/console-7ddf5dd989-qdhpw"
Jul 20 13:03:05.790318 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:05.790285    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9c107b77-265a-4cb2-bbcc-54a9c6369b71-console-serving-cert\") pod \"console-7ddf5dd989-qdhpw\" (UID: \"9c107b77-265a-4cb2-bbcc-54a9c6369b71\") " pod="openshift-console/console-7ddf5dd989-qdhpw"
Jul 20 13:03:05.791145 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:05.791120    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9c107b77-265a-4cb2-bbcc-54a9c6369b71-console-oauth-config\") pod \"console-7ddf5dd989-qdhpw\" (UID: \"9c107b77-265a-4cb2-bbcc-54a9c6369b71\") " pod="openshift-console/console-7ddf5dd989-qdhpw"
Jul 20 13:03:05.795627 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:05.795603    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tngl5\" (UniqueName: \"kubernetes.io/projected/9c107b77-265a-4cb2-bbcc-54a9c6369b71-kube-api-access-tngl5\") pod \"console-7ddf5dd989-qdhpw\" (UID: \"9c107b77-265a-4cb2-bbcc-54a9c6369b71\") " pod="openshift-console/console-7ddf5dd989-qdhpw"
Jul 20 13:03:05.848321 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:05.848287    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7ddf5dd989-qdhpw"
Jul 20 13:03:05.934151 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:05.934080    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:03:06.017470 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:06.017424    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7ddf5dd989-qdhpw"]
Jul 20 13:03:06.021155 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:06.021122    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:03:06.021954 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:03:06.021927    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c107b77_265a_4cb2_bbcc_54a9c6369b71.slice/crio-fa40db99ccf781ca437573fe12e4b8a7e3af68832f3a256aba29752d2e36babc WatchSource:0}: Error finding container fa40db99ccf781ca437573fe12e4b8a7e3af68832f3a256aba29752d2e36babc: Status 404 returned error can't find the container with id fa40db99ccf781ca437573fe12e4b8a7e3af68832f3a256aba29752d2e36babc
Jul 20 13:03:06.590740 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:06.590692    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qx9vr" event={"ID":"9abbe951-1217-4b84-9adc-eb7acd175e15","Type":"ContainerStarted","Data":"764648d3ecc5bc0194d92981c15d6035cac9b93a270b48a7dbe30b2367c4df9b"}
Jul 20 13:03:06.591235 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:06.590754    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-qx9vr" event={"ID":"9abbe951-1217-4b84-9adc-eb7acd175e15","Type":"ContainerStarted","Data":"3e623c7c0eccd522988d1a9ba6a1122250af1dd72147dd69d0599950c83a7433"}
Jul 20 13:03:06.593468 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:06.593399    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7ddf5dd989-qdhpw" event={"ID":"9c107b77-265a-4cb2-bbcc-54a9c6369b71","Type":"ContainerStarted","Data":"fa40db99ccf781ca437573fe12e4b8a7e3af68832f3a256aba29752d2e36babc"}
Jul 20 13:03:06.612378 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:06.612306    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-qx9vr" podStartSLOduration=7.093875016 podStartE2EDuration="8.612286762s" totalImagesPullingTime="1.413883895s" totalInitContainerRuntime="104.527851ms" isStatefulPod=true podCreationTimestamp="2026-07-20 13:02:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:03:06.61080628 +0000 UTC m=+93.080338399" watchObservedRunningTime="2026-07-20 13:03:06.612286762 +0000 UTC m=+93.081818882"
Jul 20 13:03:10.516962 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:10.516893    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:03:10.575654 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:10.575619    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:03:11.498611 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:11.498573    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:03:11.599806 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:11.599761    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:03:11.649441 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:11.649403    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:03:12.630540 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:12.630500    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7ddf5dd989-qdhpw" event={"ID":"9c107b77-265a-4cb2-bbcc-54a9c6369b71","Type":"ContainerStarted","Data":"845c1073d69103c6b13b615254c92772e05a42142e4536bbc38d86bdf20b1bf1"}
Jul 20 13:03:12.632889 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:12.632859    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c4l5l" event={"ID":"0a8fb30e-8f10-43ba-8934-017ae9f76a57","Type":"ContainerStarted","Data":"c32d24cc0f460236b7b5ef010fc629be580ba3d6e7fa1afa177c692127a2d37a"}
Jul 20 13:03:12.652147 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:12.652090    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7ddf5dd989-qdhpw" podStartSLOduration=1.5746992720000001 podStartE2EDuration="7.652069009s" totalImagesPullingTime="6.077369737s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:03:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:03:12.650662235 +0000 UTC m=+99.120194356" watchObservedRunningTime="2026-07-20 13:03:12.652069009 +0000 UTC m=+99.121601130"
Jul 20 13:03:14.012210 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:14.012171    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:03:14.116209 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:14.116166    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:03:15.849352 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:15.849314    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7ddf5dd989-qdhpw"
Jul 20 13:03:15.849843 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:15.849421    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7ddf5dd989-qdhpw"
Jul 20 13:03:15.855089 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:15.855062    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7ddf5dd989-qdhpw"
Jul 20 13:03:16.652635 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:16.652603    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7ddf5dd989-qdhpw"
Jul 20 13:03:16.790017 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:16.789970    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:03:17.652812 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:17.652779    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-c4l5l" event={"ID":"0a8fb30e-8f10-43ba-8934-017ae9f76a57","Type":"ContainerStarted","Data":"803d2ff0cd537c945c1f63f3454f865285c863d3f814190870711b04ac66db0e"}
Jul 20 13:03:17.673202 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:17.673145    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-c4l5l" podStartSLOduration=33.739162451 podStartE2EDuration="1m1.673130606s" totalImagesPullingTime="27.933968155s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 13:02:16 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:03:17.672478637 +0000 UTC m=+104.142010772" watchObservedRunningTime="2026-07-20 13:03:17.673130606 +0000 UTC m=+104.142662724"
Jul 20 13:03:18.706518 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:18.706486    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:03:18.761986 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:18.761951    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:03:19.071667 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:19.071586    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:03:19.123905 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:19.123871    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:03:19.503394 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:19.503349    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:03:19.600227 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:19.600196    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:03:20.509915 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:20.509875    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-8vjqm"
Jul 20 13:03:40.795177 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:40.795142    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:03:40.852245 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:40.852204    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:03:49.071088 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:49.071050    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:03:49.121320 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:03:49.121280    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:04:18.208091 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:18.208055    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:04:18.678734 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:18.678682    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:04:18.994179 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:18.994102    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:04:26.680696 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:26.680615    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-55f4f84c5c-m5qkp"]
Jul 20 13:04:26.682645 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:26.682630    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55f4f84c5c-m5qkp"
Jul 20 13:04:26.693051 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:26.693024    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55f4f84c5c-m5qkp"]
Jul 20 13:04:26.747297 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:26.747262    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:04:26.802832 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:26.802804    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:04:26.821038 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:26.821004    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/22f1b487-1601-4e4d-b631-e40e6a7b69a6-service-ca\") pod \"console-55f4f84c5c-m5qkp\" (UID: \"22f1b487-1601-4e4d-b631-e40e6a7b69a6\") " pod="openshift-console/console-55f4f84c5c-m5qkp"
Jul 20 13:04:26.821038 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:26.821037    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/22f1b487-1601-4e4d-b631-e40e6a7b69a6-oauth-serving-cert\") pod \"console-55f4f84c5c-m5qkp\" (UID: \"22f1b487-1601-4e4d-b631-e40e6a7b69a6\") " pod="openshift-console/console-55f4f84c5c-m5qkp"
Jul 20 13:04:26.821226 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:26.821070    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/22f1b487-1601-4e4d-b631-e40e6a7b69a6-console-serving-cert\") pod \"console-55f4f84c5c-m5qkp\" (UID: \"22f1b487-1601-4e4d-b631-e40e6a7b69a6\") " pod="openshift-console/console-55f4f84c5c-m5qkp"
Jul 20 13:04:26.821226 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:26.821152    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d6l2q\" (UniqueName: \"kubernetes.io/projected/22f1b487-1601-4e4d-b631-e40e6a7b69a6-kube-api-access-d6l2q\") pod \"console-55f4f84c5c-m5qkp\" (UID: \"22f1b487-1601-4e4d-b631-e40e6a7b69a6\") " pod="openshift-console/console-55f4f84c5c-m5qkp"
Jul 20 13:04:26.821226 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:26.821182    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/22f1b487-1601-4e4d-b631-e40e6a7b69a6-console-config\") pod \"console-55f4f84c5c-m5qkp\" (UID: \"22f1b487-1601-4e4d-b631-e40e6a7b69a6\") " pod="openshift-console/console-55f4f84c5c-m5qkp"
Jul 20 13:04:26.821226 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:26.821210    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22f1b487-1601-4e4d-b631-e40e6a7b69a6-trusted-ca-bundle\") pod \"console-55f4f84c5c-m5qkp\" (UID: \"22f1b487-1601-4e4d-b631-e40e6a7b69a6\") " pod="openshift-console/console-55f4f84c5c-m5qkp"
Jul 20 13:04:26.821383 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:26.821230    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/22f1b487-1601-4e4d-b631-e40e6a7b69a6-console-oauth-config\") pod \"console-55f4f84c5c-m5qkp\" (UID: \"22f1b487-1601-4e4d-b631-e40e6a7b69a6\") " pod="openshift-console/console-55f4f84c5c-m5qkp"
Jul 20 13:04:26.922511 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:26.922482    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/22f1b487-1601-4e4d-b631-e40e6a7b69a6-service-ca\") pod \"console-55f4f84c5c-m5qkp\" (UID: \"22f1b487-1601-4e4d-b631-e40e6a7b69a6\") " pod="openshift-console/console-55f4f84c5c-m5qkp"
Jul 20 13:04:26.922511 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:26.922511    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/22f1b487-1601-4e4d-b631-e40e6a7b69a6-oauth-serving-cert\") pod \"console-55f4f84c5c-m5qkp\" (UID: \"22f1b487-1601-4e4d-b631-e40e6a7b69a6\") " pod="openshift-console/console-55f4f84c5c-m5qkp"
Jul 20 13:04:26.922752 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:26.922552    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/22f1b487-1601-4e4d-b631-e40e6a7b69a6-console-serving-cert\") pod \"console-55f4f84c5c-m5qkp\" (UID: \"22f1b487-1601-4e4d-b631-e40e6a7b69a6\") " pod="openshift-console/console-55f4f84c5c-m5qkp"
Jul 20 13:04:26.922752 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:26.922590    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d6l2q\" (UniqueName: \"kubernetes.io/projected/22f1b487-1601-4e4d-b631-e40e6a7b69a6-kube-api-access-d6l2q\") pod \"console-55f4f84c5c-m5qkp\" (UID: \"22f1b487-1601-4e4d-b631-e40e6a7b69a6\") " pod="openshift-console/console-55f4f84c5c-m5qkp"
Jul 20 13:04:26.922752 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:26.922608    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/22f1b487-1601-4e4d-b631-e40e6a7b69a6-console-config\") pod \"console-55f4f84c5c-m5qkp\" (UID: \"22f1b487-1601-4e4d-b631-e40e6a7b69a6\") " pod="openshift-console/console-55f4f84c5c-m5qkp"
Jul 20 13:04:26.922752 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:26.922630    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22f1b487-1601-4e4d-b631-e40e6a7b69a6-trusted-ca-bundle\") pod \"console-55f4f84c5c-m5qkp\" (UID: \"22f1b487-1601-4e4d-b631-e40e6a7b69a6\") " pod="openshift-console/console-55f4f84c5c-m5qkp"
Jul 20 13:04:26.922752 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:26.922656    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/22f1b487-1601-4e4d-b631-e40e6a7b69a6-console-oauth-config\") pod \"console-55f4f84c5c-m5qkp\" (UID: \"22f1b487-1601-4e4d-b631-e40e6a7b69a6\") " pod="openshift-console/console-55f4f84c5c-m5qkp"
Jul 20 13:04:26.923382 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:26.923327    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/22f1b487-1601-4e4d-b631-e40e6a7b69a6-service-ca\") pod \"console-55f4f84c5c-m5qkp\" (UID: \"22f1b487-1601-4e4d-b631-e40e6a7b69a6\") " pod="openshift-console/console-55f4f84c5c-m5qkp"
Jul 20 13:04:26.923496 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:26.923327    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/22f1b487-1601-4e4d-b631-e40e6a7b69a6-oauth-serving-cert\") pod \"console-55f4f84c5c-m5qkp\" (UID: \"22f1b487-1601-4e4d-b631-e40e6a7b69a6\") " pod="openshift-console/console-55f4f84c5c-m5qkp"
Jul 20 13:04:26.923496 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:26.923435    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/22f1b487-1601-4e4d-b631-e40e6a7b69a6-console-config\") pod \"console-55f4f84c5c-m5qkp\" (UID: \"22f1b487-1601-4e4d-b631-e40e6a7b69a6\") " pod="openshift-console/console-55f4f84c5c-m5qkp"
Jul 20 13:04:26.923567 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:26.923542    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22f1b487-1601-4e4d-b631-e40e6a7b69a6-trusted-ca-bundle\") pod \"console-55f4f84c5c-m5qkp\" (UID: \"22f1b487-1601-4e4d-b631-e40e6a7b69a6\") " pod="openshift-console/console-55f4f84c5c-m5qkp"
Jul 20 13:04:26.925017 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:26.924990    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/22f1b487-1601-4e4d-b631-e40e6a7b69a6-console-oauth-config\") pod \"console-55f4f84c5c-m5qkp\" (UID: \"22f1b487-1601-4e4d-b631-e40e6a7b69a6\") " pod="openshift-console/console-55f4f84c5c-m5qkp"
Jul 20 13:04:26.925236 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:26.925217    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/22f1b487-1601-4e4d-b631-e40e6a7b69a6-console-serving-cert\") pod \"console-55f4f84c5c-m5qkp\" (UID: \"22f1b487-1601-4e4d-b631-e40e6a7b69a6\") " pod="openshift-console/console-55f4f84c5c-m5qkp"
Jul 20 13:04:26.931168 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:26.931113    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d6l2q\" (UniqueName: \"kubernetes.io/projected/22f1b487-1601-4e4d-b631-e40e6a7b69a6-kube-api-access-d6l2q\") pod \"console-55f4f84c5c-m5qkp\" (UID: \"22f1b487-1601-4e4d-b631-e40e6a7b69a6\") " pod="openshift-console/console-55f4f84c5c-m5qkp"
Jul 20 13:04:26.991617 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:26.991583    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55f4f84c5c-m5qkp"
Jul 20 13:04:27.116728 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:27.116698    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-55f4f84c5c-m5qkp"]
Jul 20 13:04:27.119139 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:04:27.119104    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22f1b487_1601_4e4d_b631_e40e6a7b69a6.slice/crio-45983dd55d8d3f9d345f176a6d9fb8bbee55ef3d3636d142d5d3d3093460dcab WatchSource:0}: Error finding container 45983dd55d8d3f9d345f176a6d9fb8bbee55ef3d3636d142d5d3d3093460dcab: Status 404 returned error can't find the container with id 45983dd55d8d3f9d345f176a6d9fb8bbee55ef3d3636d142d5d3d3093460dcab
Jul 20 13:04:27.892818 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:27.892782    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55f4f84c5c-m5qkp" event={"ID":"22f1b487-1601-4e4d-b631-e40e6a7b69a6","Type":"ContainerStarted","Data":"947d67b78e539858fadc981fb120587bca83357019c83a16c2974d7696e79e94"}
Jul 20 13:04:27.893242 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:27.892830    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55f4f84c5c-m5qkp" event={"ID":"22f1b487-1601-4e4d-b631-e40e6a7b69a6","Type":"ContainerStarted","Data":"45983dd55d8d3f9d345f176a6d9fb8bbee55ef3d3636d142d5d3d3093460dcab"}
Jul 20 13:04:27.911738 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:27.911683    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-55f4f84c5c-m5qkp" podStartSLOduration=1.9116648550000002 podStartE2EDuration="1.911664855s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:04:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:04:27.911301408 +0000 UTC m=+174.380833526" watchObservedRunningTime="2026-07-20 13:04:27.911664855 +0000 UTC m=+174.381196974"
Jul 20 13:04:32.330042 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:32.330011    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:04:33.409991 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:33.409953    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:04:33.509145 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:33.509111    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:04:35.058048 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:35.058008    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55f4f84c5c-m5qkp"]
Jul 20 13:04:35.094370 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:35.094325    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6ffcc4cf54-rnrb4"]
Jul 20 13:04:35.096869 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:35.096851    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ffcc4cf54-rnrb4"
Jul 20 13:04:35.119223 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:35.119198    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6ffcc4cf54-rnrb4"]
Jul 20 13:04:35.180922 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:35.180883    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d35fff9e-ab5d-49bd-af8b-d1f60adda4a7-service-ca\") pod \"console-6ffcc4cf54-rnrb4\" (UID: \"d35fff9e-ab5d-49bd-af8b-d1f60adda4a7\") " pod="openshift-console/console-6ffcc4cf54-rnrb4"
Jul 20 13:04:35.180922 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:35.180923    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d35fff9e-ab5d-49bd-af8b-d1f60adda4a7-trusted-ca-bundle\") pod \"console-6ffcc4cf54-rnrb4\" (UID: \"d35fff9e-ab5d-49bd-af8b-d1f60adda4a7\") " pod="openshift-console/console-6ffcc4cf54-rnrb4"
Jul 20 13:04:35.181140 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:35.180953    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d35fff9e-ab5d-49bd-af8b-d1f60adda4a7-console-serving-cert\") pod \"console-6ffcc4cf54-rnrb4\" (UID: \"d35fff9e-ab5d-49bd-af8b-d1f60adda4a7\") " pod="openshift-console/console-6ffcc4cf54-rnrb4"
Jul 20 13:04:35.181140 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:35.180991    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d35fff9e-ab5d-49bd-af8b-d1f60adda4a7-console-config\") pod \"console-6ffcc4cf54-rnrb4\" (UID: \"d35fff9e-ab5d-49bd-af8b-d1f60adda4a7\") " pod="openshift-console/console-6ffcc4cf54-rnrb4"
Jul 20 13:04:35.181140 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:35.181036    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tr4bg\" (UniqueName: \"kubernetes.io/projected/d35fff9e-ab5d-49bd-af8b-d1f60adda4a7-kube-api-access-tr4bg\") pod \"console-6ffcc4cf54-rnrb4\" (UID: \"d35fff9e-ab5d-49bd-af8b-d1f60adda4a7\") " pod="openshift-console/console-6ffcc4cf54-rnrb4"
Jul 20 13:04:35.181140 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:35.181070    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d35fff9e-ab5d-49bd-af8b-d1f60adda4a7-console-oauth-config\") pod \"console-6ffcc4cf54-rnrb4\" (UID: \"d35fff9e-ab5d-49bd-af8b-d1f60adda4a7\") " pod="openshift-console/console-6ffcc4cf54-rnrb4"
Jul 20 13:04:35.181140 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:35.181095    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d35fff9e-ab5d-49bd-af8b-d1f60adda4a7-oauth-serving-cert\") pod \"console-6ffcc4cf54-rnrb4\" (UID: \"d35fff9e-ab5d-49bd-af8b-d1f60adda4a7\") " pod="openshift-console/console-6ffcc4cf54-rnrb4"
Jul 20 13:04:35.282212 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:35.282170    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d35fff9e-ab5d-49bd-af8b-d1f60adda4a7-trusted-ca-bundle\") pod \"console-6ffcc4cf54-rnrb4\" (UID: \"d35fff9e-ab5d-49bd-af8b-d1f60adda4a7\") " pod="openshift-console/console-6ffcc4cf54-rnrb4"
Jul 20 13:04:35.282212 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:35.282214    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d35fff9e-ab5d-49bd-af8b-d1f60adda4a7-console-serving-cert\") pod \"console-6ffcc4cf54-rnrb4\" (UID: \"d35fff9e-ab5d-49bd-af8b-d1f60adda4a7\") " pod="openshift-console/console-6ffcc4cf54-rnrb4"
Jul 20 13:04:35.282459 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:35.282237    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d35fff9e-ab5d-49bd-af8b-d1f60adda4a7-console-config\") pod \"console-6ffcc4cf54-rnrb4\" (UID: \"d35fff9e-ab5d-49bd-af8b-d1f60adda4a7\") " pod="openshift-console/console-6ffcc4cf54-rnrb4"
Jul 20 13:04:35.282459 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:35.282408    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tr4bg\" (UniqueName: \"kubernetes.io/projected/d35fff9e-ab5d-49bd-af8b-d1f60adda4a7-kube-api-access-tr4bg\") pod \"console-6ffcc4cf54-rnrb4\" (UID: \"d35fff9e-ab5d-49bd-af8b-d1f60adda4a7\") " pod="openshift-console/console-6ffcc4cf54-rnrb4"
Jul 20 13:04:35.282459 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:35.282447    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d35fff9e-ab5d-49bd-af8b-d1f60adda4a7-console-oauth-config\") pod \"console-6ffcc4cf54-rnrb4\" (UID: \"d35fff9e-ab5d-49bd-af8b-d1f60adda4a7\") " pod="openshift-console/console-6ffcc4cf54-rnrb4"
Jul 20 13:04:35.282605 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:35.282468    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d35fff9e-ab5d-49bd-af8b-d1f60adda4a7-oauth-serving-cert\") pod \"console-6ffcc4cf54-rnrb4\" (UID: \"d35fff9e-ab5d-49bd-af8b-d1f60adda4a7\") " pod="openshift-console/console-6ffcc4cf54-rnrb4"
Jul 20 13:04:35.282605 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:35.282522    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d35fff9e-ab5d-49bd-af8b-d1f60adda4a7-service-ca\") pod \"console-6ffcc4cf54-rnrb4\" (UID: \"d35fff9e-ab5d-49bd-af8b-d1f60adda4a7\") " pod="openshift-console/console-6ffcc4cf54-rnrb4"
Jul 20 13:04:35.283133 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:35.283099    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d35fff9e-ab5d-49bd-af8b-d1f60adda4a7-console-config\") pod \"console-6ffcc4cf54-rnrb4\" (UID: \"d35fff9e-ab5d-49bd-af8b-d1f60adda4a7\") " pod="openshift-console/console-6ffcc4cf54-rnrb4"
Jul 20 13:04:35.283279 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:35.283162    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d35fff9e-ab5d-49bd-af8b-d1f60adda4a7-service-ca\") pod \"console-6ffcc4cf54-rnrb4\" (UID: \"d35fff9e-ab5d-49bd-af8b-d1f60adda4a7\") " pod="openshift-console/console-6ffcc4cf54-rnrb4"
Jul 20 13:04:35.283279 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:35.283173    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d35fff9e-ab5d-49bd-af8b-d1f60adda4a7-trusted-ca-bundle\") pod \"console-6ffcc4cf54-rnrb4\" (UID: \"d35fff9e-ab5d-49bd-af8b-d1f60adda4a7\") " pod="openshift-console/console-6ffcc4cf54-rnrb4"
Jul 20 13:04:35.283279 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:35.283242    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d35fff9e-ab5d-49bd-af8b-d1f60adda4a7-oauth-serving-cert\") pod \"console-6ffcc4cf54-rnrb4\" (UID: \"d35fff9e-ab5d-49bd-af8b-d1f60adda4a7\") " pod="openshift-console/console-6ffcc4cf54-rnrb4"
Jul 20 13:04:35.284765 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:35.284745    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d35fff9e-ab5d-49bd-af8b-d1f60adda4a7-console-serving-cert\") pod \"console-6ffcc4cf54-rnrb4\" (UID: \"d35fff9e-ab5d-49bd-af8b-d1f60adda4a7\") " pod="openshift-console/console-6ffcc4cf54-rnrb4"
Jul 20 13:04:35.284969 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:35.284947    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d35fff9e-ab5d-49bd-af8b-d1f60adda4a7-console-oauth-config\") pod \"console-6ffcc4cf54-rnrb4\" (UID: \"d35fff9e-ab5d-49bd-af8b-d1f60adda4a7\") " pod="openshift-console/console-6ffcc4cf54-rnrb4"
Jul 20 13:04:35.290439 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:35.290419    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tr4bg\" (UniqueName: \"kubernetes.io/projected/d35fff9e-ab5d-49bd-af8b-d1f60adda4a7-kube-api-access-tr4bg\") pod \"console-6ffcc4cf54-rnrb4\" (UID: \"d35fff9e-ab5d-49bd-af8b-d1f60adda4a7\") " pod="openshift-console/console-6ffcc4cf54-rnrb4"
Jul 20 13:04:35.405061 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:35.405027    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ffcc4cf54-rnrb4"
Jul 20 13:04:35.528988 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:35.528953    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6ffcc4cf54-rnrb4"]
Jul 20 13:04:35.531998 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:04:35.531966    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd35fff9e_ab5d_49bd_af8b_d1f60adda4a7.slice/crio-d8d63719e728ddf0894cc7161a4fc6bff83b67e99a176ea1a359ae81b4172241 WatchSource:0}: Error finding container d8d63719e728ddf0894cc7161a4fc6bff83b67e99a176ea1a359ae81b4172241: Status 404 returned error can't find the container with id d8d63719e728ddf0894cc7161a4fc6bff83b67e99a176ea1a359ae81b4172241
Jul 20 13:04:35.921997 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:35.921959    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ffcc4cf54-rnrb4" event={"ID":"d35fff9e-ab5d-49bd-af8b-d1f60adda4a7","Type":"ContainerStarted","Data":"ac1b032a23ee3fe4ffab5110a8be9812bf0c26e35ec6a41fc388f42e5b88375a"}
Jul 20 13:04:35.922181 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:35.922017    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ffcc4cf54-rnrb4" event={"ID":"d35fff9e-ab5d-49bd-af8b-d1f60adda4a7","Type":"ContainerStarted","Data":"d8d63719e728ddf0894cc7161a4fc6bff83b67e99a176ea1a359ae81b4172241"}
Jul 20 13:04:35.952460 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:35.952409    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6ffcc4cf54-rnrb4" podStartSLOduration=0.952394241 podStartE2EDuration="952.394241ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:04:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:04:35.950292 +0000 UTC m=+182.419824132" watchObservedRunningTime="2026-07-20 13:04:35.952394241 +0000 UTC m=+182.421926430"
Jul 20 13:04:36.992502 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:36.992475    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-55f4f84c5c-m5qkp"
Jul 20 13:04:45.385607 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:45.385578    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:04:45.405454 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:45.405428    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6ffcc4cf54-rnrb4"
Jul 20 13:04:45.405536 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:45.405486    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6ffcc4cf54-rnrb4"
Jul 20 13:04:45.410129 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:45.410099    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6ffcc4cf54-rnrb4"
Jul 20 13:04:45.487311 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:45.487282    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:04:45.958545 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:45.958518    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6ffcc4cf54-rnrb4"
Jul 20 13:04:46.004127 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:46.004097    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7ddf5dd989-qdhpw"]
Jul 20 13:04:46.105138 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:46.105093    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:04:47.356323 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:47.356284    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:04:47.451549 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:47.451515    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:04:49.067418 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:49.067349    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:04:49.168446 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:49.168407    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:04:50.362412 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:04:50.362374    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:05:00.077696 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:00.077634    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-55f4f84c5c-m5qkp" podUID="22f1b487-1601-4e4d-b631-e40e6a7b69a6" containerName="console" containerID="cri-o://947d67b78e539858fadc981fb120587bca83357019c83a16c2974d7696e79e94" gracePeriod=15
Jul 20 13:05:00.318800 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:00.318775    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55f4f84c5c-m5qkp"
Jul 20 13:05:00.385713 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:00.385684    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/22f1b487-1601-4e4d-b631-e40e6a7b69a6-oauth-serving-cert\") pod \"22f1b487-1601-4e4d-b631-e40e6a7b69a6\" (UID: \"22f1b487-1601-4e4d-b631-e40e6a7b69a6\") "
Jul 20 13:05:00.385877 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:00.385718    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22f1b487-1601-4e4d-b631-e40e6a7b69a6-trusted-ca-bundle\") pod \"22f1b487-1601-4e4d-b631-e40e6a7b69a6\" (UID: \"22f1b487-1601-4e4d-b631-e40e6a7b69a6\") "
Jul 20 13:05:00.385877 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:00.385752    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/22f1b487-1601-4e4d-b631-e40e6a7b69a6-console-serving-cert\") pod \"22f1b487-1601-4e4d-b631-e40e6a7b69a6\" (UID: \"22f1b487-1601-4e4d-b631-e40e6a7b69a6\") "
Jul 20 13:05:00.385877 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:00.385863    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/22f1b487-1601-4e4d-b631-e40e6a7b69a6-service-ca\") pod \"22f1b487-1601-4e4d-b631-e40e6a7b69a6\" (UID: \"22f1b487-1601-4e4d-b631-e40e6a7b69a6\") "
Jul 20 13:05:00.386043 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:00.385900    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d6l2q\" (UniqueName: \"kubernetes.io/projected/22f1b487-1601-4e4d-b631-e40e6a7b69a6-kube-api-access-d6l2q\") pod \"22f1b487-1601-4e4d-b631-e40e6a7b69a6\" (UID: \"22f1b487-1601-4e4d-b631-e40e6a7b69a6\") "
Jul 20 13:05:00.386043 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:00.385922    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/22f1b487-1601-4e4d-b631-e40e6a7b69a6-console-config\") pod \"22f1b487-1601-4e4d-b631-e40e6a7b69a6\" (UID: \"22f1b487-1601-4e4d-b631-e40e6a7b69a6\") "
Jul 20 13:05:00.386043 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:00.385947    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/22f1b487-1601-4e4d-b631-e40e6a7b69a6-console-oauth-config\") pod \"22f1b487-1601-4e4d-b631-e40e6a7b69a6\" (UID: \"22f1b487-1601-4e4d-b631-e40e6a7b69a6\") "
Jul 20 13:05:00.386196 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:00.386108    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22f1b487-1601-4e4d-b631-e40e6a7b69a6-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "22f1b487-1601-4e4d-b631-e40e6a7b69a6" (UID: "22f1b487-1601-4e4d-b631-e40e6a7b69a6"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:05:00.386251 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:00.386215    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22f1b487-1601-4e4d-b631-e40e6a7b69a6-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "22f1b487-1601-4e4d-b631-e40e6a7b69a6" (UID: "22f1b487-1601-4e4d-b631-e40e6a7b69a6"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:05:00.386307 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:00.386247    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22f1b487-1601-4e4d-b631-e40e6a7b69a6-service-ca" (OuterVolumeSpecName: "service-ca") pod "22f1b487-1601-4e4d-b631-e40e6a7b69a6" (UID: "22f1b487-1601-4e4d-b631-e40e6a7b69a6"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:05:00.386307 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:00.386261    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22f1b487-1601-4e4d-b631-e40e6a7b69a6-console-config" (OuterVolumeSpecName: "console-config") pod "22f1b487-1601-4e4d-b631-e40e6a7b69a6" (UID: "22f1b487-1601-4e4d-b631-e40e6a7b69a6"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:05:00.386307 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:00.386292    2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/22f1b487-1601-4e4d-b631-e40e6a7b69a6-oauth-serving-cert\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:05:00.386483 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:00.386310    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/22f1b487-1601-4e4d-b631-e40e6a7b69a6-trusted-ca-bundle\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:05:00.388077 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:00.388041    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22f1b487-1601-4e4d-b631-e40e6a7b69a6-kube-api-access-d6l2q" (OuterVolumeSpecName: "kube-api-access-d6l2q") pod "22f1b487-1601-4e4d-b631-e40e6a7b69a6" (UID: "22f1b487-1601-4e4d-b631-e40e6a7b69a6"). InnerVolumeSpecName "kube-api-access-d6l2q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:05:00.388077 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:00.388066    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22f1b487-1601-4e4d-b631-e40e6a7b69a6-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "22f1b487-1601-4e4d-b631-e40e6a7b69a6" (UID: "22f1b487-1601-4e4d-b631-e40e6a7b69a6"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 13:05:00.388216 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:00.388082    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/22f1b487-1601-4e4d-b631-e40e6a7b69a6-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "22f1b487-1601-4e4d-b631-e40e6a7b69a6" (UID: "22f1b487-1601-4e4d-b631-e40e6a7b69a6"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 13:05:00.486999 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:00.486965    2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/22f1b487-1601-4e4d-b631-e40e6a7b69a6-console-serving-cert\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:05:00.486999 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:00.486995    2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/22f1b487-1601-4e4d-b631-e40e6a7b69a6-service-ca\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:05:00.486999 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:00.487004    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d6l2q\" (UniqueName: \"kubernetes.io/projected/22f1b487-1601-4e4d-b631-e40e6a7b69a6-kube-api-access-d6l2q\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:05:00.487223 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:00.487015    2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/22f1b487-1601-4e4d-b631-e40e6a7b69a6-console-config\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:05:00.487223 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:00.487025    2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/22f1b487-1601-4e4d-b631-e40e6a7b69a6-console-oauth-config\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:05:01.008209 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:01.008172    2565 generic.go:356] "Generic (PLEG): container finished" podID="22f1b487-1601-4e4d-b631-e40e6a7b69a6" containerID="947d67b78e539858fadc981fb120587bca83357019c83a16c2974d7696e79e94" exitCode=0
Jul 20 13:05:01.008437 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:01.008220    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-55f4f84c5c-m5qkp"
Jul 20 13:05:01.008437 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:01.008261    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55f4f84c5c-m5qkp" event={"ID":"22f1b487-1601-4e4d-b631-e40e6a7b69a6","Type":"ContainerDied","Data":"947d67b78e539858fadc981fb120587bca83357019c83a16c2974d7696e79e94"}
Jul 20 13:05:01.008437 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:01.008322    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-55f4f84c5c-m5qkp" event={"ID":"22f1b487-1601-4e4d-b631-e40e6a7b69a6","Type":"ContainerDied","Data":"45983dd55d8d3f9d345f176a6d9fb8bbee55ef3d3636d142d5d3d3093460dcab"}
Jul 20 13:05:01.008437 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:01.008350    2565 scope.go:117] "RemoveContainer" containerID="947d67b78e539858fadc981fb120587bca83357019c83a16c2974d7696e79e94"
Jul 20 13:05:01.017277 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:01.017258    2565 scope.go:117] "RemoveContainer" containerID="947d67b78e539858fadc981fb120587bca83357019c83a16c2974d7696e79e94"
Jul 20 13:05:01.017565 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:05:01.017547    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"947d67b78e539858fadc981fb120587bca83357019c83a16c2974d7696e79e94\": container with ID starting with 947d67b78e539858fadc981fb120587bca83357019c83a16c2974d7696e79e94 not found: ID does not exist" containerID="947d67b78e539858fadc981fb120587bca83357019c83a16c2974d7696e79e94"
Jul 20 13:05:01.017627 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:01.017573    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"947d67b78e539858fadc981fb120587bca83357019c83a16c2974d7696e79e94"} err="failed to get container status \"947d67b78e539858fadc981fb120587bca83357019c83a16c2974d7696e79e94\": rpc error: code = NotFound desc = could not find container \"947d67b78e539858fadc981fb120587bca83357019c83a16c2974d7696e79e94\": container with ID starting with 947d67b78e539858fadc981fb120587bca83357019c83a16c2974d7696e79e94 not found: ID does not exist"
Jul 20 13:05:01.028086 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:01.028059    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-55f4f84c5c-m5qkp"]
Jul 20 13:05:01.030878 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:01.030857    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-55f4f84c5c-m5qkp"]
Jul 20 13:05:02.146273 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:02.146240    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22f1b487-1601-4e4d-b631-e40e6a7b69a6" path="/var/lib/kubelet/pods/22f1b487-1601-4e4d-b631-e40e6a7b69a6/volumes"
Jul 20 13:05:02.490817 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:02.490733    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:05:02.542776 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:02.542744    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:05:06.687594 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:06.687562    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:05:11.024121 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:11.024082    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7ddf5dd989-qdhpw" podUID="9c107b77-265a-4cb2-bbcc-54a9c6369b71" containerName="console" containerID="cri-o://845c1073d69103c6b13b615254c92772e05a42142e4536bbc38d86bdf20b1bf1" gracePeriod=15
Jul 20 13:05:11.268160 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:11.268133    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7ddf5dd989-qdhpw"
Jul 20 13:05:11.370948 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:11.370915    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tngl5\" (UniqueName: \"kubernetes.io/projected/9c107b77-265a-4cb2-bbcc-54a9c6369b71-kube-api-access-tngl5\") pod \"9c107b77-265a-4cb2-bbcc-54a9c6369b71\" (UID: \"9c107b77-265a-4cb2-bbcc-54a9c6369b71\") "
Jul 20 13:05:11.371119 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:11.370956    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c107b77-265a-4cb2-bbcc-54a9c6369b71-trusted-ca-bundle\") pod \"9c107b77-265a-4cb2-bbcc-54a9c6369b71\" (UID: \"9c107b77-265a-4cb2-bbcc-54a9c6369b71\") "
Jul 20 13:05:11.371119 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:11.370991    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9c107b77-265a-4cb2-bbcc-54a9c6369b71-oauth-serving-cert\") pod \"9c107b77-265a-4cb2-bbcc-54a9c6369b71\" (UID: \"9c107b77-265a-4cb2-bbcc-54a9c6369b71\") "
Jul 20 13:05:11.371119 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:11.371009    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9c107b77-265a-4cb2-bbcc-54a9c6369b71-console-oauth-config\") pod \"9c107b77-265a-4cb2-bbcc-54a9c6369b71\" (UID: \"9c107b77-265a-4cb2-bbcc-54a9c6369b71\") "
Jul 20 13:05:11.371119 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:11.371058    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9c107b77-265a-4cb2-bbcc-54a9c6369b71-console-serving-cert\") pod \"9c107b77-265a-4cb2-bbcc-54a9c6369b71\" (UID: \"9c107b77-265a-4cb2-bbcc-54a9c6369b71\") "
Jul 20 13:05:11.371119 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:11.371085    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9c107b77-265a-4cb2-bbcc-54a9c6369b71-console-config\") pod \"9c107b77-265a-4cb2-bbcc-54a9c6369b71\" (UID: \"9c107b77-265a-4cb2-bbcc-54a9c6369b71\") "
Jul 20 13:05:11.371119 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:11.371113    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9c107b77-265a-4cb2-bbcc-54a9c6369b71-service-ca\") pod \"9c107b77-265a-4cb2-bbcc-54a9c6369b71\" (UID: \"9c107b77-265a-4cb2-bbcc-54a9c6369b71\") "
Jul 20 13:05:11.371525 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:11.371493    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c107b77-265a-4cb2-bbcc-54a9c6369b71-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "9c107b77-265a-4cb2-bbcc-54a9c6369b71" (UID: "9c107b77-265a-4cb2-bbcc-54a9c6369b71"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:05:11.371654 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:11.371502    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c107b77-265a-4cb2-bbcc-54a9c6369b71-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9c107b77-265a-4cb2-bbcc-54a9c6369b71" (UID: "9c107b77-265a-4cb2-bbcc-54a9c6369b71"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:05:11.371728 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:11.371655    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c107b77-265a-4cb2-bbcc-54a9c6369b71-console-config" (OuterVolumeSpecName: "console-config") pod "9c107b77-265a-4cb2-bbcc-54a9c6369b71" (UID: "9c107b77-265a-4cb2-bbcc-54a9c6369b71"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:05:11.371728 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:11.371686    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9c107b77-265a-4cb2-bbcc-54a9c6369b71-service-ca" (OuterVolumeSpecName: "service-ca") pod "9c107b77-265a-4cb2-bbcc-54a9c6369b71" (UID: "9c107b77-265a-4cb2-bbcc-54a9c6369b71"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:05:11.373132 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:11.373103    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c107b77-265a-4cb2-bbcc-54a9c6369b71-kube-api-access-tngl5" (OuterVolumeSpecName: "kube-api-access-tngl5") pod "9c107b77-265a-4cb2-bbcc-54a9c6369b71" (UID: "9c107b77-265a-4cb2-bbcc-54a9c6369b71"). InnerVolumeSpecName "kube-api-access-tngl5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:05:11.373243 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:11.373177    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c107b77-265a-4cb2-bbcc-54a9c6369b71-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9c107b77-265a-4cb2-bbcc-54a9c6369b71" (UID: "9c107b77-265a-4cb2-bbcc-54a9c6369b71"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 13:05:11.373290 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:11.373247    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9c107b77-265a-4cb2-bbcc-54a9c6369b71-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9c107b77-265a-4cb2-bbcc-54a9c6369b71" (UID: "9c107b77-265a-4cb2-bbcc-54a9c6369b71"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 13:05:11.472036 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:11.471996    2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9c107b77-265a-4cb2-bbcc-54a9c6369b71-console-serving-cert\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:05:11.472036 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:11.472029    2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9c107b77-265a-4cb2-bbcc-54a9c6369b71-console-config\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:05:11.472036 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:11.472044    2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9c107b77-265a-4cb2-bbcc-54a9c6369b71-service-ca\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:05:11.472268 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:11.472058    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tngl5\" (UniqueName: \"kubernetes.io/projected/9c107b77-265a-4cb2-bbcc-54a9c6369b71-kube-api-access-tngl5\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:05:11.472268 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:11.472072    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/9c107b77-265a-4cb2-bbcc-54a9c6369b71-trusted-ca-bundle\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:05:11.472268 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:11.472084    2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9c107b77-265a-4cb2-bbcc-54a9c6369b71-oauth-serving-cert\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:05:11.472268 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:11.472096    2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9c107b77-265a-4cb2-bbcc-54a9c6369b71-console-oauth-config\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:05:12.051025 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:12.050990    2565 generic.go:356] "Generic (PLEG): container finished" podID="9c107b77-265a-4cb2-bbcc-54a9c6369b71" containerID="845c1073d69103c6b13b615254c92772e05a42142e4536bbc38d86bdf20b1bf1" exitCode=0
Jul 20 13:05:12.051025 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:12.051029    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7ddf5dd989-qdhpw"
Jul 20 13:05:12.051516 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:12.051077    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7ddf5dd989-qdhpw" event={"ID":"9c107b77-265a-4cb2-bbcc-54a9c6369b71","Type":"ContainerDied","Data":"845c1073d69103c6b13b615254c92772e05a42142e4536bbc38d86bdf20b1bf1"}
Jul 20 13:05:12.051516 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:12.051122    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7ddf5dd989-qdhpw" event={"ID":"9c107b77-265a-4cb2-bbcc-54a9c6369b71","Type":"ContainerDied","Data":"fa40db99ccf781ca437573fe12e4b8a7e3af68832f3a256aba29752d2e36babc"}
Jul 20 13:05:12.051516 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:12.051144    2565 scope.go:117] "RemoveContainer" containerID="845c1073d69103c6b13b615254c92772e05a42142e4536bbc38d86bdf20b1bf1"
Jul 20 13:05:12.059720 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:12.059705    2565 scope.go:117] "RemoveContainer" containerID="845c1073d69103c6b13b615254c92772e05a42142e4536bbc38d86bdf20b1bf1"
Jul 20 13:05:12.059960 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:05:12.059943    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"845c1073d69103c6b13b615254c92772e05a42142e4536bbc38d86bdf20b1bf1\": container with ID starting with 845c1073d69103c6b13b615254c92772e05a42142e4536bbc38d86bdf20b1bf1 not found: ID does not exist" containerID="845c1073d69103c6b13b615254c92772e05a42142e4536bbc38d86bdf20b1bf1"
Jul 20 13:05:12.060007 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:12.059967    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"845c1073d69103c6b13b615254c92772e05a42142e4536bbc38d86bdf20b1bf1"} err="failed to get container status \"845c1073d69103c6b13b615254c92772e05a42142e4536bbc38d86bdf20b1bf1\": rpc error: code = NotFound desc = could not find container \"845c1073d69103c6b13b615254c92772e05a42142e4536bbc38d86bdf20b1bf1\": container with ID starting with 845c1073d69103c6b13b615254c92772e05a42142e4536bbc38d86bdf20b1bf1 not found: ID does not exist"
Jul 20 13:05:12.071927 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:12.071902    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7ddf5dd989-qdhpw"]
Jul 20 13:05:12.076100 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:12.076073    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7ddf5dd989-qdhpw"]
Jul 20 13:05:12.145544 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:12.145514    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9c107b77-265a-4cb2-bbcc-54a9c6369b71" path="/var/lib/kubelet/pods/9c107b77-265a-4cb2-bbcc-54a9c6369b71/volumes"
Jul 20 13:05:40.944857 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:40.944818    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:05:41.002200 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:05:41.002171    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:06:10.690743 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:10.690703    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:06:10.796535 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:10.796500    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:06:11.262911 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:11.262875    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bjn65"]
Jul 20 13:06:11.263117 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:11.263106    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c107b77-265a-4cb2-bbcc-54a9c6369b71" containerName="console"
Jul 20 13:06:11.263159 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:11.263118    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c107b77-265a-4cb2-bbcc-54a9c6369b71" containerName="console"
Jul 20 13:06:11.263159 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:11.263127    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22f1b487-1601-4e4d-b631-e40e6a7b69a6" containerName="console"
Jul 20 13:06:11.263159 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:11.263133    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="22f1b487-1601-4e4d-b631-e40e6a7b69a6" containerName="console"
Jul 20 13:06:11.263251 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:11.263180    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c107b77-265a-4cb2-bbcc-54a9c6369b71" containerName="console"
Jul 20 13:06:11.263251 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:11.263187    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="22f1b487-1601-4e4d-b631-e40e6a7b69a6" containerName="console"
Jul 20 13:06:11.265816 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:11.265801    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bjn65"
Jul 20 13:06:11.268527 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:11.268496    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\""
Jul 20 13:06:11.268668 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:11.268621    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\""
Jul 20 13:06:11.269695 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:11.269676    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-d2nvl\""
Jul 20 13:06:11.277845 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:11.277821    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bjn65"]
Jul 20 13:06:11.304891 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:11.304869    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e0736044-6bdc-4097-8723-7057869842e5-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bjn65\" (UID: \"e0736044-6bdc-4097-8723-7057869842e5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bjn65"
Jul 20 13:06:11.304994 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:11.304903    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mktcn\" (UniqueName: \"kubernetes.io/projected/e0736044-6bdc-4097-8723-7057869842e5-kube-api-access-mktcn\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bjn65\" (UID: \"e0736044-6bdc-4097-8723-7057869842e5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bjn65"
Jul 20 13:06:11.304994 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:11.304932    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e0736044-6bdc-4097-8723-7057869842e5-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bjn65\" (UID: \"e0736044-6bdc-4097-8723-7057869842e5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bjn65"
Jul 20 13:06:11.405798 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:11.405767    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e0736044-6bdc-4097-8723-7057869842e5-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bjn65\" (UID: \"e0736044-6bdc-4097-8723-7057869842e5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bjn65"
Jul 20 13:06:11.405949 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:11.405810    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mktcn\" (UniqueName: \"kubernetes.io/projected/e0736044-6bdc-4097-8723-7057869842e5-kube-api-access-mktcn\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bjn65\" (UID: \"e0736044-6bdc-4097-8723-7057869842e5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bjn65"
Jul 20 13:06:11.405949 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:11.405837    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e0736044-6bdc-4097-8723-7057869842e5-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bjn65\" (UID: \"e0736044-6bdc-4097-8723-7057869842e5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bjn65"
Jul 20 13:06:11.406197 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:11.406176    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e0736044-6bdc-4097-8723-7057869842e5-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bjn65\" (UID: \"e0736044-6bdc-4097-8723-7057869842e5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bjn65"
Jul 20 13:06:11.406238 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:11.406207    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e0736044-6bdc-4097-8723-7057869842e5-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bjn65\" (UID: \"e0736044-6bdc-4097-8723-7057869842e5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bjn65"
Jul 20 13:06:11.415493 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:11.415468    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mktcn\" (UniqueName: \"kubernetes.io/projected/e0736044-6bdc-4097-8723-7057869842e5-kube-api-access-mktcn\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bjn65\" (UID: \"e0736044-6bdc-4097-8723-7057869842e5\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bjn65"
Jul 20 13:06:11.574755 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:11.574661    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bjn65"
Jul 20 13:06:11.707626 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:11.702888    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bjn65"]
Jul 20 13:06:12.251935 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:12.251897    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bjn65" event={"ID":"e0736044-6bdc-4097-8723-7057869842e5","Type":"ContainerStarted","Data":"05eb358cdd4b983e4351eee07df1fac8be01e1810b5ee77cffab202cbafd4565"}
Jul 20 13:06:18.275197 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:18.275104    2565 generic.go:356] "Generic (PLEG): container finished" podID="e0736044-6bdc-4097-8723-7057869842e5" containerID="c8c14f06ba7346dbb598357ae3fdf321e6638f60fc1f9bf7042b058eb5ade6bf" exitCode=0
Jul 20 13:06:18.275197 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:18.275177    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bjn65" event={"ID":"e0736044-6bdc-4097-8723-7057869842e5","Type":"ContainerDied","Data":"c8c14f06ba7346dbb598357ae3fdf321e6638f60fc1f9bf7042b058eb5ade6bf"}
Jul 20 13:06:21.288149 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:21.288106    2565 generic.go:356] "Generic (PLEG): container finished" podID="e0736044-6bdc-4097-8723-7057869842e5" containerID="b6246335299492d2df7615cfc305cb88e42e3d843d4513c47a71b2ee068e6595" exitCode=0
Jul 20 13:06:21.288556 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:21.288188    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bjn65" event={"ID":"e0736044-6bdc-4097-8723-7057869842e5","Type":"ContainerDied","Data":"b6246335299492d2df7615cfc305cb88e42e3d843d4513c47a71b2ee068e6595"}
Jul 20 13:06:28.316756 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:28.316717    2565 generic.go:356] "Generic (PLEG): container finished" podID="e0736044-6bdc-4097-8723-7057869842e5" containerID="ec510504aa47e9f6077490744f570e66f72596f67b1bdc680d1f59ae00234c22" exitCode=0
Jul 20 13:06:28.317134 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:28.316761    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bjn65" event={"ID":"e0736044-6bdc-4097-8723-7057869842e5","Type":"ContainerDied","Data":"ec510504aa47e9f6077490744f570e66f72596f67b1bdc680d1f59ae00234c22"}
Jul 20 13:06:29.442425 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:29.442392    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bjn65"
Jul 20 13:06:29.556441 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:29.556390    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mktcn\" (UniqueName: \"kubernetes.io/projected/e0736044-6bdc-4097-8723-7057869842e5-kube-api-access-mktcn\") pod \"e0736044-6bdc-4097-8723-7057869842e5\" (UID: \"e0736044-6bdc-4097-8723-7057869842e5\") "
Jul 20 13:06:29.556612 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:29.556489    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e0736044-6bdc-4097-8723-7057869842e5-bundle\") pod \"e0736044-6bdc-4097-8723-7057869842e5\" (UID: \"e0736044-6bdc-4097-8723-7057869842e5\") "
Jul 20 13:06:29.556612 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:29.556520    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e0736044-6bdc-4097-8723-7057869842e5-util\") pod \"e0736044-6bdc-4097-8723-7057869842e5\" (UID: \"e0736044-6bdc-4097-8723-7057869842e5\") "
Jul 20 13:06:29.557195 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:29.557160    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0736044-6bdc-4097-8723-7057869842e5-bundle" (OuterVolumeSpecName: "bundle") pod "e0736044-6bdc-4097-8723-7057869842e5" (UID: "e0736044-6bdc-4097-8723-7057869842e5"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:06:29.558656 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:29.558626    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0736044-6bdc-4097-8723-7057869842e5-kube-api-access-mktcn" (OuterVolumeSpecName: "kube-api-access-mktcn") pod "e0736044-6bdc-4097-8723-7057869842e5" (UID: "e0736044-6bdc-4097-8723-7057869842e5"). InnerVolumeSpecName "kube-api-access-mktcn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:06:29.561048 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:29.561023    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e0736044-6bdc-4097-8723-7057869842e5-util" (OuterVolumeSpecName: "util") pod "e0736044-6bdc-4097-8723-7057869842e5" (UID: "e0736044-6bdc-4097-8723-7057869842e5"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:06:29.657677 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:29.657643    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mktcn\" (UniqueName: \"kubernetes.io/projected/e0736044-6bdc-4097-8723-7057869842e5-kube-api-access-mktcn\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:06:29.657677 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:29.657674    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e0736044-6bdc-4097-8723-7057869842e5-bundle\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:06:29.657856 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:29.657686    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e0736044-6bdc-4097-8723-7057869842e5-util\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:06:30.325466 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:30.325430    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bjn65" event={"ID":"e0736044-6bdc-4097-8723-7057869842e5","Type":"ContainerDied","Data":"05eb358cdd4b983e4351eee07df1fac8be01e1810b5ee77cffab202cbafd4565"}
Jul 20 13:06:30.325466 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:30.325462    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540bjn65"
Jul 20 13:06:30.325668 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:30.325481    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="05eb358cdd4b983e4351eee07df1fac8be01e1810b5ee77cffab202cbafd4565"
Jul 20 13:06:32.332429 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:32.332392    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:06:33.194062 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:33.194033    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:06:33.980146 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:33.980119    2565 kubelet.go:1648] "Image garbage collection succeeded"
Jul 20 13:06:35.939428 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:35.939384    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:06:36.040565 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:36.040538    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:06:38.280178 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:38.280142    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:06:38.372845 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:38.372784    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:06:38.750927 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:38.750891    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:06:38.872609 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:38.872578    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:06:40.452310 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:40.452281    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:06:40.732302 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:40.732210    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:06:42.954716 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:42.954686    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:06:43.050245 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:43.050210    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:06:47.866966 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:47.866936    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:06:47.952247 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:47.952210    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:06:48.470913 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:48.470879    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:06:50.633438 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:50.633400    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-h7dxj"]
Jul 20 13:06:50.633812 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:50.633642    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0736044-6bdc-4097-8723-7057869842e5" containerName="util"
Jul 20 13:06:50.633812 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:50.633654    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0736044-6bdc-4097-8723-7057869842e5" containerName="util"
Jul 20 13:06:50.633812 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:50.633668    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0736044-6bdc-4097-8723-7057869842e5" containerName="pull"
Jul 20 13:06:50.633812 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:50.633673    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0736044-6bdc-4097-8723-7057869842e5" containerName="pull"
Jul 20 13:06:50.633812 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:50.633679    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0736044-6bdc-4097-8723-7057869842e5" containerName="extract"
Jul 20 13:06:50.633812 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:50.633685    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0736044-6bdc-4097-8723-7057869842e5" containerName="extract"
Jul 20 13:06:50.633812 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:50.633724    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0736044-6bdc-4097-8723-7057869842e5" containerName="extract"
Jul 20 13:06:50.640246 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:50.640226    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-h7dxj"
Jul 20 13:06:50.644273 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:50.644251    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-s4nfv\""
Jul 20 13:06:50.644426 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:50.644253    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 20 13:06:50.645412 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:50.645395    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 20 13:06:50.650062 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:50.650040    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-h7dxj"]
Jul 20 13:06:50.820914 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:50.820873    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/309776e2-e15a-45ef-8896-b2b8e5b01bd7-bound-sa-token\") pod \"cert-manager-55b4d954d5-h7dxj\" (UID: \"309776e2-e15a-45ef-8896-b2b8e5b01bd7\") " pod="cert-manager/cert-manager-55b4d954d5-h7dxj"
Jul 20 13:06:50.821095 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:50.820938    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n59cl\" (UniqueName: \"kubernetes.io/projected/309776e2-e15a-45ef-8896-b2b8e5b01bd7-kube-api-access-n59cl\") pod \"cert-manager-55b4d954d5-h7dxj\" (UID: \"309776e2-e15a-45ef-8896-b2b8e5b01bd7\") " pod="cert-manager/cert-manager-55b4d954d5-h7dxj"
Jul 20 13:06:50.922377 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:50.922286    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n59cl\" (UniqueName: \"kubernetes.io/projected/309776e2-e15a-45ef-8896-b2b8e5b01bd7-kube-api-access-n59cl\") pod \"cert-manager-55b4d954d5-h7dxj\" (UID: \"309776e2-e15a-45ef-8896-b2b8e5b01bd7\") " pod="cert-manager/cert-manager-55b4d954d5-h7dxj"
Jul 20 13:06:50.922493 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:50.922379    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/309776e2-e15a-45ef-8896-b2b8e5b01bd7-bound-sa-token\") pod \"cert-manager-55b4d954d5-h7dxj\" (UID: \"309776e2-e15a-45ef-8896-b2b8e5b01bd7\") " pod="cert-manager/cert-manager-55b4d954d5-h7dxj"
Jul 20 13:06:50.934753 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:50.934727    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n59cl\" (UniqueName: \"kubernetes.io/projected/309776e2-e15a-45ef-8896-b2b8e5b01bd7-kube-api-access-n59cl\") pod \"cert-manager-55b4d954d5-h7dxj\" (UID: \"309776e2-e15a-45ef-8896-b2b8e5b01bd7\") " pod="cert-manager/cert-manager-55b4d954d5-h7dxj"
Jul 20 13:06:50.936079 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:50.936060    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/309776e2-e15a-45ef-8896-b2b8e5b01bd7-bound-sa-token\") pod \"cert-manager-55b4d954d5-h7dxj\" (UID: \"309776e2-e15a-45ef-8896-b2b8e5b01bd7\") " pod="cert-manager/cert-manager-55b4d954d5-h7dxj"
Jul 20 13:06:50.948887 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:50.948866    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-h7dxj"
Jul 20 13:06:51.085011 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:51.084976    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-h7dxj"]
Jul 20 13:06:51.089020 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:06:51.088994    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod309776e2_e15a_45ef_8896_b2b8e5b01bd7.slice/crio-e0e0fcb59cbdd6155fae7a486fa098d9375b976ae1036962468928d51d977d40 WatchSource:0}: Error finding container e0e0fcb59cbdd6155fae7a486fa098d9375b976ae1036962468928d51d977d40: Status 404 returned error can't find the container with id e0e0fcb59cbdd6155fae7a486fa098d9375b976ae1036962468928d51d977d40
Jul 20 13:06:51.090956 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:51.090939    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 13:06:51.398096 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:51.398061    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-h7dxj" event={"ID":"309776e2-e15a-45ef-8896-b2b8e5b01bd7","Type":"ContainerStarted","Data":"e0e0fcb59cbdd6155fae7a486fa098d9375b976ae1036962468928d51d977d40"}
Jul 20 13:06:54.411932 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:54.411893    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-h7dxj" event={"ID":"309776e2-e15a-45ef-8896-b2b8e5b01bd7","Type":"ContainerStarted","Data":"622e9e373f9b24496bc7272c6370fd7f804afbb82727f07e9f4933256e601fd2"}
Jul 20 13:06:54.433352 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:06:54.433304    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-h7dxj" podStartSLOduration=2.02623678 podStartE2EDuration="4.433290343s" totalImagesPullingTime="2.407053563s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:06:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:06:54.431931156 +0000 UTC m=+320.901463275" watchObservedRunningTime="2026-07-20 13:06:54.433290343 +0000 UTC m=+320.902822461"
Jul 20 13:07:00.855851 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:00.855818    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:07:00.954336 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:00.954289    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:07:02.698926 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:02.698888    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8cn2l"]
Jul 20 13:07:02.701082 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:02.701065    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8cn2l"
Jul 20 13:07:02.703787 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:02.703765    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-kkb6n\""
Jul 20 13:07:02.703903 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:02.703767    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 20 13:07:02.704829 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:02.704810    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 20 13:07:02.706078 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:02.706061    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9fe30511-54c3-4aef-b591-32426a623500-tmp\") pod \"openshift-lws-operator-fd8ccff4c-8cn2l\" (UID: \"9fe30511-54c3-4aef-b591-32426a623500\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8cn2l"
Jul 20 13:07:02.706148 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:02.706102    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9c8ld\" (UniqueName: \"kubernetes.io/projected/9fe30511-54c3-4aef-b591-32426a623500-kube-api-access-9c8ld\") pod \"openshift-lws-operator-fd8ccff4c-8cn2l\" (UID: \"9fe30511-54c3-4aef-b591-32426a623500\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8cn2l"
Jul 20 13:07:02.711191 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:02.711171    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8cn2l"]
Jul 20 13:07:02.807446 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:02.807396    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9c8ld\" (UniqueName: \"kubernetes.io/projected/9fe30511-54c3-4aef-b591-32426a623500-kube-api-access-9c8ld\") pod \"openshift-lws-operator-fd8ccff4c-8cn2l\" (UID: \"9fe30511-54c3-4aef-b591-32426a623500\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8cn2l"
Jul 20 13:07:02.807648 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:02.807492    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9fe30511-54c3-4aef-b591-32426a623500-tmp\") pod \"openshift-lws-operator-fd8ccff4c-8cn2l\" (UID: \"9fe30511-54c3-4aef-b591-32426a623500\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8cn2l"
Jul 20 13:07:02.807885 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:02.807862    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/9fe30511-54c3-4aef-b591-32426a623500-tmp\") pod \"openshift-lws-operator-fd8ccff4c-8cn2l\" (UID: \"9fe30511-54c3-4aef-b591-32426a623500\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8cn2l"
Jul 20 13:07:02.817991 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:02.817956    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9c8ld\" (UniqueName: \"kubernetes.io/projected/9fe30511-54c3-4aef-b591-32426a623500-kube-api-access-9c8ld\") pod \"openshift-lws-operator-fd8ccff4c-8cn2l\" (UID: \"9fe30511-54c3-4aef-b591-32426a623500\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8cn2l"
Jul 20 13:07:03.010326 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:03.010242    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8cn2l"
Jul 20 13:07:03.135561 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:03.135530    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8cn2l"]
Jul 20 13:07:03.138563 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:07:03.138534    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9fe30511_54c3_4aef_b591_32426a623500.slice/crio-376e35269a4520d29836d69a2ad5fbb594a1db1148c935d411639808fca350b1 WatchSource:0}: Error finding container 376e35269a4520d29836d69a2ad5fbb594a1db1148c935d411639808fca350b1: Status 404 returned error can't find the container with id 376e35269a4520d29836d69a2ad5fbb594a1db1148c935d411639808fca350b1
Jul 20 13:07:03.443320 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:03.443286    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8cn2l" event={"ID":"9fe30511-54c3-4aef-b591-32426a623500","Type":"ContainerStarted","Data":"376e35269a4520d29836d69a2ad5fbb594a1db1148c935d411639808fca350b1"}
Jul 20 13:07:06.457163 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:06.457125    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8cn2l" event={"ID":"9fe30511-54c3-4aef-b591-32426a623500","Type":"ContainerStarted","Data":"6aeb1670db01e45d13627c6354fdc565d8ab561d8e717b9fec41983711f10e10"}
Jul 20 13:07:06.478559 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:06.478509    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-8cn2l" podStartSLOduration=1.848032452 podStartE2EDuration="4.478493649s" totalImagesPullingTime="2.630461197s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:07:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:07:06.4778302 +0000 UTC m=+332.947362320" watchObservedRunningTime="2026-07-20 13:07:06.478493649 +0000 UTC m=+332.948025767"
Jul 20 13:07:07.271688 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:07.271649    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:07:07.368457 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:07.368425    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:07:09.524370 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:09.524333    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:07:21.427721 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:21.427684    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:07:21.521339 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:21.521300    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:07:22.028766 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:22.028727    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:07:22.286470 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:22.286327    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:07:22.387438 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:22.387397    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:07:22.416543 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:22.416512    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85766d874c-9fqjb"]
Jul 20 13:07:22.422133 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:22.422095    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-85766d874c-9fqjb"
Jul 20 13:07:22.424734 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:22.424702    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 20 13:07:22.424858 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:22.424736    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 20 13:07:22.424993 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:22.424977    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 20 13:07:22.425227 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:22.425210    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-s8pp8\""
Jul 20 13:07:22.425288 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:22.425270    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 20 13:07:22.434886 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:22.434862    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85766d874c-9fqjb"]
Jul 20 13:07:22.459702 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:22.459678    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a115c00e-4e1b-4c5d-9ebd-c7d6e3dcfd45-tmp\") pod \"opendatahub-operator-controller-manager-85766d874c-9fqjb\" (UID: \"a115c00e-4e1b-4c5d-9ebd-c7d6e3dcfd45\") " pod="opendatahub/opendatahub-operator-controller-manager-85766d874c-9fqjb"
Jul 20 13:07:22.459808 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:22.459713    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a115c00e-4e1b-4c5d-9ebd-c7d6e3dcfd45-webhook-cert\") pod \"opendatahub-operator-controller-manager-85766d874c-9fqjb\" (UID: \"a115c00e-4e1b-4c5d-9ebd-c7d6e3dcfd45\") " pod="opendatahub/opendatahub-operator-controller-manager-85766d874c-9fqjb"
Jul 20 13:07:22.459808 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:22.459737    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a115c00e-4e1b-4c5d-9ebd-c7d6e3dcfd45-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85766d874c-9fqjb\" (UID: \"a115c00e-4e1b-4c5d-9ebd-c7d6e3dcfd45\") " pod="opendatahub/opendatahub-operator-controller-manager-85766d874c-9fqjb"
Jul 20 13:07:22.459808 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:22.459793    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hh2b\" (UniqueName: \"kubernetes.io/projected/a115c00e-4e1b-4c5d-9ebd-c7d6e3dcfd45-kube-api-access-4hh2b\") pod \"opendatahub-operator-controller-manager-85766d874c-9fqjb\" (UID: \"a115c00e-4e1b-4c5d-9ebd-c7d6e3dcfd45\") " pod="opendatahub/opendatahub-operator-controller-manager-85766d874c-9fqjb"
Jul 20 13:07:22.459926 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:22.459868    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a115c00e-4e1b-4c5d-9ebd-c7d6e3dcfd45-manifests\") pod \"opendatahub-operator-controller-manager-85766d874c-9fqjb\" (UID: \"a115c00e-4e1b-4c5d-9ebd-c7d6e3dcfd45\") " pod="opendatahub/opendatahub-operator-controller-manager-85766d874c-9fqjb"
Jul 20 13:07:22.556452 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:22.556345    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:07:22.560470 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:22.560450    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a115c00e-4e1b-4c5d-9ebd-c7d6e3dcfd45-manifests\") pod \"opendatahub-operator-controller-manager-85766d874c-9fqjb\" (UID: \"a115c00e-4e1b-4c5d-9ebd-c7d6e3dcfd45\") " pod="opendatahub/opendatahub-operator-controller-manager-85766d874c-9fqjb"
Jul 20 13:07:22.560551 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:22.560484    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a115c00e-4e1b-4c5d-9ebd-c7d6e3dcfd45-tmp\") pod \"opendatahub-operator-controller-manager-85766d874c-9fqjb\" (UID: \"a115c00e-4e1b-4c5d-9ebd-c7d6e3dcfd45\") " pod="opendatahub/opendatahub-operator-controller-manager-85766d874c-9fqjb"
Jul 20 13:07:22.560551 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:22.560515    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a115c00e-4e1b-4c5d-9ebd-c7d6e3dcfd45-webhook-cert\") pod \"opendatahub-operator-controller-manager-85766d874c-9fqjb\" (UID: \"a115c00e-4e1b-4c5d-9ebd-c7d6e3dcfd45\") " pod="opendatahub/opendatahub-operator-controller-manager-85766d874c-9fqjb"
Jul 20 13:07:22.560551 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:22.560541    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a115c00e-4e1b-4c5d-9ebd-c7d6e3dcfd45-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85766d874c-9fqjb\" (UID: \"a115c00e-4e1b-4c5d-9ebd-c7d6e3dcfd45\") " pod="opendatahub/opendatahub-operator-controller-manager-85766d874c-9fqjb"
Jul 20 13:07:22.560698 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:22.560570    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hh2b\" (UniqueName: \"kubernetes.io/projected/a115c00e-4e1b-4c5d-9ebd-c7d6e3dcfd45-kube-api-access-4hh2b\") pod \"opendatahub-operator-controller-manager-85766d874c-9fqjb\" (UID: \"a115c00e-4e1b-4c5d-9ebd-c7d6e3dcfd45\") " pod="opendatahub/opendatahub-operator-controller-manager-85766d874c-9fqjb"
Jul 20 13:07:22.560872 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:22.560849    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/a115c00e-4e1b-4c5d-9ebd-c7d6e3dcfd45-manifests\") pod \"opendatahub-operator-controller-manager-85766d874c-9fqjb\" (UID: \"a115c00e-4e1b-4c5d-9ebd-c7d6e3dcfd45\") " pod="opendatahub/opendatahub-operator-controller-manager-85766d874c-9fqjb"
Jul 20 13:07:22.562898 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:22.562866    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a115c00e-4e1b-4c5d-9ebd-c7d6e3dcfd45-tmp\") pod \"opendatahub-operator-controller-manager-85766d874c-9fqjb\" (UID: \"a115c00e-4e1b-4c5d-9ebd-c7d6e3dcfd45\") " pod="opendatahub/opendatahub-operator-controller-manager-85766d874c-9fqjb"
Jul 20 13:07:22.563010 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:22.562961    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/a115c00e-4e1b-4c5d-9ebd-c7d6e3dcfd45-apiservice-cert\") pod \"opendatahub-operator-controller-manager-85766d874c-9fqjb\" (UID: \"a115c00e-4e1b-4c5d-9ebd-c7d6e3dcfd45\") " pod="opendatahub/opendatahub-operator-controller-manager-85766d874c-9fqjb"
Jul 20 13:07:22.563070 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:22.563038    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/a115c00e-4e1b-4c5d-9ebd-c7d6e3dcfd45-webhook-cert\") pod \"opendatahub-operator-controller-manager-85766d874c-9fqjb\" (UID: \"a115c00e-4e1b-4c5d-9ebd-c7d6e3dcfd45\") " pod="opendatahub/opendatahub-operator-controller-manager-85766d874c-9fqjb"
Jul 20 13:07:22.568904 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:22.568881    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hh2b\" (UniqueName: \"kubernetes.io/projected/a115c00e-4e1b-4c5d-9ebd-c7d6e3dcfd45-kube-api-access-4hh2b\") pod \"opendatahub-operator-controller-manager-85766d874c-9fqjb\" (UID: \"a115c00e-4e1b-4c5d-9ebd-c7d6e3dcfd45\") " pod="opendatahub/opendatahub-operator-controller-manager-85766d874c-9fqjb"
Jul 20 13:07:22.654428 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:22.654393    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:07:22.732321 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:22.732283    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-85766d874c-9fqjb"
Jul 20 13:07:22.758315 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:22.758280    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:07:22.855691 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:22.855653    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:07:22.865606 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:22.865563    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-85766d874c-9fqjb"]
Jul 20 13:07:22.868013 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:07:22.867989    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda115c00e_4e1b_4c5d_9ebd_c7d6e3dcfd45.slice/crio-7c914f9084bec00a6af128b5267187ff6da30c7c97a0909c75570a5b417b005d WatchSource:0}: Error finding container 7c914f9084bec00a6af128b5267187ff6da30c7c97a0909c75570a5b417b005d: Status 404 returned error can't find the container with id 7c914f9084bec00a6af128b5267187ff6da30c7c97a0909c75570a5b417b005d
Jul 20 13:07:22.935776 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:22.935744    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:07:23.519942 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:23.519894    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85766d874c-9fqjb" event={"ID":"a115c00e-4e1b-4c5d-9ebd-c7d6e3dcfd45","Type":"ContainerStarted","Data":"7c914f9084bec00a6af128b5267187ff6da30c7c97a0909c75570a5b417b005d"}
Jul 20 13:07:26.534669 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:26.534633    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85766d874c-9fqjb" event={"ID":"a115c00e-4e1b-4c5d-9ebd-c7d6e3dcfd45","Type":"ContainerStarted","Data":"e56bb4a6ded4af4f7799905680c3816ee2d1ad51f6be71f4df6fe245b79fa654"}
Jul 20 13:07:27.540122 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:27.540086    2565 generic.go:356] "Generic (PLEG): container finished" podID="a115c00e-4e1b-4c5d-9ebd-c7d6e3dcfd45" containerID="e56bb4a6ded4af4f7799905680c3816ee2d1ad51f6be71f4df6fe245b79fa654" exitCode=0
Jul 20 13:07:27.540533 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:27.540132    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85766d874c-9fqjb" event={"ID":"a115c00e-4e1b-4c5d-9ebd-c7d6e3dcfd45","Type":"ContainerDied","Data":"e56bb4a6ded4af4f7799905680c3816ee2d1ad51f6be71f4df6fe245b79fa654"}
Jul 20 13:07:27.815967 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:27.815864    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:07:27.910526 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:27.910490    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:07:29.550685 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:29.550650    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-85766d874c-9fqjb" event={"ID":"a115c00e-4e1b-4c5d-9ebd-c7d6e3dcfd45","Type":"ContainerStarted","Data":"710b7a238d7b31c1c06cb038e104ca930ab337c38cf2a2f155c6573c9d3d3508"}
Jul 20 13:07:29.551064 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:29.550807    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-85766d874c-9fqjb"
Jul 20 13:07:29.576810 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:29.576765    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-85766d874c-9fqjb" podStartSLOduration=1.612596206 podStartE2EDuration="7.576750767s" totalImagesPullingTime="4.891338503s" totalInitContainerRuntime="1.072816058s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:07:22 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:07:29.574131524 +0000 UTC m=+356.043663641" watchObservedRunningTime="2026-07-20 13:07:29.576750767 +0000 UTC m=+356.046282886"
Jul 20 13:07:40.556695 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:40.556661    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-85766d874c-9fqjb"
Jul 20 13:07:42.329725 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:42.329676    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:07:42.414887 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:42.414847    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:07:42.712264 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:42.712231    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:07:42.795547 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:42.795512    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-7bb65f5cb7-h75tq"]
Jul 20 13:07:42.804210 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:42.804187    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7bb65f5cb7-h75tq"
Jul 20 13:07:42.806932 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:42.806911    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 20 13:07:42.808049 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:42.808028    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-69lqz\""
Jul 20 13:07:42.808211 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:42.808185    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 20 13:07:42.808319 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:42.808031    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 20 13:07:42.808407 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:42.808387    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 20 13:07:42.810100 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:42.810075    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7bb65f5cb7-h75tq"]
Jul 20 13:07:42.836308 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:42.836286    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:07:42.924367 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:42.924326    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6eca5b4b-df68-40f8-a84e-8c074aa8e4a3-tmp\") pod \"kube-auth-proxy-7bb65f5cb7-h75tq\" (UID: \"6eca5b4b-df68-40f8-a84e-8c074aa8e4a3\") " pod="openshift-ingress/kube-auth-proxy-7bb65f5cb7-h75tq"
Jul 20 13:07:42.924367 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:42.924369    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6eca5b4b-df68-40f8-a84e-8c074aa8e4a3-tls-certs\") pod \"kube-auth-proxy-7bb65f5cb7-h75tq\" (UID: \"6eca5b4b-df68-40f8-a84e-8c074aa8e4a3\") " pod="openshift-ingress/kube-auth-proxy-7bb65f5cb7-h75tq"
Jul 20 13:07:42.924573 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:42.924473    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hvv9d\" (UniqueName: \"kubernetes.io/projected/6eca5b4b-df68-40f8-a84e-8c074aa8e4a3-kube-api-access-hvv9d\") pod \"kube-auth-proxy-7bb65f5cb7-h75tq\" (UID: \"6eca5b4b-df68-40f8-a84e-8c074aa8e4a3\") " pod="openshift-ingress/kube-auth-proxy-7bb65f5cb7-h75tq"
Jul 20 13:07:42.941305 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:42.941264    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:07:43.025555 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:43.025474    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6eca5b4b-df68-40f8-a84e-8c074aa8e4a3-tmp\") pod \"kube-auth-proxy-7bb65f5cb7-h75tq\" (UID: \"6eca5b4b-df68-40f8-a84e-8c074aa8e4a3\") " pod="openshift-ingress/kube-auth-proxy-7bb65f5cb7-h75tq"
Jul 20 13:07:43.025555 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:43.025507    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6eca5b4b-df68-40f8-a84e-8c074aa8e4a3-tls-certs\") pod \"kube-auth-proxy-7bb65f5cb7-h75tq\" (UID: \"6eca5b4b-df68-40f8-a84e-8c074aa8e4a3\") " pod="openshift-ingress/kube-auth-proxy-7bb65f5cb7-h75tq"
Jul 20 13:07:43.025778 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:43.025658    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hvv9d\" (UniqueName: \"kubernetes.io/projected/6eca5b4b-df68-40f8-a84e-8c074aa8e4a3-kube-api-access-hvv9d\") pod \"kube-auth-proxy-7bb65f5cb7-h75tq\" (UID: \"6eca5b4b-df68-40f8-a84e-8c074aa8e4a3\") " pod="openshift-ingress/kube-auth-proxy-7bb65f5cb7-h75tq"
Jul 20 13:07:43.027670 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:43.027637    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6eca5b4b-df68-40f8-a84e-8c074aa8e4a3-tmp\") pod \"kube-auth-proxy-7bb65f5cb7-h75tq\" (UID: \"6eca5b4b-df68-40f8-a84e-8c074aa8e4a3\") " pod="openshift-ingress/kube-auth-proxy-7bb65f5cb7-h75tq"
Jul 20 13:07:43.027907 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:43.027888    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/6eca5b4b-df68-40f8-a84e-8c074aa8e4a3-tls-certs\") pod \"kube-auth-proxy-7bb65f5cb7-h75tq\" (UID: \"6eca5b4b-df68-40f8-a84e-8c074aa8e4a3\") " pod="openshift-ingress/kube-auth-proxy-7bb65f5cb7-h75tq"
Jul 20 13:07:43.035503 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:43.035483    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hvv9d\" (UniqueName: \"kubernetes.io/projected/6eca5b4b-df68-40f8-a84e-8c074aa8e4a3-kube-api-access-hvv9d\") pod \"kube-auth-proxy-7bb65f5cb7-h75tq\" (UID: \"6eca5b4b-df68-40f8-a84e-8c074aa8e4a3\") " pod="openshift-ingress/kube-auth-proxy-7bb65f5cb7-h75tq"
Jul 20 13:07:43.039759 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:43.039730    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:07:43.114647 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:43.114618    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-7bb65f5cb7-h75tq"
Jul 20 13:07:43.139457 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:43.139406    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:07:43.254503 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:43.254472    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-7bb65f5cb7-h75tq"]
Jul 20 13:07:43.257305 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:07:43.257279    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6eca5b4b_df68_40f8_a84e_8c074aa8e4a3.slice/crio-36efd06cac5ea1445f492d0fc4e6a9897e510a595003bbd204a0ec5b6a342df1 WatchSource:0}: Error finding container 36efd06cac5ea1445f492d0fc4e6a9897e510a595003bbd204a0ec5b6a342df1: Status 404 returned error can't find the container with id 36efd06cac5ea1445f492d0fc4e6a9897e510a595003bbd204a0ec5b6a342df1
Jul 20 13:07:43.369505 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:43.369471    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:07:43.482786 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:43.482755    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:07:43.612042 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:43.612006    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7bb65f5cb7-h75tq" event={"ID":"6eca5b4b-df68-40f8-a84e-8c074aa8e4a3","Type":"ContainerStarted","Data":"36efd06cac5ea1445f492d0fc4e6a9897e510a595003bbd204a0ec5b6a342df1"}
Jul 20 13:07:43.745984 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:43.745895    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:07:44.024322 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:44.024233    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:07:44.092010 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:44.091965    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:07:44.982230 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:44.982194    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:07:46.624438 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:46.624399    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-7bb65f5cb7-h75tq" event={"ID":"6eca5b4b-df68-40f8-a84e-8c074aa8e4a3","Type":"ContainerStarted","Data":"756f93eb4d536fd656cf44c92dca8c008f9c14f0312f38c754c430a3b9a3d390"}
Jul 20 13:07:46.641147 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:46.641100    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-7bb65f5cb7-h75tq" podStartSLOduration=1.5497963289999999 podStartE2EDuration="4.641085869s" totalImagesPullingTime="3.09128954s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:07:42 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:07:46.640538421 +0000 UTC m=+373.110070542" watchObservedRunningTime="2026-07-20 13:07:46.641085869 +0000 UTC m=+373.110617988"
Jul 20 13:07:49.792413 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:49.792353    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:07:49.834797 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:49.834769    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xcsst"]
Jul 20 13:07:49.837881 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:49.837866    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xcsst"
Jul 20 13:07:49.842115 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:49.842095    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 20 13:07:49.842266 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:49.842255    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 20 13:07:49.842333 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:49.842310    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-7ctwb\""
Jul 20 13:07:49.842500 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:49.842485    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 20 13:07:49.842851 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:49.842835    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 20 13:07:49.852511 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:49.852489    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xcsst"]
Jul 20 13:07:49.875159 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:49.875132    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:07:49.980891 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:49.980861    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/acfd6445-aa5e-4353-ac49-245efb12fd9c-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-xcsst\" (UID: \"acfd6445-aa5e-4353-ac49-245efb12fd9c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xcsst"
Jul 20 13:07:49.980891 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:49.980895    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/acfd6445-aa5e-4353-ac49-245efb12fd9c-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-xcsst\" (UID: \"acfd6445-aa5e-4353-ac49-245efb12fd9c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xcsst"
Jul 20 13:07:49.981090 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:49.980912    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/acfd6445-aa5e-4353-ac49-245efb12fd9c-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-xcsst\" (UID: \"acfd6445-aa5e-4353-ac49-245efb12fd9c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xcsst"
Jul 20 13:07:49.981090 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:49.980931    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/acfd6445-aa5e-4353-ac49-245efb12fd9c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-xcsst\" (UID: \"acfd6445-aa5e-4353-ac49-245efb12fd9c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xcsst"
Jul 20 13:07:49.981090 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:49.980951    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/acfd6445-aa5e-4353-ac49-245efb12fd9c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-xcsst\" (UID: \"acfd6445-aa5e-4353-ac49-245efb12fd9c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xcsst"
Jul 20 13:07:49.981090 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:49.981071    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9d78\" (UniqueName: \"kubernetes.io/projected/acfd6445-aa5e-4353-ac49-245efb12fd9c-kube-api-access-j9d78\") pod \"istiod-openshift-gateway-94bb8fbfd-xcsst\" (UID: \"acfd6445-aa5e-4353-ac49-245efb12fd9c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xcsst"
Jul 20 13:07:49.981214 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:49.981122    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/acfd6445-aa5e-4353-ac49-245efb12fd9c-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-xcsst\" (UID: \"acfd6445-aa5e-4353-ac49-245efb12fd9c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xcsst"
Jul 20 13:07:50.082216 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:50.082144    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/acfd6445-aa5e-4353-ac49-245efb12fd9c-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-xcsst\" (UID: \"acfd6445-aa5e-4353-ac49-245efb12fd9c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xcsst"
Jul 20 13:07:50.082216 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:50.082180    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/acfd6445-aa5e-4353-ac49-245efb12fd9c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-xcsst\" (UID: \"acfd6445-aa5e-4353-ac49-245efb12fd9c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xcsst"
Jul 20 13:07:50.082216 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:50.082206    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/acfd6445-aa5e-4353-ac49-245efb12fd9c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-xcsst\" (UID: \"acfd6445-aa5e-4353-ac49-245efb12fd9c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xcsst"
Jul 20 13:07:50.082499 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:50.082267    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9d78\" (UniqueName: \"kubernetes.io/projected/acfd6445-aa5e-4353-ac49-245efb12fd9c-kube-api-access-j9d78\") pod \"istiod-openshift-gateway-94bb8fbfd-xcsst\" (UID: \"acfd6445-aa5e-4353-ac49-245efb12fd9c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xcsst"
Jul 20 13:07:50.082499 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:50.082307    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/acfd6445-aa5e-4353-ac49-245efb12fd9c-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-xcsst\" (UID: \"acfd6445-aa5e-4353-ac49-245efb12fd9c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xcsst"
Jul 20 13:07:50.082499 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:50.082346    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/acfd6445-aa5e-4353-ac49-245efb12fd9c-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-xcsst\" (UID: \"acfd6445-aa5e-4353-ac49-245efb12fd9c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xcsst"
Jul 20 13:07:50.082499 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:50.082395    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/acfd6445-aa5e-4353-ac49-245efb12fd9c-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-xcsst\" (UID: \"acfd6445-aa5e-4353-ac49-245efb12fd9c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xcsst"
Jul 20 13:07:50.082947 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:50.082922    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/acfd6445-aa5e-4353-ac49-245efb12fd9c-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-xcsst\" (UID: \"acfd6445-aa5e-4353-ac49-245efb12fd9c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xcsst"
Jul 20 13:07:50.084612 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:50.084585    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/acfd6445-aa5e-4353-ac49-245efb12fd9c-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-xcsst\" (UID: \"acfd6445-aa5e-4353-ac49-245efb12fd9c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xcsst"
Jul 20 13:07:50.084697 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:50.084621    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/acfd6445-aa5e-4353-ac49-245efb12fd9c-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-xcsst\" (UID: \"acfd6445-aa5e-4353-ac49-245efb12fd9c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xcsst"
Jul 20 13:07:50.085470 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:50.085452    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/acfd6445-aa5e-4353-ac49-245efb12fd9c-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-xcsst\" (UID: \"acfd6445-aa5e-4353-ac49-245efb12fd9c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xcsst"
Jul 20 13:07:50.085517 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:50.085484    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/acfd6445-aa5e-4353-ac49-245efb12fd9c-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-xcsst\" (UID: \"acfd6445-aa5e-4353-ac49-245efb12fd9c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xcsst"
Jul 20 13:07:50.116739 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:50.116712    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9d78\" (UniqueName: \"kubernetes.io/projected/acfd6445-aa5e-4353-ac49-245efb12fd9c-kube-api-access-j9d78\") pod \"istiod-openshift-gateway-94bb8fbfd-xcsst\" (UID: \"acfd6445-aa5e-4353-ac49-245efb12fd9c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xcsst"
Jul 20 13:07:50.118595 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:50.118569    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/acfd6445-aa5e-4353-ac49-245efb12fd9c-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-xcsst\" (UID: \"acfd6445-aa5e-4353-ac49-245efb12fd9c\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xcsst"
Jul 20 13:07:50.147519 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:50.147495    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xcsst"
Jul 20 13:07:50.165555 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:50.165528    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:07:50.284847 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:50.284824    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xcsst"]
Jul 20 13:07:50.286784 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:07:50.286756    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podacfd6445_aa5e_4353_ac49_245efb12fd9c.slice/crio-a4e98833d7e1bf6ebc597ad144501752a48b351d0e052f47b48274246b4cb9da WatchSource:0}: Error finding container a4e98833d7e1bf6ebc597ad144501752a48b351d0e052f47b48274246b4cb9da: Status 404 returned error can't find the container with id a4e98833d7e1bf6ebc597ad144501752a48b351d0e052f47b48274246b4cb9da
Jul 20 13:07:50.308570 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:50.308518    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:07:50.373510 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:50.373466    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:07:50.642330 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:50.642242    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xcsst" event={"ID":"acfd6445-aa5e-4353-ac49-245efb12fd9c","Type":"ContainerStarted","Data":"a4e98833d7e1bf6ebc597ad144501752a48b351d0e052f47b48274246b4cb9da"}
Jul 20 13:07:52.955541 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:52.955474    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:07:53.055877 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:53.055839    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-jj2ts"]
Jul 20 13:07:53.059114 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:53.059086    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jj2ts"
Jul 20 13:07:53.061007 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:53.060980    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:07:53.062545 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:53.062523    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\""
Jul 20 13:07:53.063064 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:53.063049    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-4bnwc\""
Jul 20 13:07:53.071957 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:53.071928    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-jj2ts"]
Jul 20 13:07:53.094231 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:53.094185    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 13:07:53.094387 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:53.094261    2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"}
Jul 20 13:07:53.168164 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:53.168132    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:07:53.209228 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:53.209136    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/43326e41-9683-41e8-b6f8-4582eb4790ff-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-jj2ts\" (UID: \"43326e41-9683-41e8-b6f8-4582eb4790ff\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jj2ts"
Jul 20 13:07:53.209228 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:53.209191    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnk2n\" (UniqueName: \"kubernetes.io/projected/43326e41-9683-41e8-b6f8-4582eb4790ff-kube-api-access-tnk2n\") pod \"llmisvc-controller-manager-777c6bd7d5-jj2ts\" (UID: \"43326e41-9683-41e8-b6f8-4582eb4790ff\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jj2ts"
Jul 20 13:07:53.283981 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:53.283912    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:07:53.309979 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:53.309947    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/43326e41-9683-41e8-b6f8-4582eb4790ff-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-jj2ts\" (UID: \"43326e41-9683-41e8-b6f8-4582eb4790ff\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jj2ts"
Jul 20 13:07:53.310133 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:53.309987    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnk2n\" (UniqueName: \"kubernetes.io/projected/43326e41-9683-41e8-b6f8-4582eb4790ff-kube-api-access-tnk2n\") pod \"llmisvc-controller-manager-777c6bd7d5-jj2ts\" (UID: \"43326e41-9683-41e8-b6f8-4582eb4790ff\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jj2ts"
Jul 20 13:07:53.312676 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:53.312653    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/43326e41-9683-41e8-b6f8-4582eb4790ff-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-jj2ts\" (UID: \"43326e41-9683-41e8-b6f8-4582eb4790ff\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jj2ts"
Jul 20 13:07:53.319936 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:53.319910    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnk2n\" (UniqueName: \"kubernetes.io/projected/43326e41-9683-41e8-b6f8-4582eb4790ff-kube-api-access-tnk2n\") pod \"llmisvc-controller-manager-777c6bd7d5-jj2ts\" (UID: \"43326e41-9683-41e8-b6f8-4582eb4790ff\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jj2ts"
Jul 20 13:07:53.370879 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:53.370848    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jj2ts"
Jul 20 13:07:53.551815 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:53.551722    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-jj2ts"]
Jul 20 13:07:53.554893 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:07:53.554864    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod43326e41_9683_41e8_b6f8_4582eb4790ff.slice/crio-9e0e121e75ee951eae13fc74b6a0e8346bacdd2c68802b96286f6d3b4e6363f1 WatchSource:0}: Error finding container 9e0e121e75ee951eae13fc74b6a0e8346bacdd2c68802b96286f6d3b4e6363f1: Status 404 returned error can't find the container with id 9e0e121e75ee951eae13fc74b6a0e8346bacdd2c68802b96286f6d3b4e6363f1
Jul 20 13:07:53.646063 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:53.646031    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:07:53.656115 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:53.656083    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jj2ts" event={"ID":"43326e41-9683-41e8-b6f8-4582eb4790ff","Type":"ContainerStarted","Data":"9e0e121e75ee951eae13fc74b6a0e8346bacdd2c68802b96286f6d3b4e6363f1"}
Jul 20 13:07:53.657737 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:53.657713    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xcsst" event={"ID":"acfd6445-aa5e-4353-ac49-245efb12fd9c","Type":"ContainerStarted","Data":"33d0abf33682a8b33c82854ab9d91d6f7944066d21168eb1e38798e7cf39ab1a"}
Jul 20 13:07:53.657846 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:53.657828    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xcsst"
Jul 20 13:07:53.690753 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:53.690712    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xcsst" podStartSLOduration=1.8855478159999999 podStartE2EDuration="4.690695668s" totalImagesPullingTime="2.805147852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:07:49 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:07:53.68843879 +0000 UTC m=+380.157970918" watchObservedRunningTime="2026-07-20 13:07:53.690695668 +0000 UTC m=+380.160227786"
Jul 20 13:07:54.310944 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:54.310908    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:07:54.409327 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:54.409289    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:07:54.665393 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:54.665227    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-xcsst"
Jul 20 13:07:55.140395 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:55.140336    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:07:57.676272 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:57.676238    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jj2ts" event={"ID":"43326e41-9683-41e8-b6f8-4582eb4790ff","Type":"ContainerStarted","Data":"7a8c996940867f9d395877426b13bc831b9c810fafb4293281208e8af9d51d40"}
Jul 20 13:07:57.676687 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:57.676440    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jj2ts"
Jul 20 13:07:57.693217 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:07:57.693172    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jj2ts" podStartSLOduration=1.6196657669999999 podStartE2EDuration="4.693158194s" totalImagesPullingTime="3.073492427s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:07:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:07:57.692818896 +0000 UTC m=+384.162351015" watchObservedRunningTime="2026-07-20 13:07:57.693158194 +0000 UTC m=+384.162690313"
Jul 20 13:08:28.682883 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:08:28.682851    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jj2ts"
Jul 20 13:08:43.836019 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:08:43.835976    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:08:43.941666 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:08:43.941569    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:08:44.002043 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:08:44.002012    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:08:46.937016 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:08:46.936976    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:08:46.991285 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:08:46.991255    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:08:48.883729 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:08:48.883696    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:08:48.984661 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:08:48.984628    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:08:59.343469 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:08:59.343384    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rczz4"]
Jul 20 13:08:59.346623 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:08:59.346606    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rczz4"
Jul 20 13:08:59.349449 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:08:59.349422    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 20 13:08:59.349570 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:08:59.349455    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 20 13:08:59.349570 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:08:59.349540    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-kpwv5\""
Jul 20 13:08:59.355003 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:08:59.354983    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rczz4"]
Jul 20 13:08:59.426676 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:08:59.426632    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bb9dl\" (UniqueName: \"kubernetes.io/projected/c69d34f8-9dd2-4b23-a74d-50ccf4908e71-kube-api-access-bb9dl\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rczz4\" (UID: \"c69d34f8-9dd2-4b23-a74d-50ccf4908e71\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rczz4"
Jul 20 13:08:59.426848 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:08:59.426700    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c69d34f8-9dd2-4b23-a74d-50ccf4908e71-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rczz4\" (UID: \"c69d34f8-9dd2-4b23-a74d-50ccf4908e71\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rczz4"
Jul 20 13:08:59.426848 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:08:59.426731    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c69d34f8-9dd2-4b23-a74d-50ccf4908e71-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rczz4\" (UID: \"c69d34f8-9dd2-4b23-a74d-50ccf4908e71\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rczz4"
Jul 20 13:08:59.527082 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:08:59.527046    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c69d34f8-9dd2-4b23-a74d-50ccf4908e71-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rczz4\" (UID: \"c69d34f8-9dd2-4b23-a74d-50ccf4908e71\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rczz4"
Jul 20 13:08:59.527259 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:08:59.527106    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bb9dl\" (UniqueName: \"kubernetes.io/projected/c69d34f8-9dd2-4b23-a74d-50ccf4908e71-kube-api-access-bb9dl\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rczz4\" (UID: \"c69d34f8-9dd2-4b23-a74d-50ccf4908e71\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rczz4"
Jul 20 13:08:59.527259 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:08:59.527147    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c69d34f8-9dd2-4b23-a74d-50ccf4908e71-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rczz4\" (UID: \"c69d34f8-9dd2-4b23-a74d-50ccf4908e71\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rczz4"
Jul 20 13:08:59.527456 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:08:59.527439    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c69d34f8-9dd2-4b23-a74d-50ccf4908e71-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rczz4\" (UID: \"c69d34f8-9dd2-4b23-a74d-50ccf4908e71\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rczz4"
Jul 20 13:08:59.527501 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:08:59.527469    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c69d34f8-9dd2-4b23-a74d-50ccf4908e71-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rczz4\" (UID: \"c69d34f8-9dd2-4b23-a74d-50ccf4908e71\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rczz4"
Jul 20 13:08:59.535992 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:08:59.535955    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bb9dl\" (UniqueName: \"kubernetes.io/projected/c69d34f8-9dd2-4b23-a74d-50ccf4908e71-kube-api-access-bb9dl\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rczz4\" (UID: \"c69d34f8-9dd2-4b23-a74d-50ccf4908e71\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rczz4"
Jul 20 13:08:59.656171 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:08:59.656134    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rczz4"
Jul 20 13:08:59.785303 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:08:59.785248    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rczz4"]
Jul 20 13:08:59.787496 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:08:59.787470    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc69d34f8_9dd2_4b23_a74d_50ccf4908e71.slice/crio-34e2feba215565a25af51b275549e78a141370b0d950adc6a3960598ce0b79df WatchSource:0}: Error finding container 34e2feba215565a25af51b275549e78a141370b0d950adc6a3960598ce0b79df: Status 404 returned error can't find the container with id 34e2feba215565a25af51b275549e78a141370b0d950adc6a3960598ce0b79df
Jul 20 13:08:59.931726 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:08:59.931646    2565 generic.go:356] "Generic (PLEG): container finished" podID="c69d34f8-9dd2-4b23-a74d-50ccf4908e71" containerID="d7681ce1ee34cfb88aff5a5f4ba1000a05bc8838f1e0bc20cc53bb84be5ad46b" exitCode=0
Jul 20 13:08:59.931726 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:08:59.931686    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rczz4" event={"ID":"c69d34f8-9dd2-4b23-a74d-50ccf4908e71","Type":"ContainerDied","Data":"d7681ce1ee34cfb88aff5a5f4ba1000a05bc8838f1e0bc20cc53bb84be5ad46b"}
Jul 20 13:08:59.931933 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:08:59.931764    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rczz4" event={"ID":"c69d34f8-9dd2-4b23-a74d-50ccf4908e71","Type":"ContainerStarted","Data":"34e2feba215565a25af51b275549e78a141370b0d950adc6a3960598ce0b79df"}
Jul 20 13:09:00.146128 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:00.146096    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592b2tj"]
Jul 20 13:09:00.149266 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:00.149251    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592b2tj"
Jul 20 13:09:00.155337 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:00.155313    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592b2tj"]
Jul 20 13:09:00.232644 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:00.232562    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86461128-7b52-486f-9e6f-6c557854d45e-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592b2tj\" (UID: \"86461128-7b52-486f-9e6f-6c557854d45e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592b2tj"
Jul 20 13:09:00.232644 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:00.232619    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86461128-7b52-486f-9e6f-6c557854d45e-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592b2tj\" (UID: \"86461128-7b52-486f-9e6f-6c557854d45e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592b2tj"
Jul 20 13:09:00.232827 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:00.232645    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4jjp\" (UniqueName: \"kubernetes.io/projected/86461128-7b52-486f-9e6f-6c557854d45e-kube-api-access-t4jjp\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592b2tj\" (UID: \"86461128-7b52-486f-9e6f-6c557854d45e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592b2tj"
Jul 20 13:09:00.333674 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:00.333637    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86461128-7b52-486f-9e6f-6c557854d45e-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592b2tj\" (UID: \"86461128-7b52-486f-9e6f-6c557854d45e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592b2tj"
Jul 20 13:09:00.333856 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:00.333700    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86461128-7b52-486f-9e6f-6c557854d45e-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592b2tj\" (UID: \"86461128-7b52-486f-9e6f-6c557854d45e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592b2tj"
Jul 20 13:09:00.333856 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:00.333743    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4jjp\" (UniqueName: \"kubernetes.io/projected/86461128-7b52-486f-9e6f-6c557854d45e-kube-api-access-t4jjp\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592b2tj\" (UID: \"86461128-7b52-486f-9e6f-6c557854d45e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592b2tj"
Jul 20 13:09:00.334016 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:00.333999    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86461128-7b52-486f-9e6f-6c557854d45e-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592b2tj\" (UID: \"86461128-7b52-486f-9e6f-6c557854d45e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592b2tj"
Jul 20 13:09:00.334084 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:00.334067    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86461128-7b52-486f-9e6f-6c557854d45e-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592b2tj\" (UID: \"86461128-7b52-486f-9e6f-6c557854d45e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592b2tj"
Jul 20 13:09:00.343084 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:00.343059    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4jjp\" (UniqueName: \"kubernetes.io/projected/86461128-7b52-486f-9e6f-6c557854d45e-kube-api-access-t4jjp\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592b2tj\" (UID: \"86461128-7b52-486f-9e6f-6c557854d45e\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592b2tj"
Jul 20 13:09:00.459379 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:00.459322    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592b2tj"
Jul 20 13:09:00.594424 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:00.594400    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592b2tj"]
Jul 20 13:09:00.638646 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:09:00.638607    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86461128_7b52_486f_9e6f_6c557854d45e.slice/crio-7a1f64e3573e42b29a495a9d41b3bfed2f51bbaa7baa09cb14e025bd52c4b311 WatchSource:0}: Error finding container 7a1f64e3573e42b29a495a9d41b3bfed2f51bbaa7baa09cb14e025bd52c4b311: Status 404 returned error can't find the container with id 7a1f64e3573e42b29a495a9d41b3bfed2f51bbaa7baa09cb14e025bd52c4b311
Jul 20 13:09:00.939560 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:00.939527    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fbnlh"]
Jul 20 13:09:00.941961 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:00.941933    2565 generic.go:356] "Generic (PLEG): container finished" podID="c69d34f8-9dd2-4b23-a74d-50ccf4908e71" containerID="ec01932461ae2c1bed7576cbdb95bd928edd9ff3570ac65ca5379f95a94ea669" exitCode=0
Jul 20 13:09:00.942989 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:00.942969    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rczz4" event={"ID":"c69d34f8-9dd2-4b23-a74d-50ccf4908e71","Type":"ContainerDied","Data":"ec01932461ae2c1bed7576cbdb95bd928edd9ff3570ac65ca5379f95a94ea669"}
Jul 20 13:09:00.943104 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:00.943063    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fbnlh"
Jul 20 13:09:00.943765 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:00.943741    2565 generic.go:356] "Generic (PLEG): container finished" podID="86461128-7b52-486f-9e6f-6c557854d45e" containerID="d93e6bddab6cc5f449236c6e57b5db195db73f362cb06726f83de6de0adb4a4f" exitCode=0
Jul 20 13:09:00.943832 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:00.943783    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592b2tj" event={"ID":"86461128-7b52-486f-9e6f-6c557854d45e","Type":"ContainerDied","Data":"d93e6bddab6cc5f449236c6e57b5db195db73f362cb06726f83de6de0adb4a4f"}
Jul 20 13:09:00.943832 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:00.943814    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592b2tj" event={"ID":"86461128-7b52-486f-9e6f-6c557854d45e","Type":"ContainerStarted","Data":"7a1f64e3573e42b29a495a9d41b3bfed2f51bbaa7baa09cb14e025bd52c4b311"}
Jul 20 13:09:00.953255 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:00.953230    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fbnlh"]
Jul 20 13:09:01.040111 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:01.039789    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vhm6c\" (UniqueName: \"kubernetes.io/projected/da3ca765-f6e9-4de4-b14f-da895187dc8a-kube-api-access-vhm6c\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fbnlh\" (UID: \"da3ca765-f6e9-4de4-b14f-da895187dc8a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fbnlh"
Jul 20 13:09:01.040111 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:01.039838    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da3ca765-f6e9-4de4-b14f-da895187dc8a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fbnlh\" (UID: \"da3ca765-f6e9-4de4-b14f-da895187dc8a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fbnlh"
Jul 20 13:09:01.040111 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:01.039876    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da3ca765-f6e9-4de4-b14f-da895187dc8a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fbnlh\" (UID: \"da3ca765-f6e9-4de4-b14f-da895187dc8a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fbnlh"
Jul 20 13:09:01.140971 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:01.140938    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vhm6c\" (UniqueName: \"kubernetes.io/projected/da3ca765-f6e9-4de4-b14f-da895187dc8a-kube-api-access-vhm6c\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fbnlh\" (UID: \"da3ca765-f6e9-4de4-b14f-da895187dc8a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fbnlh"
Jul 20 13:09:01.141141 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:01.140986    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da3ca765-f6e9-4de4-b14f-da895187dc8a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fbnlh\" (UID: \"da3ca765-f6e9-4de4-b14f-da895187dc8a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fbnlh"
Jul 20 13:09:01.141141 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:01.141014    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da3ca765-f6e9-4de4-b14f-da895187dc8a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fbnlh\" (UID: \"da3ca765-f6e9-4de4-b14f-da895187dc8a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fbnlh"
Jul 20 13:09:01.141453 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:01.141433    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da3ca765-f6e9-4de4-b14f-da895187dc8a-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fbnlh\" (UID: \"da3ca765-f6e9-4de4-b14f-da895187dc8a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fbnlh"
Jul 20 13:09:01.141512 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:01.141451    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da3ca765-f6e9-4de4-b14f-da895187dc8a-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fbnlh\" (UID: \"da3ca765-f6e9-4de4-b14f-da895187dc8a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fbnlh"
Jul 20 13:09:01.149487 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:01.149464    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vhm6c\" (UniqueName: \"kubernetes.io/projected/da3ca765-f6e9-4de4-b14f-da895187dc8a-kube-api-access-vhm6c\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fbnlh\" (UID: \"da3ca765-f6e9-4de4-b14f-da895187dc8a\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fbnlh"
Jul 20 13:09:01.254291 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:01.254260    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fbnlh"
Jul 20 13:09:01.342236 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:01.342206    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwrlk"]
Jul 20 13:09:01.346496 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:01.346478    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwrlk"
Jul 20 13:09:01.354489 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:01.354433    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwrlk"]
Jul 20 13:09:01.381958 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:01.381866    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fbnlh"]
Jul 20 13:09:01.384009 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:09:01.383985    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda3ca765_f6e9_4de4_b14f_da895187dc8a.slice/crio-b33a0b3bf21ebffe49a2efcbc0f703a19e30269adba8b37ff0f9e8d1453ee499 WatchSource:0}: Error finding container b33a0b3bf21ebffe49a2efcbc0f703a19e30269adba8b37ff0f9e8d1453ee499: Status 404 returned error can't find the container with id b33a0b3bf21ebffe49a2efcbc0f703a19e30269adba8b37ff0f9e8d1453ee499
Jul 20 13:09:01.444349 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:01.444324    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d02fb4bd-8b6a-4feb-9290-8c8f23e9a770-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwrlk\" (UID: \"d02fb4bd-8b6a-4feb-9290-8c8f23e9a770\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwrlk"
Jul 20 13:09:01.444475 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:01.444379    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gjjft\" (UniqueName: \"kubernetes.io/projected/d02fb4bd-8b6a-4feb-9290-8c8f23e9a770-kube-api-access-gjjft\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwrlk\" (UID: \"d02fb4bd-8b6a-4feb-9290-8c8f23e9a770\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwrlk"
Jul 20 13:09:01.444534 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:01.444498    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d02fb4bd-8b6a-4feb-9290-8c8f23e9a770-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwrlk\" (UID: \"d02fb4bd-8b6a-4feb-9290-8c8f23e9a770\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwrlk"
Jul 20 13:09:01.545255 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:01.545224    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d02fb4bd-8b6a-4feb-9290-8c8f23e9a770-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwrlk\" (UID: \"d02fb4bd-8b6a-4feb-9290-8c8f23e9a770\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwrlk"
Jul 20 13:09:01.545668 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:01.545310    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d02fb4bd-8b6a-4feb-9290-8c8f23e9a770-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwrlk\" (UID: \"d02fb4bd-8b6a-4feb-9290-8c8f23e9a770\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwrlk"
Jul 20 13:09:01.545668 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:01.545332    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gjjft\" (UniqueName: \"kubernetes.io/projected/d02fb4bd-8b6a-4feb-9290-8c8f23e9a770-kube-api-access-gjjft\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwrlk\" (UID: \"d02fb4bd-8b6a-4feb-9290-8c8f23e9a770\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwrlk"
Jul 20 13:09:01.545668 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:01.545617    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d02fb4bd-8b6a-4feb-9290-8c8f23e9a770-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwrlk\" (UID: \"d02fb4bd-8b6a-4feb-9290-8c8f23e9a770\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwrlk"
Jul 20 13:09:01.545822 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:01.545683    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d02fb4bd-8b6a-4feb-9290-8c8f23e9a770-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwrlk\" (UID: \"d02fb4bd-8b6a-4feb-9290-8c8f23e9a770\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwrlk"
Jul 20 13:09:01.554227 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:01.554169    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gjjft\" (UniqueName: \"kubernetes.io/projected/d02fb4bd-8b6a-4feb-9290-8c8f23e9a770-kube-api-access-gjjft\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwrlk\" (UID: \"d02fb4bd-8b6a-4feb-9290-8c8f23e9a770\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwrlk"
Jul 20 13:09:01.658283 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:01.658249    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwrlk"
Jul 20 13:09:01.782324 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:01.782301    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwrlk"]
Jul 20 13:09:01.784492 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:09:01.784465    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd02fb4bd_8b6a_4feb_9290_8c8f23e9a770.slice/crio-4bbc7a8e7383fa33ba78f417fdd7ac0dbef58c285d573472702334c6154c42ae WatchSource:0}: Error finding container 4bbc7a8e7383fa33ba78f417fdd7ac0dbef58c285d573472702334c6154c42ae: Status 404 returned error can't find the container with id 4bbc7a8e7383fa33ba78f417fdd7ac0dbef58c285d573472702334c6154c42ae
Jul 20 13:09:01.950073 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:01.950043    2565 generic.go:356] "Generic (PLEG): container finished" podID="da3ca765-f6e9-4de4-b14f-da895187dc8a" containerID="e7af611ffc8e5bb68d30e0292c9a4f0630dee397302e83cbc1353d3008fceb40" exitCode=0
Jul 20 13:09:01.950235 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:01.950138    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fbnlh" event={"ID":"da3ca765-f6e9-4de4-b14f-da895187dc8a","Type":"ContainerDied","Data":"e7af611ffc8e5bb68d30e0292c9a4f0630dee397302e83cbc1353d3008fceb40"}
Jul 20 13:09:01.950235 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:01.950200    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fbnlh" event={"ID":"da3ca765-f6e9-4de4-b14f-da895187dc8a","Type":"ContainerStarted","Data":"b33a0b3bf21ebffe49a2efcbc0f703a19e30269adba8b37ff0f9e8d1453ee499"}
Jul 20 13:09:01.952424 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:01.952330    2565 generic.go:356] "Generic (PLEG): container finished" podID="c69d34f8-9dd2-4b23-a74d-50ccf4908e71" containerID="30e723999496cc8932a983541a179c9a52ee649cd469b8b360fdb5a0d652dff0" exitCode=0
Jul 20 13:09:01.952424 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:01.952396    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rczz4" event={"ID":"c69d34f8-9dd2-4b23-a74d-50ccf4908e71","Type":"ContainerDied","Data":"30e723999496cc8932a983541a179c9a52ee649cd469b8b360fdb5a0d652dff0"}
Jul 20 13:09:01.953914 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:01.953885    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwrlk" event={"ID":"d02fb4bd-8b6a-4feb-9290-8c8f23e9a770","Type":"ContainerStarted","Data":"278596669b7ed15d5f385db8c08cfe500b48a155de25443a9a1361055951774f"}
Jul 20 13:09:01.954004 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:01.953927    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwrlk" event={"ID":"d02fb4bd-8b6a-4feb-9290-8c8f23e9a770","Type":"ContainerStarted","Data":"4bbc7a8e7383fa33ba78f417fdd7ac0dbef58c285d573472702334c6154c42ae"}
Jul 20 13:09:02.959637 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:02.959602    2565 generic.go:356] "Generic (PLEG): container finished" podID="da3ca765-f6e9-4de4-b14f-da895187dc8a" containerID="44639fd350664114028f8afd4fa15dcfa4a3e612df7b0a4bcec5d70461baea19" exitCode=0
Jul 20 13:09:02.959985 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:02.959696    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fbnlh" event={"ID":"da3ca765-f6e9-4de4-b14f-da895187dc8a","Type":"ContainerDied","Data":"44639fd350664114028f8afd4fa15dcfa4a3e612df7b0a4bcec5d70461baea19"}
Jul 20 13:09:02.961585 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:02.961560    2565 generic.go:356] "Generic (PLEG): container finished" podID="86461128-7b52-486f-9e6f-6c557854d45e" containerID="a709921acd3fa82d08aba106027a7de97aaf29ac764c9d7202761330b67d7710" exitCode=0
Jul 20 13:09:02.961692 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:02.961641    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592b2tj" event={"ID":"86461128-7b52-486f-9e6f-6c557854d45e","Type":"ContainerDied","Data":"a709921acd3fa82d08aba106027a7de97aaf29ac764c9d7202761330b67d7710"}
Jul 20 13:09:02.963681 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:02.963660    2565 generic.go:356] "Generic (PLEG): container finished" podID="d02fb4bd-8b6a-4feb-9290-8c8f23e9a770" containerID="278596669b7ed15d5f385db8c08cfe500b48a155de25443a9a1361055951774f" exitCode=0
Jul 20 13:09:02.963681 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:02.963678    2565 generic.go:356] "Generic (PLEG): container finished" podID="d02fb4bd-8b6a-4feb-9290-8c8f23e9a770" containerID="a0de80fee1e774d74eb5b895297a6b37f54cbdf5043d3b6d89569813e72ad567" exitCode=0
Jul 20 13:09:02.963829 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:02.963717    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwrlk" event={"ID":"d02fb4bd-8b6a-4feb-9290-8c8f23e9a770","Type":"ContainerDied","Data":"278596669b7ed15d5f385db8c08cfe500b48a155de25443a9a1361055951774f"}
Jul 20 13:09:02.963829 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:02.963753    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwrlk" event={"ID":"d02fb4bd-8b6a-4feb-9290-8c8f23e9a770","Type":"ContainerDied","Data":"a0de80fee1e774d74eb5b895297a6b37f54cbdf5043d3b6d89569813e72ad567"}
Jul 20 13:09:03.100283 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:03.100252    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rczz4"
Jul 20 13:09:03.259562 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:03.259535    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bb9dl\" (UniqueName: \"kubernetes.io/projected/c69d34f8-9dd2-4b23-a74d-50ccf4908e71-kube-api-access-bb9dl\") pod \"c69d34f8-9dd2-4b23-a74d-50ccf4908e71\" (UID: \"c69d34f8-9dd2-4b23-a74d-50ccf4908e71\") "
Jul 20 13:09:03.259704 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:03.259616    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c69d34f8-9dd2-4b23-a74d-50ccf4908e71-bundle\") pod \"c69d34f8-9dd2-4b23-a74d-50ccf4908e71\" (UID: \"c69d34f8-9dd2-4b23-a74d-50ccf4908e71\") "
Jul 20 13:09:03.259763 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:03.259708    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c69d34f8-9dd2-4b23-a74d-50ccf4908e71-util\") pod \"c69d34f8-9dd2-4b23-a74d-50ccf4908e71\" (UID: \"c69d34f8-9dd2-4b23-a74d-50ccf4908e71\") "
Jul 20 13:09:03.260076 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:03.260054    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c69d34f8-9dd2-4b23-a74d-50ccf4908e71-bundle" (OuterVolumeSpecName: "bundle") pod "c69d34f8-9dd2-4b23-a74d-50ccf4908e71" (UID: "c69d34f8-9dd2-4b23-a74d-50ccf4908e71"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:09:03.261757 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:03.261736    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c69d34f8-9dd2-4b23-a74d-50ccf4908e71-kube-api-access-bb9dl" (OuterVolumeSpecName: "kube-api-access-bb9dl") pod "c69d34f8-9dd2-4b23-a74d-50ccf4908e71" (UID: "c69d34f8-9dd2-4b23-a74d-50ccf4908e71"). InnerVolumeSpecName "kube-api-access-bb9dl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:09:03.264936 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:03.264912    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c69d34f8-9dd2-4b23-a74d-50ccf4908e71-util" (OuterVolumeSpecName: "util") pod "c69d34f8-9dd2-4b23-a74d-50ccf4908e71" (UID: "c69d34f8-9dd2-4b23-a74d-50ccf4908e71"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:09:03.361262 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:03.361233    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bb9dl\" (UniqueName: \"kubernetes.io/projected/c69d34f8-9dd2-4b23-a74d-50ccf4908e71-kube-api-access-bb9dl\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:09:03.361405 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:03.361266    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/c69d34f8-9dd2-4b23-a74d-50ccf4908e71-bundle\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:09:03.361405 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:03.361276    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/c69d34f8-9dd2-4b23-a74d-50ccf4908e71-util\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:09:03.970366 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:03.970327    2565 generic.go:356] "Generic (PLEG): container finished" podID="da3ca765-f6e9-4de4-b14f-da895187dc8a" containerID="f7c97ab942d2a5f0aa2ee3b3194f41c276e71e6b311896d58891392883f89489" exitCode=0
Jul 20 13:09:03.970782 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:03.970425    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fbnlh" event={"ID":"da3ca765-f6e9-4de4-b14f-da895187dc8a","Type":"ContainerDied","Data":"f7c97ab942d2a5f0aa2ee3b3194f41c276e71e6b311896d58891392883f89489"}
Jul 20 13:09:03.972465 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:03.972436    2565 generic.go:356] "Generic (PLEG): container finished" podID="86461128-7b52-486f-9e6f-6c557854d45e" containerID="fa36888b926569a1328b5a29fab41ea44302e5860008db15b3f9db34a52b89a3" exitCode=0
Jul 20 13:09:03.972589 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:03.972522    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592b2tj" event={"ID":"86461128-7b52-486f-9e6f-6c557854d45e","Type":"ContainerDied","Data":"fa36888b926569a1328b5a29fab41ea44302e5860008db15b3f9db34a52b89a3"}
Jul 20 13:09:03.974238 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:03.974219    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rczz4" event={"ID":"c69d34f8-9dd2-4b23-a74d-50ccf4908e71","Type":"ContainerDied","Data":"34e2feba215565a25af51b275549e78a141370b0d950adc6a3960598ce0b79df"}
Jul 20 13:09:03.974385 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:03.974255    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="34e2feba215565a25af51b275549e78a141370b0d950adc6a3960598ce0b79df"
Jul 20 13:09:03.974385 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:03.974224    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rczz4"
Jul 20 13:09:03.976272 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:03.976250    2565 generic.go:356] "Generic (PLEG): container finished" podID="d02fb4bd-8b6a-4feb-9290-8c8f23e9a770" containerID="e9ec9e05516aa747698299a1b00cf84784281c6d2bc20900a8661c98b2a8c397" exitCode=0
Jul 20 13:09:03.976369 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:03.976304    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwrlk" event={"ID":"d02fb4bd-8b6a-4feb-9290-8c8f23e9a770","Type":"ContainerDied","Data":"e9ec9e05516aa747698299a1b00cf84784281c6d2bc20900a8661c98b2a8c397"}
Jul 20 13:09:05.119375 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:05.119331    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fbnlh"
Jul 20 13:09:05.168763 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:05.168737    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592b2tj"
Jul 20 13:09:05.171454 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:05.171435    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwrlk"
Jul 20 13:09:05.277501 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:05.277409    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86461128-7b52-486f-9e6f-6c557854d45e-bundle\") pod \"86461128-7b52-486f-9e6f-6c557854d45e\" (UID: \"86461128-7b52-486f-9e6f-6c557854d45e\") "
Jul 20 13:09:05.277501 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:05.277447    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gjjft\" (UniqueName: \"kubernetes.io/projected/d02fb4bd-8b6a-4feb-9290-8c8f23e9a770-kube-api-access-gjjft\") pod \"d02fb4bd-8b6a-4feb-9290-8c8f23e9a770\" (UID: \"d02fb4bd-8b6a-4feb-9290-8c8f23e9a770\") "
Jul 20 13:09:05.277501 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:05.277469    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d02fb4bd-8b6a-4feb-9290-8c8f23e9a770-util\") pod \"d02fb4bd-8b6a-4feb-9290-8c8f23e9a770\" (UID: \"d02fb4bd-8b6a-4feb-9290-8c8f23e9a770\") "
Jul 20 13:09:05.277772 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:05.277520    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vhm6c\" (UniqueName: \"kubernetes.io/projected/da3ca765-f6e9-4de4-b14f-da895187dc8a-kube-api-access-vhm6c\") pod \"da3ca765-f6e9-4de4-b14f-da895187dc8a\" (UID: \"da3ca765-f6e9-4de4-b14f-da895187dc8a\") "
Jul 20 13:09:05.277772 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:05.277552    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t4jjp\" (UniqueName: \"kubernetes.io/projected/86461128-7b52-486f-9e6f-6c557854d45e-kube-api-access-t4jjp\") pod \"86461128-7b52-486f-9e6f-6c557854d45e\" (UID: \"86461128-7b52-486f-9e6f-6c557854d45e\") "
Jul 20 13:09:05.277772 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:05.277587    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86461128-7b52-486f-9e6f-6c557854d45e-util\") pod \"86461128-7b52-486f-9e6f-6c557854d45e\" (UID: \"86461128-7b52-486f-9e6f-6c557854d45e\") "
Jul 20 13:09:05.277772 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:05.277607    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da3ca765-f6e9-4de4-b14f-da895187dc8a-util\") pod \"da3ca765-f6e9-4de4-b14f-da895187dc8a\" (UID: \"da3ca765-f6e9-4de4-b14f-da895187dc8a\") "
Jul 20 13:09:05.277772 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:05.277640    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d02fb4bd-8b6a-4feb-9290-8c8f23e9a770-bundle\") pod \"d02fb4bd-8b6a-4feb-9290-8c8f23e9a770\" (UID: \"d02fb4bd-8b6a-4feb-9290-8c8f23e9a770\") "
Jul 20 13:09:05.277772 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:05.277665    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da3ca765-f6e9-4de4-b14f-da895187dc8a-bundle\") pod \"da3ca765-f6e9-4de4-b14f-da895187dc8a\" (UID: \"da3ca765-f6e9-4de4-b14f-da895187dc8a\") "
Jul 20 13:09:05.278102 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:05.278015    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86461128-7b52-486f-9e6f-6c557854d45e-bundle" (OuterVolumeSpecName: "bundle") pod "86461128-7b52-486f-9e6f-6c557854d45e" (UID: "86461128-7b52-486f-9e6f-6c557854d45e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:09:05.279074 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:05.278811    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d02fb4bd-8b6a-4feb-9290-8c8f23e9a770-bundle" (OuterVolumeSpecName: "bundle") pod "d02fb4bd-8b6a-4feb-9290-8c8f23e9a770" (UID: "d02fb4bd-8b6a-4feb-9290-8c8f23e9a770"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:09:05.279698 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:05.279660    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da3ca765-f6e9-4de4-b14f-da895187dc8a-bundle" (OuterVolumeSpecName: "bundle") pod "da3ca765-f6e9-4de4-b14f-da895187dc8a" (UID: "da3ca765-f6e9-4de4-b14f-da895187dc8a"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:09:05.280381 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:05.280333    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/da3ca765-f6e9-4de4-b14f-da895187dc8a-kube-api-access-vhm6c" (OuterVolumeSpecName: "kube-api-access-vhm6c") pod "da3ca765-f6e9-4de4-b14f-da895187dc8a" (UID: "da3ca765-f6e9-4de4-b14f-da895187dc8a"). InnerVolumeSpecName "kube-api-access-vhm6c". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:09:05.280480 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:05.280401    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d02fb4bd-8b6a-4feb-9290-8c8f23e9a770-kube-api-access-gjjft" (OuterVolumeSpecName: "kube-api-access-gjjft") pod "d02fb4bd-8b6a-4feb-9290-8c8f23e9a770" (UID: "d02fb4bd-8b6a-4feb-9290-8c8f23e9a770"). InnerVolumeSpecName "kube-api-access-gjjft". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:09:05.280480 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:05.280398    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86461128-7b52-486f-9e6f-6c557854d45e-kube-api-access-t4jjp" (OuterVolumeSpecName: "kube-api-access-t4jjp") pod "86461128-7b52-486f-9e6f-6c557854d45e" (UID: "86461128-7b52-486f-9e6f-6c557854d45e"). InnerVolumeSpecName "kube-api-access-t4jjp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:09:05.284254 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:05.284233    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d02fb4bd-8b6a-4feb-9290-8c8f23e9a770-util" (OuterVolumeSpecName: "util") pod "d02fb4bd-8b6a-4feb-9290-8c8f23e9a770" (UID: "d02fb4bd-8b6a-4feb-9290-8c8f23e9a770"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:09:05.284316 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:05.284276    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/da3ca765-f6e9-4de4-b14f-da895187dc8a-util" (OuterVolumeSpecName: "util") pod "da3ca765-f6e9-4de4-b14f-da895187dc8a" (UID: "da3ca765-f6e9-4de4-b14f-da895187dc8a"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:09:05.285612 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:05.285584    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/86461128-7b52-486f-9e6f-6c557854d45e-util" (OuterVolumeSpecName: "util") pod "86461128-7b52-486f-9e6f-6c557854d45e" (UID: "86461128-7b52-486f-9e6f-6c557854d45e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:09:05.379117 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:05.379074    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/86461128-7b52-486f-9e6f-6c557854d45e-util\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:09:05.379117 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:05.379108    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/da3ca765-f6e9-4de4-b14f-da895187dc8a-util\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:09:05.379117 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:05.379122    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/d02fb4bd-8b6a-4feb-9290-8c8f23e9a770-bundle\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:09:05.379404 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:05.379135    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/da3ca765-f6e9-4de4-b14f-da895187dc8a-bundle\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:09:05.379404 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:05.379146    2565 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/86461128-7b52-486f-9e6f-6c557854d45e-bundle\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:09:05.379404 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:05.379159    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gjjft\" (UniqueName: \"kubernetes.io/projected/d02fb4bd-8b6a-4feb-9290-8c8f23e9a770-kube-api-access-gjjft\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:09:05.379404 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:05.379172    2565 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/d02fb4bd-8b6a-4feb-9290-8c8f23e9a770-util\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:09:05.379404 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:05.379185    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vhm6c\" (UniqueName: \"kubernetes.io/projected/da3ca765-f6e9-4de4-b14f-da895187dc8a-kube-api-access-vhm6c\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:09:05.379404 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:05.379197    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t4jjp\" (UniqueName: \"kubernetes.io/projected/86461128-7b52-486f-9e6f-6c557854d45e-kube-api-access-t4jjp\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:09:05.989683 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:05.989647    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwrlk"
Jul 20 13:09:05.989847 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:05.989645    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwrlk" event={"ID":"d02fb4bd-8b6a-4feb-9290-8c8f23e9a770","Type":"ContainerDied","Data":"4bbc7a8e7383fa33ba78f417fdd7ac0dbef58c285d573472702334c6154c42ae"}
Jul 20 13:09:05.989847 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:05.989805    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4bbc7a8e7383fa33ba78f417fdd7ac0dbef58c285d573472702334c6154c42ae"
Jul 20 13:09:05.991564 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:05.991543    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fbnlh"
Jul 20 13:09:05.991564 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:05.991554    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fbnlh" event={"ID":"da3ca765-f6e9-4de4-b14f-da895187dc8a","Type":"ContainerDied","Data":"b33a0b3bf21ebffe49a2efcbc0f703a19e30269adba8b37ff0f9e8d1453ee499"}
Jul 20 13:09:05.991741 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:05.991596    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b33a0b3bf21ebffe49a2efcbc0f703a19e30269adba8b37ff0f9e8d1453ee499"
Jul 20 13:09:05.993524 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:05.993501    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592b2tj" event={"ID":"86461128-7b52-486f-9e6f-6c557854d45e","Type":"ContainerDied","Data":"7a1f64e3573e42b29a495a9d41b3bfed2f51bbaa7baa09cb14e025bd52c4b311"}
Jul 20 13:09:05.993637 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:05.993544    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7a1f64e3573e42b29a495a9d41b3bfed2f51bbaa7baa09cb14e025bd52c4b311"
Jul 20 13:09:05.993637 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:05.993507    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592b2tj"
Jul 20 13:09:18.569721 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:18.569690    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:09:19.572947 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:19.572908    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:09:25.388209 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:25.388170    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:09:27.501078 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:27.501041    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-t4n9j"]
Jul 20 13:09:27.501481 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:27.501313    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da3ca765-f6e9-4de4-b14f-da895187dc8a" containerName="util"
Jul 20 13:09:27.501481 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:27.501323    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="da3ca765-f6e9-4de4-b14f-da895187dc8a" containerName="util"
Jul 20 13:09:27.501481 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:27.501333    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da3ca765-f6e9-4de4-b14f-da895187dc8a" containerName="extract"
Jul 20 13:09:27.501481 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:27.501338    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="da3ca765-f6e9-4de4-b14f-da895187dc8a" containerName="extract"
Jul 20 13:09:27.501481 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:27.501349    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86461128-7b52-486f-9e6f-6c557854d45e" containerName="extract"
Jul 20 13:09:27.501481 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:27.501370    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="86461128-7b52-486f-9e6f-6c557854d45e" containerName="extract"
Jul 20 13:09:27.501481 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:27.501378    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86461128-7b52-486f-9e6f-6c557854d45e" containerName="util"
Jul 20 13:09:27.501481 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:27.501384    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="86461128-7b52-486f-9e6f-6c557854d45e" containerName="util"
Jul 20 13:09:27.501481 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:27.501389    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d02fb4bd-8b6a-4feb-9290-8c8f23e9a770" containerName="util"
Jul 20 13:09:27.501481 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:27.501395    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d02fb4bd-8b6a-4feb-9290-8c8f23e9a770" containerName="util"
Jul 20 13:09:27.501481 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:27.501401    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c69d34f8-9dd2-4b23-a74d-50ccf4908e71" containerName="extract"
Jul 20 13:09:27.501481 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:27.501406    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c69d34f8-9dd2-4b23-a74d-50ccf4908e71" containerName="extract"
Jul 20 13:09:27.501481 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:27.501418    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c69d34f8-9dd2-4b23-a74d-50ccf4908e71" containerName="util"
Jul 20 13:09:27.501481 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:27.501422    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c69d34f8-9dd2-4b23-a74d-50ccf4908e71" containerName="util"
Jul 20 13:09:27.501481 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:27.501429    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c69d34f8-9dd2-4b23-a74d-50ccf4908e71" containerName="pull"
Jul 20 13:09:27.501481 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:27.501433    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c69d34f8-9dd2-4b23-a74d-50ccf4908e71" containerName="pull"
Jul 20 13:09:27.501481 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:27.501441    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86461128-7b52-486f-9e6f-6c557854d45e" containerName="pull"
Jul 20 13:09:27.501481 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:27.501446    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="86461128-7b52-486f-9e6f-6c557854d45e" containerName="pull"
Jul 20 13:09:27.501481 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:27.501452    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d02fb4bd-8b6a-4feb-9290-8c8f23e9a770" containerName="pull"
Jul 20 13:09:27.501481 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:27.501457    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d02fb4bd-8b6a-4feb-9290-8c8f23e9a770" containerName="pull"
Jul 20 13:09:27.501481 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:27.501462    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="da3ca765-f6e9-4de4-b14f-da895187dc8a" containerName="pull"
Jul 20 13:09:27.501481 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:27.501467    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="da3ca765-f6e9-4de4-b14f-da895187dc8a" containerName="pull"
Jul 20 13:09:27.501481 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:27.501476    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d02fb4bd-8b6a-4feb-9290-8c8f23e9a770" containerName="extract"
Jul 20 13:09:27.501481 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:27.501481    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d02fb4bd-8b6a-4feb-9290-8c8f23e9a770" containerName="extract"
Jul 20 13:09:27.502240 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:27.501524    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="da3ca765-f6e9-4de4-b14f-da895187dc8a" containerName="extract"
Jul 20 13:09:27.502240 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:27.501533    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c69d34f8-9dd2-4b23-a74d-50ccf4908e71" containerName="extract"
Jul 20 13:09:27.502240 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:27.501538    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d02fb4bd-8b6a-4feb-9290-8c8f23e9a770" containerName="extract"
Jul 20 13:09:27.502240 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:27.501543    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="86461128-7b52-486f-9e6f-6c557854d45e" containerName="extract"
Jul 20 13:09:27.504413 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:27.504397    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t4n9j"
Jul 20 13:09:27.507174 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:27.507148    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-jskf4\""
Jul 20 13:09:27.507278 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:27.507155    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 20 13:09:27.507278 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:27.507214    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 20 13:09:27.508298 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:27.508281    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 20 13:09:27.515052 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:27.515030    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-t4n9j"]
Jul 20 13:09:27.552128 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:27.552097    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w98j6\" (UniqueName: \"kubernetes.io/projected/b1137bca-71d8-42ca-b067-705ccd70b38d-kube-api-access-w98j6\") pod \"dns-operator-controller-manager-864dd78c4c-t4n9j\" (UID: \"b1137bca-71d8-42ca-b067-705ccd70b38d\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t4n9j"
Jul 20 13:09:27.653321 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:27.653289    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w98j6\" (UniqueName: \"kubernetes.io/projected/b1137bca-71d8-42ca-b067-705ccd70b38d-kube-api-access-w98j6\") pod \"dns-operator-controller-manager-864dd78c4c-t4n9j\" (UID: \"b1137bca-71d8-42ca-b067-705ccd70b38d\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t4n9j"
Jul 20 13:09:27.667001 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:27.666977    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w98j6\" (UniqueName: \"kubernetes.io/projected/b1137bca-71d8-42ca-b067-705ccd70b38d-kube-api-access-w98j6\") pod \"dns-operator-controller-manager-864dd78c4c-t4n9j\" (UID: \"b1137bca-71d8-42ca-b067-705ccd70b38d\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t4n9j"
Jul 20 13:09:27.804671 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:27.804589    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:09:27.814437 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:27.814413    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t4n9j"
Jul 20 13:09:27.914024 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:27.913910    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:09:27.966712 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:27.966686    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-t4n9j"]
Jul 20 13:09:27.968699 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:09:27.968663    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb1137bca_71d8_42ca_b067_705ccd70b38d.slice/crio-bec857660af2946746db2ad2572ad50b23ae238b63a40d23611eab62611637aa WatchSource:0}: Error finding container bec857660af2946746db2ad2572ad50b23ae238b63a40d23611eab62611637aa: Status 404 returned error can't find the container with id bec857660af2946746db2ad2572ad50b23ae238b63a40d23611eab62611637aa
Jul 20 13:09:28.101337 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:28.101252    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t4n9j" event={"ID":"b1137bca-71d8-42ca-b067-705ccd70b38d","Type":"ContainerStarted","Data":"bec857660af2946746db2ad2572ad50b23ae238b63a40d23611eab62611637aa"}
Jul 20 13:09:28.583954 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:28.583919    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:09:28.822403 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:28.822350    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-59c54cddf5-lm4r9"]
Jul 20 13:09:28.827105 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:28.827080    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59c54cddf5-lm4r9"
Jul 20 13:09:28.841349 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:28.841292    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59c54cddf5-lm4r9"]
Jul 20 13:09:28.863764 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:28.863729    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f677328c-d638-4a53-8f6e-cc4db0a73962-console-config\") pod \"console-59c54cddf5-lm4r9\" (UID: \"f677328c-d638-4a53-8f6e-cc4db0a73962\") " pod="openshift-console/console-59c54cddf5-lm4r9"
Jul 20 13:09:28.863764 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:28.863761    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f677328c-d638-4a53-8f6e-cc4db0a73962-service-ca\") pod \"console-59c54cddf5-lm4r9\" (UID: \"f677328c-d638-4a53-8f6e-cc4db0a73962\") " pod="openshift-console/console-59c54cddf5-lm4r9"
Jul 20 13:09:28.863955 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:28.863785    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f677328c-d638-4a53-8f6e-cc4db0a73962-trusted-ca-bundle\") pod \"console-59c54cddf5-lm4r9\" (UID: \"f677328c-d638-4a53-8f6e-cc4db0a73962\") " pod="openshift-console/console-59c54cddf5-lm4r9"
Jul 20 13:09:28.863955 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:28.863819    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f677328c-d638-4a53-8f6e-cc4db0a73962-oauth-serving-cert\") pod \"console-59c54cddf5-lm4r9\" (UID: \"f677328c-d638-4a53-8f6e-cc4db0a73962\") " pod="openshift-console/console-59c54cddf5-lm4r9"
Jul 20 13:09:28.863955 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:28.863855    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f677328c-d638-4a53-8f6e-cc4db0a73962-console-serving-cert\") pod \"console-59c54cddf5-lm4r9\" (UID: \"f677328c-d638-4a53-8f6e-cc4db0a73962\") " pod="openshift-console/console-59c54cddf5-lm4r9"
Jul 20 13:09:28.864080 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:28.863958    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46vg4\" (UniqueName: \"kubernetes.io/projected/f677328c-d638-4a53-8f6e-cc4db0a73962-kube-api-access-46vg4\") pod \"console-59c54cddf5-lm4r9\" (UID: \"f677328c-d638-4a53-8f6e-cc4db0a73962\") " pod="openshift-console/console-59c54cddf5-lm4r9"
Jul 20 13:09:28.864080 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:28.864021    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f677328c-d638-4a53-8f6e-cc4db0a73962-console-oauth-config\") pod \"console-59c54cddf5-lm4r9\" (UID: \"f677328c-d638-4a53-8f6e-cc4db0a73962\") " pod="openshift-console/console-59c54cddf5-lm4r9"
Jul 20 13:09:28.887906 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:28.887871    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:09:28.965207 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:28.965173    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f677328c-d638-4a53-8f6e-cc4db0a73962-console-oauth-config\") pod \"console-59c54cddf5-lm4r9\" (UID: \"f677328c-d638-4a53-8f6e-cc4db0a73962\") " pod="openshift-console/console-59c54cddf5-lm4r9"
Jul 20 13:09:28.965390 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:28.965236    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f677328c-d638-4a53-8f6e-cc4db0a73962-console-config\") pod \"console-59c54cddf5-lm4r9\" (UID: \"f677328c-d638-4a53-8f6e-cc4db0a73962\") " pod="openshift-console/console-59c54cddf5-lm4r9"
Jul 20 13:09:28.965390 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:28.965262    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f677328c-d638-4a53-8f6e-cc4db0a73962-service-ca\") pod \"console-59c54cddf5-lm4r9\" (UID: \"f677328c-d638-4a53-8f6e-cc4db0a73962\") " pod="openshift-console/console-59c54cddf5-lm4r9"
Jul 20 13:09:28.965390 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:28.965283    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f677328c-d638-4a53-8f6e-cc4db0a73962-trusted-ca-bundle\") pod \"console-59c54cddf5-lm4r9\" (UID: \"f677328c-d638-4a53-8f6e-cc4db0a73962\") " pod="openshift-console/console-59c54cddf5-lm4r9"
Jul 20 13:09:28.965390 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:28.965320    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f677328c-d638-4a53-8f6e-cc4db0a73962-oauth-serving-cert\") pod \"console-59c54cddf5-lm4r9\" (UID: \"f677328c-d638-4a53-8f6e-cc4db0a73962\") " pod="openshift-console/console-59c54cddf5-lm4r9"
Jul 20 13:09:28.965599 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:28.965471    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f677328c-d638-4a53-8f6e-cc4db0a73962-console-serving-cert\") pod \"console-59c54cddf5-lm4r9\" (UID: \"f677328c-d638-4a53-8f6e-cc4db0a73962\") " pod="openshift-console/console-59c54cddf5-lm4r9"
Jul 20 13:09:28.965599 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:28.965533    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46vg4\" (UniqueName: \"kubernetes.io/projected/f677328c-d638-4a53-8f6e-cc4db0a73962-kube-api-access-46vg4\") pod \"console-59c54cddf5-lm4r9\" (UID: \"f677328c-d638-4a53-8f6e-cc4db0a73962\") " pod="openshift-console/console-59c54cddf5-lm4r9"
Jul 20 13:09:28.966126 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:28.966051    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f677328c-d638-4a53-8f6e-cc4db0a73962-oauth-serving-cert\") pod \"console-59c54cddf5-lm4r9\" (UID: \"f677328c-d638-4a53-8f6e-cc4db0a73962\") " pod="openshift-console/console-59c54cddf5-lm4r9"
Jul 20 13:09:28.966126 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:28.966064    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f677328c-d638-4a53-8f6e-cc4db0a73962-console-config\") pod \"console-59c54cddf5-lm4r9\" (UID: \"f677328c-d638-4a53-8f6e-cc4db0a73962\") " pod="openshift-console/console-59c54cddf5-lm4r9"
Jul 20 13:09:28.966404 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:28.966376    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f677328c-d638-4a53-8f6e-cc4db0a73962-trusted-ca-bundle\") pod \"console-59c54cddf5-lm4r9\" (UID: \"f677328c-d638-4a53-8f6e-cc4db0a73962\") " pod="openshift-console/console-59c54cddf5-lm4r9"
Jul 20 13:09:28.966751 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:28.966702    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f677328c-d638-4a53-8f6e-cc4db0a73962-service-ca\") pod \"console-59c54cddf5-lm4r9\" (UID: \"f677328c-d638-4a53-8f6e-cc4db0a73962\") " pod="openshift-console/console-59c54cddf5-lm4r9"
Jul 20 13:09:28.967950 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:28.967927    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f677328c-d638-4a53-8f6e-cc4db0a73962-console-oauth-config\") pod \"console-59c54cddf5-lm4r9\" (UID: \"f677328c-d638-4a53-8f6e-cc4db0a73962\") " pod="openshift-console/console-59c54cddf5-lm4r9"
Jul 20 13:09:28.968079 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:28.968063    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f677328c-d638-4a53-8f6e-cc4db0a73962-console-serving-cert\") pod \"console-59c54cddf5-lm4r9\" (UID: \"f677328c-d638-4a53-8f6e-cc4db0a73962\") " pod="openshift-console/console-59c54cddf5-lm4r9"
Jul 20 13:09:28.978524 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:28.978488    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46vg4\" (UniqueName: \"kubernetes.io/projected/f677328c-d638-4a53-8f6e-cc4db0a73962-kube-api-access-46vg4\") pod \"console-59c54cddf5-lm4r9\" (UID: \"f677328c-d638-4a53-8f6e-cc4db0a73962\") " pod="openshift-console/console-59c54cddf5-lm4r9"
Jul 20 13:09:29.000420 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:29.000387    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:09:29.141514 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:29.141478    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-59c54cddf5-lm4r9"
Jul 20 13:09:29.433502 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:29.433478    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-59c54cddf5-lm4r9"]
Jul 20 13:09:29.437144 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:09:29.437116    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf677328c_d638_4a53_8f6e_cc4db0a73962.slice/crio-2ec019a2cba3f50de5b89ba75bdeb47c552e5ccbe6781b6e033ecb95248aa62b WatchSource:0}: Error finding container 2ec019a2cba3f50de5b89ba75bdeb47c552e5ccbe6781b6e033ecb95248aa62b: Status 404 returned error can't find the container with id 2ec019a2cba3f50de5b89ba75bdeb47c552e5ccbe6781b6e033ecb95248aa62b
Jul 20 13:09:29.811878 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:29.811731    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:09:30.116680 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:30.116639    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59c54cddf5-lm4r9" event={"ID":"f677328c-d638-4a53-8f6e-cc4db0a73962","Type":"ContainerStarted","Data":"e5156fa4392ecb4e1c19b0fb0e6c061faae796c4c905a46c84c265a97464b9e7"}
Jul 20 13:09:30.116996 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:30.116696    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-59c54cddf5-lm4r9" event={"ID":"f677328c-d638-4a53-8f6e-cc4db0a73962","Type":"ContainerStarted","Data":"2ec019a2cba3f50de5b89ba75bdeb47c552e5ccbe6781b6e033ecb95248aa62b"}
Jul 20 13:09:30.118186 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:30.118162    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t4n9j" event={"ID":"b1137bca-71d8-42ca-b067-705ccd70b38d","Type":"ContainerStarted","Data":"7d1a6bbdf2fd6573588c7166dd1e4288835768d5a2995dabe2ace66f7ff4e19a"}
Jul 20 13:09:30.118304 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:30.118234    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t4n9j"
Jul 20 13:09:30.153593 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:30.153543    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-59c54cddf5-lm4r9" podStartSLOduration=2.153527933 podStartE2EDuration="2.153527933s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:09:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:09:30.152027677 +0000 UTC m=+476.621559796" watchObservedRunningTime="2026-07-20 13:09:30.153527933 +0000 UTC m=+476.623060051"
Jul 20 13:09:30.183558 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:30.183509    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t4n9j" podStartSLOduration=1.242634857 podStartE2EDuration="3.183495394s" totalImagesPullingTime="1.940860537s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:09:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:09:30.181848841 +0000 UTC m=+476.651380961" watchObservedRunningTime="2026-07-20 13:09:30.183495394 +0000 UTC m=+476.653027513"
Jul 20 13:09:30.834425 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:30.834390    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p7bnm"]
Jul 20 13:09:30.837837 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:30.837820    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p7bnm"
Jul 20 13:09:30.840698 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:30.840677    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-hf46m\""
Jul 20 13:09:30.846672 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:30.846644    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p7bnm"]
Jul 20 13:09:30.881048 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:30.881022    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmxlb\" (UniqueName: \"kubernetes.io/projected/fd03a243-ff92-4757-a449-447623d2eae4-kube-api-access-rmxlb\") pod \"limitador-operator-controller-manager-859d7b78bd-p7bnm\" (UID: \"fd03a243-ff92-4757-a449-447623d2eae4\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p7bnm"
Jul 20 13:09:30.981527 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:30.981487    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmxlb\" (UniqueName: \"kubernetes.io/projected/fd03a243-ff92-4757-a449-447623d2eae4-kube-api-access-rmxlb\") pod \"limitador-operator-controller-manager-859d7b78bd-p7bnm\" (UID: \"fd03a243-ff92-4757-a449-447623d2eae4\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p7bnm"
Jul 20 13:09:30.990093 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:30.990056    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmxlb\" (UniqueName: \"kubernetes.io/projected/fd03a243-ff92-4757-a449-447623d2eae4-kube-api-access-rmxlb\") pod \"limitador-operator-controller-manager-859d7b78bd-p7bnm\" (UID: \"fd03a243-ff92-4757-a449-447623d2eae4\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p7bnm"
Jul 20 13:09:31.149105 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:31.149073    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p7bnm"
Jul 20 13:09:31.277903 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:31.277865    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p7bnm"]
Jul 20 13:09:31.279988 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:09:31.279961    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfd03a243_ff92_4757_a449_447623d2eae4.slice/crio-5f7df58ae01d27cae2eb111f02ade03947cd2feb04390df7652265fa6630300c WatchSource:0}: Error finding container 5f7df58ae01d27cae2eb111f02ade03947cd2feb04390df7652265fa6630300c: Status 404 returned error can't find the container with id 5f7df58ae01d27cae2eb111f02ade03947cd2feb04390df7652265fa6630300c
Jul 20 13:09:31.574178 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:31.574079    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:09:32.130220 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:32.130184    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p7bnm" event={"ID":"fd03a243-ff92-4757-a449-447623d2eae4","Type":"ContainerStarted","Data":"5f7df58ae01d27cae2eb111f02ade03947cd2feb04390df7652265fa6630300c"}
Jul 20 13:09:32.213157 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:32.213070    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:09:34.139909 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:34.139878    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p7bnm" event={"ID":"fd03a243-ff92-4757-a449-447623d2eae4","Type":"ContainerStarted","Data":"5ec484040f89eba2e9d0212cf54a009901949de08d989b4ab16d81dbc5ce8d39"}
Jul 20 13:09:34.140293 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:34.139990    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p7bnm"
Jul 20 13:09:34.158503 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:34.158454    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p7bnm" podStartSLOduration=2.303276199 podStartE2EDuration="4.15843837s" totalImagesPullingTime="1.855162171s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:09:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:09:34.156463787 +0000 UTC m=+480.625995933" watchObservedRunningTime="2026-07-20 13:09:34.15843837 +0000 UTC m=+480.627970489"
Jul 20 13:09:35.403913 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:35.403880    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:09:37.425898 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:37.425845    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:09:37.533884 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:37.533854    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:09:37.844856 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:37.844769    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:09:37.962045 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:37.962017    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:09:39.142412 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:39.142378    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-59c54cddf5-lm4r9"
Jul 20 13:09:39.142792 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:39.142472    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-59c54cddf5-lm4r9"
Jul 20 13:09:39.147244 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:39.147222    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-59c54cddf5-lm4r9"
Jul 20 13:09:39.164440 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:39.164420    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-59c54cddf5-lm4r9"
Jul 20 13:09:39.351680 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:39.351644    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6ffcc4cf54-rnrb4"]
Jul 20 13:09:39.596442 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:39.596334    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:09:39.755587 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:39.755554    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:09:39.865770 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:39.865731    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:09:41.126096 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:41.126065    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t4n9j"
Jul 20 13:09:41.625333 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:41.625289    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:09:41.724064 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:41.724024    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:09:44.000894 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:44.000849    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:09:44.192019 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:44.191971    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:09:45.147514 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:45.147481    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p7bnm"
Jul 20 13:09:45.625158 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:45.625125    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:09:45.732875 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:45.732835    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:09:49.191045 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:49.191010    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:09:49.300818 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:49.300785    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:09:54.850045 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:54.850008    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bbxfz"]
Jul 20 13:09:54.853470 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:54.853453    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bbxfz"
Jul 20 13:09:54.858273 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:54.858251    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-swm8s\""
Jul 20 13:09:54.903985 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:54.903955    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bbxfz"]
Jul 20 13:09:54.977913 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:54.977881    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gbhg5\" (UniqueName: \"kubernetes.io/projected/e56256af-0f9b-4758-89fb-43856c37978a-kube-api-access-gbhg5\") pod \"kuadrant-operator-controller-manager-55467d9f7-bbxfz\" (UID: \"e56256af-0f9b-4758-89fb-43856c37978a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bbxfz"
Jul 20 13:09:54.978048 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:54.977926    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e56256af-0f9b-4758-89fb-43856c37978a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-bbxfz\" (UID: \"e56256af-0f9b-4758-89fb-43856c37978a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bbxfz"
Jul 20 13:09:55.078657 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:55.078625    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gbhg5\" (UniqueName: \"kubernetes.io/projected/e56256af-0f9b-4758-89fb-43856c37978a-kube-api-access-gbhg5\") pod \"kuadrant-operator-controller-manager-55467d9f7-bbxfz\" (UID: \"e56256af-0f9b-4758-89fb-43856c37978a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bbxfz"
Jul 20 13:09:55.078825 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:55.078670    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e56256af-0f9b-4758-89fb-43856c37978a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-bbxfz\" (UID: \"e56256af-0f9b-4758-89fb-43856c37978a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bbxfz"
Jul 20 13:09:55.079015 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:55.079000    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e56256af-0f9b-4758-89fb-43856c37978a-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-bbxfz\" (UID: \"e56256af-0f9b-4758-89fb-43856c37978a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bbxfz"
Jul 20 13:09:55.134166 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:55.134130    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gbhg5\" (UniqueName: \"kubernetes.io/projected/e56256af-0f9b-4758-89fb-43856c37978a-kube-api-access-gbhg5\") pod \"kuadrant-operator-controller-manager-55467d9f7-bbxfz\" (UID: \"e56256af-0f9b-4758-89fb-43856c37978a\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bbxfz"
Jul 20 13:09:55.163173 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:55.163134    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bbxfz"
Jul 20 13:09:55.315288 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:55.315254    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bbxfz"]
Jul 20 13:09:55.316052 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:09:55.316030    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode56256af_0f9b_4758_89fb_43856c37978a.slice/crio-4202a656c2af7f41ae5b1208cb18f63cafce89a3ae7222db33ad5114c248a190 WatchSource:0}: Error finding container 4202a656c2af7f41ae5b1208cb18f63cafce89a3ae7222db33ad5114c248a190: Status 404 returned error can't find the container with id 4202a656c2af7f41ae5b1208cb18f63cafce89a3ae7222db33ad5114c248a190
Jul 20 13:09:55.526691 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:55.526613    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bbxfz"]
Jul 20 13:09:55.528716 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:55.528676    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bbxfz"]
Jul 20 13:09:55.591938 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:55.591904    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p7bnm"]
Jul 20 13:09:55.592172 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:55.592146    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p7bnm" podUID="fd03a243-ff92-4757-a449-447623d2eae4" containerName="manager" containerID="cri-o://5ec484040f89eba2e9d0212cf54a009901949de08d989b4ab16d81dbc5ce8d39" gracePeriod=2
Jul 20 13:09:55.603280 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:55.602947    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p7bnm"]
Jul 20 13:09:55.605588 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:55.605549    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncq8l"]
Jul 20 13:09:55.605916 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:55.605900    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fd03a243-ff92-4757-a449-447623d2eae4" containerName="manager"
Jul 20 13:09:55.605916 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:55.605918    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fd03a243-ff92-4757-a449-447623d2eae4" containerName="manager"
Jul 20 13:09:55.606050 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:55.605975    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="fd03a243-ff92-4757-a449-447623d2eae4" containerName="manager"
Jul 20 13:09:55.608855 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:55.608834    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncq8l"
Jul 20 13:09:55.626711 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:09:55.626682    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-p7bnm\" is forbidden: User \"system:node:ip-10-0-141-182.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-182.ec2.internal' and this object" podUID="fd03a243-ff92-4757-a449-447623d2eae4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p7bnm"
Jul 20 13:09:55.642677 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:55.642646    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5mrn2"]
Jul 20 13:09:55.645914 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:55.645894    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5mrn2"
Jul 20 13:09:55.649087 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:55.649067    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncq8l"]
Jul 20 13:09:55.667054 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:55.667025    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5mrn2"]
Jul 20 13:09:55.682749 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:55.682722    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7016e7cb-b530-4b5e-ab0d-e33527a5f135-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ncq8l\" (UID: \"7016e7cb-b530-4b5e-ab0d-e33527a5f135\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncq8l"
Jul 20 13:09:55.682889 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:55.682793    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4qkw\" (UniqueName: \"kubernetes.io/projected/7016e7cb-b530-4b5e-ab0d-e33527a5f135-kube-api-access-c4qkw\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ncq8l\" (UID: \"7016e7cb-b530-4b5e-ab0d-e33527a5f135\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncq8l"
Jul 20 13:09:55.715799 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:09:55.715764    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-p7bnm\" is forbidden: User \"system:node:ip-10-0-141-182.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-182.ec2.internal' and this object" podUID="fd03a243-ff92-4757-a449-447623d2eae4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p7bnm"
Jul 20 13:09:55.784034 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:55.783966    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7016e7cb-b530-4b5e-ab0d-e33527a5f135-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ncq8l\" (UID: \"7016e7cb-b530-4b5e-ab0d-e33527a5f135\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncq8l"
Jul 20 13:09:55.784034 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:55.784014    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2f9q\" (UniqueName: \"kubernetes.io/projected/c55138aa-6fb6-495e-9a24-ef1561579329-kube-api-access-v2f9q\") pod \"limitador-operator-controller-manager-859d7b78bd-5mrn2\" (UID: \"c55138aa-6fb6-495e-9a24-ef1561579329\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5mrn2"
Jul 20 13:09:55.784188 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:55.784071    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4qkw\" (UniqueName: \"kubernetes.io/projected/7016e7cb-b530-4b5e-ab0d-e33527a5f135-kube-api-access-c4qkw\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ncq8l\" (UID: \"7016e7cb-b530-4b5e-ab0d-e33527a5f135\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncq8l"
Jul 20 13:09:55.784452 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:55.784427    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7016e7cb-b530-4b5e-ab0d-e33527a5f135-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ncq8l\" (UID: \"7016e7cb-b530-4b5e-ab0d-e33527a5f135\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncq8l"
Jul 20 13:09:55.801378 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:55.801338    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4qkw\" (UniqueName: \"kubernetes.io/projected/7016e7cb-b530-4b5e-ab0d-e33527a5f135-kube-api-access-c4qkw\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ncq8l\" (UID: \"7016e7cb-b530-4b5e-ab0d-e33527a5f135\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncq8l"
Jul 20 13:09:55.822603 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:55.822583    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p7bnm"
Jul 20 13:09:55.834718 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:09:55.834693    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-p7bnm\" is forbidden: User \"system:node:ip-10-0-141-182.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-182.ec2.internal' and this object" podUID="fd03a243-ff92-4757-a449-447623d2eae4" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p7bnm"
Jul 20 13:09:55.884910 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:55.884872    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rmxlb\" (UniqueName: \"kubernetes.io/projected/fd03a243-ff92-4757-a449-447623d2eae4-kube-api-access-rmxlb\") pod \"fd03a243-ff92-4757-a449-447623d2eae4\" (UID: \"fd03a243-ff92-4757-a449-447623d2eae4\") "
Jul 20 13:09:55.885316 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:55.885120    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2f9q\" (UniqueName: \"kubernetes.io/projected/c55138aa-6fb6-495e-9a24-ef1561579329-kube-api-access-v2f9q\") pod \"limitador-operator-controller-manager-859d7b78bd-5mrn2\" (UID: \"c55138aa-6fb6-495e-9a24-ef1561579329\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5mrn2"
Jul 20 13:09:55.886955 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:55.886933    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fd03a243-ff92-4757-a449-447623d2eae4-kube-api-access-rmxlb" (OuterVolumeSpecName: "kube-api-access-rmxlb") pod "fd03a243-ff92-4757-a449-447623d2eae4" (UID: "fd03a243-ff92-4757-a449-447623d2eae4"). InnerVolumeSpecName "kube-api-access-rmxlb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:09:55.912405 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:55.912350    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2f9q\" (UniqueName: \"kubernetes.io/projected/c55138aa-6fb6-495e-9a24-ef1561579329-kube-api-access-v2f9q\") pod \"limitador-operator-controller-manager-859d7b78bd-5mrn2\" (UID: \"c55138aa-6fb6-495e-9a24-ef1561579329\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5mrn2"
Jul 20 13:09:55.977511 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:55.977479    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncq8l"
Jul 20 13:09:55.984105 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:55.984083    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5mrn2"
Jul 20 13:09:55.986546 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:55.986513    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rmxlb\" (UniqueName: \"kubernetes.io/projected/fd03a243-ff92-4757-a449-447623d2eae4-kube-api-access-rmxlb\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:09:56.148585 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:56.148555    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fd03a243-ff92-4757-a449-447623d2eae4" path="/var/lib/kubelet/pods/fd03a243-ff92-4757-a449-447623d2eae4/volumes"
Jul 20 13:09:56.246001 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:56.245960    2565 generic.go:356] "Generic (PLEG): container finished" podID="fd03a243-ff92-4757-a449-447623d2eae4" containerID="5ec484040f89eba2e9d0212cf54a009901949de08d989b4ab16d81dbc5ce8d39" exitCode=0
Jul 20 13:09:56.246231 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:56.246025    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-p7bnm"
Jul 20 13:09:56.246231 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:56.246116    2565 scope.go:117] "RemoveContainer" containerID="5ec484040f89eba2e9d0212cf54a009901949de08d989b4ab16d81dbc5ce8d39"
Jul 20 13:09:56.363090 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:56.362840    2565 scope.go:117] "RemoveContainer" containerID="5ec484040f89eba2e9d0212cf54a009901949de08d989b4ab16d81dbc5ce8d39"
Jul 20 13:09:56.363495 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:09:56.363457    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ec484040f89eba2e9d0212cf54a009901949de08d989b4ab16d81dbc5ce8d39\": container with ID starting with 5ec484040f89eba2e9d0212cf54a009901949de08d989b4ab16d81dbc5ce8d39 not found: ID does not exist" containerID="5ec484040f89eba2e9d0212cf54a009901949de08d989b4ab16d81dbc5ce8d39"
Jul 20 13:09:56.363605 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:56.363506    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ec484040f89eba2e9d0212cf54a009901949de08d989b4ab16d81dbc5ce8d39"} err="failed to get container status \"5ec484040f89eba2e9d0212cf54a009901949de08d989b4ab16d81dbc5ce8d39\": rpc error: code = NotFound desc = could not find container \"5ec484040f89eba2e9d0212cf54a009901949de08d989b4ab16d81dbc5ce8d39\": container with ID starting with 5ec484040f89eba2e9d0212cf54a009901949de08d989b4ab16d81dbc5ce8d39 not found: ID does not exist"
Jul 20 13:09:56.455620 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:56.455589    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncq8l"]
Jul 20 13:09:56.470484 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:09:56.470448    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7016e7cb_b530_4b5e_ab0d_e33527a5f135.slice/crio-fe1e2b1651d2a074d6d484f45f98911d4f8b2927e8f66bb0fbe8e024bb76ddd3 WatchSource:0}: Error finding container fe1e2b1651d2a074d6d484f45f98911d4f8b2927e8f66bb0fbe8e024bb76ddd3: Status 404 returned error can't find the container with id fe1e2b1651d2a074d6d484f45f98911d4f8b2927e8f66bb0fbe8e024bb76ddd3
Jul 20 13:09:56.496787 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:56.496751    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5mrn2"]
Jul 20 13:09:56.520731 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:09:56.520696    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc55138aa_6fb6_495e_9a24_ef1561579329.slice/crio-9c77b341f3199573c924a635c61f7e13f49251e2baca365842268f770a25ce94 WatchSource:0}: Error finding container 9c77b341f3199573c924a635c61f7e13f49251e2baca365842268f770a25ce94: Status 404 returned error can't find the container with id 9c77b341f3199573c924a635c61f7e13f49251e2baca365842268f770a25ce94
Jul 20 13:09:57.257537 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:57.257041    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5mrn2" event={"ID":"c55138aa-6fb6-495e-9a24-ef1561579329","Type":"ContainerStarted","Data":"b9d81eaf4f6058d9db470b244ac44c6ed85d942c68a9f85c838c522f5594f12e"}
Jul 20 13:09:57.257537 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:57.257100    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5mrn2" event={"ID":"c55138aa-6fb6-495e-9a24-ef1561579329","Type":"ContainerStarted","Data":"9c77b341f3199573c924a635c61f7e13f49251e2baca365842268f770a25ce94"}
Jul 20 13:09:57.257537 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:57.257151    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5mrn2"
Jul 20 13:09:57.260031 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:57.260002    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncq8l" event={"ID":"7016e7cb-b530-4b5e-ab0d-e33527a5f135","Type":"ContainerStarted","Data":"fe1e2b1651d2a074d6d484f45f98911d4f8b2927e8f66bb0fbe8e024bb76ddd3"}
Jul 20 13:09:57.277837 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:57.277804    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:09:57.287098 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:57.287030    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5mrn2" podStartSLOduration=2.287010757 podStartE2EDuration="2.287010757s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:09:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:09:57.284540841 +0000 UTC m=+503.754072987" watchObservedRunningTime="2026-07-20 13:09:57.287010757 +0000 UTC m=+503.756542878"
Jul 20 13:09:57.378954 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:57.378905    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:09:57.709591 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:57.709554    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:09:57.815185 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:09:57.815144    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:10:00.278192 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:00.278098    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncq8l" event={"ID":"7016e7cb-b530-4b5e-ab0d-e33527a5f135","Type":"ContainerStarted","Data":"0ced2d50595ffdb3156a680765a5bea0cd4586c8cd9eaa244c7fe66dbd117e42"}
Jul 20 13:10:00.278631 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:00.278195    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncq8l"
Jul 20 13:10:00.279834 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:00.279803    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bbxfz" podUID="e56256af-0f9b-4758-89fb-43856c37978a" containerName="manager" containerID="cri-o://91f9864ee6d587004c4f2afffa1f73c821b2c6173241378a9d20cd08c15d7dcc" gracePeriod=2
Jul 20 13:10:00.303942 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:00.303898    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncq8l" podStartSLOduration=1.864349137 podStartE2EDuration="5.303881389s" totalImagesPullingTime="3.439532252s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:09:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:10:00.301378775 +0000 UTC m=+506.770910913" watchObservedRunningTime="2026-07-20 13:10:00.303881389 +0000 UTC m=+506.773413508"
Jul 20 13:10:00.519277 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:00.519247    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bbxfz"
Jul 20 13:10:00.523598 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:10:00.523573    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-bbxfz\" is forbidden: User \"system:node:ip-10-0-141-182.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-182.ec2.internal' and this object" podUID="e56256af-0f9b-4758-89fb-43856c37978a" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bbxfz"
Jul 20 13:10:00.627753 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:00.627712    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gbhg5\" (UniqueName: \"kubernetes.io/projected/e56256af-0f9b-4758-89fb-43856c37978a-kube-api-access-gbhg5\") pod \"e56256af-0f9b-4758-89fb-43856c37978a\" (UID: \"e56256af-0f9b-4758-89fb-43856c37978a\") "
Jul 20 13:10:00.627912 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:00.627773    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e56256af-0f9b-4758-89fb-43856c37978a-extensions-socket-volume\") pod \"e56256af-0f9b-4758-89fb-43856c37978a\" (UID: \"e56256af-0f9b-4758-89fb-43856c37978a\") "
Jul 20 13:10:00.628047 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:00.628024    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e56256af-0f9b-4758-89fb-43856c37978a-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e56256af-0f9b-4758-89fb-43856c37978a" (UID: "e56256af-0f9b-4758-89fb-43856c37978a"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:10:00.629791 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:00.629764    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e56256af-0f9b-4758-89fb-43856c37978a-kube-api-access-gbhg5" (OuterVolumeSpecName: "kube-api-access-gbhg5") pod "e56256af-0f9b-4758-89fb-43856c37978a" (UID: "e56256af-0f9b-4758-89fb-43856c37978a"). InnerVolumeSpecName "kube-api-access-gbhg5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:10:00.729063 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:00.729026    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gbhg5\" (UniqueName: \"kubernetes.io/projected/e56256af-0f9b-4758-89fb-43856c37978a-kube-api-access-gbhg5\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:10:00.729063 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:00.729058    2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e56256af-0f9b-4758-89fb-43856c37978a-extensions-socket-volume\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:10:01.285582 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:01.285493    2565 generic.go:356] "Generic (PLEG): container finished" podID="e56256af-0f9b-4758-89fb-43856c37978a" containerID="91f9864ee6d587004c4f2afffa1f73c821b2c6173241378a9d20cd08c15d7dcc" exitCode=2
Jul 20 13:10:01.285582 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:01.285541    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bbxfz"
Jul 20 13:10:01.286065 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:01.285589    2565 scope.go:117] "RemoveContainer" containerID="91f9864ee6d587004c4f2afffa1f73c821b2c6173241378a9d20cd08c15d7dcc"
Jul 20 13:10:01.289212 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:10:01.289188    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-bbxfz\" is forbidden: User \"system:node:ip-10-0-141-182.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-182.ec2.internal' and this object" podUID="e56256af-0f9b-4758-89fb-43856c37978a" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bbxfz"
Jul 20 13:10:01.294501 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:01.294484    2565 scope.go:117] "RemoveContainer" containerID="91f9864ee6d587004c4f2afffa1f73c821b2c6173241378a9d20cd08c15d7dcc"
Jul 20 13:10:01.294750 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:10:01.294733    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"91f9864ee6d587004c4f2afffa1f73c821b2c6173241378a9d20cd08c15d7dcc\": container with ID starting with 91f9864ee6d587004c4f2afffa1f73c821b2c6173241378a9d20cd08c15d7dcc not found: ID does not exist" containerID="91f9864ee6d587004c4f2afffa1f73c821b2c6173241378a9d20cd08c15d7dcc"
Jul 20 13:10:01.294796 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:01.294758    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"91f9864ee6d587004c4f2afffa1f73c821b2c6173241378a9d20cd08c15d7dcc"} err="failed to get container status \"91f9864ee6d587004c4f2afffa1f73c821b2c6173241378a9d20cd08c15d7dcc\": rpc error: code = NotFound desc = could not find container \"91f9864ee6d587004c4f2afffa1f73c821b2c6173241378a9d20cd08c15d7dcc\": container with ID starting with 91f9864ee6d587004c4f2afffa1f73c821b2c6173241378a9d20cd08c15d7dcc not found: ID does not exist"
Jul 20 13:10:01.296079 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:10:01.296053    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-bbxfz\" is forbidden: User \"system:node:ip-10-0-141-182.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-141-182.ec2.internal' and this object" podUID="e56256af-0f9b-4758-89fb-43856c37978a" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-bbxfz"
Jul 20 13:10:01.462265 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:01.462214    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:10:01.525040 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:01.525007    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:10:02.146503 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:02.146470    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e56256af-0f9b-4758-89fb-43856c37978a" path="/var/lib/kubelet/pods/e56256af-0f9b-4758-89fb-43856c37978a/volumes"
Jul 20 13:10:03.975962 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:03.975923    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:10:04.371267 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:04.371226    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6ffcc4cf54-rnrb4" podUID="d35fff9e-ab5d-49bd-af8b-d1f60adda4a7" containerName="console" containerID="cri-o://ac1b032a23ee3fe4ffab5110a8be9812bf0c26e35ec6a41fc388f42e5b88375a" gracePeriod=15
Jul 20 13:10:04.617870 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:04.617843    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ffcc4cf54-rnrb4"
Jul 20 13:10:04.764419 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:04.764310    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d35fff9e-ab5d-49bd-af8b-d1f60adda4a7-console-serving-cert\") pod \"d35fff9e-ab5d-49bd-af8b-d1f60adda4a7\" (UID: \"d35fff9e-ab5d-49bd-af8b-d1f60adda4a7\") "
Jul 20 13:10:04.764419 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:04.764378    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d35fff9e-ab5d-49bd-af8b-d1f60adda4a7-trusted-ca-bundle\") pod \"d35fff9e-ab5d-49bd-af8b-d1f60adda4a7\" (UID: \"d35fff9e-ab5d-49bd-af8b-d1f60adda4a7\") "
Jul 20 13:10:04.764419 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:04.764411    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d35fff9e-ab5d-49bd-af8b-d1f60adda4a7-service-ca\") pod \"d35fff9e-ab5d-49bd-af8b-d1f60adda4a7\" (UID: \"d35fff9e-ab5d-49bd-af8b-d1f60adda4a7\") "
Jul 20 13:10:04.764678 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:04.764495    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d35fff9e-ab5d-49bd-af8b-d1f60adda4a7-console-config\") pod \"d35fff9e-ab5d-49bd-af8b-d1f60adda4a7\" (UID: \"d35fff9e-ab5d-49bd-af8b-d1f60adda4a7\") "
Jul 20 13:10:04.764678 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:04.764520    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d35fff9e-ab5d-49bd-af8b-d1f60adda4a7-oauth-serving-cert\") pod \"d35fff9e-ab5d-49bd-af8b-d1f60adda4a7\" (UID: \"d35fff9e-ab5d-49bd-af8b-d1f60adda4a7\") "
Jul 20 13:10:04.764678 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:04.764560    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tr4bg\" (UniqueName: \"kubernetes.io/projected/d35fff9e-ab5d-49bd-af8b-d1f60adda4a7-kube-api-access-tr4bg\") pod \"d35fff9e-ab5d-49bd-af8b-d1f60adda4a7\" (UID: \"d35fff9e-ab5d-49bd-af8b-d1f60adda4a7\") "
Jul 20 13:10:04.764678 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:04.764590    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d35fff9e-ab5d-49bd-af8b-d1f60adda4a7-console-oauth-config\") pod \"d35fff9e-ab5d-49bd-af8b-d1f60adda4a7\" (UID: \"d35fff9e-ab5d-49bd-af8b-d1f60adda4a7\") "
Jul 20 13:10:04.764902 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:04.764871    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d35fff9e-ab5d-49bd-af8b-d1f60adda4a7-service-ca" (OuterVolumeSpecName: "service-ca") pod "d35fff9e-ab5d-49bd-af8b-d1f60adda4a7" (UID: "d35fff9e-ab5d-49bd-af8b-d1f60adda4a7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:10:04.764902 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:04.764888    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d35fff9e-ab5d-49bd-af8b-d1f60adda4a7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d35fff9e-ab5d-49bd-af8b-d1f60adda4a7" (UID: "d35fff9e-ab5d-49bd-af8b-d1f60adda4a7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:10:04.764995 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:04.764913    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d35fff9e-ab5d-49bd-af8b-d1f60adda4a7-console-config" (OuterVolumeSpecName: "console-config") pod "d35fff9e-ab5d-49bd-af8b-d1f60adda4a7" (UID: "d35fff9e-ab5d-49bd-af8b-d1f60adda4a7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:10:04.765259 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:04.765219    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d35fff9e-ab5d-49bd-af8b-d1f60adda4a7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d35fff9e-ab5d-49bd-af8b-d1f60adda4a7" (UID: "d35fff9e-ab5d-49bd-af8b-d1f60adda4a7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:10:04.766652 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:04.766619    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d35fff9e-ab5d-49bd-af8b-d1f60adda4a7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d35fff9e-ab5d-49bd-af8b-d1f60adda4a7" (UID: "d35fff9e-ab5d-49bd-af8b-d1f60adda4a7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 13:10:04.766771 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:04.766706    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d35fff9e-ab5d-49bd-af8b-d1f60adda4a7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d35fff9e-ab5d-49bd-af8b-d1f60adda4a7" (UID: "d35fff9e-ab5d-49bd-af8b-d1f60adda4a7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 13:10:04.766869 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:04.766845    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d35fff9e-ab5d-49bd-af8b-d1f60adda4a7-kube-api-access-tr4bg" (OuterVolumeSpecName: "kube-api-access-tr4bg") pod "d35fff9e-ab5d-49bd-af8b-d1f60adda4a7" (UID: "d35fff9e-ab5d-49bd-af8b-d1f60adda4a7"). InnerVolumeSpecName "kube-api-access-tr4bg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:10:04.855540 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:04.855499    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:10:04.865684 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:04.865658    2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d35fff9e-ab5d-49bd-af8b-d1f60adda4a7-console-oauth-config\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:10:04.865684 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:04.865683    2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d35fff9e-ab5d-49bd-af8b-d1f60adda4a7-console-serving-cert\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:10:04.865807 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:04.865693    2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d35fff9e-ab5d-49bd-af8b-d1f60adda4a7-trusted-ca-bundle\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:10:04.865807 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:04.865702    2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d35fff9e-ab5d-49bd-af8b-d1f60adda4a7-service-ca\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:10:04.865807 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:04.865713    2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d35fff9e-ab5d-49bd-af8b-d1f60adda4a7-console-config\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:10:04.865807 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:04.865721    2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d35fff9e-ab5d-49bd-af8b-d1f60adda4a7-oauth-serving-cert\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:10:04.865807 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:04.865730    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tr4bg\" (UniqueName: \"kubernetes.io/projected/d35fff9e-ab5d-49bd-af8b-d1f60adda4a7-kube-api-access-tr4bg\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:10:04.957230 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:04.957195    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:10:05.309483 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:05.309440    2565 generic.go:356] "Generic (PLEG): container finished" podID="d35fff9e-ab5d-49bd-af8b-d1f60adda4a7" containerID="ac1b032a23ee3fe4ffab5110a8be9812bf0c26e35ec6a41fc388f42e5b88375a" exitCode=0
Jul 20 13:10:05.309483 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:05.309486    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6ffcc4cf54-rnrb4"
Jul 20 13:10:05.309982 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:05.309530    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ffcc4cf54-rnrb4" event={"ID":"d35fff9e-ab5d-49bd-af8b-d1f60adda4a7","Type":"ContainerDied","Data":"ac1b032a23ee3fe4ffab5110a8be9812bf0c26e35ec6a41fc388f42e5b88375a"}
Jul 20 13:10:05.309982 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:05.309596    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6ffcc4cf54-rnrb4" event={"ID":"d35fff9e-ab5d-49bd-af8b-d1f60adda4a7","Type":"ContainerDied","Data":"d8d63719e728ddf0894cc7161a4fc6bff83b67e99a176ea1a359ae81b4172241"}
Jul 20 13:10:05.309982 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:05.309632    2565 scope.go:117] "RemoveContainer" containerID="ac1b032a23ee3fe4ffab5110a8be9812bf0c26e35ec6a41fc388f42e5b88375a"
Jul 20 13:10:05.318831 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:05.318812    2565 scope.go:117] "RemoveContainer" containerID="ac1b032a23ee3fe4ffab5110a8be9812bf0c26e35ec6a41fc388f42e5b88375a"
Jul 20 13:10:05.319087 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:10:05.319068    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ac1b032a23ee3fe4ffab5110a8be9812bf0c26e35ec6a41fc388f42e5b88375a\": container with ID starting with ac1b032a23ee3fe4ffab5110a8be9812bf0c26e35ec6a41fc388f42e5b88375a not found: ID does not exist" containerID="ac1b032a23ee3fe4ffab5110a8be9812bf0c26e35ec6a41fc388f42e5b88375a"
Jul 20 13:10:05.319147 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:05.319099    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ac1b032a23ee3fe4ffab5110a8be9812bf0c26e35ec6a41fc388f42e5b88375a"} err="failed to get container status \"ac1b032a23ee3fe4ffab5110a8be9812bf0c26e35ec6a41fc388f42e5b88375a\": rpc error: code = NotFound desc = could not find container \"ac1b032a23ee3fe4ffab5110a8be9812bf0c26e35ec6a41fc388f42e5b88375a\": container with ID starting with ac1b032a23ee3fe4ffab5110a8be9812bf0c26e35ec6a41fc388f42e5b88375a not found: ID does not exist"
Jul 20 13:10:05.342571 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:05.342541    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6ffcc4cf54-rnrb4"]
Jul 20 13:10:05.352056 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:05.352034    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6ffcc4cf54-rnrb4"]
Jul 20 13:10:06.147567 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:06.147532    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d35fff9e-ab5d-49bd-af8b-d1f60adda4a7" path="/var/lib/kubelet/pods/d35fff9e-ab5d-49bd-af8b-d1f60adda4a7/volumes"
Jul 20 13:10:07.476481 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:07.476446    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncq8l"]
Jul 20 13:10:07.476932 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:07.476624    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncq8l" podUID="7016e7cb-b530-4b5e-ab0d-e33527a5f135" containerName="manager" containerID="cri-o://0ced2d50595ffdb3156a680765a5bea0cd4586c8cd9eaa244c7fe66dbd117e42" gracePeriod=10
Jul 20 13:10:07.478570 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:07.478546    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncq8l"
Jul 20 13:10:07.719881 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:07.719854    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncq8l"
Jul 20 13:10:07.891633 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:07.891596    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7016e7cb-b530-4b5e-ab0d-e33527a5f135-extensions-socket-volume\") pod \"7016e7cb-b530-4b5e-ab0d-e33527a5f135\" (UID: \"7016e7cb-b530-4b5e-ab0d-e33527a5f135\") "
Jul 20 13:10:07.891791 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:07.891661    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c4qkw\" (UniqueName: \"kubernetes.io/projected/7016e7cb-b530-4b5e-ab0d-e33527a5f135-kube-api-access-c4qkw\") pod \"7016e7cb-b530-4b5e-ab0d-e33527a5f135\" (UID: \"7016e7cb-b530-4b5e-ab0d-e33527a5f135\") "
Jul 20 13:10:07.892115 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:07.892076    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7016e7cb-b530-4b5e-ab0d-e33527a5f135-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7016e7cb-b530-4b5e-ab0d-e33527a5f135" (UID: "7016e7cb-b530-4b5e-ab0d-e33527a5f135"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:10:07.893817 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:07.893785    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7016e7cb-b530-4b5e-ab0d-e33527a5f135-kube-api-access-c4qkw" (OuterVolumeSpecName: "kube-api-access-c4qkw") pod "7016e7cb-b530-4b5e-ab0d-e33527a5f135" (UID: "7016e7cb-b530-4b5e-ab0d-e33527a5f135"). InnerVolumeSpecName "kube-api-access-c4qkw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:10:07.921081 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:07.921053    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8ms9h"]
Jul 20 13:10:07.921391 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:07.921377    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7016e7cb-b530-4b5e-ab0d-e33527a5f135" containerName="manager"
Jul 20 13:10:07.921438 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:07.921395    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7016e7cb-b530-4b5e-ab0d-e33527a5f135" containerName="manager"
Jul 20 13:10:07.921438 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:07.921413    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e56256af-0f9b-4758-89fb-43856c37978a" containerName="manager"
Jul 20 13:10:07.921438 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:07.921420    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e56256af-0f9b-4758-89fb-43856c37978a" containerName="manager"
Jul 20 13:10:07.921438 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:07.921432    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d35fff9e-ab5d-49bd-af8b-d1f60adda4a7" containerName="console"
Jul 20 13:10:07.921438 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:07.921437    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d35fff9e-ab5d-49bd-af8b-d1f60adda4a7" containerName="console"
Jul 20 13:10:07.921589 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:07.921503    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d35fff9e-ab5d-49bd-af8b-d1f60adda4a7" containerName="console"
Jul 20 13:10:07.921589 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:07.921511    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e56256af-0f9b-4758-89fb-43856c37978a" containerName="manager"
Jul 20 13:10:07.921589 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:07.921517    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7016e7cb-b530-4b5e-ab0d-e33527a5f135" containerName="manager"
Jul 20 13:10:07.924470 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:07.924454    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8ms9h"
Jul 20 13:10:07.942318 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:07.942295    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8ms9h"]
Jul 20 13:10:07.992593 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:07.992558    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c4qkw\" (UniqueName: \"kubernetes.io/projected/7016e7cb-b530-4b5e-ab0d-e33527a5f135-kube-api-access-c4qkw\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:10:07.992593 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:07.992585    2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7016e7cb-b530-4b5e-ab0d-e33527a5f135-extensions-socket-volume\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:10:08.093279 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:08.093240    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/194efd87-d75e-4e6b-8680-8a710caccd26-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8ms9h\" (UID: \"194efd87-d75e-4e6b-8680-8a710caccd26\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8ms9h"
Jul 20 13:10:08.093459 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:08.093307    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5jg69\" (UniqueName: \"kubernetes.io/projected/194efd87-d75e-4e6b-8680-8a710caccd26-kube-api-access-5jg69\") pod \"kuadrant-operator-controller-manager-86878c769f-8ms9h\" (UID: \"194efd87-d75e-4e6b-8680-8a710caccd26\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8ms9h"
Jul 20 13:10:08.194516 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:08.194481    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/194efd87-d75e-4e6b-8680-8a710caccd26-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8ms9h\" (UID: \"194efd87-d75e-4e6b-8680-8a710caccd26\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8ms9h"
Jul 20 13:10:08.194654 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:08.194547    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5jg69\" (UniqueName: \"kubernetes.io/projected/194efd87-d75e-4e6b-8680-8a710caccd26-kube-api-access-5jg69\") pod \"kuadrant-operator-controller-manager-86878c769f-8ms9h\" (UID: \"194efd87-d75e-4e6b-8680-8a710caccd26\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8ms9h"
Jul 20 13:10:08.194912 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:08.194891    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/194efd87-d75e-4e6b-8680-8a710caccd26-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-8ms9h\" (UID: \"194efd87-d75e-4e6b-8680-8a710caccd26\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8ms9h"
Jul 20 13:10:08.207876 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:08.207842    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5jg69\" (UniqueName: \"kubernetes.io/projected/194efd87-d75e-4e6b-8680-8a710caccd26-kube-api-access-5jg69\") pod \"kuadrant-operator-controller-manager-86878c769f-8ms9h\" (UID: \"194efd87-d75e-4e6b-8680-8a710caccd26\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8ms9h"
Jul 20 13:10:08.233811 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:08.233788    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8ms9h"
Jul 20 13:10:08.269903 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:08.269875    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-5mrn2"
Jul 20 13:10:08.328096 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:08.328065    2565 generic.go:356] "Generic (PLEG): container finished" podID="7016e7cb-b530-4b5e-ab0d-e33527a5f135" containerID="0ced2d50595ffdb3156a680765a5bea0cd4586c8cd9eaa244c7fe66dbd117e42" exitCode=0
Jul 20 13:10:08.328234 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:08.328122    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncq8l"
Jul 20 13:10:08.328234 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:08.328149    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncq8l" event={"ID":"7016e7cb-b530-4b5e-ab0d-e33527a5f135","Type":"ContainerDied","Data":"0ced2d50595ffdb3156a680765a5bea0cd4586c8cd9eaa244c7fe66dbd117e42"}
Jul 20 13:10:08.328234 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:08.328220    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncq8l" event={"ID":"7016e7cb-b530-4b5e-ab0d-e33527a5f135","Type":"ContainerDied","Data":"fe1e2b1651d2a074d6d484f45f98911d4f8b2927e8f66bb0fbe8e024bb76ddd3"}
Jul 20 13:10:08.328410 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:08.328254    2565 scope.go:117] "RemoveContainer" containerID="0ced2d50595ffdb3156a680765a5bea0cd4586c8cd9eaa244c7fe66dbd117e42"
Jul 20 13:10:08.337604 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:08.337585    2565 scope.go:117] "RemoveContainer" containerID="0ced2d50595ffdb3156a680765a5bea0cd4586c8cd9eaa244c7fe66dbd117e42"
Jul 20 13:10:08.337863 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:10:08.337841    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ced2d50595ffdb3156a680765a5bea0cd4586c8cd9eaa244c7fe66dbd117e42\": container with ID starting with 0ced2d50595ffdb3156a680765a5bea0cd4586c8cd9eaa244c7fe66dbd117e42 not found: ID does not exist" containerID="0ced2d50595ffdb3156a680765a5bea0cd4586c8cd9eaa244c7fe66dbd117e42"
Jul 20 13:10:08.337938 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:08.337869    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ced2d50595ffdb3156a680765a5bea0cd4586c8cd9eaa244c7fe66dbd117e42"} err="failed to get container status \"0ced2d50595ffdb3156a680765a5bea0cd4586c8cd9eaa244c7fe66dbd117e42\": rpc error: code = NotFound desc = could not find container \"0ced2d50595ffdb3156a680765a5bea0cd4586c8cd9eaa244c7fe66dbd117e42\": container with ID starting with 0ced2d50595ffdb3156a680765a5bea0cd4586c8cd9eaa244c7fe66dbd117e42 not found: ID does not exist"
Jul 20 13:10:08.367924 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:08.367888    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncq8l"]
Jul 20 13:10:08.370266 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:08.370244    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ncq8l"]
Jul 20 13:10:08.375966 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:08.375936    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:10:08.387465 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:08.387439    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8ms9h"]
Jul 20 13:10:08.390444 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:10:08.390422    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod194efd87_d75e_4e6b_8680_8a710caccd26.slice/crio-941a88ff77052ad11b2d5d47d52748d27851cd75f1ad21e436346d8de0d622ec WatchSource:0}: Error finding container 941a88ff77052ad11b2d5d47d52748d27851cd75f1ad21e436346d8de0d622ec: Status 404 returned error can't find the container with id 941a88ff77052ad11b2d5d47d52748d27851cd75f1ad21e436346d8de0d622ec
Jul 20 13:10:08.476987 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:08.476942    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:10:09.335594 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:09.335541    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8ms9h" event={"ID":"194efd87-d75e-4e6b-8680-8a710caccd26","Type":"ContainerStarted","Data":"d9d09b140d03f9ffcb0013f158439290397768daf865e5bb4d6c83c38cc9aca7"}
Jul 20 13:10:09.335594 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:09.335602    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8ms9h"
Jul 20 13:10:09.335880 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:09.335626    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8ms9h" event={"ID":"194efd87-d75e-4e6b-8680-8a710caccd26","Type":"ContainerStarted","Data":"941a88ff77052ad11b2d5d47d52748d27851cd75f1ad21e436346d8de0d622ec"}
Jul 20 13:10:09.366842 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:09.366790    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8ms9h" podStartSLOduration=2.366772331 podStartE2EDuration="2.366772331s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:10:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:10:09.364135555 +0000 UTC m=+515.833667673" watchObservedRunningTime="2026-07-20 13:10:09.366772331 +0000 UTC m=+515.836304516"
Jul 20 13:10:10.147510 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:10.147469    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7016e7cb-b530-4b5e-ab0d-e33527a5f135" path="/var/lib/kubelet/pods/7016e7cb-b530-4b5e-ab0d-e33527a5f135/volumes"
Jul 20 13:10:20.343845 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:20.343802    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8ms9h"
Jul 20 13:10:23.914349 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:23.914305    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:10:24.079830 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:24.079784    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:10:30.644839 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:30.644754    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:10:34.823971 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:34.823921    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:10:34.886917 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:34.886888    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:10:40.867009 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:40.866969    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:10:40.961557 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:40.961521    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:10:41.057503 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:41.057470    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:10:41.316561 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:41.316483    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:10:41.321893 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:41.321869    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"
Jul 20 13:10:41.325735 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:41.325714    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-kpwv5\""
Jul 20 13:10:41.325735 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:41.325722    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 20 13:10:41.334051 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:41.334030    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:10:41.359510 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:41.359481    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxml7\" (UniqueName: \"kubernetes.io/projected/bbbf337f-cc05-4c32-ad56-d281516be96d-kube-api-access-rxml7\") pod \"limitador-limitador-54d6d988d5-rqn5h\" (UID: \"bbbf337f-cc05-4c32-ad56-d281516be96d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"
Jul 20 13:10:41.359609 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:41.359518    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bbbf337f-cc05-4c32-ad56-d281516be96d-config-file\") pod \"limitador-limitador-54d6d988d5-rqn5h\" (UID: \"bbbf337f-cc05-4c32-ad56-d281516be96d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"
Jul 20 13:10:41.388831 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:41.388803    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:10:41.460417 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:41.460386    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxml7\" (UniqueName: \"kubernetes.io/projected/bbbf337f-cc05-4c32-ad56-d281516be96d-kube-api-access-rxml7\") pod \"limitador-limitador-54d6d988d5-rqn5h\" (UID: \"bbbf337f-cc05-4c32-ad56-d281516be96d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"
Jul 20 13:10:41.460617 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:41.460422    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bbbf337f-cc05-4c32-ad56-d281516be96d-config-file\") pod \"limitador-limitador-54d6d988d5-rqn5h\" (UID: \"bbbf337f-cc05-4c32-ad56-d281516be96d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"
Jul 20 13:10:41.460969 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:41.460952    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/bbbf337f-cc05-4c32-ad56-d281516be96d-config-file\") pod \"limitador-limitador-54d6d988d5-rqn5h\" (UID: \"bbbf337f-cc05-4c32-ad56-d281516be96d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"
Jul 20 13:10:41.473462 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:41.473428    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxml7\" (UniqueName: \"kubernetes.io/projected/bbbf337f-cc05-4c32-ad56-d281516be96d-kube-api-access-rxml7\") pod \"limitador-limitador-54d6d988d5-rqn5h\" (UID: \"bbbf337f-cc05-4c32-ad56-d281516be96d\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"
Jul 20 13:10:41.631717 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:41.631685    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"
Jul 20 13:10:41.773628 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:41.773603    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:10:41.775929 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:10:41.775903    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbbbf337f_cc05_4c32_ad56_d281516be96d.slice/crio-5f5c5a08d4564046d78fdda0b0cbd1ef10f7476f3b1b95c8a726bf0c4550dba0 WatchSource:0}: Error finding container 5f5c5a08d4564046d78fdda0b0cbd1ef10f7476f3b1b95c8a726bf0c4550dba0: Status 404 returned error can't find the container with id 5f5c5a08d4564046d78fdda0b0cbd1ef10f7476f3b1b95c8a726bf0c4550dba0
Jul 20 13:10:41.782590 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:41.782563    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:10:41.844056 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:41.844030    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:10:42.498898 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:42.498862    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-rqn5h" event={"ID":"bbbf337f-cc05-4c32-ad56-d281516be96d","Type":"ContainerStarted","Data":"5f5c5a08d4564046d78fdda0b0cbd1ef10f7476f3b1b95c8a726bf0c4550dba0"}
Jul 20 13:10:44.511074 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:44.511036    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-rqn5h" event={"ID":"bbbf337f-cc05-4c32-ad56-d281516be96d","Type":"ContainerStarted","Data":"689c8cc2d26967f52b314af4aad0ff0474e2fc40d004bbddc86f51880a7e1e46"}
Jul 20 13:10:44.511464 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:44.511122    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"
Jul 20 13:10:44.532574 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:44.532531    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-rqn5h" podStartSLOduration=0.915079905 podStartE2EDuration="3.532516975s" totalImagesPullingTime="2.61743707s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:10:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:10:44.530652826 +0000 UTC m=+551.000184946" watchObservedRunningTime="2026-07-20 13:10:44.532516975 +0000 UTC m=+551.002049116"
Jul 20 13:10:55.517530 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:55.517497    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"
Jul 20 13:10:57.139887 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:57.139844    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:10:57.231271 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:57.231235    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:10:57.616806 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:10:57.616762    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:11:01.798050 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:11:01.798002    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:11:09.079291 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:11:09.079255    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:11:09.497915 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:11:09.497870    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:11:16.243508 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:11:16.243464    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:11:16.343415 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:11:16.343376    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:11:16.449440 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:11:16.449406    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:11:16.875261 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:11:16.875230    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:11:20.580851 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:11:20.580811    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:11:20.656532 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:11:20.656498    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:11:43.454237 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:11:43.454204    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:11:52.445423 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:11:52.445378    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:11:52.512514 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:11:52.512478    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:11:53.010276 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:11:53.010244    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:11:53.304628 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:11:53.304511    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:11:53.556863 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:11:53.556766    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:11:53.660086 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:11:53.660054    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:11:53.823186 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:11:53.823114    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:12:05.036685 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:12:05.036586    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:12:05.135894 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:12:05.135843    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:12:21.954630 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:12:21.954582    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:12:22.421067 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:12:22.421033    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:12:26.749877 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:12:26.749842    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:12:27.533482 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:12:27.533445    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:12:35.069821 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:12:35.069758    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:12:36.126236 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:12:36.126198    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:12:40.545590 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:12:40.545554    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:12:40.610167 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:12:40.610130    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:12:43.418945 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:12:43.418913    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdt95k"]
Jul 20 13:12:43.422439 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:12:43.422414    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdt95k"
Jul 20 13:12:43.426463 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:12:43.426438    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 20 13:12:43.426463 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:12:43.426454    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-x7r74\""
Jul 20 13:12:43.426463 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:12:43.426466    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 20 13:12:43.426707 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:12:43.426574    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\""
Jul 20 13:12:43.433975 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:12:43.433954    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdt95k"]
Jul 20 13:12:43.448042 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:12:43.448022    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:12:43.482414 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:12:43.482382    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/638ef82a-8a28-4c0b-b3d0-0cba18596be4-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdt95k\" (UID: \"638ef82a-8a28-4c0b-b3d0-0cba18596be4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdt95k"
Jul 20 13:12:43.482538 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:12:43.482461    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/638ef82a-8a28-4c0b-b3d0-0cba18596be4-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdt95k\" (UID: \"638ef82a-8a28-4c0b-b3d0-0cba18596be4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdt95k"
Jul 20 13:12:43.482538 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:12:43.482489    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/638ef82a-8a28-4c0b-b3d0-0cba18596be4-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdt95k\" (UID: \"638ef82a-8a28-4c0b-b3d0-0cba18596be4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdt95k"
Jul 20 13:12:43.482538 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:12:43.482510    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/638ef82a-8a28-4c0b-b3d0-0cba18596be4-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdt95k\" (UID: \"638ef82a-8a28-4c0b-b3d0-0cba18596be4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdt95k"
Jul 20 13:12:43.482538 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:12:43.482535    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ml6tv\" (UniqueName: \"kubernetes.io/projected/638ef82a-8a28-4c0b-b3d0-0cba18596be4-kube-api-access-ml6tv\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdt95k\" (UID: \"638ef82a-8a28-4c0b-b3d0-0cba18596be4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdt95k"
Jul 20 13:12:43.482733 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:12:43.482563    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/638ef82a-8a28-4c0b-b3d0-0cba18596be4-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdt95k\" (UID: \"638ef82a-8a28-4c0b-b3d0-0cba18596be4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdt95k"
Jul 20 13:12:43.583207 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:12:43.583169    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/638ef82a-8a28-4c0b-b3d0-0cba18596be4-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdt95k\" (UID: \"638ef82a-8a28-4c0b-b3d0-0cba18596be4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdt95k"
Jul 20 13:12:43.583386 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:12:43.583213    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/638ef82a-8a28-4c0b-b3d0-0cba18596be4-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdt95k\" (UID: \"638ef82a-8a28-4c0b-b3d0-0cba18596be4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdt95k"
Jul 20 13:12:43.583386 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:12:43.583235    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/638ef82a-8a28-4c0b-b3d0-0cba18596be4-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdt95k\" (UID: \"638ef82a-8a28-4c0b-b3d0-0cba18596be4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdt95k"
Jul 20 13:12:43.583386 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:12:43.583264    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ml6tv\" (UniqueName: \"kubernetes.io/projected/638ef82a-8a28-4c0b-b3d0-0cba18596be4-kube-api-access-ml6tv\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdt95k\" (UID: \"638ef82a-8a28-4c0b-b3d0-0cba18596be4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdt95k"
Jul 20 13:12:43.583386 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:12:43.583293    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/638ef82a-8a28-4c0b-b3d0-0cba18596be4-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdt95k\" (UID: \"638ef82a-8a28-4c0b-b3d0-0cba18596be4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdt95k"
Jul 20 13:12:43.583386 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:12:43.583324    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/638ef82a-8a28-4c0b-b3d0-0cba18596be4-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdt95k\" (UID: \"638ef82a-8a28-4c0b-b3d0-0cba18596be4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdt95k"
Jul 20 13:12:43.583686 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:12:43.583661    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/638ef82a-8a28-4c0b-b3d0-0cba18596be4-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdt95k\" (UID: \"638ef82a-8a28-4c0b-b3d0-0cba18596be4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdt95k"
Jul 20 13:12:43.583740 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:12:43.583667    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/638ef82a-8a28-4c0b-b3d0-0cba18596be4-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdt95k\" (UID: \"638ef82a-8a28-4c0b-b3d0-0cba18596be4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdt95k"
Jul 20 13:12:43.583815 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:12:43.583798    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/638ef82a-8a28-4c0b-b3d0-0cba18596be4-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdt95k\" (UID: \"638ef82a-8a28-4c0b-b3d0-0cba18596be4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdt95k"
Jul 20 13:12:43.585565 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:12:43.585537    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/638ef82a-8a28-4c0b-b3d0-0cba18596be4-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdt95k\" (UID: \"638ef82a-8a28-4c0b-b3d0-0cba18596be4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdt95k"
Jul 20 13:12:43.585859 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:12:43.585839    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/638ef82a-8a28-4c0b-b3d0-0cba18596be4-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdt95k\" (UID: \"638ef82a-8a28-4c0b-b3d0-0cba18596be4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdt95k"
Jul 20 13:12:43.595236 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:12:43.595202    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ml6tv\" (UniqueName: \"kubernetes.io/projected/638ef82a-8a28-4c0b-b3d0-0cba18596be4-kube-api-access-ml6tv\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdt95k\" (UID: \"638ef82a-8a28-4c0b-b3d0-0cba18596be4\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdt95k"
Jul 20 13:12:43.734330 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:12:43.734240    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdt95k"
Jul 20 13:12:43.866029 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:12:43.865995    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdt95k"]
Jul 20 13:12:43.868615 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:12:43.868579    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod638ef82a_8a28_4c0b_b3d0_0cba18596be4.slice/crio-8bbd290d9fd7ad513369c5dabea7dd6c0f9941f5e6d63d88860eeb4f91eecc3f WatchSource:0}: Error finding container 8bbd290d9fd7ad513369c5dabea7dd6c0f9941f5e6d63d88860eeb4f91eecc3f: Status 404 returned error can't find the container with id 8bbd290d9fd7ad513369c5dabea7dd6c0f9941f5e6d63d88860eeb4f91eecc3f
Jul 20 13:12:43.869912 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:12:43.869891    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 13:12:44.087063 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:12:44.086969    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdt95k" event={"ID":"638ef82a-8a28-4c0b-b3d0-0cba18596be4","Type":"ContainerStarted","Data":"8bbd290d9fd7ad513369c5dabea7dd6c0f9941f5e6d63d88860eeb4f91eecc3f"}
Jul 20 13:12:45.094430 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:12:45.094391    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdt95k" event={"ID":"638ef82a-8a28-4c0b-b3d0-0cba18596be4","Type":"ContainerStarted","Data":"742b30fc420e546bde08a1e8fe136062f71b3386b86d15e09cdbb5774eb88a69"}
Jul 20 13:12:45.112468 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:12:45.112415    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdt95k" podStartSLOduration=1.001203038 podStartE2EDuration="2.112399632s" totalImagesPullingTime="1.111196594s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:12:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:12:45.111375672 +0000 UTC m=+671.580907772" watchObservedRunningTime="2026-07-20 13:12:45.112399632 +0000 UTC m=+671.581931745"
Jul 20 13:12:45.218836 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:12:45.218801    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:12:47.421055 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:12:47.421021    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:12:47.851121 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:12:47.851028    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:12:53.734368 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:12:53.734330    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdt95k"
Jul 20 13:12:53.734865 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:12:53.734418    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdt95k"
Jul 20 13:12:53.746856 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:12:53.746830    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdt95k"
Jul 20 13:12:54.152532 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:12:54.152499    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdt95k"
Jul 20 13:12:56.022156 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:12:56.022103    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:13:00.762619 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:13:00.762577    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:13:04.621579 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:13:04.621538    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:13:06.798805 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:13:06.798768    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:13:06.852282 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:13:06.852245    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:13:11.847563 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:13:11.847525    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:13:22.560426 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:13:22.560379    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:14:28.854209 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:14:28.854172    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:14:28.947808 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:14:28.947769    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:14:30.038342 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:14:30.038296    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:14:30.155968 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:14:30.155929    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:14:49.818666 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:14:49.818634    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:14:49.919832 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:14:49.919795    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:14:58.119433 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:14:58.119297    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:15:08.418629 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:15:08.418593    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:15:18.821329 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:15:18.821291    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:15:28.520011 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:15:28.519972    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:15:39.321291 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:15:39.321252    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:15:41.545102 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:15:41.545054    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:15:42.854272 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:15:42.854240    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:16:05.539150 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:16:05.539112    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:16:18.131492 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:16:18.131459    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:16:21.681492 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:16:21.681454    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:16:21.777787 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:16:21.777742    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:16:21.902150 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:16:21.902117    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:16:27.711183 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:16:27.711056    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:16:27.777561 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:16:27.777526    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:16:27.855693 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:16:27.855660    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:16:27.955863 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:16:27.955833    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:16:28.087709 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:16:28.087591    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:16:33.899200 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:16:33.899171    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:16:34.001929 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:16:34.001900    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:16:36.126557 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:16:36.126521    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:16:45.337093 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:16:45.337061    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:16:54.334914 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:16:54.334880    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:17:03.740821 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:17:03.740777    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:17:13.856396 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:17:13.856342    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:17:22.734965 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:17:22.734930    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:17:31.727818 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:17:31.727778    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:17:43.238634 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:17:43.238592    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:17:54.090568 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:17:54.090531    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:18:04.156267 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:18:04.156184    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:18:15.023406 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:18:15.023347    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:18:29.833427 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:18:29.833391    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:18:41.750063 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:18:41.750020    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:19:05.454510 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:19:05.454473    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:19:16.234450 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:19:16.234413    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:19:33.538529 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:19:33.538450    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:19:42.659146 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:19:42.659106    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:19:50.425084 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:19:50.425048    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:19:50.492197 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:19:50.492161    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:19:52.433909 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:19:52.433869    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:20:01.828117 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:20:01.828077    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:20:11.245866 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:20:11.245830    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:20:37.371926 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:20:37.371895    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:20:37.400121 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:20:37.400081    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8ms9h"]
Jul 20 13:20:37.400330 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:20:37.400305    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8ms9h" podUID="194efd87-d75e-4e6b-8680-8a710caccd26" containerName="manager" containerID="cri-o://d9d09b140d03f9ffcb0013f158439290397768daf865e5bb4d6c83c38cc9aca7" gracePeriod=10
Jul 20 13:20:40.052090 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:20:40.052063    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8ms9h"
Jul 20 13:20:40.132296 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:20:40.132212    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/194efd87-d75e-4e6b-8680-8a710caccd26-extensions-socket-volume\") pod \"194efd87-d75e-4e6b-8680-8a710caccd26\" (UID: \"194efd87-d75e-4e6b-8680-8a710caccd26\") "
Jul 20 13:20:40.132296 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:20:40.132246    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5jg69\" (UniqueName: \"kubernetes.io/projected/194efd87-d75e-4e6b-8680-8a710caccd26-kube-api-access-5jg69\") pod \"194efd87-d75e-4e6b-8680-8a710caccd26\" (UID: \"194efd87-d75e-4e6b-8680-8a710caccd26\") "
Jul 20 13:20:40.132634 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:20:40.132608    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/194efd87-d75e-4e6b-8680-8a710caccd26-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "194efd87-d75e-4e6b-8680-8a710caccd26" (UID: "194efd87-d75e-4e6b-8680-8a710caccd26"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:20:40.134324 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:20:40.134296    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/194efd87-d75e-4e6b-8680-8a710caccd26-kube-api-access-5jg69" (OuterVolumeSpecName: "kube-api-access-5jg69") pod "194efd87-d75e-4e6b-8680-8a710caccd26" (UID: "194efd87-d75e-4e6b-8680-8a710caccd26"). InnerVolumeSpecName "kube-api-access-5jg69". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:20:40.233809 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:20:40.233776    2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/194efd87-d75e-4e6b-8680-8a710caccd26-extensions-socket-volume\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:20:40.233809 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:20:40.233802    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5jg69\" (UniqueName: \"kubernetes.io/projected/194efd87-d75e-4e6b-8680-8a710caccd26-kube-api-access-5jg69\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:20:40.370590 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:20:40.370556    2565 generic.go:356] "Generic (PLEG): container finished" podID="194efd87-d75e-4e6b-8680-8a710caccd26" containerID="d9d09b140d03f9ffcb0013f158439290397768daf865e5bb4d6c83c38cc9aca7" exitCode=0
Jul 20 13:20:40.370749 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:20:40.370595    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8ms9h" event={"ID":"194efd87-d75e-4e6b-8680-8a710caccd26","Type":"ContainerDied","Data":"d9d09b140d03f9ffcb0013f158439290397768daf865e5bb4d6c83c38cc9aca7"}
Jul 20 13:20:40.370749 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:20:40.370663    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8ms9h" event={"ID":"194efd87-d75e-4e6b-8680-8a710caccd26","Type":"ContainerDied","Data":"941a88ff77052ad11b2d5d47d52748d27851cd75f1ad21e436346d8de0d622ec"}
Jul 20 13:20:40.370749 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:20:40.370609    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8ms9h"
Jul 20 13:20:40.370852 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:20:40.370690    2565 scope.go:117] "RemoveContainer" containerID="d9d09b140d03f9ffcb0013f158439290397768daf865e5bb4d6c83c38cc9aca7"
Jul 20 13:20:40.381514 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:20:40.381492    2565 scope.go:117] "RemoveContainer" containerID="d9d09b140d03f9ffcb0013f158439290397768daf865e5bb4d6c83c38cc9aca7"
Jul 20 13:20:40.381764 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:20:40.381745    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9d09b140d03f9ffcb0013f158439290397768daf865e5bb4d6c83c38cc9aca7\": container with ID starting with d9d09b140d03f9ffcb0013f158439290397768daf865e5bb4d6c83c38cc9aca7 not found: ID does not exist" containerID="d9d09b140d03f9ffcb0013f158439290397768daf865e5bb4d6c83c38cc9aca7"
Jul 20 13:20:40.381811 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:20:40.381774    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9d09b140d03f9ffcb0013f158439290397768daf865e5bb4d6c83c38cc9aca7"} err="failed to get container status \"d9d09b140d03f9ffcb0013f158439290397768daf865e5bb4d6c83c38cc9aca7\": rpc error: code = NotFound desc = could not find container \"d9d09b140d03f9ffcb0013f158439290397768daf865e5bb4d6c83c38cc9aca7\": container with ID starting with d9d09b140d03f9ffcb0013f158439290397768daf865e5bb4d6c83c38cc9aca7 not found: ID does not exist"
Jul 20 13:20:40.393498 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:20:40.393438    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8ms9h"]
Jul 20 13:20:40.398999 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:20:40.398974    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-8ms9h"]
Jul 20 13:20:42.147131 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:20:42.147097    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="194efd87-d75e-4e6b-8680-8a710caccd26" path="/var/lib/kubelet/pods/194efd87-d75e-4e6b-8680-8a710caccd26/volumes"
Jul 20 13:21:35.663981 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:21:35.663947    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:21:35.716394 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:21:35.716341    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:21:38.601464 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:21:38.601424    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pkzkq"]
Jul 20 13:21:38.601850 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:21:38.601750    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="194efd87-d75e-4e6b-8680-8a710caccd26" containerName="manager"
Jul 20 13:21:38.601850 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:21:38.601762    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="194efd87-d75e-4e6b-8680-8a710caccd26" containerName="manager"
Jul 20 13:21:38.601850 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:21:38.601826    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="194efd87-d75e-4e6b-8680-8a710caccd26" containerName="manager"
Jul 20 13:21:38.605069 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:21:38.605049    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pkzkq"
Jul 20 13:21:38.607814 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:21:38.607787    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-swm8s\""
Jul 20 13:21:38.648997 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:21:38.648969    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pkzkq"]
Jul 20 13:21:38.688130 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:21:38.688094    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jhxnc\" (UniqueName: \"kubernetes.io/projected/76f9c88c-c07f-4dbd-a3de-00a9f1642745-kube-api-access-jhxnc\") pod \"kuadrant-operator-controller-manager-86878c769f-pkzkq\" (UID: \"76f9c88c-c07f-4dbd-a3de-00a9f1642745\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pkzkq"
Jul 20 13:21:38.688304 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:21:38.688140    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/76f9c88c-c07f-4dbd-a3de-00a9f1642745-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-pkzkq\" (UID: \"76f9c88c-c07f-4dbd-a3de-00a9f1642745\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pkzkq"
Jul 20 13:21:38.789370 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:21:38.789325    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/76f9c88c-c07f-4dbd-a3de-00a9f1642745-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-pkzkq\" (UID: \"76f9c88c-c07f-4dbd-a3de-00a9f1642745\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pkzkq"
Jul 20 13:21:38.789533 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:21:38.789432    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jhxnc\" (UniqueName: \"kubernetes.io/projected/76f9c88c-c07f-4dbd-a3de-00a9f1642745-kube-api-access-jhxnc\") pod \"kuadrant-operator-controller-manager-86878c769f-pkzkq\" (UID: \"76f9c88c-c07f-4dbd-a3de-00a9f1642745\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pkzkq"
Jul 20 13:21:38.789686 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:21:38.789666    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/76f9c88c-c07f-4dbd-a3de-00a9f1642745-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-pkzkq\" (UID: \"76f9c88c-c07f-4dbd-a3de-00a9f1642745\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pkzkq"
Jul 20 13:21:38.798779 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:21:38.798759    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jhxnc\" (UniqueName: \"kubernetes.io/projected/76f9c88c-c07f-4dbd-a3de-00a9f1642745-kube-api-access-jhxnc\") pod \"kuadrant-operator-controller-manager-86878c769f-pkzkq\" (UID: \"76f9c88c-c07f-4dbd-a3de-00a9f1642745\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pkzkq"
Jul 20 13:21:38.915944 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:21:38.915906    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pkzkq"
Jul 20 13:21:39.056908 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:21:39.056881    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pkzkq"]
Jul 20 13:21:39.059430 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:21:39.059399    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76f9c88c_c07f_4dbd_a3de_00a9f1642745.slice/crio-dd00975f45d54ac972936b31bfdbcf8d89451ba7fa3edb2969523421ed5f00f3 WatchSource:0}: Error finding container dd00975f45d54ac972936b31bfdbcf8d89451ba7fa3edb2969523421ed5f00f3: Status 404 returned error can't find the container with id dd00975f45d54ac972936b31bfdbcf8d89451ba7fa3edb2969523421ed5f00f3
Jul 20 13:21:39.655189 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:21:39.655149    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pkzkq" event={"ID":"76f9c88c-c07f-4dbd-a3de-00a9f1642745","Type":"ContainerStarted","Data":"ed2dbb76bb77864712e609fef7536e541599fc28832e47554e0d6efdfe663c81"}
Jul 20 13:21:39.655704 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:21:39.655206    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pkzkq" event={"ID":"76f9c88c-c07f-4dbd-a3de-00a9f1642745","Type":"ContainerStarted","Data":"dd00975f45d54ac972936b31bfdbcf8d89451ba7fa3edb2969523421ed5f00f3"}
Jul 20 13:21:39.655704 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:21:39.655233    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pkzkq"
Jul 20 13:21:39.683752 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:21:39.683705    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pkzkq" podStartSLOduration=1.6836909740000001 podStartE2EDuration="1.683690974s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:21:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:21:39.681518813 +0000 UTC m=+1206.151050949" watchObservedRunningTime="2026-07-20 13:21:39.683690974 +0000 UTC m=+1206.153223092"
Jul 20 13:21:50.661909 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:21:50.661877    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-pkzkq"
Jul 20 13:22:00.955512 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:22:00.955474    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:22:11.431053 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:22:11.431014    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:22:25.539737 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:22:25.539653    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:22:37.843023 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:22:37.842985    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:22:47.726992 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:22:47.726950    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:22:57.130776 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:22:57.130739    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:23:06.338172 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:23:06.338139    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:23:16.925627 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:23:16.925587    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:23:27.927301 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:23:27.927255    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:23:37.231809 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:23:37.231776    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:23:50.832974 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:23:50.832938    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:24:14.532508 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:24:14.532471    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:24:21.932630 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:24:21.932594    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:24:32.027707 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:24:32.027668    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:24:41.428165 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:24:41.428130    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:24:52.131107 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:24:52.131068    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:25:01.232597 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:25:01.232557    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:25:14.857102 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:25:14.857065    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:25:23.828376 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:25:23.828322    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:25:38.946688 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:25:38.946609    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:25:48.037633 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:25:48.037588    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:25:57.441226 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:25:57.441180    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:26:11.835006 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:26:11.834966    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:26:21.039677 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:26:21.039644    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:26:30.834057 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:26:30.834017    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:26:40.847368 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:26:40.847315    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:26:41.112783 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:26:41.112748    2565 generic.go:356] "Generic (PLEG): container finished" podID="b1137bca-71d8-42ca-b067-705ccd70b38d" containerID="7d1a6bbdf2fd6573588c7166dd1e4288835768d5a2995dabe2ace66f7ff4e19a" exitCode=1
Jul 20 13:26:41.112944 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:26:41.112820    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t4n9j" event={"ID":"b1137bca-71d8-42ca-b067-705ccd70b38d","Type":"ContainerDied","Data":"7d1a6bbdf2fd6573588c7166dd1e4288835768d5a2995dabe2ace66f7ff4e19a"}
Jul 20 13:26:41.113133 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:26:41.113121    2565 scope.go:117] "RemoveContainer" containerID="7d1a6bbdf2fd6573588c7166dd1e4288835768d5a2995dabe2ace66f7ff4e19a"
Jul 20 13:26:41.117223 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:26:41.117204    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 20 13:26:41.124043 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:26:41.124023    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t4n9j"
Jul 20 13:26:42.120129 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:26:42.120095    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t4n9j" event={"ID":"b1137bca-71d8-42ca-b067-705ccd70b38d","Type":"ContainerStarted","Data":"e52524f603ffb053f3604b63144b7b3ea8b19b0f7fa2f74c615b3019c4646dc2"}
Jul 20 13:26:42.120545 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:26:42.120186    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t4n9j"
Jul 20 13:26:53.127835 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:26:53.127804    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t4n9j"
Jul 20 13:26:59.349703 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:26:59.349624    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:27:08.471571 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:27:08.471527    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:27:24.259190 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:27:24.259157    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:27:38.646313 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:27:38.646278    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:27:42.279684 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:27:42.279646    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:27:49.355188 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:27:49.355152    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:28:02.280063 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:02.280030    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:28:05.183202 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:05.183169    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:28:05.283715 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:05.283682    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:28:05.718609 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:05.718565    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:28:11.676824 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:11.676788    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:28:11.737584 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:11.737531    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:28:11.936139 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:11.936055    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:28:12.799884 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:12.799844    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:28:13.138868 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:13.138837    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:28:13.235237 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:13.235204    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:28:13.482432 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:13.482336    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:28:13.710265 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:13.710230    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:28:14.480281 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:14.480249    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:28:14.578381 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:14.578332    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:28:15.696529 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:15.696494    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:28:18.257653 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:18.257617    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7291c4b7-sw5lk"]
Jul 20 13:28:18.261228 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:18.261210    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7291c4b7-sw5lk"
Jul 20 13:28:18.264255 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:18.264228    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 13:28:18.264415 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:18.264229    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zcsfd\""
Jul 20 13:28:18.270409 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:18.270038    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7291c4b7-sw5lk"]
Jul 20 13:28:18.271954 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:18.271922    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f53aef2-7f46-4a7a-8ebe-5f4f6cd4fe89-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-7291c4b7-sw5lk\" (UID: \"4f53aef2-7f46-4a7a-8ebe-5f4f6cd4fe89\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7291c4b7-sw5lk"
Jul 20 13:28:18.372638 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:18.372602    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f53aef2-7f46-4a7a-8ebe-5f4f6cd4fe89-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-7291c4b7-sw5lk\" (UID: \"4f53aef2-7f46-4a7a-8ebe-5f4f6cd4fe89\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7291c4b7-sw5lk"
Jul 20 13:28:18.373205 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:18.373188    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f53aef2-7f46-4a7a-8ebe-5f4f6cd4fe89-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-7291c4b7-sw5lk\" (UID: \"4f53aef2-7f46-4a7a-8ebe-5f4f6cd4fe89\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7291c4b7-sw5lk"
Jul 20 13:28:18.573969 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:18.573880    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7291c4b7-sw5lk"
Jul 20 13:28:18.705457 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:18.705432    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7291c4b7-sw5lk"]
Jul 20 13:28:18.707818 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:28:18.707793    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4f53aef2_7f46_4a7a_8ebe_5f4f6cd4fe89.slice/crio-a7e9470b38b96cbf327673d77b9e9a4ef48f9b0fcd2f27d0a61da9eb3551cb14 WatchSource:0}: Error finding container a7e9470b38b96cbf327673d77b9e9a4ef48f9b0fcd2f27d0a61da9eb3551cb14: Status 404 returned error can't find the container with id a7e9470b38b96cbf327673d77b9e9a4ef48f9b0fcd2f27d0a61da9eb3551cb14
Jul 20 13:28:18.710030 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:18.710013    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 13:28:19.581683 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:19.581643    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7291c4b7-sw5lk" event={"ID":"4f53aef2-7f46-4a7a-8ebe-5f4f6cd4fe89","Type":"ContainerStarted","Data":"a7e9470b38b96cbf327673d77b9e9a4ef48f9b0fcd2f27d0a61da9eb3551cb14"}
Jul 20 13:28:20.339167 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:20.339131    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:28:21.598062 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:21.598022    2565 generic.go:356] "Generic (PLEG): container finished" podID="4f53aef2-7f46-4a7a-8ebe-5f4f6cd4fe89" containerID="390f308ba836bf91437a378acb26b5cf2ca7f6e4a5f1623e702f30d7c9243255" exitCode=7
Jul 20 13:28:21.598459 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:21.598098    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7291c4b7-sw5lk" event={"ID":"4f53aef2-7f46-4a7a-8ebe-5f4f6cd4fe89","Type":"ContainerDied","Data":"390f308ba836bf91437a378acb26b5cf2ca7f6e4a5f1623e702f30d7c9243255"}
Jul 20 13:28:21.598459 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:21.598331    2565 scope.go:117] "RemoveContainer" containerID="390f308ba836bf91437a378acb26b5cf2ca7f6e4a5f1623e702f30d7c9243255"
Jul 20 13:28:22.604908 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:22.604836    2565 generic.go:356] "Generic (PLEG): container finished" podID="4f53aef2-7f46-4a7a-8ebe-5f4f6cd4fe89" containerID="6a7379b1084e8bd96c6227e53f466a209da1fd40eac398a645510c8e82925d0a" exitCode=0
Jul 20 13:28:22.605278 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:22.604926    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7291c4b7-sw5lk" event={"ID":"4f53aef2-7f46-4a7a-8ebe-5f4f6cd4fe89","Type":"ContainerDied","Data":"6a7379b1084e8bd96c6227e53f466a209da1fd40eac398a645510c8e82925d0a"}
Jul 20 13:28:22.605278 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:22.604992    2565 scope.go:117] "RemoveContainer" containerID="390f308ba836bf91437a378acb26b5cf2ca7f6e4a5f1623e702f30d7c9243255"
Jul 20 13:28:23.746944 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:23.746919    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7291c4b7-sw5lk"
Jul 20 13:28:23.811041 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:23.811013    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f53aef2-7f46-4a7a-8ebe-5f4f6cd4fe89-maas-api-service-ca\") pod \"4f53aef2-7f46-4a7a-8ebe-5f4f6cd4fe89\" (UID: \"4f53aef2-7f46-4a7a-8ebe-5f4f6cd4fe89\") "
Jul 20 13:28:23.811438 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:23.811417    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4f53aef2-7f46-4a7a-8ebe-5f4f6cd4fe89-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "4f53aef2-7f46-4a7a-8ebe-5f4f6cd4fe89" (UID: "4f53aef2-7f46-4a7a-8ebe-5f4f6cd4fe89"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:28:23.911801 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:23.911698    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/4f53aef2-7f46-4a7a-8ebe-5f4f6cd4fe89-maas-api-service-ca\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:28:24.616693 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:24.616659    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7291c4b7-sw5lk" event={"ID":"4f53aef2-7f46-4a7a-8ebe-5f4f6cd4fe89","Type":"ContainerDied","Data":"a7e9470b38b96cbf327673d77b9e9a4ef48f9b0fcd2f27d0a61da9eb3551cb14"}
Jul 20 13:28:24.616693 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:24.616686    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-7291c4b7-sw5lk"
Jul 20 13:28:24.616929 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:24.616707    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a7e9470b38b96cbf327673d77b9e9a4ef48f9b0fcd2f27d0a61da9eb3551cb14"
Jul 20 13:28:28.861672 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:28.861579    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:28:31.325202 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:31.325165    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:28:33.344452 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:33.344416    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:28:36.019518 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:36.019484    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:28:36.082269 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:36.082237    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:28:39.368281 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:39.368241    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:28:39.436974 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:39.436941    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:28:43.559667 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:43.559625    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:28:43.953225 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:43.953190    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:28:44.055836 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:44.055799    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:28:44.154593 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:44.154558    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:28:45.405199 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:45.405163    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:28:45.510371 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:45.510335    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:28:45.723982 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:45.723877    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:28:46.011226 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:46.011143    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:28:46.614296 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:46.614258    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:28:49.979382 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:49.979327    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dc1ba087-5p4kv"]
Jul 20 13:28:49.979758 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:49.979693    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f53aef2-7f46-4a7a-8ebe-5f4f6cd4fe89" containerName="revoke-keys"
Jul 20 13:28:49.979758 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:49.979704    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f53aef2-7f46-4a7a-8ebe-5f4f6cd4fe89" containerName="revoke-keys"
Jul 20 13:28:49.979758 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:49.979722    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4f53aef2-7f46-4a7a-8ebe-5f4f6cd4fe89" containerName="revoke-keys"
Jul 20 13:28:49.979758 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:49.979727    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="4f53aef2-7f46-4a7a-8ebe-5f4f6cd4fe89" containerName="revoke-keys"
Jul 20 13:28:49.979887 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:49.979777    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f53aef2-7f46-4a7a-8ebe-5f4f6cd4fe89" containerName="revoke-keys"
Jul 20 13:28:49.979887 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:49.979785    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="4f53aef2-7f46-4a7a-8ebe-5f4f6cd4fe89" containerName="revoke-keys"
Jul 20 13:28:49.985558 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:49.985536    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dc1ba087-5p4kv"
Jul 20 13:28:49.989290 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:49.989005    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 13:28:49.989290 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:49.989091    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zcsfd\""
Jul 20 13:28:49.990460 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:49.990439    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dc1ba087-5p4kv"]
Jul 20 13:28:50.025810 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:50.025777    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d349012a-fbd6-4317-9699-6aa75ae613aa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-dc1ba087-5p4kv\" (UID: \"d349012a-fbd6-4317-9699-6aa75ae613aa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dc1ba087-5p4kv"
Jul 20 13:28:50.127265 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:50.127227    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d349012a-fbd6-4317-9699-6aa75ae613aa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-dc1ba087-5p4kv\" (UID: \"d349012a-fbd6-4317-9699-6aa75ae613aa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dc1ba087-5p4kv"
Jul 20 13:28:50.127879 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:50.127860    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d349012a-fbd6-4317-9699-6aa75ae613aa-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-dc1ba087-5p4kv\" (UID: \"d349012a-fbd6-4317-9699-6aa75ae613aa\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dc1ba087-5p4kv"
Jul 20 13:28:50.172066 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:50.172036    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:28:50.229928 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:50.229847    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:28:50.297842 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:50.297810    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dc1ba087-5p4kv"
Jul 20 13:28:50.428986 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:50.428954    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dc1ba087-5p4kv"]
Jul 20 13:28:50.430836 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:28:50.430812    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd349012a_fbd6_4317_9699_6aa75ae613aa.slice/crio-9b26b8a649316badf1fcfa808524fe185d90636c514c007719acacf4c55e0d75 WatchSource:0}: Error finding container 9b26b8a649316badf1fcfa808524fe185d90636c514c007719acacf4c55e0d75: Status 404 returned error can't find the container with id 9b26b8a649316badf1fcfa808524fe185d90636c514c007719acacf4c55e0d75
Jul 20 13:28:50.740830 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:50.740789    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dc1ba087-5p4kv" event={"ID":"d349012a-fbd6-4317-9699-6aa75ae613aa","Type":"ContainerStarted","Data":"9b26b8a649316badf1fcfa808524fe185d90636c514c007719acacf4c55e0d75"}
Jul 20 13:28:51.746783 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:51.746746    2565 generic.go:356] "Generic (PLEG): container finished" podID="d349012a-fbd6-4317-9699-6aa75ae613aa" containerID="c9a6126137b9d70128a64a65e3a399fd2ee6351cd9509935ee1825e0efbb2fa1" exitCode=7
Jul 20 13:28:51.746783 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:51.746785    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dc1ba087-5p4kv" event={"ID":"d349012a-fbd6-4317-9699-6aa75ae613aa","Type":"ContainerDied","Data":"c9a6126137b9d70128a64a65e3a399fd2ee6351cd9509935ee1825e0efbb2fa1"}
Jul 20 13:28:51.747303 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:51.747018    2565 scope.go:117] "RemoveContainer" containerID="c9a6126137b9d70128a64a65e3a399fd2ee6351cd9509935ee1825e0efbb2fa1"
Jul 20 13:28:52.754103 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:52.754012    2565 generic.go:356] "Generic (PLEG): container finished" podID="d349012a-fbd6-4317-9699-6aa75ae613aa" containerID="ed37796c13590902db6470178ff21999690d6ba0e196991b695d007d2484cf4d" exitCode=7
Jul 20 13:28:52.754103 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:52.754049    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dc1ba087-5p4kv" event={"ID":"d349012a-fbd6-4317-9699-6aa75ae613aa","Type":"ContainerDied","Data":"ed37796c13590902db6470178ff21999690d6ba0e196991b695d007d2484cf4d"}
Jul 20 13:28:52.754103 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:52.754097    2565 scope.go:117] "RemoveContainer" containerID="c9a6126137b9d70128a64a65e3a399fd2ee6351cd9509935ee1825e0efbb2fa1"
Jul 20 13:28:52.754674 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:52.754329    2565 scope.go:117] "RemoveContainer" containerID="ed37796c13590902db6470178ff21999690d6ba0e196991b695d007d2484cf4d"
Jul 20 13:28:52.754674 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:28:52.754595    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-dc1ba087-5p4kv_odh-ai-gateway-infra(d349012a-fbd6-4317-9699-6aa75ae613aa)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dc1ba087-5p4kv" podUID="d349012a-fbd6-4317-9699-6aa75ae613aa"
Jul 20 13:28:53.618270 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:53.618233    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:28:53.760729 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:53.760704    2565 scope.go:117] "RemoveContainer" containerID="ed37796c13590902db6470178ff21999690d6ba0e196991b695d007d2484cf4d"
Jul 20 13:28:53.761126 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:28:53.760874    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-migrate-dc1ba087-5p4kv_odh-ai-gateway-infra(d349012a-fbd6-4317-9699-6aa75ae613aa)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dc1ba087-5p4kv" podUID="d349012a-fbd6-4317-9699-6aa75ae613aa"
Jul 20 13:28:54.608346 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:28:54.608312    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:29:09.141379 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:29:09.141325    2565 scope.go:117] "RemoveContainer" containerID="ed37796c13590902db6470178ff21999690d6ba0e196991b695d007d2484cf4d"
Jul 20 13:29:09.840470 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:29:09.840353    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dc1ba087-5p4kv" event={"ID":"d349012a-fbd6-4317-9699-6aa75ae613aa","Type":"ContainerStarted","Data":"7780ab14baa25716085161754e9e3e745d2d338d1ea6e1c86104221a9f85a9ea"}
Jul 20 13:29:09.858164 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:29:09.858116    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dc1ba087-5p4kv" podStartSLOduration=20.858101118 podStartE2EDuration="20.858101118s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:28:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:29:09.856029182 +0000 UTC m=+1656.325561300" watchObservedRunningTime="2026-07-20 13:29:09.858101118 +0000 UTC m=+1656.327633214"
Jul 20 13:29:10.848296 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:29:10.848259    2565 generic.go:356] "Generic (PLEG): container finished" podID="d349012a-fbd6-4317-9699-6aa75ae613aa" containerID="7780ab14baa25716085161754e9e3e745d2d338d1ea6e1c86104221a9f85a9ea" exitCode=0
Jul 20 13:29:10.848775 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:29:10.848328    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dc1ba087-5p4kv" event={"ID":"d349012a-fbd6-4317-9699-6aa75ae613aa","Type":"ContainerDied","Data":"7780ab14baa25716085161754e9e3e745d2d338d1ea6e1c86104221a9f85a9ea"}
Jul 20 13:29:10.848775 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:29:10.848398    2565 scope.go:117] "RemoveContainer" containerID="ed37796c13590902db6470178ff21999690d6ba0e196991b695d007d2484cf4d"
Jul 20 13:29:10.868299 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:29:10.868273    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dc1ba087-5p4kv"]
Jul 20 13:29:11.983133 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:29:11.983109    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dc1ba087-5p4kv"
Jul 20 13:29:12.120995 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:29:12.120965    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d349012a-fbd6-4317-9699-6aa75ae613aa-maas-api-service-ca\") pod \"d349012a-fbd6-4317-9699-6aa75ae613aa\" (UID: \"d349012a-fbd6-4317-9699-6aa75ae613aa\") "
Jul 20 13:29:12.121347 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:29:12.121322    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d349012a-fbd6-4317-9699-6aa75ae613aa-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "d349012a-fbd6-4317-9699-6aa75ae613aa" (UID: "d349012a-fbd6-4317-9699-6aa75ae613aa"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:29:12.222176 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:29:12.222149    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/d349012a-fbd6-4317-9699-6aa75ae613aa-maas-api-service-ca\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:29:12.860238 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:29:12.860209    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dc1ba087-5p4kv"
Jul 20 13:29:12.860451 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:29:12.860249    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dc1ba087-5p4kv" event={"ID":"d349012a-fbd6-4317-9699-6aa75ae613aa","Type":"ContainerDied","Data":"9b26b8a649316badf1fcfa808524fe185d90636c514c007719acacf4c55e0d75"}
Jul 20 13:29:12.860451 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:29:12.860298    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9b26b8a649316badf1fcfa808524fe185d90636c514c007719acacf4c55e0d75"
Jul 20 13:29:12.892920 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:29:12.892883    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dc1ba087-5p4kv"]
Jul 20 13:29:12.894563 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:29:12.894531    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dc1ba087-5p4kv"]
Jul 20 13:29:14.147394 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:29:14.147330    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d349012a-fbd6-4317-9699-6aa75ae613aa" path="/var/lib/kubelet/pods/d349012a-fbd6-4317-9699-6aa75ae613aa/volumes"
Jul 20 13:29:20.877576 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:29:20.877540    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:29:50.030855 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:29:50.030817    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dc1ba087-vktmj"]
Jul 20 13:29:50.031375 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:29:50.031189    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d349012a-fbd6-4317-9699-6aa75ae613aa" containerName="revoke-keys"
Jul 20 13:29:50.031375 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:29:50.031200    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d349012a-fbd6-4317-9699-6aa75ae613aa" containerName="revoke-keys"
Jul 20 13:29:50.031375 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:29:50.031209    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d349012a-fbd6-4317-9699-6aa75ae613aa" containerName="revoke-keys"
Jul 20 13:29:50.031375 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:29:50.031214    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d349012a-fbd6-4317-9699-6aa75ae613aa" containerName="revoke-keys"
Jul 20 13:29:50.031375 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:29:50.031226    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d349012a-fbd6-4317-9699-6aa75ae613aa" containerName="revoke-keys"
Jul 20 13:29:50.031375 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:29:50.031231    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d349012a-fbd6-4317-9699-6aa75ae613aa" containerName="revoke-keys"
Jul 20 13:29:50.031375 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:29:50.031281    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d349012a-fbd6-4317-9699-6aa75ae613aa" containerName="revoke-keys"
Jul 20 13:29:50.031375 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:29:50.031289    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d349012a-fbd6-4317-9699-6aa75ae613aa" containerName="revoke-keys"
Jul 20 13:29:50.034251 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:29:50.034234    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dc1ba087-vktmj"
Jul 20 13:29:50.037151 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:29:50.037129    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 13:29:50.037265 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:29:50.037191    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zcsfd\""
Jul 20 13:29:50.042155 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:29:50.042128    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dc1ba087-vktmj"]
Jul 20 13:29:50.132534 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:29:50.132498    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:29:50.152366 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:29:50.152329    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/caecd64e-3192-488c-a72f-cba21453886c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-dc1ba087-vktmj\" (UID: \"caecd64e-3192-488c-a72f-cba21453886c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dc1ba087-vktmj"
Jul 20 13:29:50.244143 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:29:50.244114    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:29:50.253624 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:29:50.253600    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/caecd64e-3192-488c-a72f-cba21453886c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-dc1ba087-vktmj\" (UID: \"caecd64e-3192-488c-a72f-cba21453886c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dc1ba087-vktmj"
Jul 20 13:29:50.254208 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:29:50.254189    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/caecd64e-3192-488c-a72f-cba21453886c-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-dc1ba087-vktmj\" (UID: \"caecd64e-3192-488c-a72f-cba21453886c\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dc1ba087-vktmj"
Jul 20 13:29:50.346764 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:29:50.346678    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dc1ba087-vktmj"
Jul 20 13:29:50.704251 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:29:50.704224    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dc1ba087-vktmj"]
Jul 20 13:29:50.706936 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:29:50.706912    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaecd64e_3192_488c_a72f_cba21453886c.slice/crio-aaf92c2bfc6db85182a2a0ef20e0d2eb89a13ddb5954087ab0efed063e735ea3 WatchSource:0}: Error finding container aaf92c2bfc6db85182a2a0ef20e0d2eb89a13ddb5954087ab0efed063e735ea3: Status 404 returned error can't find the container with id aaf92c2bfc6db85182a2a0ef20e0d2eb89a13ddb5954087ab0efed063e735ea3
Jul 20 13:29:51.052252 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:29:51.052212    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dc1ba087-vktmj" event={"ID":"caecd64e-3192-488c-a72f-cba21453886c","Type":"ContainerStarted","Data":"62b20f2ff52b523244363d6597c0a68f91c1b55497ed9fe182f3604def0edb82"}
Jul 20 13:29:51.052666 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:29:51.052270    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dc1ba087-vktmj" event={"ID":"caecd64e-3192-488c-a72f-cba21453886c","Type":"ContainerStarted","Data":"aaf92c2bfc6db85182a2a0ef20e0d2eb89a13ddb5954087ab0efed063e735ea3"}
Jul 20 13:29:51.071737 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:29:51.071690    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dc1ba087-vktmj" podStartSLOduration=1.071676025 podStartE2EDuration="1.071676025s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:29:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:29:51.070779518 +0000 UTC m=+1697.540311640" watchObservedRunningTime="2026-07-20 13:29:51.071676025 +0000 UTC m=+1697.541208144"
Jul 20 13:29:52.059044 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:29:52.059008    2565 generic.go:356] "Generic (PLEG): container finished" podID="caecd64e-3192-488c-a72f-cba21453886c" containerID="62b20f2ff52b523244363d6597c0a68f91c1b55497ed9fe182f3604def0edb82" exitCode=0
Jul 20 13:29:52.059460 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:29:52.059093    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dc1ba087-vktmj" event={"ID":"caecd64e-3192-488c-a72f-cba21453886c","Type":"ContainerDied","Data":"62b20f2ff52b523244363d6597c0a68f91c1b55497ed9fe182f3604def0edb82"}
Jul 20 13:29:52.922096 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:29:52.922056    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:29:53.196622 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:29:53.196598    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dc1ba087-vktmj"
Jul 20 13:29:53.284207 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:29:53.284165    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/caecd64e-3192-488c-a72f-cba21453886c-maas-api-service-ca\") pod \"caecd64e-3192-488c-a72f-cba21453886c\" (UID: \"caecd64e-3192-488c-a72f-cba21453886c\") "
Jul 20 13:29:53.284551 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:29:53.284529    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/caecd64e-3192-488c-a72f-cba21453886c-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "caecd64e-3192-488c-a72f-cba21453886c" (UID: "caecd64e-3192-488c-a72f-cba21453886c"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:29:53.385175 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:29:53.385137    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/caecd64e-3192-488c-a72f-cba21453886c-maas-api-service-ca\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:29:54.071494 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:29:54.071467    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dc1ba087-vktmj"
Jul 20 13:29:54.071667 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:29:54.071498    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-dc1ba087-vktmj" event={"ID":"caecd64e-3192-488c-a72f-cba21453886c","Type":"ContainerDied","Data":"aaf92c2bfc6db85182a2a0ef20e0d2eb89a13ddb5954087ab0efed063e735ea3"}
Jul 20 13:29:54.071667 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:29:54.071545    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aaf92c2bfc6db85182a2a0ef20e0d2eb89a13ddb5954087ab0efed063e735ea3"
Jul 20 13:29:55.734412 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:29:55.734317    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:29:56.486567 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:29:56.486537    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:29:56.685995 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:29:56.685963    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:30:00.136256 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:00.136221    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742570-nnx4v"]
Jul 20 13:30:00.136688 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:00.136570    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="caecd64e-3192-488c-a72f-cba21453886c" containerName="revoke-keys"
Jul 20 13:30:00.136688 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:00.136583    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="caecd64e-3192-488c-a72f-cba21453886c" containerName="revoke-keys"
Jul 20 13:30:00.136688 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:00.136645    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d349012a-fbd6-4317-9699-6aa75ae613aa" containerName="revoke-keys"
Jul 20 13:30:00.136688 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:00.136654    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="caecd64e-3192-488c-a72f-cba21453886c" containerName="revoke-keys"
Jul 20 13:30:00.139819 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:00.139804    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742570-nnx4v"
Jul 20 13:30:00.142489 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:00.142469    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zcsfd\""
Jul 20 13:30:00.148660 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:00.148639    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742570-nnx4v"]
Jul 20 13:30:00.155008 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:00.154983    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742570-nnx4v"
Jul 20 13:30:00.489015 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:00.488988    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742570-nnx4v"]
Jul 20 13:30:00.490562 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:30:00.490527    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd44b2c95_fcc8_4374_8486_dccd5ca4c5a4.slice/crio-0e5843943ac1504edc5360131c90e3f102bfd8efb133701622aa6f891566479c WatchSource:0}: Error finding container 0e5843943ac1504edc5360131c90e3f102bfd8efb133701622aa6f891566479c: Status 404 returned error can't find the container with id 0e5843943ac1504edc5360131c90e3f102bfd8efb133701622aa6f891566479c
Jul 20 13:30:01.105613 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:01.105577    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742570-nnx4v" event={"ID":"d44b2c95-fcc8-4374-8486-dccd5ca4c5a4","Type":"ContainerStarted","Data":"bb7ebaf85f8eb016fa3ab897c1fd1dda1fd4b26bed43867b3abeee30842ce6ed"}
Jul 20 13:30:01.105781 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:01.105631    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742570-nnx4v" event={"ID":"d44b2c95-fcc8-4374-8486-dccd5ca4c5a4","Type":"ContainerStarted","Data":"0e5843943ac1504edc5360131c90e3f102bfd8efb133701622aa6f891566479c"}
Jul 20 13:30:01.122917 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:01.122875    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742570-nnx4v" podStartSLOduration=1.122860851 podStartE2EDuration="1.122860851s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:30:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:30:01.12132484 +0000 UTC m=+1707.590856958" watchObservedRunningTime="2026-07-20 13:30:01.122860851 +0000 UTC m=+1707.592392977"
Jul 20 13:30:02.111999 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:02.111967    2565 generic.go:356] "Generic (PLEG): container finished" podID="d44b2c95-fcc8-4374-8486-dccd5ca4c5a4" containerID="bb7ebaf85f8eb016fa3ab897c1fd1dda1fd4b26bed43867b3abeee30842ce6ed" exitCode=0
Jul 20 13:30:02.112486 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:02.112037    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742570-nnx4v" event={"ID":"d44b2c95-fcc8-4374-8486-dccd5ca4c5a4","Type":"ContainerDied","Data":"bb7ebaf85f8eb016fa3ab897c1fd1dda1fd4b26bed43867b3abeee30842ce6ed"}
Jul 20 13:30:02.291441 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:02.291409    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:30:02.393303 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:02.393222    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:30:02.533809 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:02.533774    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:30:02.633803 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:02.633765    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:30:03.249936 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:03.249909    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742570-nnx4v"
Jul 20 13:30:03.647113 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:03.647042    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:30:03.739682 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:03.739651    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:30:03.909949 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:03.909854    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:30:04.010279 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:04.010245    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:30:04.123126 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:04.123097    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742570-nnx4v"
Jul 20 13:30:04.123274 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:04.123134    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742570-nnx4v" event={"ID":"d44b2c95-fcc8-4374-8486-dccd5ca4c5a4","Type":"ContainerDied","Data":"0e5843943ac1504edc5360131c90e3f102bfd8efb133701622aa6f891566479c"}
Jul 20 13:30:04.123274 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:04.123184    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0e5843943ac1504edc5360131c90e3f102bfd8efb133701622aa6f891566479c"
Jul 20 13:30:04.468072 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:04.468018    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:30:04.568524 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:04.568489    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:30:06.009030 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:06.008977    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:30:06.316026 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:06.315938    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:30:08.850199 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:08.850164    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-22b1bd43-z82hl"]
Jul 20 13:30:08.850574 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:08.850502    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d44b2c95-fcc8-4374-8486-dccd5ca4c5a4" containerName="cleanup"
Jul 20 13:30:08.850574 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:08.850513    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d44b2c95-fcc8-4374-8486-dccd5ca4c5a4" containerName="cleanup"
Jul 20 13:30:08.850574 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:08.850569    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d44b2c95-fcc8-4374-8486-dccd5ca4c5a4" containerName="cleanup"
Jul 20 13:30:08.853517 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:08.853498    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-22b1bd43-z82hl"
Jul 20 13:30:08.856193 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:08.856173    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 13:30:08.856284 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:08.856176    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zcsfd\""
Jul 20 13:30:08.861172 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:08.861145    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-22b1bd43-z82hl"]
Jul 20 13:30:08.916204 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:08.916169    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/43613665-fb5d-4f30-8ff7-d9a346019dcc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-22b1bd43-z82hl\" (UID: \"43613665-fb5d-4f30-8ff7-d9a346019dcc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-22b1bd43-z82hl"
Jul 20 13:30:09.016786 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:09.016747    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/43613665-fb5d-4f30-8ff7-d9a346019dcc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-22b1bd43-z82hl\" (UID: \"43613665-fb5d-4f30-8ff7-d9a346019dcc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-22b1bd43-z82hl"
Jul 20 13:30:09.017400 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:09.017382    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/43613665-fb5d-4f30-8ff7-d9a346019dcc-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-22b1bd43-z82hl\" (UID: \"43613665-fb5d-4f30-8ff7-d9a346019dcc\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-22b1bd43-z82hl"
Jul 20 13:30:09.165412 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:09.165379    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-22b1bd43-z82hl"
Jul 20 13:30:09.497735 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:09.497709    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-22b1bd43-z82hl"]
Jul 20 13:30:09.499654 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:30:09.499623    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43613665_fb5d_4f30_8ff7_d9a346019dcc.slice/crio-49e04b579d6243e799636958c49c113291918430e79fbdf50db6a74f8653261c WatchSource:0}: Error finding container 49e04b579d6243e799636958c49c113291918430e79fbdf50db6a74f8653261c: Status 404 returned error can't find the container with id 49e04b579d6243e799636958c49c113291918430e79fbdf50db6a74f8653261c
Jul 20 13:30:10.155186 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:10.155156    2565 generic.go:356] "Generic (PLEG): container finished" podID="43613665-fb5d-4f30-8ff7-d9a346019dcc" containerID="bbcec575834d7b22c5819a1e2ff9803ab337751b2b3b1b58147f302e0912c634" exitCode=7
Jul 20 13:30:10.155634 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:10.155208    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-22b1bd43-z82hl" event={"ID":"43613665-fb5d-4f30-8ff7-d9a346019dcc","Type":"ContainerDied","Data":"bbcec575834d7b22c5819a1e2ff9803ab337751b2b3b1b58147f302e0912c634"}
Jul 20 13:30:10.155634 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:10.155257    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-22b1bd43-z82hl" event={"ID":"43613665-fb5d-4f30-8ff7-d9a346019dcc","Type":"ContainerStarted","Data":"49e04b579d6243e799636958c49c113291918430e79fbdf50db6a74f8653261c"}
Jul 20 13:30:10.155634 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:10.155470    2565 scope.go:117] "RemoveContainer" containerID="bbcec575834d7b22c5819a1e2ff9803ab337751b2b3b1b58147f302e0912c634"
Jul 20 13:30:11.162712 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:11.162678    2565 generic.go:356] "Generic (PLEG): container finished" podID="43613665-fb5d-4f30-8ff7-d9a346019dcc" containerID="9b1e05ee4898a40625db9f10adfdc7d733a5b1604498f3b16ed821cea46bd629" exitCode=7
Jul 20 13:30:11.163153 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:11.162771    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-22b1bd43-z82hl" event={"ID":"43613665-fb5d-4f30-8ff7-d9a346019dcc","Type":"ContainerDied","Data":"9b1e05ee4898a40625db9f10adfdc7d733a5b1604498f3b16ed821cea46bd629"}
Jul 20 13:30:11.163153 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:11.162846    2565 scope.go:117] "RemoveContainer" containerID="bbcec575834d7b22c5819a1e2ff9803ab337751b2b3b1b58147f302e0912c634"
Jul 20 13:30:11.163153 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:11.163057    2565 scope.go:117] "RemoveContainer" containerID="9b1e05ee4898a40625db9f10adfdc7d733a5b1604498f3b16ed821cea46bd629"
Jul 20 13:30:11.163342 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:30:11.163297    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-22b1bd43-z82hl_odh-ai-gateway-infra(43613665-fb5d-4f30-8ff7-d9a346019dcc)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-22b1bd43-z82hl" podUID="43613665-fb5d-4f30-8ff7-d9a346019dcc"
Jul 20 13:30:12.170421 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:12.170390    2565 scope.go:117] "RemoveContainer" containerID="9b1e05ee4898a40625db9f10adfdc7d733a5b1604498f3b16ed821cea46bd629"
Jul 20 13:30:12.170878 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:30:12.170627    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-22b1bd43-z82hl_odh-ai-gateway-infra(43613665-fb5d-4f30-8ff7-d9a346019dcc)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-22b1bd43-z82hl" podUID="43613665-fb5d-4f30-8ff7-d9a346019dcc"
Jul 20 13:30:24.144917 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:24.144890    2565 scope.go:117] "RemoveContainer" containerID="9b1e05ee4898a40625db9f10adfdc7d733a5b1604498f3b16ed821cea46bd629"
Jul 20 13:30:25.239225 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:25.239182    2565 generic.go:356] "Generic (PLEG): container finished" podID="43613665-fb5d-4f30-8ff7-d9a346019dcc" containerID="340aeffb4e70f533534812daf77dea03b7c3796fdf9baaa031fb5cc863fb109a" exitCode=0
Jul 20 13:30:25.239737 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:25.239257    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-22b1bd43-z82hl" event={"ID":"43613665-fb5d-4f30-8ff7-d9a346019dcc","Type":"ContainerDied","Data":"340aeffb4e70f533534812daf77dea03b7c3796fdf9baaa031fb5cc863fb109a"}
Jul 20 13:30:25.239737 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:25.239342    2565 scope.go:117] "RemoveContainer" containerID="9b1e05ee4898a40625db9f10adfdc7d733a5b1604498f3b16ed821cea46bd629"
Jul 20 13:30:26.272098 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:26.272053    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-22b1bd43-z82hl"]
Jul 20 13:30:26.379403 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:26.379377    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-22b1bd43-z82hl"
Jul 20 13:30:26.461313 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:26.461282    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/43613665-fb5d-4f30-8ff7-d9a346019dcc-maas-api-service-ca\") pod \"43613665-fb5d-4f30-8ff7-d9a346019dcc\" (UID: \"43613665-fb5d-4f30-8ff7-d9a346019dcc\") "
Jul 20 13:30:26.461670 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:26.461647    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43613665-fb5d-4f30-8ff7-d9a346019dcc-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "43613665-fb5d-4f30-8ff7-d9a346019dcc" (UID: "43613665-fb5d-4f30-8ff7-d9a346019dcc"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:30:26.562296 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:26.562213    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/43613665-fb5d-4f30-8ff7-d9a346019dcc-maas-api-service-ca\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:30:27.251601 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:27.251571    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-22b1bd43-z82hl"
Jul 20 13:30:27.251806 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:27.251611    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-22b1bd43-z82hl" event={"ID":"43613665-fb5d-4f30-8ff7-d9a346019dcc","Type":"ContainerDied","Data":"49e04b579d6243e799636958c49c113291918430e79fbdf50db6a74f8653261c"}
Jul 20 13:30:27.251806 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:27.251660    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="49e04b579d6243e799636958c49c113291918430e79fbdf50db6a74f8653261c"
Jul 20 13:30:27.285129 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:27.285097    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-22b1bd43-z82hl"]
Jul 20 13:30:27.290616 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:27.290591    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-22b1bd43-z82hl"]
Jul 20 13:30:28.147367 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:28.147323    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43613665-fb5d-4f30-8ff7-d9a346019dcc" path="/var/lib/kubelet/pods/43613665-fb5d-4f30-8ff7-d9a346019dcc/volumes"
Jul 20 13:30:58.908210 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:58.908173    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-22b1bd43-md74d"]
Jul 20 13:30:58.908719 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:58.908530    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43613665-fb5d-4f30-8ff7-d9a346019dcc" containerName="revoke-keys"
Jul 20 13:30:58.908719 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:58.908541    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="43613665-fb5d-4f30-8ff7-d9a346019dcc" containerName="revoke-keys"
Jul 20 13:30:58.908719 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:58.908554    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43613665-fb5d-4f30-8ff7-d9a346019dcc" containerName="revoke-keys"
Jul 20 13:30:58.908719 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:58.908559    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="43613665-fb5d-4f30-8ff7-d9a346019dcc" containerName="revoke-keys"
Jul 20 13:30:58.908719 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:58.908569    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43613665-fb5d-4f30-8ff7-d9a346019dcc" containerName="revoke-keys"
Jul 20 13:30:58.908719 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:58.908576    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="43613665-fb5d-4f30-8ff7-d9a346019dcc" containerName="revoke-keys"
Jul 20 13:30:58.908719 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:58.908631    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="43613665-fb5d-4f30-8ff7-d9a346019dcc" containerName="revoke-keys"
Jul 20 13:30:58.908719 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:58.908638    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="43613665-fb5d-4f30-8ff7-d9a346019dcc" containerName="revoke-keys"
Jul 20 13:30:58.911704 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:58.911687    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-22b1bd43-md74d"
Jul 20 13:30:58.914556 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:58.914535    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zcsfd\""
Jul 20 13:30:58.914556 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:58.914537    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 13:30:58.919349 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:58.919327    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-22b1bd43-md74d"]
Jul 20 13:30:59.043494 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:59.043461    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9ad15a1-b72b-402b-87a9-ebc997a55aa2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-22b1bd43-md74d\" (UID: \"e9ad15a1-b72b-402b-87a9-ebc997a55aa2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-22b1bd43-md74d"
Jul 20 13:30:59.144408 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:59.144378    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9ad15a1-b72b-402b-87a9-ebc997a55aa2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-22b1bd43-md74d\" (UID: \"e9ad15a1-b72b-402b-87a9-ebc997a55aa2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-22b1bd43-md74d"
Jul 20 13:30:59.145058 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:59.145038    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9ad15a1-b72b-402b-87a9-ebc997a55aa2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-22b1bd43-md74d\" (UID: \"e9ad15a1-b72b-402b-87a9-ebc997a55aa2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-22b1bd43-md74d"
Jul 20 13:30:59.223720 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:59.223624    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-22b1bd43-md74d"
Jul 20 13:30:59.361713 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:59.361687    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-22b1bd43-md74d"]
Jul 20 13:30:59.363304 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:30:59.363260    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode9ad15a1_b72b_402b_87a9_ebc997a55aa2.slice/crio-b621901d3089343f52d78399c7d81d8cb7eef5b7076c84346ddb0284afed729b WatchSource:0}: Error finding container b621901d3089343f52d78399c7d81d8cb7eef5b7076c84346ddb0284afed729b: Status 404 returned error can't find the container with id b621901d3089343f52d78399c7d81d8cb7eef5b7076c84346ddb0284afed729b
Jul 20 13:30:59.408619 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:30:59.408589    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-22b1bd43-md74d" event={"ID":"e9ad15a1-b72b-402b-87a9-ebc997a55aa2","Type":"ContainerStarted","Data":"b621901d3089343f52d78399c7d81d8cb7eef5b7076c84346ddb0284afed729b"}
Jul 20 13:31:00.415586 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:00.415545    2565 generic.go:356] "Generic (PLEG): container finished" podID="e9ad15a1-b72b-402b-87a9-ebc997a55aa2" containerID="91031f62a9e284e21194f52f93e7a607b720d94bba7b351169b657608ef5bc9d" exitCode=0
Jul 20 13:31:00.415977 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:00.415634    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-22b1bd43-md74d" event={"ID":"e9ad15a1-b72b-402b-87a9-ebc997a55aa2","Type":"ContainerDied","Data":"91031f62a9e284e21194f52f93e7a607b720d94bba7b351169b657608ef5bc9d"}
Jul 20 13:31:01.553186 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:01.553161    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-22b1bd43-md74d"
Jul 20 13:31:01.663976 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:01.663945    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9ad15a1-b72b-402b-87a9-ebc997a55aa2-maas-api-service-ca\") pod \"e9ad15a1-b72b-402b-87a9-ebc997a55aa2\" (UID: \"e9ad15a1-b72b-402b-87a9-ebc997a55aa2\") "
Jul 20 13:31:01.664299 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:01.664276    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e9ad15a1-b72b-402b-87a9-ebc997a55aa2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "e9ad15a1-b72b-402b-87a9-ebc997a55aa2" (UID: "e9ad15a1-b72b-402b-87a9-ebc997a55aa2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:31:01.765417 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:01.765330    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/e9ad15a1-b72b-402b-87a9-ebc997a55aa2-maas-api-service-ca\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:31:02.427472 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:02.427388    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-22b1bd43-md74d" event={"ID":"e9ad15a1-b72b-402b-87a9-ebc997a55aa2","Type":"ContainerDied","Data":"b621901d3089343f52d78399c7d81d8cb7eef5b7076c84346ddb0284afed729b"}
Jul 20 13:31:02.427472 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:02.427415    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-22b1bd43-md74d"
Jul 20 13:31:02.427472 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:02.427437    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b621901d3089343f52d78399c7d81d8cb7eef5b7076c84346ddb0284afed729b"
Jul 20 13:31:04.202603 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:04.202554    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:31:04.306236 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:04.306197    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:31:09.481405 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:09.481345    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:31:09.583252 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:09.583222    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:31:09.766775 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:09.766694    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:31:12.624459 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:12.624421    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:31:13.998202 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:13.998167    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:31:20.229893 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:20.229803    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:31:20.330250 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:20.330217    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:31:25.100248 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:25.100216    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:31:25.444684 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:25.444649    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:31:26.583774 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:26.583738    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:31:26.671065 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:26.671021    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:31:26.835237 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:26.835145    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:31:27.441841 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:27.441806    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:31:27.539370 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:27.539331    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:31:27.691456 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:27.691421    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:31:29.135752 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:29.135716    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:31:30.985562 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:30.985523    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-704386e9-gwnxj"]
Jul 20 13:31:30.985996 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:30.985852    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e9ad15a1-b72b-402b-87a9-ebc997a55aa2" containerName="revoke-keys"
Jul 20 13:31:30.985996 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:30.985863    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e9ad15a1-b72b-402b-87a9-ebc997a55aa2" containerName="revoke-keys"
Jul 20 13:31:30.985996 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:30.985927    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e9ad15a1-b72b-402b-87a9-ebc997a55aa2" containerName="revoke-keys"
Jul 20 13:31:30.985996 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:30.985934    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="43613665-fb5d-4f30-8ff7-d9a346019dcc" containerName="revoke-keys"
Jul 20 13:31:30.989170 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:30.989152    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-704386e9-gwnxj"
Jul 20 13:31:30.992207 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:30.992190    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zcsfd\""
Jul 20 13:31:30.992507 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:30.992493    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 13:31:30.996741 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:30.996639    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-704386e9-gwnxj"]
Jul 20 13:31:31.121352 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:31.121306    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce14bb22-ef97-47a6-b763-8bd1f9a7cebb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-704386e9-gwnxj\" (UID: \"ce14bb22-ef97-47a6-b763-8bd1f9a7cebb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-704386e9-gwnxj"
Jul 20 13:31:31.222501 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:31.222463    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce14bb22-ef97-47a6-b763-8bd1f9a7cebb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-704386e9-gwnxj\" (UID: \"ce14bb22-ef97-47a6-b763-8bd1f9a7cebb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-704386e9-gwnxj"
Jul 20 13:31:31.223055 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:31.223037    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce14bb22-ef97-47a6-b763-8bd1f9a7cebb-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-704386e9-gwnxj\" (UID: \"ce14bb22-ef97-47a6-b763-8bd1f9a7cebb\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-704386e9-gwnxj"
Jul 20 13:31:31.301142 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:31.301056    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-704386e9-gwnxj"
Jul 20 13:31:31.432220 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:31.432197    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-704386e9-gwnxj"]
Jul 20 13:31:31.433610 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:31:31.433583    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podce14bb22_ef97_47a6_b763_8bd1f9a7cebb.slice/crio-2fa7ba8d28c5dfcd387413c820ca1d827a251e378b27d796730ba891955c038d WatchSource:0}: Error finding container 2fa7ba8d28c5dfcd387413c820ca1d827a251e378b27d796730ba891955c038d: Status 404 returned error can't find the container with id 2fa7ba8d28c5dfcd387413c820ca1d827a251e378b27d796730ba891955c038d
Jul 20 13:31:31.579582 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:31.579540    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-704386e9-gwnxj" event={"ID":"ce14bb22-ef97-47a6-b763-8bd1f9a7cebb","Type":"ContainerStarted","Data":"2fa7ba8d28c5dfcd387413c820ca1d827a251e378b27d796730ba891955c038d"}
Jul 20 13:31:32.585779 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:32.585742    2565 generic.go:356] "Generic (PLEG): container finished" podID="ce14bb22-ef97-47a6-b763-8bd1f9a7cebb" containerID="76706f873dc8294a02c953ff54969e3146e63fc10426807ef847f66386eec9c0" exitCode=7
Jul 20 13:31:32.586169 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:32.585830    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-704386e9-gwnxj" event={"ID":"ce14bb22-ef97-47a6-b763-8bd1f9a7cebb","Type":"ContainerDied","Data":"76706f873dc8294a02c953ff54969e3146e63fc10426807ef847f66386eec9c0"}
Jul 20 13:31:32.586169 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:32.586026    2565 scope.go:117] "RemoveContainer" containerID="76706f873dc8294a02c953ff54969e3146e63fc10426807ef847f66386eec9c0"
Jul 20 13:31:33.593447 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:33.593407    2565 generic.go:356] "Generic (PLEG): container finished" podID="ce14bb22-ef97-47a6-b763-8bd1f9a7cebb" containerID="7ca18d7294273637e9336f1d643d1fbf4bc525bdbd7a9270d18f38cf7a9dd08b" exitCode=7
Jul 20 13:31:33.593936 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:33.593494    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-704386e9-gwnxj" event={"ID":"ce14bb22-ef97-47a6-b763-8bd1f9a7cebb","Type":"ContainerDied","Data":"7ca18d7294273637e9336f1d643d1fbf4bc525bdbd7a9270d18f38cf7a9dd08b"}
Jul 20 13:31:33.593936 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:33.593548    2565 scope.go:117] "RemoveContainer" containerID="76706f873dc8294a02c953ff54969e3146e63fc10426807ef847f66386eec9c0"
Jul 20 13:31:33.593936 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:33.593721    2565 scope.go:117] "RemoveContainer" containerID="7ca18d7294273637e9336f1d643d1fbf4bc525bdbd7a9270d18f38cf7a9dd08b"
Jul 20 13:31:33.594096 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:31:33.593988    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-704386e9-gwnxj_odh-ai-gateway-infra(ce14bb22-ef97-47a6-b763-8bd1f9a7cebb)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-704386e9-gwnxj" podUID="ce14bb22-ef97-47a6-b763-8bd1f9a7cebb"
Jul 20 13:31:34.600728 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:34.600699    2565 scope.go:117] "RemoveContainer" containerID="7ca18d7294273637e9336f1d643d1fbf4bc525bdbd7a9270d18f38cf7a9dd08b"
Jul 20 13:31:34.601102 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:31:34.600883    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-704386e9-gwnxj_odh-ai-gateway-infra(ce14bb22-ef97-47a6-b763-8bd1f9a7cebb)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-704386e9-gwnxj" podUID="ce14bb22-ef97-47a6-b763-8bd1f9a7cebb"
Jul 20 13:31:42.733700 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:42.733667    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:31:42.835512 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:42.835479    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:31:46.037809 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:46.037741    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:31:47.141803 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:47.141775    2565 scope.go:117] "RemoveContainer" containerID="7ca18d7294273637e9336f1d643d1fbf4bc525bdbd7a9270d18f38cf7a9dd08b"
Jul 20 13:31:47.666694 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:47.666659    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-704386e9-gwnxj" event={"ID":"ce14bb22-ef97-47a6-b763-8bd1f9a7cebb","Type":"ContainerStarted","Data":"b314f167e9eebe2a650292fdce8694313c434a63834b88b10dfd1dd5b3f51f82"}
Jul 20 13:31:47.684179 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:47.684128    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-704386e9-gwnxj" podStartSLOduration=17.684112854 podStartE2EDuration="17.684112854s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:31:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:31:47.682766636 +0000 UTC m=+1814.152298749" watchObservedRunningTime="2026-07-20 13:31:47.684112854 +0000 UTC m=+1814.153644972"
Jul 20 13:31:48.674603 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:48.674565    2565 generic.go:356] "Generic (PLEG): container finished" podID="ce14bb22-ef97-47a6-b763-8bd1f9a7cebb" containerID="b314f167e9eebe2a650292fdce8694313c434a63834b88b10dfd1dd5b3f51f82" exitCode=0
Jul 20 13:31:48.675054 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:48.674607    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-704386e9-gwnxj" event={"ID":"ce14bb22-ef97-47a6-b763-8bd1f9a7cebb","Type":"ContainerDied","Data":"b314f167e9eebe2a650292fdce8694313c434a63834b88b10dfd1dd5b3f51f82"}
Jul 20 13:31:48.675054 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:48.674673    2565 scope.go:117] "RemoveContainer" containerID="7ca18d7294273637e9336f1d643d1fbf4bc525bdbd7a9270d18f38cf7a9dd08b"
Jul 20 13:31:48.696215 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:48.696186    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-704386e9-gwnxj"]
Jul 20 13:31:49.817434 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:49.817405    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-704386e9-gwnxj"
Jul 20 13:31:49.976991 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:49.976883    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce14bb22-ef97-47a6-b763-8bd1f9a7cebb-maas-api-service-ca\") pod \"ce14bb22-ef97-47a6-b763-8bd1f9a7cebb\" (UID: \"ce14bb22-ef97-47a6-b763-8bd1f9a7cebb\") "
Jul 20 13:31:49.977249 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:49.977226    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ce14bb22-ef97-47a6-b763-8bd1f9a7cebb-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ce14bb22-ef97-47a6-b763-8bd1f9a7cebb" (UID: "ce14bb22-ef97-47a6-b763-8bd1f9a7cebb"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:31:50.077955 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:50.077920    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ce14bb22-ef97-47a6-b763-8bd1f9a7cebb-maas-api-service-ca\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:31:50.687416 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:50.687384    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-704386e9-gwnxj"
Jul 20 13:31:50.687416 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:50.687395    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-704386e9-gwnxj" event={"ID":"ce14bb22-ef97-47a6-b763-8bd1f9a7cebb","Type":"ContainerDied","Data":"2fa7ba8d28c5dfcd387413c820ca1d827a251e378b27d796730ba891955c038d"}
Jul 20 13:31:50.687595 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:50.687449    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="2fa7ba8d28c5dfcd387413c820ca1d827a251e378b27d796730ba891955c038d"
Jul 20 13:31:50.752406 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:50.752350    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-704386e9-gwnxj"]
Jul 20 13:31:50.758054 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:50.758021    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-704386e9-gwnxj"]
Jul 20 13:31:52.146640 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:31:52.146601    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ce14bb22-ef97-47a6-b763-8bd1f9a7cebb" path="/var/lib/kubelet/pods/ce14bb22-ef97-47a6-b763-8bd1f9a7cebb/volumes"
Jul 20 13:32:21.030402 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:32:21.030338    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-704386e9-wwhrx"]
Jul 20 13:32:21.030922 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:32:21.030712    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce14bb22-ef97-47a6-b763-8bd1f9a7cebb" containerName="revoke-keys"
Jul 20 13:32:21.030922 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:32:21.030724    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce14bb22-ef97-47a6-b763-8bd1f9a7cebb" containerName="revoke-keys"
Jul 20 13:32:21.030922 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:32:21.030733    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce14bb22-ef97-47a6-b763-8bd1f9a7cebb" containerName="revoke-keys"
Jul 20 13:32:21.030922 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:32:21.030739    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce14bb22-ef97-47a6-b763-8bd1f9a7cebb" containerName="revoke-keys"
Jul 20 13:32:21.030922 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:32:21.030798    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce14bb22-ef97-47a6-b763-8bd1f9a7cebb" containerName="revoke-keys"
Jul 20 13:32:21.030922 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:32:21.030806    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce14bb22-ef97-47a6-b763-8bd1f9a7cebb" containerName="revoke-keys"
Jul 20 13:32:21.030922 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:32:21.030811    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="ce14bb22-ef97-47a6-b763-8bd1f9a7cebb" containerName="revoke-keys"
Jul 20 13:32:21.033838 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:32:21.033822    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-704386e9-wwhrx"
Jul 20 13:32:21.036541 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:32:21.036517    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 13:32:21.036658 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:32:21.036637    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zcsfd\""
Jul 20 13:32:21.042895 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:32:21.042870    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-704386e9-wwhrx"]
Jul 20 13:32:21.136292 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:32:21.136256    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/44314865-7114-44d4-952e-446f145fcee7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-704386e9-wwhrx\" (UID: \"44314865-7114-44d4-952e-446f145fcee7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-704386e9-wwhrx"
Jul 20 13:32:21.237159 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:32:21.237123    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/44314865-7114-44d4-952e-446f145fcee7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-704386e9-wwhrx\" (UID: \"44314865-7114-44d4-952e-446f145fcee7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-704386e9-wwhrx"
Jul 20 13:32:21.237799 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:32:21.237775    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/44314865-7114-44d4-952e-446f145fcee7-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-704386e9-wwhrx\" (UID: \"44314865-7114-44d4-952e-446f145fcee7\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-704386e9-wwhrx"
Jul 20 13:32:21.344857 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:32:21.344764    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-704386e9-wwhrx"
Jul 20 13:32:21.477037 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:32:21.477014    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-704386e9-wwhrx"]
Jul 20 13:32:21.478921 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:32:21.478882    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44314865_7114_44d4_952e_446f145fcee7.slice/crio-8d9e77dcf2aae516998d1cf1de8721446298eda4074e5cdce69bdfd40c3dd47f WatchSource:0}: Error finding container 8d9e77dcf2aae516998d1cf1de8721446298eda4074e5cdce69bdfd40c3dd47f: Status 404 returned error can't find the container with id 8d9e77dcf2aae516998d1cf1de8721446298eda4074e5cdce69bdfd40c3dd47f
Jul 20 13:32:21.852393 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:32:21.852333    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-704386e9-wwhrx" event={"ID":"44314865-7114-44d4-952e-446f145fcee7","Type":"ContainerStarted","Data":"9925eb3e1876b45d0841c934143bfab9779bc0d3eaaca77c2b87e3246e9ba3d8"}
Jul 20 13:32:21.852597 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:32:21.852418    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-704386e9-wwhrx" event={"ID":"44314865-7114-44d4-952e-446f145fcee7","Type":"ContainerStarted","Data":"8d9e77dcf2aae516998d1cf1de8721446298eda4074e5cdce69bdfd40c3dd47f"}
Jul 20 13:32:21.869549 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:32:21.869493    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-704386e9-wwhrx" podStartSLOduration=0.869474708 podStartE2EDuration="869.474708ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:32:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:32:21.869063265 +0000 UTC m=+1848.338595384" watchObservedRunningTime="2026-07-20 13:32:21.869474708 +0000 UTC m=+1848.339006828"
Jul 20 13:32:22.858786 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:32:22.858750    2565 generic.go:356] "Generic (PLEG): container finished" podID="44314865-7114-44d4-952e-446f145fcee7" containerID="9925eb3e1876b45d0841c934143bfab9779bc0d3eaaca77c2b87e3246e9ba3d8" exitCode=0
Jul 20 13:32:22.859251 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:32:22.858847    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-704386e9-wwhrx" event={"ID":"44314865-7114-44d4-952e-446f145fcee7","Type":"ContainerDied","Data":"9925eb3e1876b45d0841c934143bfab9779bc0d3eaaca77c2b87e3246e9ba3d8"}
Jul 20 13:32:23.989644 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:32:23.989621    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-704386e9-wwhrx"
Jul 20 13:32:24.060478 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:32:24.060443    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/44314865-7114-44d4-952e-446f145fcee7-maas-api-service-ca\") pod \"44314865-7114-44d4-952e-446f145fcee7\" (UID: \"44314865-7114-44d4-952e-446f145fcee7\") "
Jul 20 13:32:24.060825 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:32:24.060801    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/44314865-7114-44d4-952e-446f145fcee7-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "44314865-7114-44d4-952e-446f145fcee7" (UID: "44314865-7114-44d4-952e-446f145fcee7"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:32:24.161900 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:32:24.161877    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/44314865-7114-44d4-952e-446f145fcee7-maas-api-service-ca\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:32:24.869434 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:32:24.869402    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-704386e9-wwhrx"
Jul 20 13:32:24.869434 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:32:24.869421    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-704386e9-wwhrx" event={"ID":"44314865-7114-44d4-952e-446f145fcee7","Type":"ContainerDied","Data":"8d9e77dcf2aae516998d1cf1de8721446298eda4074e5cdce69bdfd40c3dd47f"}
Jul 20 13:32:24.869667 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:32:24.869475    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="8d9e77dcf2aae516998d1cf1de8721446298eda4074e5cdce69bdfd40c3dd47f"
Jul 20 13:32:31.746502 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:32:31.746464    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:32:34.726126 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:32:34.726089    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:32:36.141187 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:32:36.141147    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:32:38.084615 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:32:38.084577    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:32:41.888699 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:32:41.888667    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:32:41.953614 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:32:41.953578    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:32:46.604941 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:32:46.604904    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:32:47.976308 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:32:47.976277    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:32:52.433375 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:32:52.433315    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:32:53.039981 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:32:53.039952    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:33:01.066940 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:33:01.066904    2565 generic.go:356] "Generic (PLEG): container finished" podID="b1137bca-71d8-42ca-b067-705ccd70b38d" containerID="e52524f603ffb053f3604b63144b7b3ea8b19b0f7fa2f74c615b3019c4646dc2" exitCode=1
Jul 20 13:33:01.067435 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:33:01.066980    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t4n9j" event={"ID":"b1137bca-71d8-42ca-b067-705ccd70b38d","Type":"ContainerDied","Data":"e52524f603ffb053f3604b63144b7b3ea8b19b0f7fa2f74c615b3019c4646dc2"}
Jul 20 13:33:01.067435 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:33:01.067064    2565 scope.go:117] "RemoveContainer" containerID="7d1a6bbdf2fd6573588c7166dd1e4288835768d5a2995dabe2ace66f7ff4e19a"
Jul 20 13:33:01.067435 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:33:01.067436    2565 scope.go:117] "RemoveContainer" containerID="e52524f603ffb053f3604b63144b7b3ea8b19b0f7fa2f74c615b3019c4646dc2"
Jul 20 13:33:01.067710 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:33:01.067689    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=dns-operator-controller-manager-864dd78c4c-t4n9j_kuadrant-system(b1137bca-71d8-42ca-b067-705ccd70b38d)\"" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t4n9j" podUID="b1137bca-71d8-42ca-b067-705ccd70b38d"
Jul 20 13:33:03.126140 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:33:03.126108    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t4n9j"
Jul 20 13:33:03.126540 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:33:03.126448    2565 scope.go:117] "RemoveContainer" containerID="e52524f603ffb053f3604b63144b7b3ea8b19b0f7fa2f74c615b3019c4646dc2"
Jul 20 13:33:03.126684 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:33:03.126664    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=dns-operator-controller-manager-864dd78c4c-t4n9j_kuadrant-system(b1137bca-71d8-42ca-b067-705ccd70b38d)\"" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t4n9j" podUID="b1137bca-71d8-42ca-b067-705ccd70b38d"
Jul 20 13:33:07.815582 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:33:07.815534    2565 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t4n9j"
Jul 20 13:33:07.815986 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:33:07.815975    2565 scope.go:117] "RemoveContainer" containerID="e52524f603ffb053f3604b63144b7b3ea8b19b0f7fa2f74c615b3019c4646dc2"
Jul 20 13:33:07.816196 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:33:07.816173    2565 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"manager\" with CrashLoopBackOff: \"back-off 10s restarting failed container=manager pod=dns-operator-controller-manager-864dd78c4c-t4n9j_kuadrant-system(b1137bca-71d8-42ca-b067-705ccd70b38d)\"" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t4n9j" podUID="b1137bca-71d8-42ca-b067-705ccd70b38d"
Jul 20 13:33:09.735283 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:33:09.735242    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:33:12.859376 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:33:12.859320    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:33:16.008248 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:33:16.008210    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:33:16.067697 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:33:16.067657    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:33:16.138124 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:33:16.138091    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:33:16.232115 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:33:16.232079    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:33:16.332453 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:33:16.332351    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:33:16.722949 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:33:16.722913    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:33:18.241907 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:33:18.241877    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:33:18.947403 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:33:18.947348    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:33:20.142162 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:33:20.142127    2565 scope.go:117] "RemoveContainer" containerID="e52524f603ffb053f3604b63144b7b3ea8b19b0f7fa2f74c615b3019c4646dc2"
Jul 20 13:33:20.146072 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:33:20.146047    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 20 13:33:21.175766 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:33:21.175731    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t4n9j" event={"ID":"b1137bca-71d8-42ca-b067-705ccd70b38d","Type":"ContainerStarted","Data":"01f3c0256fcdbcb5c427918c97367f0a224a315a1088bec1ab0499d2c80b0e3e"}
Jul 20 13:33:21.176171 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:33:21.175952    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t4n9j"
Jul 20 13:33:32.183464 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:33:32.183433    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-t4n9j"
Jul 20 13:33:42.729892 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:33:42.729851    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:33:49.065207 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:33:49.065170    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:33:49.124194 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:33:49.124160    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:33:49.193245 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:33:49.193209    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:33:49.295078 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:33:49.295040    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:34:05.304213 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:34:05.304175    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:34:11.113706 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:34:11.113662    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:34:11.166279 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:34:11.166246    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:34:11.292593 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:34:11.292555    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:34:11.381060 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:34:11.380973    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:34:21.916145 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:34:21.916099    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:34:22.850261 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:34:22.850226    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:34:29.025181 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:34:29.025105    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:34:29.128094 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:34:29.128027    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:34:29.225484 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:34:29.225444    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:34:29.327711 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:34:29.327627    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:34:29.427563 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:34:29.427529    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:34:30.207289 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:34:30.207251    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:34:30.296483 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:34:30.296441    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:34:30.400530 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:34:30.400493    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:34:31.325215 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:34:31.325182    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:34:32.236606 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:34:32.236570    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:34:37.940651 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:34:37.940614    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:34:37.999555 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:34:37.999520    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:34:38.680553 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:34:38.680506    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:34:38.827130 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:34:38.827093    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:34:44.753863 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:34:44.753827    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:34:44.855001 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:34:44.854959    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:34:44.985323 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:34:44.985287    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:34:45.318089 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:34:45.318051    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:34:45.600970 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:34:45.600860    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:34:47.678540 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:34:47.678502    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:34:48.212727 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:34:48.212691    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:34:48.299911 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:34:48.299873    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:34:48.364061 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:34:48.364030    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:34:48.613144 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:34:48.613112    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:34:48.979706 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:34:48.979625    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:34:49.068056 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:34:49.068021    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:34:52.713117 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:34:52.713083    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:34:53.391375 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:34:53.391323    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:34:53.488188 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:34:53.488156    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:34:53.587951 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:34:53.587920    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:34:53.841619 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:34:53.841539    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:34:57.619151 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:34:57.619113    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:34:59.826783 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:34:59.826737    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:34:59.924560 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:34:59.924523    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:35:00.197938 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:35:00.197907    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-28e80ad8-vnmsk"]
Jul 20 13:35:00.198230 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:35:00.198218    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44314865-7114-44d4-952e-446f145fcee7" containerName="revoke-keys"
Jul 20 13:35:00.198276 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:35:00.198232    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="44314865-7114-44d4-952e-446f145fcee7" containerName="revoke-keys"
Jul 20 13:35:00.198276 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:35:00.198249    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ce14bb22-ef97-47a6-b763-8bd1f9a7cebb" containerName="revoke-keys"
Jul 20 13:35:00.198276 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:35:00.198255    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="ce14bb22-ef97-47a6-b763-8bd1f9a7cebb" containerName="revoke-keys"
Jul 20 13:35:00.198400 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:35:00.198308    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="44314865-7114-44d4-952e-446f145fcee7" containerName="revoke-keys"
Jul 20 13:35:00.201237 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:35:00.201214    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-28e80ad8-vnmsk"
Jul 20 13:35:00.204181 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:35:00.204162    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zcsfd\""
Jul 20 13:35:00.204294 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:35:00.204198    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 13:35:00.210343 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:35:00.210318    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-28e80ad8-vnmsk"]
Jul 20 13:35:00.395142 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:35:00.395106    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/301c0c19-6d54-44ee-b619-ca7ef8ab0479-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-28e80ad8-vnmsk\" (UID: \"301c0c19-6d54-44ee-b619-ca7ef8ab0479\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-28e80ad8-vnmsk"
Jul 20 13:35:00.495847 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:35:00.495772    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/301c0c19-6d54-44ee-b619-ca7ef8ab0479-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-28e80ad8-vnmsk\" (UID: \"301c0c19-6d54-44ee-b619-ca7ef8ab0479\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-28e80ad8-vnmsk"
Jul 20 13:35:00.496417 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:35:00.496396    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/301c0c19-6d54-44ee-b619-ca7ef8ab0479-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-28e80ad8-vnmsk\" (UID: \"301c0c19-6d54-44ee-b619-ca7ef8ab0479\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-28e80ad8-vnmsk"
Jul 20 13:35:00.512465 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:35:00.512439    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-28e80ad8-vnmsk"
Jul 20 13:35:00.643582 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:35:00.643553    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-28e80ad8-vnmsk"]
Jul 20 13:35:00.645084 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:35:00.645048    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod301c0c19_6d54_44ee_b619_ca7ef8ab0479.slice/crio-9d7f2581bbcf19aedafbf10c90dfcd5c2dc192daaab3f68ac76ef41773b52bd2 WatchSource:0}: Error finding container 9d7f2581bbcf19aedafbf10c90dfcd5c2dc192daaab3f68ac76ef41773b52bd2: Status 404 returned error can't find the container with id 9d7f2581bbcf19aedafbf10c90dfcd5c2dc192daaab3f68ac76ef41773b52bd2
Jul 20 13:35:00.684323 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:35:00.684296    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-28e80ad8-vnmsk" event={"ID":"301c0c19-6d54-44ee-b619-ca7ef8ab0479","Type":"ContainerStarted","Data":"9d7f2581bbcf19aedafbf10c90dfcd5c2dc192daaab3f68ac76ef41773b52bd2"}
Jul 20 13:35:01.690830 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:35:01.690726    2565 generic.go:356] "Generic (PLEG): container finished" podID="301c0c19-6d54-44ee-b619-ca7ef8ab0479" containerID="ff9c3c7d9e18a293c58b2f3575cdcfcf336b7171ab19652fc0229d5effb39a76" exitCode=0
Jul 20 13:35:01.690830 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:35:01.690803    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-28e80ad8-vnmsk" event={"ID":"301c0c19-6d54-44ee-b619-ca7ef8ab0479","Type":"ContainerDied","Data":"ff9c3c7d9e18a293c58b2f3575cdcfcf336b7171ab19652fc0229d5effb39a76"}
Jul 20 13:35:02.823873 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:35:02.823848    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-28e80ad8-vnmsk"
Jul 20 13:35:03.014619 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:35:03.014532    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/301c0c19-6d54-44ee-b619-ca7ef8ab0479-maas-api-service-ca\") pod \"301c0c19-6d54-44ee-b619-ca7ef8ab0479\" (UID: \"301c0c19-6d54-44ee-b619-ca7ef8ab0479\") "
Jul 20 13:35:03.014894 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:35:03.014870    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/301c0c19-6d54-44ee-b619-ca7ef8ab0479-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "301c0c19-6d54-44ee-b619-ca7ef8ab0479" (UID: "301c0c19-6d54-44ee-b619-ca7ef8ab0479"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:35:03.115844 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:35:03.115809    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/301c0c19-6d54-44ee-b619-ca7ef8ab0479-maas-api-service-ca\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:35:03.702821 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:35:03.702793    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-28e80ad8-vnmsk"
Jul 20 13:35:03.702993 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:35:03.702839    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-28e80ad8-vnmsk" event={"ID":"301c0c19-6d54-44ee-b619-ca7ef8ab0479","Type":"ContainerDied","Data":"9d7f2581bbcf19aedafbf10c90dfcd5c2dc192daaab3f68ac76ef41773b52bd2"}
Jul 20 13:35:03.702993 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:35:03.702883    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9d7f2581bbcf19aedafbf10c90dfcd5c2dc192daaab3f68ac76ef41773b52bd2"
Jul 20 13:35:10.958478 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:35:10.958442    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:35:13.617894 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:35:13.617858    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:35:15.303295 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:35:15.303248    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:35:21.239711 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:35:21.239679    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:35:21.296366 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:35:21.296338    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:35:25.989592 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:35:25.989552    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:35:26.240182 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:35:26.240095    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:35:26.372940 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:35:26.372906    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:35:26.486791 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:35:26.486761    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:35:26.660825 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:35:26.660787    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:35:32.556862 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:35:32.556818    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:35:32.621325 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:35:32.621292    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:35:32.694194 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:35:32.694166    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:35:32.795305 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:35:32.795259    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:35:32.910899 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:35:32.910856    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:35:34.202267 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:35:34.202236    2565 scope.go:117] "RemoveContainer" containerID="7780ab14baa25716085161754e9e3e745d2d338d1ea6e1c86104221a9f85a9ea"
Jul 20 13:35:38.807426 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:35:38.807387    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:35:38.904945 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:35:38.904911    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:35:45.637191 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:35:45.637151    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:35:45.940071 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:35:45.939975    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:35:46.039874 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:35:46.039825    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:35:49.454775 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:35:49.454743    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:35:49.542922 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:35:49.542887    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:35:49.600459 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:35:49.600422    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:35:49.704077 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:35:49.704041    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:35:50.143507 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:35:50.143477    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:35:50.243242 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:35:50.243203    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:35:53.523764 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:35:53.523728    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:35:53.846757 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:35:53.846647    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:36:01.545832 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:01.545794    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:36:05.119582 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:05.119543    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:36:05.220226 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:05.220187    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:36:11.195566 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:11.195532    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:36:11.291070 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:11.291034    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:36:15.336403 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:15.336351    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-aba71aa1/e2e-lifecycle-model-aba71aa1-kserve-565988bff-dmpd2"]
Jul 20 13:36:15.336860 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:15.336844    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="301c0c19-6d54-44ee-b619-ca7ef8ab0479" containerName="revoke-keys"
Jul 20 13:36:15.336905 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:15.336864    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="301c0c19-6d54-44ee-b619-ca7ef8ab0479" containerName="revoke-keys"
Jul 20 13:36:15.336981 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:15.336969    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="301c0c19-6d54-44ee-b619-ca7ef8ab0479" containerName="revoke-keys"
Jul 20 13:36:15.340382 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:15.340335    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-aba71aa1/e2e-lifecycle-model-aba71aa1-kserve-565988bff-dmpd2"
Jul 20 13:36:15.343241 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:15.343209    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-aba71aa1\"/\"kube-root-ca.crt\""
Jul 20 13:36:15.343241 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:15.343214    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-aba71aa1\"/\"openshift-service-ca.crt\""
Jul 20 13:36:15.344913 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:15.344892    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-aba71aa1\"/\"e2e-lifecycle-model-aba71aa1-kserve-self-signed-certs\""
Jul 20 13:36:15.345020 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:15.344954    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-aba71aa1\"/\"default-dockercfg-7dl2h\""
Jul 20 13:36:15.348237 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:15.347989    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-aba71aa1/e2e-lifecycle-model-aba71aa1-kserve-565988bff-dmpd2"]
Jul 20 13:36:15.365736 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:15.365713    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:36:15.422418 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:15.422380    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2f301bc-9956-471e-8b01-a1b4afd2843e-model-cache\") pod \"e2e-lifecycle-model-aba71aa1-kserve-565988bff-dmpd2\" (UID: \"d2f301bc-9956-471e-8b01-a1b4afd2843e\") " pod="ai-tenant-e2e-mt-aba71aa1/e2e-lifecycle-model-aba71aa1-kserve-565988bff-dmpd2"
Jul 20 13:36:15.422613 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:15.422437    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2f301bc-9956-471e-8b01-a1b4afd2843e-dshm\") pod \"e2e-lifecycle-model-aba71aa1-kserve-565988bff-dmpd2\" (UID: \"d2f301bc-9956-471e-8b01-a1b4afd2843e\") " pod="ai-tenant-e2e-mt-aba71aa1/e2e-lifecycle-model-aba71aa1-kserve-565988bff-dmpd2"
Jul 20 13:36:15.422613 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:15.422496    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2f301bc-9956-471e-8b01-a1b4afd2843e-home\") pod \"e2e-lifecycle-model-aba71aa1-kserve-565988bff-dmpd2\" (UID: \"d2f301bc-9956-471e-8b01-a1b4afd2843e\") " pod="ai-tenant-e2e-mt-aba71aa1/e2e-lifecycle-model-aba71aa1-kserve-565988bff-dmpd2"
Jul 20 13:36:15.422613 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:15.422552    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2f301bc-9956-471e-8b01-a1b4afd2843e-tmp-dir\") pod \"e2e-lifecycle-model-aba71aa1-kserve-565988bff-dmpd2\" (UID: \"d2f301bc-9956-471e-8b01-a1b4afd2843e\") " pod="ai-tenant-e2e-mt-aba71aa1/e2e-lifecycle-model-aba71aa1-kserve-565988bff-dmpd2"
Jul 20 13:36:15.422613 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:15.422583    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phjmd\" (UniqueName: \"kubernetes.io/projected/d2f301bc-9956-471e-8b01-a1b4afd2843e-kube-api-access-phjmd\") pod \"e2e-lifecycle-model-aba71aa1-kserve-565988bff-dmpd2\" (UID: \"d2f301bc-9956-471e-8b01-a1b4afd2843e\") " pod="ai-tenant-e2e-mt-aba71aa1/e2e-lifecycle-model-aba71aa1-kserve-565988bff-dmpd2"
Jul 20 13:36:15.422788 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:15.422624    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2f301bc-9956-471e-8b01-a1b4afd2843e-tls-certs\") pod \"e2e-lifecycle-model-aba71aa1-kserve-565988bff-dmpd2\" (UID: \"d2f301bc-9956-471e-8b01-a1b4afd2843e\") " pod="ai-tenant-e2e-mt-aba71aa1/e2e-lifecycle-model-aba71aa1-kserve-565988bff-dmpd2"
Jul 20 13:36:15.522988 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:15.522950    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2f301bc-9956-471e-8b01-a1b4afd2843e-model-cache\") pod \"e2e-lifecycle-model-aba71aa1-kserve-565988bff-dmpd2\" (UID: \"d2f301bc-9956-471e-8b01-a1b4afd2843e\") " pod="ai-tenant-e2e-mt-aba71aa1/e2e-lifecycle-model-aba71aa1-kserve-565988bff-dmpd2"
Jul 20 13:36:15.523167 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:15.523026    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2f301bc-9956-471e-8b01-a1b4afd2843e-dshm\") pod \"e2e-lifecycle-model-aba71aa1-kserve-565988bff-dmpd2\" (UID: \"d2f301bc-9956-471e-8b01-a1b4afd2843e\") " pod="ai-tenant-e2e-mt-aba71aa1/e2e-lifecycle-model-aba71aa1-kserve-565988bff-dmpd2"
Jul 20 13:36:15.523167 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:15.523059    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2f301bc-9956-471e-8b01-a1b4afd2843e-home\") pod \"e2e-lifecycle-model-aba71aa1-kserve-565988bff-dmpd2\" (UID: \"d2f301bc-9956-471e-8b01-a1b4afd2843e\") " pod="ai-tenant-e2e-mt-aba71aa1/e2e-lifecycle-model-aba71aa1-kserve-565988bff-dmpd2"
Jul 20 13:36:15.523167 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:15.523097    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2f301bc-9956-471e-8b01-a1b4afd2843e-tmp-dir\") pod \"e2e-lifecycle-model-aba71aa1-kserve-565988bff-dmpd2\" (UID: \"d2f301bc-9956-471e-8b01-a1b4afd2843e\") " pod="ai-tenant-e2e-mt-aba71aa1/e2e-lifecycle-model-aba71aa1-kserve-565988bff-dmpd2"
Jul 20 13:36:15.523167 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:15.523121    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phjmd\" (UniqueName: \"kubernetes.io/projected/d2f301bc-9956-471e-8b01-a1b4afd2843e-kube-api-access-phjmd\") pod \"e2e-lifecycle-model-aba71aa1-kserve-565988bff-dmpd2\" (UID: \"d2f301bc-9956-471e-8b01-a1b4afd2843e\") " pod="ai-tenant-e2e-mt-aba71aa1/e2e-lifecycle-model-aba71aa1-kserve-565988bff-dmpd2"
Jul 20 13:36:15.523167 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:15.523161    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2f301bc-9956-471e-8b01-a1b4afd2843e-tls-certs\") pod \"e2e-lifecycle-model-aba71aa1-kserve-565988bff-dmpd2\" (UID: \"d2f301bc-9956-471e-8b01-a1b4afd2843e\") " pod="ai-tenant-e2e-mt-aba71aa1/e2e-lifecycle-model-aba71aa1-kserve-565988bff-dmpd2"
Jul 20 13:36:15.523476 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:15.523430    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2f301bc-9956-471e-8b01-a1b4afd2843e-model-cache\") pod \"e2e-lifecycle-model-aba71aa1-kserve-565988bff-dmpd2\" (UID: \"d2f301bc-9956-471e-8b01-a1b4afd2843e\") " pod="ai-tenant-e2e-mt-aba71aa1/e2e-lifecycle-model-aba71aa1-kserve-565988bff-dmpd2"
Jul 20 13:36:15.523476 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:15.523453    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2f301bc-9956-471e-8b01-a1b4afd2843e-tmp-dir\") pod \"e2e-lifecycle-model-aba71aa1-kserve-565988bff-dmpd2\" (UID: \"d2f301bc-9956-471e-8b01-a1b4afd2843e\") " pod="ai-tenant-e2e-mt-aba71aa1/e2e-lifecycle-model-aba71aa1-kserve-565988bff-dmpd2"
Jul 20 13:36:15.523587 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:15.523488    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2f301bc-9956-471e-8b01-a1b4afd2843e-home\") pod \"e2e-lifecycle-model-aba71aa1-kserve-565988bff-dmpd2\" (UID: \"d2f301bc-9956-471e-8b01-a1b4afd2843e\") " pod="ai-tenant-e2e-mt-aba71aa1/e2e-lifecycle-model-aba71aa1-kserve-565988bff-dmpd2"
Jul 20 13:36:15.525306 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:15.525284    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2f301bc-9956-471e-8b01-a1b4afd2843e-dshm\") pod \"e2e-lifecycle-model-aba71aa1-kserve-565988bff-dmpd2\" (UID: \"d2f301bc-9956-471e-8b01-a1b4afd2843e\") " pod="ai-tenant-e2e-mt-aba71aa1/e2e-lifecycle-model-aba71aa1-kserve-565988bff-dmpd2"
Jul 20 13:36:15.525598 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:15.525581    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2f301bc-9956-471e-8b01-a1b4afd2843e-tls-certs\") pod \"e2e-lifecycle-model-aba71aa1-kserve-565988bff-dmpd2\" (UID: \"d2f301bc-9956-471e-8b01-a1b4afd2843e\") " pod="ai-tenant-e2e-mt-aba71aa1/e2e-lifecycle-model-aba71aa1-kserve-565988bff-dmpd2"
Jul 20 13:36:15.531454 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:15.531431    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-phjmd\" (UniqueName: \"kubernetes.io/projected/d2f301bc-9956-471e-8b01-a1b4afd2843e-kube-api-access-phjmd\") pod \"e2e-lifecycle-model-aba71aa1-kserve-565988bff-dmpd2\" (UID: \"d2f301bc-9956-471e-8b01-a1b4afd2843e\") " pod="ai-tenant-e2e-mt-aba71aa1/e2e-lifecycle-model-aba71aa1-kserve-565988bff-dmpd2"
Jul 20 13:36:15.651293 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:15.651251    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-aba71aa1/e2e-lifecycle-model-aba71aa1-kserve-565988bff-dmpd2"
Jul 20 13:36:15.785697 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:15.785671    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-aba71aa1/e2e-lifecycle-model-aba71aa1-kserve-565988bff-dmpd2"]
Jul 20 13:36:15.787325 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:36:15.787297    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd2f301bc_9956_471e_8b01_a1b4afd2843e.slice/crio-101e7fbbc678d5ea24c7a8b79fef1545edc92ebdcd8e40e59e8015ed1ee10387 WatchSource:0}: Error finding container 101e7fbbc678d5ea24c7a8b79fef1545edc92ebdcd8e40e59e8015ed1ee10387: Status 404 returned error can't find the container with id 101e7fbbc678d5ea24c7a8b79fef1545edc92ebdcd8e40e59e8015ed1ee10387
Jul 20 13:36:16.095936 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:16.095842    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-aba71aa1/e2e-lifecycle-model-aba71aa1-kserve-565988bff-dmpd2" event={"ID":"d2f301bc-9956-471e-8b01-a1b4afd2843e","Type":"ContainerStarted","Data":"1589f129f5dfc36d803e19811f286acc85ea5a2fc565068f8f2ab77cfb8ec51f"}
Jul 20 13:36:16.095936 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:16.095891    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-aba71aa1/e2e-lifecycle-model-aba71aa1-kserve-565988bff-dmpd2" event={"ID":"d2f301bc-9956-471e-8b01-a1b4afd2843e","Type":"ContainerStarted","Data":"101e7fbbc678d5ea24c7a8b79fef1545edc92ebdcd8e40e59e8015ed1ee10387"}
Jul 20 13:36:16.112980 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:16.112933    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-aba71aa1/e2e-lifecycle-model-aba71aa1-kserve-565988bff-dmpd2" podStartSLOduration=1.112917475 podStartE2EDuration="1.112917475s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:36:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:36:16.112143617 +0000 UTC m=+2082.581675737" watchObservedRunningTime="2026-07-20 13:36:16.112917475 +0000 UTC m=+2082.582449593"
Jul 20 13:36:18.717834 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:18.717797    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:36:25.651616 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:25.651569    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-aba71aa1/e2e-lifecycle-model-aba71aa1-kserve-565988bff-dmpd2"
Jul 20 13:36:25.652077 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:25.651631    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-aba71aa1/e2e-lifecycle-model-aba71aa1-kserve-565988bff-dmpd2"
Jul 20 13:36:25.666062 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:25.666031    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-aba71aa1/e2e-lifecycle-model-aba71aa1-kserve-565988bff-dmpd2"
Jul 20 13:36:26.160004 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:26.159973    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-aba71aa1/e2e-lifecycle-model-aba71aa1-kserve-565988bff-dmpd2"
Jul 20 13:36:34.221315 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:34.221281    2565 scope.go:117] "RemoveContainer" containerID="340aeffb4e70f533534812daf77dea03b7c3796fdf9baaa031fb5cc863fb109a"
Jul 20 13:36:34.935001 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:34.934962    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:36:38.083425 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:38.083386    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-aba71aa1-cr6qx"]
Jul 20 13:36:38.086666 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:38.086650    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-aba71aa1-cr6qx"
Jul 20 13:36:38.093282 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:38.092972    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zcsfd\""
Jul 20 13:36:38.093390 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:38.093303    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 13:36:38.122454 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:38.122423    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-aba71aa1-cr6qx"]
Jul 20 13:36:38.233572 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:38.233528    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3749aad-3a40-4d34-b4e5-4ff8ec3ce780-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-aba71aa1-cr6qx\" (UID: \"b3749aad-3a40-4d34-b4e5-4ff8ec3ce780\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-aba71aa1-cr6qx"
Jul 20 13:36:38.334771 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:38.334676    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3749aad-3a40-4d34-b4e5-4ff8ec3ce780-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-aba71aa1-cr6qx\" (UID: \"b3749aad-3a40-4d34-b4e5-4ff8ec3ce780\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-aba71aa1-cr6qx"
Jul 20 13:36:38.335348 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:38.335328    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3749aad-3a40-4d34-b4e5-4ff8ec3ce780-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-aba71aa1-cr6qx\" (UID: \"b3749aad-3a40-4d34-b4e5-4ff8ec3ce780\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-aba71aa1-cr6qx"
Jul 20 13:36:38.396652 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:38.396625    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-aba71aa1-cr6qx"
Jul 20 13:36:38.533747 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:38.533721    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-aba71aa1-cr6qx"]
Jul 20 13:36:38.535552 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:36:38.535525    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3749aad_3a40_4d34_b4e5_4ff8ec3ce780.slice/crio-5d37bd92c5f6f20e58c8545548a26e408484ff12dbdb9a857965287e58416c24 WatchSource:0}: Error finding container 5d37bd92c5f6f20e58c8545548a26e408484ff12dbdb9a857965287e58416c24: Status 404 returned error can't find the container with id 5d37bd92c5f6f20e58c8545548a26e408484ff12dbdb9a857965287e58416c24
Jul 20 13:36:39.215071 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:39.215032    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-aba71aa1-cr6qx" event={"ID":"b3749aad-3a40-4d34-b4e5-4ff8ec3ce780","Type":"ContainerStarted","Data":"ad481f997d86a528d9b8fb0469e65a437189c5c076e75e2a8e3544faddefbd83"}
Jul 20 13:36:39.215071 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:39.215089    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-aba71aa1-cr6qx" event={"ID":"b3749aad-3a40-4d34-b4e5-4ff8ec3ce780","Type":"ContainerStarted","Data":"5d37bd92c5f6f20e58c8545548a26e408484ff12dbdb9a857965287e58416c24"}
Jul 20 13:36:39.241599 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:39.237072    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-aba71aa1-cr6qx" podStartSLOduration=1.23705163 podStartE2EDuration="1.23705163s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:36:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:36:39.233658306 +0000 UTC m=+2105.703190447" watchObservedRunningTime="2026-07-20 13:36:39.23705163 +0000 UTC m=+2105.706583750"
Jul 20 13:36:40.222670 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:40.222637    2565 generic.go:356] "Generic (PLEG): container finished" podID="b3749aad-3a40-4d34-b4e5-4ff8ec3ce780" containerID="ad481f997d86a528d9b8fb0469e65a437189c5c076e75e2a8e3544faddefbd83" exitCode=0
Jul 20 13:36:40.223078 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:40.222714    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-aba71aa1-cr6qx" event={"ID":"b3749aad-3a40-4d34-b4e5-4ff8ec3ce780","Type":"ContainerDied","Data":"ad481f997d86a528d9b8fb0469e65a437189c5c076e75e2a8e3544faddefbd83"}
Jul 20 13:36:41.360533 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:41.360508    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-aba71aa1-cr6qx"
Jul 20 13:36:41.462313 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:41.462277    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3749aad-3a40-4d34-b4e5-4ff8ec3ce780-maas-api-service-ca\") pod \"b3749aad-3a40-4d34-b4e5-4ff8ec3ce780\" (UID: \"b3749aad-3a40-4d34-b4e5-4ff8ec3ce780\") "
Jul 20 13:36:41.462692 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:41.462664    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b3749aad-3a40-4d34-b4e5-4ff8ec3ce780-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "b3749aad-3a40-4d34-b4e5-4ff8ec3ce780" (UID: "b3749aad-3a40-4d34-b4e5-4ff8ec3ce780"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:36:41.563558 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:41.563473    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/b3749aad-3a40-4d34-b4e5-4ff8ec3ce780-maas-api-service-ca\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:36:42.238103 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:42.238072    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-aba71aa1-cr6qx" event={"ID":"b3749aad-3a40-4d34-b4e5-4ff8ec3ce780","Type":"ContainerDied","Data":"5d37bd92c5f6f20e58c8545548a26e408484ff12dbdb9a857965287e58416c24"}
Jul 20 13:36:42.238103 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:42.238096    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-aba71aa1-cr6qx"
Jul 20 13:36:42.238387 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:42.238118    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5d37bd92c5f6f20e58c8545548a26e408484ff12dbdb9a857965287e58416c24"
Jul 20 13:36:48.643983 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:48.643950    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:36:52.216148 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:52.216043    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:36:53.147606 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:53.147567    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:36:58.129557 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:58.129516    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-aba71aa1/e2e-lifecycle-model-aba71aa1-kserve-565988bff-dmpd2"]
Jul 20 13:36:58.175030 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:36:58.174998    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:37:08.954469 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:37:08.954435    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:37:09.055170 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:37:09.055135    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:37:13.152407 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:37:13.152337    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-aba71aa1/e2e-lifecycle-model-aba71aa1-kserve-565988bff-dmpd2" podUID="d2f301bc-9956-471e-8b01-a1b4afd2843e" containerName="main" containerID="cri-o://1589f129f5dfc36d803e19811f286acc85ea5a2fc565068f8f2ab77cfb8ec51f" gracePeriod=45
Jul 20 13:37:13.406043 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:37:13.405974    2565 generic.go:356] "Generic (PLEG): container finished" podID="d2f301bc-9956-471e-8b01-a1b4afd2843e" containerID="1589f129f5dfc36d803e19811f286acc85ea5a2fc565068f8f2ab77cfb8ec51f" exitCode=0
Jul 20 13:37:13.406152 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:37:13.406036    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-aba71aa1/e2e-lifecycle-model-aba71aa1-kserve-565988bff-dmpd2" event={"ID":"d2f301bc-9956-471e-8b01-a1b4afd2843e","Type":"ContainerDied","Data":"1589f129f5dfc36d803e19811f286acc85ea5a2fc565068f8f2ab77cfb8ec51f"}
Jul 20 13:37:13.406152 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:37:13.406085    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-aba71aa1/e2e-lifecycle-model-aba71aa1-kserve-565988bff-dmpd2" event={"ID":"d2f301bc-9956-471e-8b01-a1b4afd2843e","Type":"ContainerDied","Data":"101e7fbbc678d5ea24c7a8b79fef1545edc92ebdcd8e40e59e8015ed1ee10387"}
Jul 20 13:37:13.406152 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:37:13.406103    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="101e7fbbc678d5ea24c7a8b79fef1545edc92ebdcd8e40e59e8015ed1ee10387"
Jul 20 13:37:13.411862 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:37:13.411843    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-aba71aa1/e2e-lifecycle-model-aba71aa1-kserve-565988bff-dmpd2"
Jul 20 13:37:13.434612 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:37:13.434581    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2f301bc-9956-471e-8b01-a1b4afd2843e-dshm\") pod \"d2f301bc-9956-471e-8b01-a1b4afd2843e\" (UID: \"d2f301bc-9956-471e-8b01-a1b4afd2843e\") "
Jul 20 13:37:13.436713 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:37:13.436680    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2f301bc-9956-471e-8b01-a1b4afd2843e-dshm" (OuterVolumeSpecName: "dshm") pod "d2f301bc-9956-471e-8b01-a1b4afd2843e" (UID: "d2f301bc-9956-471e-8b01-a1b4afd2843e"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:37:13.535165 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:37:13.535131    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2f301bc-9956-471e-8b01-a1b4afd2843e-model-cache\") pod \"d2f301bc-9956-471e-8b01-a1b4afd2843e\" (UID: \"d2f301bc-9956-471e-8b01-a1b4afd2843e\") "
Jul 20 13:37:13.535393 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:37:13.535182    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2f301bc-9956-471e-8b01-a1b4afd2843e-tmp-dir\") pod \"d2f301bc-9956-471e-8b01-a1b4afd2843e\" (UID: \"d2f301bc-9956-471e-8b01-a1b4afd2843e\") "
Jul 20 13:37:13.535393 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:37:13.535211    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2f301bc-9956-471e-8b01-a1b4afd2843e-tls-certs\") pod \"d2f301bc-9956-471e-8b01-a1b4afd2843e\" (UID: \"d2f301bc-9956-471e-8b01-a1b4afd2843e\") "
Jul 20 13:37:13.535393 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:37:13.535257    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2f301bc-9956-471e-8b01-a1b4afd2843e-home\") pod \"d2f301bc-9956-471e-8b01-a1b4afd2843e\" (UID: \"d2f301bc-9956-471e-8b01-a1b4afd2843e\") "
Jul 20 13:37:13.535393 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:37:13.535303    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-phjmd\" (UniqueName: \"kubernetes.io/projected/d2f301bc-9956-471e-8b01-a1b4afd2843e-kube-api-access-phjmd\") pod \"d2f301bc-9956-471e-8b01-a1b4afd2843e\" (UID: \"d2f301bc-9956-471e-8b01-a1b4afd2843e\") "
Jul 20 13:37:13.535592 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:37:13.535465    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2f301bc-9956-471e-8b01-a1b4afd2843e-model-cache" (OuterVolumeSpecName: "model-cache") pod "d2f301bc-9956-471e-8b01-a1b4afd2843e" (UID: "d2f301bc-9956-471e-8b01-a1b4afd2843e"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:37:13.535592 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:37:13.535498    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2f301bc-9956-471e-8b01-a1b4afd2843e-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d2f301bc-9956-471e-8b01-a1b4afd2843e" (UID: "d2f301bc-9956-471e-8b01-a1b4afd2843e"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:37:13.535592 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:37:13.535566    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d2f301bc-9956-471e-8b01-a1b4afd2843e-home" (OuterVolumeSpecName: "home") pod "d2f301bc-9956-471e-8b01-a1b4afd2843e" (UID: "d2f301bc-9956-471e-8b01-a1b4afd2843e"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:37:13.535592 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:37:13.535590    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d2f301bc-9956-471e-8b01-a1b4afd2843e-model-cache\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:37:13.535720 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:37:13.535602    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d2f301bc-9956-471e-8b01-a1b4afd2843e-tmp-dir\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:37:13.535720 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:37:13.535610    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d2f301bc-9956-471e-8b01-a1b4afd2843e-dshm\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:37:13.537428 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:37:13.537408    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d2f301bc-9956-471e-8b01-a1b4afd2843e-kube-api-access-phjmd" (OuterVolumeSpecName: "kube-api-access-phjmd") pod "d2f301bc-9956-471e-8b01-a1b4afd2843e" (UID: "d2f301bc-9956-471e-8b01-a1b4afd2843e"). InnerVolumeSpecName "kube-api-access-phjmd". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:37:13.537524 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:37:13.537509    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d2f301bc-9956-471e-8b01-a1b4afd2843e-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d2f301bc-9956-471e-8b01-a1b4afd2843e" (UID: "d2f301bc-9956-471e-8b01-a1b4afd2843e"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 13:37:13.636506 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:37:13.636469    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d2f301bc-9956-471e-8b01-a1b4afd2843e-tls-certs\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:37:13.636506 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:37:13.636500    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d2f301bc-9956-471e-8b01-a1b4afd2843e-home\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:37:13.636506 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:37:13.636509    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-phjmd\" (UniqueName: \"kubernetes.io/projected/d2f301bc-9956-471e-8b01-a1b4afd2843e-kube-api-access-phjmd\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:37:14.417973 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:37:14.417884    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-aba71aa1/e2e-lifecycle-model-aba71aa1-kserve-565988bff-dmpd2"
Jul 20 13:37:14.437869 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:37:14.437834    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-aba71aa1/e2e-lifecycle-model-aba71aa1-kserve-565988bff-dmpd2"]
Jul 20 13:37:14.441407 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:37:14.441384    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-aba71aa1/e2e-lifecycle-model-aba71aa1-kserve-565988bff-dmpd2"]
Jul 20 13:37:16.147432 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:37:16.147401    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d2f301bc-9956-471e-8b01-a1b4afd2843e" path="/var/lib/kubelet/pods/d2f301bc-9956-471e-8b01-a1b4afd2843e/volumes"
Jul 20 13:37:34.435543 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:37:34.435460    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:37:35.409987 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:37:35.409954    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:37:41.218368 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:37:41.218324    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:37:41.269982 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:37:41.269945    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:37:45.529068 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:37:45.529020    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:37:45.770054 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:37:45.769988    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:37:46.860734 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:37:46.860707    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:37:46.961110 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:37:46.961076    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:37:47.068208 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:37:47.068147    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:37:47.816105 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:37:47.816075    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:37:47.905959 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:37:47.905922    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:37:49.630525 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:37:49.630489    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:37:49.671795 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:37:49.671757    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:37:55.582934 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:37:55.582853    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:37:55.682930 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:37:55.682888    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:37:56.326985 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:37:56.326950    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:38:00.831567 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:38:00.831530    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:38:02.100138 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:38:02.100101    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:38:02.208783 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:38:02.208744    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:38:02.302721 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:38:02.302689    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:38:12.910305 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:38:12.910266    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:38:13.295708 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:38:13.295628    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:38:18.371216 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:38:18.371181    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:38:34.256148 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:38:34.256117    2565 scope.go:117] "RemoveContainer" containerID="b314f167e9eebe2a650292fdce8694313c434a63834b88b10dfd1dd5b3f51f82"
Jul 20 13:38:34.384096 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:38:34.384061    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:38:40.225782 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:38:40.225744    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:38:40.326088 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:38:40.326055    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:38:40.595898 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:38:40.595816    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:38:40.976970 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:38:40.976937    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:38:41.147749 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:38:41.147711    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:38:44.405130 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:38:44.405102    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:38:44.489761 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:38:44.489726    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:38:44.563688 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:38:44.563649    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:38:44.823520 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:38:44.823428    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:38:45.177275 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:38:45.177239    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:38:45.297926 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:38:45.297897    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:38:48.945196 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:38:48.945157    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:38:49.322110 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:38:49.322019    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:38:49.634391 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:38:49.634338    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:38:49.748239 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:38:49.748206    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:38:51.622695 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:38:51.622657    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:38:52.457057 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:38:52.457025    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:38:52.549161 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:38:52.549114    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:38:52.648138 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:38:52.648109    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:38:52.753048 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:38:52.752957    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:38:53.236010 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:38:53.235947    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:38:53.337997 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:38:53.337963    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:38:57.022402 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:38:57.022353    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:39:02.889268 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:02.889232    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:39:06.127295 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:06.127256    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-5ce595/test-model-5ce595-kserve-556ff8c9b9-j6d94"]
Jul 20 13:39:06.127772 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:06.127631    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d2f301bc-9956-471e-8b01-a1b4afd2843e" containerName="main"
Jul 20 13:39:06.127772 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:06.127643    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d2f301bc-9956-471e-8b01-a1b4afd2843e" containerName="main"
Jul 20 13:39:06.127772 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:06.127653    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b3749aad-3a40-4d34-b4e5-4ff8ec3ce780" containerName="revoke-keys"
Jul 20 13:39:06.127772 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:06.127659    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="b3749aad-3a40-4d34-b4e5-4ff8ec3ce780" containerName="revoke-keys"
Jul 20 13:39:06.127772 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:06.127714    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="b3749aad-3a40-4d34-b4e5-4ff8ec3ce780" containerName="revoke-keys"
Jul 20 13:39:06.127772 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:06.127721    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d2f301bc-9956-471e-8b01-a1b4afd2843e" containerName="main"
Jul 20 13:39:06.130800 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:06.130784    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-5ce595/test-model-5ce595-kserve-556ff8c9b9-j6d94"
Jul 20 13:39:06.133892 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:06.133865    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-5ce595\"/\"kube-root-ca.crt\""
Jul 20 13:39:06.134009 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:06.133922    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-5ce595\"/\"openshift-service-ca.crt\""
Jul 20 13:39:06.135381 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:06.135350    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-5ce595\"/\"test-model-5ce595-kserve-self-signed-certs\""
Jul 20 13:39:06.135454 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:06.135440    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-5ce595\"/\"default-dockercfg-pjgkx\""
Jul 20 13:39:06.147834 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:06.147803    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:39:06.153304 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:06.149789    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-5ce595/test-model-5ce595-kserve-556ff8c9b9-j6d94"]
Jul 20 13:39:06.201231 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:06.201193    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7cfd9723-18d1-4eed-9ed0-7db5ca362784-tmp-dir\") pod \"test-model-5ce595-kserve-556ff8c9b9-j6d94\" (UID: \"7cfd9723-18d1-4eed-9ed0-7db5ca362784\") " pod="ai-tenant-e2e-inf-a-5ce595/test-model-5ce595-kserve-556ff8c9b9-j6d94"
Jul 20 13:39:06.201413 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:06.201240    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7cfd9723-18d1-4eed-9ed0-7db5ca362784-tls-certs\") pod \"test-model-5ce595-kserve-556ff8c9b9-j6d94\" (UID: \"7cfd9723-18d1-4eed-9ed0-7db5ca362784\") " pod="ai-tenant-e2e-inf-a-5ce595/test-model-5ce595-kserve-556ff8c9b9-j6d94"
Jul 20 13:39:06.201413 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:06.201333    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7cfd9723-18d1-4eed-9ed0-7db5ca362784-home\") pod \"test-model-5ce595-kserve-556ff8c9b9-j6d94\" (UID: \"7cfd9723-18d1-4eed-9ed0-7db5ca362784\") " pod="ai-tenant-e2e-inf-a-5ce595/test-model-5ce595-kserve-556ff8c9b9-j6d94"
Jul 20 13:39:06.201413 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:06.201394    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7vlhn\" (UniqueName: \"kubernetes.io/projected/7cfd9723-18d1-4eed-9ed0-7db5ca362784-kube-api-access-7vlhn\") pod \"test-model-5ce595-kserve-556ff8c9b9-j6d94\" (UID: \"7cfd9723-18d1-4eed-9ed0-7db5ca362784\") " pod="ai-tenant-e2e-inf-a-5ce595/test-model-5ce595-kserve-556ff8c9b9-j6d94"
Jul 20 13:39:06.201524 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:06.201436    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7cfd9723-18d1-4eed-9ed0-7db5ca362784-dshm\") pod \"test-model-5ce595-kserve-556ff8c9b9-j6d94\" (UID: \"7cfd9723-18d1-4eed-9ed0-7db5ca362784\") " pod="ai-tenant-e2e-inf-a-5ce595/test-model-5ce595-kserve-556ff8c9b9-j6d94"
Jul 20 13:39:06.201524 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:06.201460    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7cfd9723-18d1-4eed-9ed0-7db5ca362784-model-cache\") pod \"test-model-5ce595-kserve-556ff8c9b9-j6d94\" (UID: \"7cfd9723-18d1-4eed-9ed0-7db5ca362784\") " pod="ai-tenant-e2e-inf-a-5ce595/test-model-5ce595-kserve-556ff8c9b9-j6d94"
Jul 20 13:39:06.302121 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:06.302076    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7cfd9723-18d1-4eed-9ed0-7db5ca362784-tls-certs\") pod \"test-model-5ce595-kserve-556ff8c9b9-j6d94\" (UID: \"7cfd9723-18d1-4eed-9ed0-7db5ca362784\") " pod="ai-tenant-e2e-inf-a-5ce595/test-model-5ce595-kserve-556ff8c9b9-j6d94"
Jul 20 13:39:06.302299 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:06.302143    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7cfd9723-18d1-4eed-9ed0-7db5ca362784-home\") pod \"test-model-5ce595-kserve-556ff8c9b9-j6d94\" (UID: \"7cfd9723-18d1-4eed-9ed0-7db5ca362784\") " pod="ai-tenant-e2e-inf-a-5ce595/test-model-5ce595-kserve-556ff8c9b9-j6d94"
Jul 20 13:39:06.302299 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:06.302160    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7vlhn\" (UniqueName: \"kubernetes.io/projected/7cfd9723-18d1-4eed-9ed0-7db5ca362784-kube-api-access-7vlhn\") pod \"test-model-5ce595-kserve-556ff8c9b9-j6d94\" (UID: \"7cfd9723-18d1-4eed-9ed0-7db5ca362784\") " pod="ai-tenant-e2e-inf-a-5ce595/test-model-5ce595-kserve-556ff8c9b9-j6d94"
Jul 20 13:39:06.302299 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:06.302183    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7cfd9723-18d1-4eed-9ed0-7db5ca362784-dshm\") pod \"test-model-5ce595-kserve-556ff8c9b9-j6d94\" (UID: \"7cfd9723-18d1-4eed-9ed0-7db5ca362784\") " pod="ai-tenant-e2e-inf-a-5ce595/test-model-5ce595-kserve-556ff8c9b9-j6d94"
Jul 20 13:39:06.302299 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:06.302202    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7cfd9723-18d1-4eed-9ed0-7db5ca362784-model-cache\") pod \"test-model-5ce595-kserve-556ff8c9b9-j6d94\" (UID: \"7cfd9723-18d1-4eed-9ed0-7db5ca362784\") " pod="ai-tenant-e2e-inf-a-5ce595/test-model-5ce595-kserve-556ff8c9b9-j6d94"
Jul 20 13:39:06.302299 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:06.302228    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7cfd9723-18d1-4eed-9ed0-7db5ca362784-tmp-dir\") pod \"test-model-5ce595-kserve-556ff8c9b9-j6d94\" (UID: \"7cfd9723-18d1-4eed-9ed0-7db5ca362784\") " pod="ai-tenant-e2e-inf-a-5ce595/test-model-5ce595-kserve-556ff8c9b9-j6d94"
Jul 20 13:39:06.302604 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:06.302536    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7cfd9723-18d1-4eed-9ed0-7db5ca362784-home\") pod \"test-model-5ce595-kserve-556ff8c9b9-j6d94\" (UID: \"7cfd9723-18d1-4eed-9ed0-7db5ca362784\") " pod="ai-tenant-e2e-inf-a-5ce595/test-model-5ce595-kserve-556ff8c9b9-j6d94"
Jul 20 13:39:06.302654 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:06.302630    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7cfd9723-18d1-4eed-9ed0-7db5ca362784-tmp-dir\") pod \"test-model-5ce595-kserve-556ff8c9b9-j6d94\" (UID: \"7cfd9723-18d1-4eed-9ed0-7db5ca362784\") " pod="ai-tenant-e2e-inf-a-5ce595/test-model-5ce595-kserve-556ff8c9b9-j6d94"
Jul 20 13:39:06.302690 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:06.302661    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7cfd9723-18d1-4eed-9ed0-7db5ca362784-model-cache\") pod \"test-model-5ce595-kserve-556ff8c9b9-j6d94\" (UID: \"7cfd9723-18d1-4eed-9ed0-7db5ca362784\") " pod="ai-tenant-e2e-inf-a-5ce595/test-model-5ce595-kserve-556ff8c9b9-j6d94"
Jul 20 13:39:06.304670 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:06.304648    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7cfd9723-18d1-4eed-9ed0-7db5ca362784-dshm\") pod \"test-model-5ce595-kserve-556ff8c9b9-j6d94\" (UID: \"7cfd9723-18d1-4eed-9ed0-7db5ca362784\") " pod="ai-tenant-e2e-inf-a-5ce595/test-model-5ce595-kserve-556ff8c9b9-j6d94"
Jul 20 13:39:06.305080 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:06.305058    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7cfd9723-18d1-4eed-9ed0-7db5ca362784-tls-certs\") pod \"test-model-5ce595-kserve-556ff8c9b9-j6d94\" (UID: \"7cfd9723-18d1-4eed-9ed0-7db5ca362784\") " pod="ai-tenant-e2e-inf-a-5ce595/test-model-5ce595-kserve-556ff8c9b9-j6d94"
Jul 20 13:39:06.315624 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:06.315597    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7vlhn\" (UniqueName: \"kubernetes.io/projected/7cfd9723-18d1-4eed-9ed0-7db5ca362784-kube-api-access-7vlhn\") pod \"test-model-5ce595-kserve-556ff8c9b9-j6d94\" (UID: \"7cfd9723-18d1-4eed-9ed0-7db5ca362784\") " pod="ai-tenant-e2e-inf-a-5ce595/test-model-5ce595-kserve-556ff8c9b9-j6d94"
Jul 20 13:39:06.440953 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:06.440858    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-5ce595/test-model-5ce595-kserve-556ff8c9b9-j6d94"
Jul 20 13:39:06.573833 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:06.573804    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-5ce595/test-model-5ce595-kserve-556ff8c9b9-j6d94"]
Jul 20 13:39:06.575222 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:39:06.575197    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7cfd9723_18d1_4eed_9ed0_7db5ca362784.slice/crio-9475cca9ac729bc24d1e0bb6d641f64728b081d03cd27c208d2ca0db7f7c2355 WatchSource:0}: Error finding container 9475cca9ac729bc24d1e0bb6d641f64728b081d03cd27c208d2ca0db7f7c2355: Status 404 returned error can't find the container with id 9475cca9ac729bc24d1e0bb6d641f64728b081d03cd27c208d2ca0db7f7c2355
Jul 20 13:39:06.988093 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:06.988063    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-5ce595/test-model-5ce595-kserve-556ff8c9b9-j6d94" event={"ID":"7cfd9723-18d1-4eed-9ed0-7db5ca362784","Type":"ContainerStarted","Data":"e93d40a679a4a4f2461fe4c4821575007267d232c579efdd60876068a3d74ba8"}
Jul 20 13:39:06.988278 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:06.988104    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-5ce595/test-model-5ce595-kserve-556ff8c9b9-j6d94" event={"ID":"7cfd9723-18d1-4eed-9ed0-7db5ca362784","Type":"ContainerStarted","Data":"9475cca9ac729bc24d1e0bb6d641f64728b081d03cd27c208d2ca0db7f7c2355"}
Jul 20 13:39:07.007587 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:07.007539    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-5ce595/test-model-5ce595-kserve-556ff8c9b9-j6d94" podStartSLOduration=1.00752351 podStartE2EDuration="1.00752351s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:39:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:39:07.005829093 +0000 UTC m=+2253.475361214" watchObservedRunningTime="2026-07-20 13:39:07.00752351 +0000 UTC m=+2253.477055695"
Jul 20 13:39:07.280676 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:07.280598    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:39:07.380434 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:07.380404    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:39:10.820871 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:10.820832    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:39:14.240339 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:14.240306    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:39:14.341296 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:14.341263    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:39:16.441254 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:16.441209    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-5ce595/test-model-5ce595-kserve-556ff8c9b9-j6d94"
Jul 20 13:39:16.441718 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:16.441275    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-5ce595/test-model-5ce595-kserve-556ff8c9b9-j6d94"
Jul 20 13:39:16.454037 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:16.454010    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-5ce595/test-model-5ce595-kserve-556ff8c9b9-j6d94"
Jul 20 13:39:17.050283 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:17.050253    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-5ce595/test-model-5ce595-kserve-556ff8c9b9-j6d94"
Jul 20 13:39:31.556665 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:31.556621    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:39:35.823857 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:35.823818    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:39:49.722903 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:49.722863    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:39:55.942939 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:55.942897    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-5ce595/test-model-5ce595-kserve-556ff8c9b9-j6d94"]
Jul 20 13:39:56.012540 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:56.012500    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:39:56.908662 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:56.908628    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:39:57.033827 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:57.033789    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5ce595-q59lw"]
Jul 20 13:39:57.037261 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:57.037242    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5ce595-q59lw"
Jul 20 13:39:57.040013 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:57.039987    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zcsfd\""
Jul 20 13:39:57.040137 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:57.040013    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 13:39:57.045369 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:57.045163    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5ce595-q59lw"]
Jul 20 13:39:57.153325 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:57.153284    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be2bccc4-eddc-438a-bd93-582a4cf25fc5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-5ce595-q59lw\" (UID: \"be2bccc4-eddc-438a-bd93-582a4cf25fc5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5ce595-q59lw"
Jul 20 13:39:57.254489 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:57.254389    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be2bccc4-eddc-438a-bd93-582a4cf25fc5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-5ce595-q59lw\" (UID: \"be2bccc4-eddc-438a-bd93-582a4cf25fc5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5ce595-q59lw"
Jul 20 13:39:57.255076 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:57.255048    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be2bccc4-eddc-438a-bd93-582a4cf25fc5-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-a-5ce595-q59lw\" (UID: \"be2bccc4-eddc-438a-bd93-582a4cf25fc5\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5ce595-q59lw"
Jul 20 13:39:57.349807 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:57.349780    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5ce595-q59lw"
Jul 20 13:39:57.482446 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:57.482421    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5ce595-q59lw"]
Jul 20 13:39:57.483980 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:39:57.483952    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe2bccc4_eddc_438a_bd93_582a4cf25fc5.slice/crio-5a0438d1dcea7d94420d5383bdd2fb091fe309f8c32199211c6cb295db0b80eb WatchSource:0}: Error finding container 5a0438d1dcea7d94420d5383bdd2fb091fe309f8c32199211c6cb295db0b80eb: Status 404 returned error can't find the container with id 5a0438d1dcea7d94420d5383bdd2fb091fe309f8c32199211c6cb295db0b80eb
Jul 20 13:39:57.640336 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:57.640304    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:39:57.739622 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:57.739591    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:39:58.255671 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:58.255638    2565 generic.go:356] "Generic (PLEG): container finished" podID="be2bccc4-eddc-438a-bd93-582a4cf25fc5" containerID="51bed824a1342682e790e1eb7b5e95e5c7a8eccc80e49074b6823f539ff6c89d" exitCode=0
Jul 20 13:39:58.256007 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:58.255684    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5ce595-q59lw" event={"ID":"be2bccc4-eddc-438a-bd93-582a4cf25fc5","Type":"ContainerDied","Data":"51bed824a1342682e790e1eb7b5e95e5c7a8eccc80e49074b6823f539ff6c89d"}
Jul 20 13:39:58.256007 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:58.255737    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5ce595-q59lw" event={"ID":"be2bccc4-eddc-438a-bd93-582a4cf25fc5","Type":"ContainerStarted","Data":"5a0438d1dcea7d94420d5383bdd2fb091fe309f8c32199211c6cb295db0b80eb"}
Jul 20 13:39:59.397605 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:59.397577    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5ce595-q59lw"
Jul 20 13:39:59.482938 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:59.482905    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be2bccc4-eddc-438a-bd93-582a4cf25fc5-maas-api-service-ca\") pod \"be2bccc4-eddc-438a-bd93-582a4cf25fc5\" (UID: \"be2bccc4-eddc-438a-bd93-582a4cf25fc5\") "
Jul 20 13:39:59.483223 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:59.483201    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be2bccc4-eddc-438a-bd93-582a4cf25fc5-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "be2bccc4-eddc-438a-bd93-582a4cf25fc5" (UID: "be2bccc4-eddc-438a-bd93-582a4cf25fc5"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:39:59.584187 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:39:59.584111    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/be2bccc4-eddc-438a-bd93-582a4cf25fc5-maas-api-service-ca\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:40:00.267350 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:00.267297    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5ce595-q59lw" event={"ID":"be2bccc4-eddc-438a-bd93-582a4cf25fc5","Type":"ContainerDied","Data":"5a0438d1dcea7d94420d5383bdd2fb091fe309f8c32199211c6cb295db0b80eb"}
Jul 20 13:40:00.267350 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:00.267328    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-a-5ce595-q59lw"
Jul 20 13:40:00.267575 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:00.267385    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5a0438d1dcea7d94420d5383bdd2fb091fe309f8c32199211c6cb295db0b80eb"
Jul 20 13:40:03.115666 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:03.115627    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:40:07.520008 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:07.519970    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:40:10.963736 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:10.963667    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-5ce595/test-model-5ce595-kserve-556ff8c9b9-j6d94" podUID="7cfd9723-18d1-4eed-9ed0-7db5ca362784" containerName="main" containerID="cri-o://e93d40a679a4a4f2461fe4c4821575007267d232c579efdd60876068a3d74ba8" gracePeriod=45
Jul 20 13:40:11.219110 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:11.219057    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-5ce595/test-model-5ce595-kserve-556ff8c9b9-j6d94"
Jul 20 13:40:11.327547 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:11.327510    2565 generic.go:356] "Generic (PLEG): container finished" podID="7cfd9723-18d1-4eed-9ed0-7db5ca362784" containerID="e93d40a679a4a4f2461fe4c4821575007267d232c579efdd60876068a3d74ba8" exitCode=0
Jul 20 13:40:11.327734 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:11.327558    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-5ce595/test-model-5ce595-kserve-556ff8c9b9-j6d94"
Jul 20 13:40:11.327734 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:11.327596    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-5ce595/test-model-5ce595-kserve-556ff8c9b9-j6d94" event={"ID":"7cfd9723-18d1-4eed-9ed0-7db5ca362784","Type":"ContainerDied","Data":"e93d40a679a4a4f2461fe4c4821575007267d232c579efdd60876068a3d74ba8"}
Jul 20 13:40:11.327734 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:11.327637    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-5ce595/test-model-5ce595-kserve-556ff8c9b9-j6d94" event={"ID":"7cfd9723-18d1-4eed-9ed0-7db5ca362784","Type":"ContainerDied","Data":"9475cca9ac729bc24d1e0bb6d641f64728b081d03cd27c208d2ca0db7f7c2355"}
Jul 20 13:40:11.327734 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:11.327655    2565 scope.go:117] "RemoveContainer" containerID="e93d40a679a4a4f2461fe4c4821575007267d232c579efdd60876068a3d74ba8"
Jul 20 13:40:11.336146 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:11.336127    2565 scope.go:117] "RemoveContainer" containerID="e93d40a679a4a4f2461fe4c4821575007267d232c579efdd60876068a3d74ba8"
Jul 20 13:40:11.336435 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:40:11.336405    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e93d40a679a4a4f2461fe4c4821575007267d232c579efdd60876068a3d74ba8\": container with ID starting with e93d40a679a4a4f2461fe4c4821575007267d232c579efdd60876068a3d74ba8 not found: ID does not exist" containerID="e93d40a679a4a4f2461fe4c4821575007267d232c579efdd60876068a3d74ba8"
Jul 20 13:40:11.336544 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:11.336446    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e93d40a679a4a4f2461fe4c4821575007267d232c579efdd60876068a3d74ba8"} err="failed to get container status \"e93d40a679a4a4f2461fe4c4821575007267d232c579efdd60876068a3d74ba8\": rpc error: code = NotFound desc = could not find container \"e93d40a679a4a4f2461fe4c4821575007267d232c579efdd60876068a3d74ba8\": container with ID starting with e93d40a679a4a4f2461fe4c4821575007267d232c579efdd60876068a3d74ba8 not found: ID does not exist"
Jul 20 13:40:11.384734 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:11.384711    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7cfd9723-18d1-4eed-9ed0-7db5ca362784-dshm\") pod \"7cfd9723-18d1-4eed-9ed0-7db5ca362784\" (UID: \"7cfd9723-18d1-4eed-9ed0-7db5ca362784\") "
Jul 20 13:40:11.384885 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:11.384744    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7cfd9723-18d1-4eed-9ed0-7db5ca362784-model-cache\") pod \"7cfd9723-18d1-4eed-9ed0-7db5ca362784\" (UID: \"7cfd9723-18d1-4eed-9ed0-7db5ca362784\") "
Jul 20 13:40:11.384885 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:11.384772    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7cfd9723-18d1-4eed-9ed0-7db5ca362784-tmp-dir\") pod \"7cfd9723-18d1-4eed-9ed0-7db5ca362784\" (UID: \"7cfd9723-18d1-4eed-9ed0-7db5ca362784\") "
Jul 20 13:40:11.384885 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:11.384795    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7vlhn\" (UniqueName: \"kubernetes.io/projected/7cfd9723-18d1-4eed-9ed0-7db5ca362784-kube-api-access-7vlhn\") pod \"7cfd9723-18d1-4eed-9ed0-7db5ca362784\" (UID: \"7cfd9723-18d1-4eed-9ed0-7db5ca362784\") "
Jul 20 13:40:11.384885 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:11.384830    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7cfd9723-18d1-4eed-9ed0-7db5ca362784-tls-certs\") pod \"7cfd9723-18d1-4eed-9ed0-7db5ca362784\" (UID: \"7cfd9723-18d1-4eed-9ed0-7db5ca362784\") "
Jul 20 13:40:11.384885 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:11.384870    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7cfd9723-18d1-4eed-9ed0-7db5ca362784-home\") pod \"7cfd9723-18d1-4eed-9ed0-7db5ca362784\" (UID: \"7cfd9723-18d1-4eed-9ed0-7db5ca362784\") "
Jul 20 13:40:11.385153 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:11.384998    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cfd9723-18d1-4eed-9ed0-7db5ca362784-model-cache" (OuterVolumeSpecName: "model-cache") pod "7cfd9723-18d1-4eed-9ed0-7db5ca362784" (UID: "7cfd9723-18d1-4eed-9ed0-7db5ca362784"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:40:11.385153 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:11.385018    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cfd9723-18d1-4eed-9ed0-7db5ca362784-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "7cfd9723-18d1-4eed-9ed0-7db5ca362784" (UID: "7cfd9723-18d1-4eed-9ed0-7db5ca362784"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:40:11.385153 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:11.385122    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/7cfd9723-18d1-4eed-9ed0-7db5ca362784-tmp-dir\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:40:11.385153 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:11.385142    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/7cfd9723-18d1-4eed-9ed0-7db5ca362784-model-cache\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:40:11.385377 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:11.385251    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cfd9723-18d1-4eed-9ed0-7db5ca362784-home" (OuterVolumeSpecName: "home") pod "7cfd9723-18d1-4eed-9ed0-7db5ca362784" (UID: "7cfd9723-18d1-4eed-9ed0-7db5ca362784"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:40:11.386897 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:11.386870    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7cfd9723-18d1-4eed-9ed0-7db5ca362784-dshm" (OuterVolumeSpecName: "dshm") pod "7cfd9723-18d1-4eed-9ed0-7db5ca362784" (UID: "7cfd9723-18d1-4eed-9ed0-7db5ca362784"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:40:11.386993 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:11.386965    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/7cfd9723-18d1-4eed-9ed0-7db5ca362784-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "7cfd9723-18d1-4eed-9ed0-7db5ca362784" (UID: "7cfd9723-18d1-4eed-9ed0-7db5ca362784"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 13:40:11.387038 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:11.386986    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7cfd9723-18d1-4eed-9ed0-7db5ca362784-kube-api-access-7vlhn" (OuterVolumeSpecName: "kube-api-access-7vlhn") pod "7cfd9723-18d1-4eed-9ed0-7db5ca362784" (UID: "7cfd9723-18d1-4eed-9ed0-7db5ca362784"). InnerVolumeSpecName "kube-api-access-7vlhn". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:40:11.486259 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:11.486176    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7vlhn\" (UniqueName: \"kubernetes.io/projected/7cfd9723-18d1-4eed-9ed0-7db5ca362784-kube-api-access-7vlhn\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:40:11.486259 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:11.486208    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/7cfd9723-18d1-4eed-9ed0-7db5ca362784-tls-certs\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:40:11.486259 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:11.486218    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/7cfd9723-18d1-4eed-9ed0-7db5ca362784-home\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:40:11.486259 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:11.486226    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/7cfd9723-18d1-4eed-9ed0-7db5ca362784-dshm\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:40:11.652427 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:11.652394    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-5ce595/test-model-5ce595-kserve-556ff8c9b9-j6d94"]
Jul 20 13:40:11.655895 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:11.655869    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-5ce595/test-model-5ce595-kserve-556ff8c9b9-j6d94"]
Jul 20 13:40:12.125817 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:12.125763    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:40:12.152179 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:12.149316    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7cfd9723-18d1-4eed-9ed0-7db5ca362784" path="/var/lib/kubelet/pods/7cfd9723-18d1-4eed-9ed0-7db5ca362784/volumes"
Jul 20 13:40:14.123096 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:14.123058    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:40:18.017124 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:18.017094    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:40:18.128911 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:18.128878    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:40:22.890724 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:22.890662    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:40:23.171283 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:23.171182    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:40:23.317341 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:23.317299    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fc9057-jmvtr"]
Jul 20 13:40:23.317731 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:23.317712    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be2bccc4-eddc-438a-bd93-582a4cf25fc5" containerName="revoke-keys"
Jul 20 13:40:23.317841 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:23.317733    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="be2bccc4-eddc-438a-bd93-582a4cf25fc5" containerName="revoke-keys"
Jul 20 13:40:23.317841 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:23.317754    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7cfd9723-18d1-4eed-9ed0-7db5ca362784" containerName="main"
Jul 20 13:40:23.317841 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:23.317762    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="7cfd9723-18d1-4eed-9ed0-7db5ca362784" containerName="main"
Jul 20 13:40:23.317991 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:23.317853    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="7cfd9723-18d1-4eed-9ed0-7db5ca362784" containerName="main"
Jul 20 13:40:23.317991 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:23.317864    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="be2bccc4-eddc-438a-bd93-582a4cf25fc5" containerName="revoke-keys"
Jul 20 13:40:23.322033 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:23.322009    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fc9057-jmvtr"
Jul 20 13:40:23.324902 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:23.324877    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zcsfd\""
Jul 20 13:40:23.325024 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:23.324979    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 13:40:23.329678 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:23.329650    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fc9057-jmvtr"]
Jul 20 13:40:23.486626 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:23.486532    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e05423f-7085-4b1d-9986-da8ac694f9ca-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-fc9057-jmvtr\" (UID: \"3e05423f-7085-4b1d-9986-da8ac694f9ca\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fc9057-jmvtr"
Jul 20 13:40:23.587247 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:23.587208    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e05423f-7085-4b1d-9986-da8ac694f9ca-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-fc9057-jmvtr\" (UID: \"3e05423f-7085-4b1d-9986-da8ac694f9ca\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fc9057-jmvtr"
Jul 20 13:40:23.587891 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:23.587870    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e05423f-7085-4b1d-9986-da8ac694f9ca-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-fc9057-jmvtr\" (UID: \"3e05423f-7085-4b1d-9986-da8ac694f9ca\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fc9057-jmvtr"
Jul 20 13:40:23.634287 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:23.634244    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fc9057-jmvtr"
Jul 20 13:40:23.768725 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:23.768701    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fc9057-jmvtr"]
Jul 20 13:40:23.770574 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:40:23.770548    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e05423f_7085_4b1d_9986_da8ac694f9ca.slice/crio-f7a0bc48265bb631f8b0255a31511e5b9e27b755045122cf30c9ae9689e5ed08 WatchSource:0}: Error finding container f7a0bc48265bb631f8b0255a31511e5b9e27b755045122cf30c9ae9689e5ed08: Status 404 returned error can't find the container with id f7a0bc48265bb631f8b0255a31511e5b9e27b755045122cf30c9ae9689e5ed08
Jul 20 13:40:23.841705 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:23.841655    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:40:23.942457 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:23.942425    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:40:24.399541 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:24.399496    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fc9057-jmvtr" event={"ID":"3e05423f-7085-4b1d-9986-da8ac694f9ca","Type":"ContainerStarted","Data":"c6c42cba95e65960e948353b7a13008427475113879eb37a4d1e36f822508cd9"}
Jul 20 13:40:24.399719 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:24.399561    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fc9057-jmvtr" event={"ID":"3e05423f-7085-4b1d-9986-da8ac694f9ca","Type":"ContainerStarted","Data":"f7a0bc48265bb631f8b0255a31511e5b9e27b755045122cf30c9ae9689e5ed08"}
Jul 20 13:40:24.417635 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:24.417589    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fc9057-jmvtr" podStartSLOduration=1.417574411 podStartE2EDuration="1.417574411s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:40:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:40:24.416242368 +0000 UTC m=+2330.885774485" watchObservedRunningTime="2026-07-20 13:40:24.417574411 +0000 UTC m=+2330.887106547"
Jul 20 13:40:25.405810 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:25.405778    2565 generic.go:356] "Generic (PLEG): container finished" podID="3e05423f-7085-4b1d-9986-da8ac694f9ca" containerID="c6c42cba95e65960e948353b7a13008427475113879eb37a4d1e36f822508cd9" exitCode=0
Jul 20 13:40:25.406208 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:25.405862    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fc9057-jmvtr" event={"ID":"3e05423f-7085-4b1d-9986-da8ac694f9ca","Type":"ContainerDied","Data":"c6c42cba95e65960e948353b7a13008427475113879eb37a4d1e36f822508cd9"}
Jul 20 13:40:26.544448 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:26.544422    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fc9057-jmvtr"
Jul 20 13:40:26.713641 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:26.713535    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e05423f-7085-4b1d-9986-da8ac694f9ca-maas-api-service-ca\") pod \"3e05423f-7085-4b1d-9986-da8ac694f9ca\" (UID: \"3e05423f-7085-4b1d-9986-da8ac694f9ca\") "
Jul 20 13:40:26.713940 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:26.713919    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e05423f-7085-4b1d-9986-da8ac694f9ca-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "3e05423f-7085-4b1d-9986-da8ac694f9ca" (UID: "3e05423f-7085-4b1d-9986-da8ac694f9ca"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:40:26.814732 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:26.814687    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/3e05423f-7085-4b1d-9986-da8ac694f9ca-maas-api-service-ca\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:40:27.418111 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:27.418085    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fc9057-jmvtr"
Jul 20 13:40:27.418291 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:27.418125    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-fc9057-jmvtr" event={"ID":"3e05423f-7085-4b1d-9986-da8ac694f9ca","Type":"ContainerDied","Data":"f7a0bc48265bb631f8b0255a31511e5b9e27b755045122cf30c9ae9689e5ed08"}
Jul 20 13:40:27.418291 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:27.418172    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f7a0bc48265bb631f8b0255a31511e5b9e27b755045122cf30c9ae9689e5ed08"
Jul 20 13:40:33.975188 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:33.975150    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:40:37.324223 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:37.324185    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:40:38.406719 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:38.406688    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:40:44.193217 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:44.193182    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:40:44.293621 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:44.293584    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:40:49.172129 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:49.172095    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:40:49.448483 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:49.448400    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:40:49.843283 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:49.843203    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:40:50.146137 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:50.146101    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:40:50.721447 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:50.721414    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:40:53.103552 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:53.103517    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:40:53.194207 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:53.194176    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:40:53.265785 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:53.265749    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:40:53.780212 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:53.780176    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:40:53.880377 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:53.880329    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:40:57.632111 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:57.632072    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:40:58.137577 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:58.137543    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:40:58.170016 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:58.169971    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:40:58.519003 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:58.518905    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:40:58.633566 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:40:58.633524    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:41:01.188799 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:01.188761    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:41:01.286093 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:01.286057    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:41:01.377730 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:01.377704    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:41:01.934067 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:01.934035    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:41:02.034139 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:02.034097    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:41:02.134338 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:02.134309    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:41:05.731157 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:05.731111    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:41:05.894344 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:05.894307    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:41:05.992263 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:05.992172    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:41:09.727768 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:09.727730    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:41:13.985965 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:13.985928    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-15a544-n8qtn"]
Jul 20 13:41:13.986373 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:13.986285    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e05423f-7085-4b1d-9986-da8ac694f9ca" containerName="revoke-keys"
Jul 20 13:41:13.986373 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:13.986299    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e05423f-7085-4b1d-9986-da8ac694f9ca" containerName="revoke-keys"
Jul 20 13:41:13.986459 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:13.986385    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e05423f-7085-4b1d-9986-da8ac694f9ca" containerName="revoke-keys"
Jul 20 13:41:13.989304 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:13.989286    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-15a544-n8qtn"
Jul 20 13:41:13.991838 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:13.991812    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 13:41:13.991961 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:13.991852    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zcsfd\""
Jul 20 13:41:13.996665 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:13.996642    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-15a544-n8qtn"]
Jul 20 13:41:14.111061 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:14.111013    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/87429dfd-3e0d-46de-9e49-071c1131c61f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-15a544-n8qtn\" (UID: \"87429dfd-3e0d-46de-9e49-071c1131c61f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-15a544-n8qtn"
Jul 20 13:41:14.211825 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:14.211784    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/87429dfd-3e0d-46de-9e49-071c1131c61f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-15a544-n8qtn\" (UID: \"87429dfd-3e0d-46de-9e49-071c1131c61f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-15a544-n8qtn"
Jul 20 13:41:14.212503 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:14.212481    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/87429dfd-3e0d-46de-9e49-071c1131c61f-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-15a544-n8qtn\" (UID: \"87429dfd-3e0d-46de-9e49-071c1131c61f\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-15a544-n8qtn"
Jul 20 13:41:14.301721 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:14.301637    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-15a544-n8qtn"
Jul 20 13:41:14.436413 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:14.436384    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-15a544-n8qtn"]
Jul 20 13:41:14.438852 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:41:14.438823    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87429dfd_3e0d_46de_9e49_071c1131c61f.slice/crio-c594569fcde0b53ab5a07adef17cc3c220d688ae710243a5b16744170de2a299 WatchSource:0}: Error finding container c594569fcde0b53ab5a07adef17cc3c220d688ae710243a5b16744170de2a299: Status 404 returned error can't find the container with id c594569fcde0b53ab5a07adef17cc3c220d688ae710243a5b16744170de2a299
Jul 20 13:41:14.670184 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:14.670148    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-15a544-n8qtn" event={"ID":"87429dfd-3e0d-46de-9e49-071c1131c61f","Type":"ContainerStarted","Data":"c594569fcde0b53ab5a07adef17cc3c220d688ae710243a5b16744170de2a299"}
Jul 20 13:41:14.699161 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:14.699136    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:41:14.798402 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:14.798352    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:41:15.677199 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:15.677161    2565 generic.go:356] "Generic (PLEG): container finished" podID="87429dfd-3e0d-46de-9e49-071c1131c61f" containerID="ce7e53c23a6da42c9eea96bf42f1139ab1265cde8752a6676992d86d60bdbe93" exitCode=0
Jul 20 13:41:15.677625 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:15.677254    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-15a544-n8qtn" event={"ID":"87429dfd-3e0d-46de-9e49-071c1131c61f","Type":"ContainerDied","Data":"ce7e53c23a6da42c9eea96bf42f1139ab1265cde8752a6676992d86d60bdbe93"}
Jul 20 13:41:16.813536 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:16.813514    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-15a544-n8qtn"
Jul 20 13:41:16.937257 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:16.937170    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/87429dfd-3e0d-46de-9e49-071c1131c61f-maas-api-service-ca\") pod \"87429dfd-3e0d-46de-9e49-071c1131c61f\" (UID: \"87429dfd-3e0d-46de-9e49-071c1131c61f\") "
Jul 20 13:41:16.937573 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:16.937551    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/87429dfd-3e0d-46de-9e49-071c1131c61f-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "87429dfd-3e0d-46de-9e49-071c1131c61f" (UID: "87429dfd-3e0d-46de-9e49-071c1131c61f"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:41:17.038104 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:17.038067    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/87429dfd-3e0d-46de-9e49-071c1131c61f-maas-api-service-ca\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:41:17.688823 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:17.688788    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-15a544-n8qtn" event={"ID":"87429dfd-3e0d-46de-9e49-071c1131c61f","Type":"ContainerDied","Data":"c594569fcde0b53ab5a07adef17cc3c220d688ae710243a5b16744170de2a299"}
Jul 20 13:41:17.688823 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:17.688807    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-15a544-n8qtn"
Jul 20 13:41:17.689028 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:17.688836    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c594569fcde0b53ab5a07adef17cc3c220d688ae710243a5b16744170de2a299"
Jul 20 13:41:22.826678 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:22.826645    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:41:22.925100 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:22.925063    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:41:24.664928 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:24.664893    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:41:24.765676 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:24.765642    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:41:24.928567 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:24.928473    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:41:28.216602 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:28.216552    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:41:29.086895 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:29.086865    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:41:32.038066 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:32.038021    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:41:35.069684 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:35.069652    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:41:35.169631 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:35.169596    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:41:35.627535 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:35.627500    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:41:39.833624 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:39.833592    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:41:40.065037 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:40.065001    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:41:40.197161 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:40.197131    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b738bb-fmhzt"]
Jul 20 13:41:40.197466 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:40.197454    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87429dfd-3e0d-46de-9e49-071c1131c61f" containerName="revoke-keys"
Jul 20 13:41:40.197525 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:40.197468    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="87429dfd-3e0d-46de-9e49-071c1131c61f" containerName="revoke-keys"
Jul 20 13:41:40.197565 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:40.197535    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="87429dfd-3e0d-46de-9e49-071c1131c61f" containerName="revoke-keys"
Jul 20 13:41:40.200470 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:40.200451    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b738bb-fmhzt"
Jul 20 13:41:40.203339 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:40.203308    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zcsfd\""
Jul 20 13:41:40.203652 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:40.203634    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 13:41:40.209426 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:40.209399    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b738bb-fmhzt"]
Jul 20 13:41:40.217395 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:40.217352    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6fe7883c-0115-44b3-805e-f30e6f2fe26a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-b738bb-fmhzt\" (UID: \"6fe7883c-0115-44b3-805e-f30e6f2fe26a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b738bb-fmhzt"
Jul 20 13:41:40.318723 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:40.318688    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6fe7883c-0115-44b3-805e-f30e6f2fe26a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-b738bb-fmhzt\" (UID: \"6fe7883c-0115-44b3-805e-f30e6f2fe26a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b738bb-fmhzt"
Jul 20 13:41:40.319411 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:40.319344    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6fe7883c-0115-44b3-805e-f30e6f2fe26a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-b738bb-fmhzt\" (UID: \"6fe7883c-0115-44b3-805e-f30e6f2fe26a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b738bb-fmhzt"
Jul 20 13:41:40.512056 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:40.511964    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b738bb-fmhzt"
Jul 20 13:41:40.645442 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:40.645411    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b738bb-fmhzt"]
Jul 20 13:41:40.646771 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:41:40.646742    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6fe7883c_0115_44b3_805e_f30e6f2fe26a.slice/crio-7dcd064a7a5c5ffb475c653243766549851f9bfe6ef2f7b5aa51fb78c565001a WatchSource:0}: Error finding container 7dcd064a7a5c5ffb475c653243766549851f9bfe6ef2f7b5aa51fb78c565001a: Status 404 returned error can't find the container with id 7dcd064a7a5c5ffb475c653243766549851f9bfe6ef2f7b5aa51fb78c565001a
Jul 20 13:41:40.742237 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:40.742205    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:41:40.807091 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:40.807054    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b738bb-fmhzt" event={"ID":"6fe7883c-0115-44b3-805e-f30e6f2fe26a","Type":"ContainerStarted","Data":"7dcd064a7a5c5ffb475c653243766549851f9bfe6ef2f7b5aa51fb78c565001a"}
Jul 20 13:41:40.842035 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:40.842001    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:41:41.814059 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:41.813978    2565 generic.go:356] "Generic (PLEG): container finished" podID="6fe7883c-0115-44b3-805e-f30e6f2fe26a" containerID="f92a35c6297ab1bddb2bc21f57b0f70a7d59d0fc393f81ff4161bb41361f5289" exitCode=0
Jul 20 13:41:41.814059 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:41.814027    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b738bb-fmhzt" event={"ID":"6fe7883c-0115-44b3-805e-f30e6f2fe26a","Type":"ContainerDied","Data":"f92a35c6297ab1bddb2bc21f57b0f70a7d59d0fc393f81ff4161bb41361f5289"}
Jul 20 13:41:42.949755 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:42.949732    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b738bb-fmhzt"
Jul 20 13:41:43.042955 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:43.042921    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6fe7883c-0115-44b3-805e-f30e6f2fe26a-maas-api-service-ca\") pod \"6fe7883c-0115-44b3-805e-f30e6f2fe26a\" (UID: \"6fe7883c-0115-44b3-805e-f30e6f2fe26a\") "
Jul 20 13:41:43.043289 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:43.043265    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6fe7883c-0115-44b3-805e-f30e6f2fe26a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "6fe7883c-0115-44b3-805e-f30e6f2fe26a" (UID: "6fe7883c-0115-44b3-805e-f30e6f2fe26a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:41:43.143474 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:43.143436    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/6fe7883c-0115-44b3-805e-f30e6f2fe26a-maas-api-service-ca\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:41:43.825750 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:43.825717    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b738bb-fmhzt"
Jul 20 13:41:43.825932 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:43.825720    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-b738bb-fmhzt" event={"ID":"6fe7883c-0115-44b3-805e-f30e6f2fe26a","Type":"ContainerDied","Data":"7dcd064a7a5c5ffb475c653243766549851f9bfe6ef2f7b5aa51fb78c565001a"}
Jul 20 13:41:43.825932 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:43.825852    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7dcd064a7a5c5ffb475c653243766549851f9bfe6ef2f7b5aa51fb78c565001a"
Jul 20 13:41:49.338131 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:49.338094    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:41:50.763421 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:50.763341    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:41:53.825211 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:53.825174    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:41:55.361870 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:41:55.361838    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:42:01.172306 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:01.172275    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:42:01.279103 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:01.279069    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:42:06.082070 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:06.082037    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:42:06.313953 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:06.313918    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:42:06.657092 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:06.657063    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:42:07.062560 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:07.062470    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:42:07.486816 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:07.486781    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:42:09.602371 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:09.602331    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:42:09.699778 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:09.699743    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:42:09.807316 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:09.807266    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:42:10.104979 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:10.104940    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:42:10.365343 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:10.365259    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:42:10.463420 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:10.463345    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:42:14.072379 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:14.072329    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:42:14.416090 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:14.416058    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:42:14.734576 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:14.734498    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:42:14.780453 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:14.780420    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:42:15.127906 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:15.127876    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:42:17.611532 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:17.611493    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:42:17.716948 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:17.716918    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:42:17.945923 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:17.945847    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:42:18.287281 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:18.287199    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:42:18.534253 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:18.534224    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:42:18.634795 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:18.634763    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:42:22.094187 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:22.094152    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:42:23.247326 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:23.247290    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:42:31.205210 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:31.205173    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:42:31.321401 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:31.321368    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:42:34.305558 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:34.305530    2565 scope.go:117] "RemoveContainer" containerID="1589f129f5dfc36d803e19811f286acc85ea5a2fc565068f8f2ab77cfb8ec51f"
Jul 20 13:42:38.633656 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:38.633621    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-5e9fd6/auth-test-model-5e9fd6-kserve-6d45bdc95-nsfkw"]
Jul 20 13:42:38.634063 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:38.633948    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6fe7883c-0115-44b3-805e-f30e6f2fe26a" containerName="revoke-keys"
Jul 20 13:42:38.634063 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:38.633960    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="6fe7883c-0115-44b3-805e-f30e6f2fe26a" containerName="revoke-keys"
Jul 20 13:42:38.634063 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:38.634025    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="6fe7883c-0115-44b3-805e-f30e6f2fe26a" containerName="revoke-keys"
Jul 20 13:42:38.638284 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:38.638265    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-5e9fd6/auth-test-model-5e9fd6-kserve-6d45bdc95-nsfkw"
Jul 20 13:42:38.641379 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:38.641326    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-5e9fd6\"/\"openshift-service-ca.crt\""
Jul 20 13:42:38.642708 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:38.642686    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-5e9fd6\"/\"auth-test-model-5e9fd6-kserve-self-signed-certs\""
Jul 20 13:42:38.642863 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:38.642775    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-5e9fd6\"/\"default-dockercfg-gzftg\""
Jul 20 13:42:38.642863 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:38.642785    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-5e9fd6\"/\"kube-root-ca.crt\""
Jul 20 13:42:38.647111 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:38.647089    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-5e9fd6/auth-test-model-5e9fd6-kserve-6d45bdc95-nsfkw"]
Jul 20 13:42:38.652516 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:38.652487    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:42:38.818376 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:38.818328    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/824187ab-d4fa-4d85-ae89-529bdf2a6d2b-tls-certs\") pod \"auth-test-model-5e9fd6-kserve-6d45bdc95-nsfkw\" (UID: \"824187ab-d4fa-4d85-ae89-529bdf2a6d2b\") " pod="ai-tenant-e2e-shared-a-5e9fd6/auth-test-model-5e9fd6-kserve-6d45bdc95-nsfkw"
Jul 20 13:42:38.818543 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:38.818388    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/824187ab-d4fa-4d85-ae89-529bdf2a6d2b-home\") pod \"auth-test-model-5e9fd6-kserve-6d45bdc95-nsfkw\" (UID: \"824187ab-d4fa-4d85-ae89-529bdf2a6d2b\") " pod="ai-tenant-e2e-shared-a-5e9fd6/auth-test-model-5e9fd6-kserve-6d45bdc95-nsfkw"
Jul 20 13:42:38.818543 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:38.818506    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/824187ab-d4fa-4d85-ae89-529bdf2a6d2b-model-cache\") pod \"auth-test-model-5e9fd6-kserve-6d45bdc95-nsfkw\" (UID: \"824187ab-d4fa-4d85-ae89-529bdf2a6d2b\") " pod="ai-tenant-e2e-shared-a-5e9fd6/auth-test-model-5e9fd6-kserve-6d45bdc95-nsfkw"
Jul 20 13:42:38.818543 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:38.818535    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/824187ab-d4fa-4d85-ae89-529bdf2a6d2b-dshm\") pod \"auth-test-model-5e9fd6-kserve-6d45bdc95-nsfkw\" (UID: \"824187ab-d4fa-4d85-ae89-529bdf2a6d2b\") " pod="ai-tenant-e2e-shared-a-5e9fd6/auth-test-model-5e9fd6-kserve-6d45bdc95-nsfkw"
Jul 20 13:42:38.818714 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:38.818573    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kn84l\" (UniqueName: \"kubernetes.io/projected/824187ab-d4fa-4d85-ae89-529bdf2a6d2b-kube-api-access-kn84l\") pod \"auth-test-model-5e9fd6-kserve-6d45bdc95-nsfkw\" (UID: \"824187ab-d4fa-4d85-ae89-529bdf2a6d2b\") " pod="ai-tenant-e2e-shared-a-5e9fd6/auth-test-model-5e9fd6-kserve-6d45bdc95-nsfkw"
Jul 20 13:42:38.818714 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:38.818615    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/824187ab-d4fa-4d85-ae89-529bdf2a6d2b-tmp-dir\") pod \"auth-test-model-5e9fd6-kserve-6d45bdc95-nsfkw\" (UID: \"824187ab-d4fa-4d85-ae89-529bdf2a6d2b\") " pod="ai-tenant-e2e-shared-a-5e9fd6/auth-test-model-5e9fd6-kserve-6d45bdc95-nsfkw"
Jul 20 13:42:38.919980 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:38.919899    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/824187ab-d4fa-4d85-ae89-529bdf2a6d2b-model-cache\") pod \"auth-test-model-5e9fd6-kserve-6d45bdc95-nsfkw\" (UID: \"824187ab-d4fa-4d85-ae89-529bdf2a6d2b\") " pod="ai-tenant-e2e-shared-a-5e9fd6/auth-test-model-5e9fd6-kserve-6d45bdc95-nsfkw"
Jul 20 13:42:38.919980 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:38.919936    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/824187ab-d4fa-4d85-ae89-529bdf2a6d2b-dshm\") pod \"auth-test-model-5e9fd6-kserve-6d45bdc95-nsfkw\" (UID: \"824187ab-d4fa-4d85-ae89-529bdf2a6d2b\") " pod="ai-tenant-e2e-shared-a-5e9fd6/auth-test-model-5e9fd6-kserve-6d45bdc95-nsfkw"
Jul 20 13:42:38.919980 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:38.919963    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kn84l\" (UniqueName: \"kubernetes.io/projected/824187ab-d4fa-4d85-ae89-529bdf2a6d2b-kube-api-access-kn84l\") pod \"auth-test-model-5e9fd6-kserve-6d45bdc95-nsfkw\" (UID: \"824187ab-d4fa-4d85-ae89-529bdf2a6d2b\") " pod="ai-tenant-e2e-shared-a-5e9fd6/auth-test-model-5e9fd6-kserve-6d45bdc95-nsfkw"
Jul 20 13:42:38.920264 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:38.920008    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/824187ab-d4fa-4d85-ae89-529bdf2a6d2b-tmp-dir\") pod \"auth-test-model-5e9fd6-kserve-6d45bdc95-nsfkw\" (UID: \"824187ab-d4fa-4d85-ae89-529bdf2a6d2b\") " pod="ai-tenant-e2e-shared-a-5e9fd6/auth-test-model-5e9fd6-kserve-6d45bdc95-nsfkw"
Jul 20 13:42:38.920264 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:38.920029    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/824187ab-d4fa-4d85-ae89-529bdf2a6d2b-tls-certs\") pod \"auth-test-model-5e9fd6-kserve-6d45bdc95-nsfkw\" (UID: \"824187ab-d4fa-4d85-ae89-529bdf2a6d2b\") " pod="ai-tenant-e2e-shared-a-5e9fd6/auth-test-model-5e9fd6-kserve-6d45bdc95-nsfkw"
Jul 20 13:42:38.920264 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:38.920049    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/824187ab-d4fa-4d85-ae89-529bdf2a6d2b-home\") pod \"auth-test-model-5e9fd6-kserve-6d45bdc95-nsfkw\" (UID: \"824187ab-d4fa-4d85-ae89-529bdf2a6d2b\") " pod="ai-tenant-e2e-shared-a-5e9fd6/auth-test-model-5e9fd6-kserve-6d45bdc95-nsfkw"
Jul 20 13:42:38.920470 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:38.920342    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/824187ab-d4fa-4d85-ae89-529bdf2a6d2b-model-cache\") pod \"auth-test-model-5e9fd6-kserve-6d45bdc95-nsfkw\" (UID: \"824187ab-d4fa-4d85-ae89-529bdf2a6d2b\") " pod="ai-tenant-e2e-shared-a-5e9fd6/auth-test-model-5e9fd6-kserve-6d45bdc95-nsfkw"
Jul 20 13:42:38.920470 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:38.920450    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/824187ab-d4fa-4d85-ae89-529bdf2a6d2b-tmp-dir\") pod \"auth-test-model-5e9fd6-kserve-6d45bdc95-nsfkw\" (UID: \"824187ab-d4fa-4d85-ae89-529bdf2a6d2b\") " pod="ai-tenant-e2e-shared-a-5e9fd6/auth-test-model-5e9fd6-kserve-6d45bdc95-nsfkw"
Jul 20 13:42:38.920552 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:38.920474    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/824187ab-d4fa-4d85-ae89-529bdf2a6d2b-home\") pod \"auth-test-model-5e9fd6-kserve-6d45bdc95-nsfkw\" (UID: \"824187ab-d4fa-4d85-ae89-529bdf2a6d2b\") " pod="ai-tenant-e2e-shared-a-5e9fd6/auth-test-model-5e9fd6-kserve-6d45bdc95-nsfkw"
Jul 20 13:42:38.922181 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:38.922159    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/824187ab-d4fa-4d85-ae89-529bdf2a6d2b-dshm\") pod \"auth-test-model-5e9fd6-kserve-6d45bdc95-nsfkw\" (UID: \"824187ab-d4fa-4d85-ae89-529bdf2a6d2b\") " pod="ai-tenant-e2e-shared-a-5e9fd6/auth-test-model-5e9fd6-kserve-6d45bdc95-nsfkw"
Jul 20 13:42:38.922581 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:38.922564    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/824187ab-d4fa-4d85-ae89-529bdf2a6d2b-tls-certs\") pod \"auth-test-model-5e9fd6-kserve-6d45bdc95-nsfkw\" (UID: \"824187ab-d4fa-4d85-ae89-529bdf2a6d2b\") " pod="ai-tenant-e2e-shared-a-5e9fd6/auth-test-model-5e9fd6-kserve-6d45bdc95-nsfkw"
Jul 20 13:42:38.930633 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:38.930605    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kn84l\" (UniqueName: \"kubernetes.io/projected/824187ab-d4fa-4d85-ae89-529bdf2a6d2b-kube-api-access-kn84l\") pod \"auth-test-model-5e9fd6-kserve-6d45bdc95-nsfkw\" (UID: \"824187ab-d4fa-4d85-ae89-529bdf2a6d2b\") " pod="ai-tenant-e2e-shared-a-5e9fd6/auth-test-model-5e9fd6-kserve-6d45bdc95-nsfkw"
Jul 20 13:42:38.948392 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:38.948352    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-5e9fd6/auth-test-model-5e9fd6-kserve-6d45bdc95-nsfkw"
Jul 20 13:42:39.082520 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:39.082487    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-5e9fd6/auth-test-model-5e9fd6-kserve-6d45bdc95-nsfkw"]
Jul 20 13:42:39.084119 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:42:39.084091    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod824187ab_d4fa_4d85_ae89_529bdf2a6d2b.slice/crio-239a195c54cdaafd64f99b80def64a3bcc0082ca1fbe581db0867999668fe4bb WatchSource:0}: Error finding container 239a195c54cdaafd64f99b80def64a3bcc0082ca1fbe581db0867999668fe4bb: Status 404 returned error can't find the container with id 239a195c54cdaafd64f99b80def64a3bcc0082ca1fbe581db0867999668fe4bb
Jul 20 13:42:39.132196 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:39.132159    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-5e9fd6/auth-test-model-5e9fd6-kserve-6d45bdc95-nsfkw" event={"ID":"824187ab-d4fa-4d85-ae89-529bdf2a6d2b","Type":"ContainerStarted","Data":"239a195c54cdaafd64f99b80def64a3bcc0082ca1fbe581db0867999668fe4bb"}
Jul 20 13:42:39.433648 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:39.433613    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:42:39.533866 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:39.533830    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:42:40.138487 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:40.138456    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-5e9fd6/auth-test-model-5e9fd6-kserve-6d45bdc95-nsfkw" event={"ID":"824187ab-d4fa-4d85-ae89-529bdf2a6d2b","Type":"ContainerStarted","Data":"244d4fe634ec451062bb2a64b052b3358a6da91f92f67e2b8bd8555b2f34491f"}
Jul 20 13:42:40.168659 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:40.168591    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-5e9fd6/auth-test-model-5e9fd6-kserve-6d45bdc95-nsfkw" podStartSLOduration=2.16856837 podStartE2EDuration="2.16856837s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:42:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:42:40.15798438 +0000 UTC m=+2466.627516501" watchObservedRunningTime="2026-07-20 13:42:40.16856837 +0000 UTC m=+2466.638100491"
Jul 20 13:42:41.931008 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:41.930968    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:42:48.949457 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:48.949409    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-5e9fd6/auth-test-model-5e9fd6-kserve-6d45bdc95-nsfkw"
Jul 20 13:42:48.949868 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:48.949474    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-5e9fd6/auth-test-model-5e9fd6-kserve-6d45bdc95-nsfkw"
Jul 20 13:42:48.962236 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:48.962208    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-5e9fd6/auth-test-model-5e9fd6-kserve-6d45bdc95-nsfkw"
Jul 20 13:42:49.196224 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:42:49.196187    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-5e9fd6/auth-test-model-5e9fd6-kserve-6d45bdc95-nsfkw"
Jul 20 13:43:02.814817 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:43:02.814780    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:43:06.632867 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:43:06.632832    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:43:29.536475 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:43:29.536397    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:43:47.633010 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:43:47.632973    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:44:02.033779 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:44:02.033739    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:44:17.955697 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:44:17.955657    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:44:35.828244 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:44:35.828207    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:44:38.105960 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:44:38.105924    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:44:52.963204 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:44:52.963165    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:44:59.201034 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:44:59.200947    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:45:00.176558 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:00.176519    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-5e9fd6-29742585-cvrtn"]
Jul 20 13:45:00.179903 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:00.179886    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-5e9fd6-29742585-cvrtn"
Jul 20 13:45:00.184571 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:00.184551    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zcsfd\""
Jul 20 13:45:00.189201 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:00.189180    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-5e9fd6-29742585-cvrtn"
Jul 20 13:45:00.198837 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:00.198102    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-a69896-29742585-wdc2v"]
Jul 20 13:45:00.206372 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:00.206333    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742585-ts7gn"]
Jul 20 13:45:00.206735 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:00.206455    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-a69896-29742585-wdc2v"
Jul 20 13:45:00.209624 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:00.209607    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742585-ts7gn"
Jul 20 13:45:00.230563 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:00.230536    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-a69896-29742585-wdc2v"
Jul 20 13:45:00.231669 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:00.231643    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-5e9fd6-29742585-cvrtn"]
Jul 20 13:45:00.240041 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:00.240021    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742585-ts7gn"
Jul 20 13:45:00.242821 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:00.242751    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742585-ts7gn"]
Jul 20 13:45:00.248961 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:00.248936    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-a69896-29742585-wdc2v"]
Jul 20 13:45:00.368630 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:00.368601    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-5e9fd6-29742585-cvrtn"]
Jul 20 13:45:00.370032 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:45:00.370001    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2b619a47_f268_4cb4_aec4_161fc897e238.slice/crio-52f13b90b181468abb0049a381cc3a95a7f9015af66c1397d910cd87bf263279 WatchSource:0}: Error finding container 52f13b90b181468abb0049a381cc3a95a7f9015af66c1397d910cd87bf263279: Status 404 returned error can't find the container with id 52f13b90b181468abb0049a381cc3a95a7f9015af66c1397d910cd87bf263279
Jul 20 13:45:00.445721 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:00.445687    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29742585-ts7gn"]
Jul 20 13:45:00.445850 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:45:00.445781    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbb5b220_5752_4836_9b46_bc790f4eb599.slice/crio-778693ba8ed9c0357b359c812e7aa9aeb35217ab677aa118671380e90fcd7a3e WatchSource:0}: Error finding container 778693ba8ed9c0357b359c812e7aa9aeb35217ab677aa118671380e90fcd7a3e: Status 404 returned error can't find the container with id 778693ba8ed9c0357b359c812e7aa9aeb35217ab677aa118671380e90fcd7a3e
Jul 20 13:45:00.625725 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:00.625695    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-a69896-29742585-wdc2v"]
Jul 20 13:45:00.625849 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:45:00.625703    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddce2332b_a43a_442a_b573_105fed6b49b7.slice/crio-63df99076622823ea7c38044ea4b0b4c4048da6a4324b69ea41cddad3a69d92c WatchSource:0}: Error finding container 63df99076622823ea7c38044ea4b0b4c4048da6a4324b69ea41cddad3a69d92c: Status 404 returned error can't find the container with id 63df99076622823ea7c38044ea4b0b4c4048da6a4324b69ea41cddad3a69d92c
Jul 20 13:45:00.887347 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:00.887306    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-a69896-29742585-wdc2v" event={"ID":"dce2332b-a43a-442a-b573-105fed6b49b7","Type":"ContainerStarted","Data":"d2ec8805790b6323e9b888a0e9af7eb9849244e210489850b815ffd0123318ec"}
Jul 20 13:45:00.887566 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:00.887384    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-a69896-29742585-wdc2v" event={"ID":"dce2332b-a43a-442a-b573-105fed6b49b7","Type":"ContainerStarted","Data":"63df99076622823ea7c38044ea4b0b4c4048da6a4324b69ea41cddad3a69d92c"}
Jul 20 13:45:00.888936 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:00.888909    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742585-ts7gn" event={"ID":"dbb5b220-5752-4836-9b46-bc790f4eb599","Type":"ContainerStarted","Data":"78e39bb93ec4d22a9cc9bdb462e1fe23ec364388c42b453de9cd013ba341548b"}
Jul 20 13:45:00.889078 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:00.888965    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742585-ts7gn" event={"ID":"dbb5b220-5752-4836-9b46-bc790f4eb599","Type":"ContainerStarted","Data":"778693ba8ed9c0357b359c812e7aa9aeb35217ab677aa118671380e90fcd7a3e"}
Jul 20 13:45:00.890612 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:00.890590    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-5e9fd6-29742585-cvrtn" event={"ID":"2b619a47-f268-4cb4-aec4-161fc897e238","Type":"ContainerStarted","Data":"fdab85b01b5f48cffc479cd7fbc949248ee0ba2c5700bce8784acf6cdf714748"}
Jul 20 13:45:00.890704 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:00.890629    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-5e9fd6-29742585-cvrtn" event={"ID":"2b619a47-f268-4cb4-aec4-161fc897e238","Type":"ContainerStarted","Data":"52f13b90b181468abb0049a381cc3a95a7f9015af66c1397d910cd87bf263279"}
Jul 20 13:45:00.930375 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:00.930319    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-5e9fd6-29742585-cvrtn" podStartSLOduration=0.930303428 podStartE2EDuration="930.303428ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:45:00.930057396 +0000 UTC m=+2607.399589514" watchObservedRunningTime="2026-07-20 13:45:00.930303428 +0000 UTC m=+2607.399835568"
Jul 20 13:45:00.931859 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:00.931827    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-a69896-29742585-wdc2v" podStartSLOduration=0.931816145 podStartE2EDuration="931.816145ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:45:00.908852522 +0000 UTC m=+2607.378384641" watchObservedRunningTime="2026-07-20 13:45:00.931816145 +0000 UTC m=+2607.401348263"
Jul 20 13:45:01.897480 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:01.897444    2565 generic.go:356] "Generic (PLEG): container finished" podID="dbb5b220-5752-4836-9b46-bc790f4eb599" containerID="78e39bb93ec4d22a9cc9bdb462e1fe23ec364388c42b453de9cd013ba341548b" exitCode=0
Jul 20 13:45:01.897907 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:01.897520    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742585-ts7gn" event={"ID":"dbb5b220-5752-4836-9b46-bc790f4eb599","Type":"ContainerDied","Data":"78e39bb93ec4d22a9cc9bdb462e1fe23ec364388c42b453de9cd013ba341548b"}
Jul 20 13:45:01.899002 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:01.898976    2565 generic.go:356] "Generic (PLEG): container finished" podID="2b619a47-f268-4cb4-aec4-161fc897e238" containerID="fdab85b01b5f48cffc479cd7fbc949248ee0ba2c5700bce8784acf6cdf714748" exitCode=0
Jul 20 13:45:01.899104 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:01.899063    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-5e9fd6-29742585-cvrtn" event={"ID":"2b619a47-f268-4cb4-aec4-161fc897e238","Type":"ContainerDied","Data":"fdab85b01b5f48cffc479cd7fbc949248ee0ba2c5700bce8784acf6cdf714748"}
Jul 20 13:45:01.900512 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:01.900488    2565 generic.go:356] "Generic (PLEG): container finished" podID="dce2332b-a43a-442a-b573-105fed6b49b7" containerID="d2ec8805790b6323e9b888a0e9af7eb9849244e210489850b815ffd0123318ec" exitCode=0
Jul 20 13:45:01.900610 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:01.900564    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-a69896-29742585-wdc2v" event={"ID":"dce2332b-a43a-442a-b573-105fed6b49b7","Type":"ContainerDied","Data":"d2ec8805790b6323e9b888a0e9af7eb9849244e210489850b815ffd0123318ec"}
Jul 20 13:45:03.043989 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:03.043958    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-a69896-29742585-wdc2v"
Jul 20 13:45:03.096176 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:03.096152    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742585-ts7gn"
Jul 20 13:45:03.098822 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:03.098805    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-5e9fd6-29742585-cvrtn"
Jul 20 13:45:03.915837 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:03.915804    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742585-ts7gn"
Jul 20 13:45:03.916038 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:03.915808    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29742585-ts7gn" event={"ID":"dbb5b220-5752-4836-9b46-bc790f4eb599","Type":"ContainerDied","Data":"778693ba8ed9c0357b359c812e7aa9aeb35217ab677aa118671380e90fcd7a3e"}
Jul 20 13:45:03.916038 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:03.915928    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="778693ba8ed9c0357b359c812e7aa9aeb35217ab677aa118671380e90fcd7a3e"
Jul 20 13:45:03.917314 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:03.917296    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-5e9fd6-29742585-cvrtn"
Jul 20 13:45:03.917451 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:03.917325    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-5e9fd6-29742585-cvrtn" event={"ID":"2b619a47-f268-4cb4-aec4-161fc897e238","Type":"ContainerDied","Data":"52f13b90b181468abb0049a381cc3a95a7f9015af66c1397d910cd87bf263279"}
Jul 20 13:45:03.917451 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:03.917396    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="52f13b90b181468abb0049a381cc3a95a7f9015af66c1397d910cd87bf263279"
Jul 20 13:45:03.918653 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:03.918639    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-a69896-29742585-wdc2v"
Jul 20 13:45:03.918739 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:03.918638    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-a69896-29742585-wdc2v" event={"ID":"dce2332b-a43a-442a-b573-105fed6b49b7","Type":"ContainerDied","Data":"63df99076622823ea7c38044ea4b0b4c4048da6a4324b69ea41cddad3a69d92c"}
Jul 20 13:45:03.918786 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:03.918761    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="63df99076622823ea7c38044ea4b0b4c4048da6a4324b69ea41cddad3a69d92c"
Jul 20 13:45:08.867977 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:08.867946    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-5e9fd6/auth-test-model-5e9fd6-kserve-6d45bdc95-nsfkw"]
Jul 20 13:45:08.880726 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:08.880686    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:45:10.001610 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:10.001574    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:45:11.946916 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:11.946880    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:45:19.256129 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:19.256092    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-5e9fd6/sub-test-model-5e9fd6-kserve-cd5dc9dc7-c7n2w"]
Jul 20 13:45:19.256545 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:19.256445    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dce2332b-a43a-442a-b573-105fed6b49b7" containerName="cleanup"
Jul 20 13:45:19.256545 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:19.256457    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="dce2332b-a43a-442a-b573-105fed6b49b7" containerName="cleanup"
Jul 20 13:45:19.256545 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:19.256471    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbb5b220-5752-4836-9b46-bc790f4eb599" containerName="cleanup"
Jul 20 13:45:19.256545 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:19.256476    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbb5b220-5752-4836-9b46-bc790f4eb599" containerName="cleanup"
Jul 20 13:45:19.256545 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:19.256491    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2b619a47-f268-4cb4-aec4-161fc897e238" containerName="cleanup"
Jul 20 13:45:19.256545 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:19.256497    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="2b619a47-f268-4cb4-aec4-161fc897e238" containerName="cleanup"
Jul 20 13:45:19.256545 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:19.256550    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbb5b220-5752-4836-9b46-bc790f4eb599" containerName="cleanup"
Jul 20 13:45:19.256771 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:19.256560    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="dce2332b-a43a-442a-b573-105fed6b49b7" containerName="cleanup"
Jul 20 13:45:19.256771 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:19.256566    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="2b619a47-f268-4cb4-aec4-161fc897e238" containerName="cleanup"
Jul 20 13:45:19.259647 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:19.259618    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-5e9fd6/sub-test-model-5e9fd6-kserve-cd5dc9dc7-c7n2w"
Jul 20 13:45:19.274664 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:19.274635    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-5e9fd6\"/\"sub-test-model-5e9fd6-kserve-self-signed-certs\""
Jul 20 13:45:19.277801 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:19.277778    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-5e9fd6/sub-test-model-5e9fd6-kserve-cd5dc9dc7-c7n2w"]
Jul 20 13:45:19.340311 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:19.340271    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:45:19.382617 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:19.382573    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3167da02-df0e-4c9a-98cb-fc333e314857-dshm\") pod \"sub-test-model-5e9fd6-kserve-cd5dc9dc7-c7n2w\" (UID: \"3167da02-df0e-4c9a-98cb-fc333e314857\") " pod="ai-tenant-e2e-shared-a-5e9fd6/sub-test-model-5e9fd6-kserve-cd5dc9dc7-c7n2w"
Jul 20 13:45:19.382794 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:19.382624    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzm8t\" (UniqueName: \"kubernetes.io/projected/3167da02-df0e-4c9a-98cb-fc333e314857-kube-api-access-fzm8t\") pod \"sub-test-model-5e9fd6-kserve-cd5dc9dc7-c7n2w\" (UID: \"3167da02-df0e-4c9a-98cb-fc333e314857\") " pod="ai-tenant-e2e-shared-a-5e9fd6/sub-test-model-5e9fd6-kserve-cd5dc9dc7-c7n2w"
Jul 20 13:45:19.382794 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:19.382645    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3167da02-df0e-4c9a-98cb-fc333e314857-model-cache\") pod \"sub-test-model-5e9fd6-kserve-cd5dc9dc7-c7n2w\" (UID: \"3167da02-df0e-4c9a-98cb-fc333e314857\") " pod="ai-tenant-e2e-shared-a-5e9fd6/sub-test-model-5e9fd6-kserve-cd5dc9dc7-c7n2w"
Jul 20 13:45:19.382794 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:19.382663    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3167da02-df0e-4c9a-98cb-fc333e314857-tls-certs\") pod \"sub-test-model-5e9fd6-kserve-cd5dc9dc7-c7n2w\" (UID: \"3167da02-df0e-4c9a-98cb-fc333e314857\") " pod="ai-tenant-e2e-shared-a-5e9fd6/sub-test-model-5e9fd6-kserve-cd5dc9dc7-c7n2w"
Jul 20 13:45:19.382794 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:19.382745    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3167da02-df0e-4c9a-98cb-fc333e314857-tmp-dir\") pod \"sub-test-model-5e9fd6-kserve-cd5dc9dc7-c7n2w\" (UID: \"3167da02-df0e-4c9a-98cb-fc333e314857\") " pod="ai-tenant-e2e-shared-a-5e9fd6/sub-test-model-5e9fd6-kserve-cd5dc9dc7-c7n2w"
Jul 20 13:45:19.382794 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:19.382784    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3167da02-df0e-4c9a-98cb-fc333e314857-home\") pod \"sub-test-model-5e9fd6-kserve-cd5dc9dc7-c7n2w\" (UID: \"3167da02-df0e-4c9a-98cb-fc333e314857\") " pod="ai-tenant-e2e-shared-a-5e9fd6/sub-test-model-5e9fd6-kserve-cd5dc9dc7-c7n2w"
Jul 20 13:45:19.483613 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:19.483573    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3167da02-df0e-4c9a-98cb-fc333e314857-dshm\") pod \"sub-test-model-5e9fd6-kserve-cd5dc9dc7-c7n2w\" (UID: \"3167da02-df0e-4c9a-98cb-fc333e314857\") " pod="ai-tenant-e2e-shared-a-5e9fd6/sub-test-model-5e9fd6-kserve-cd5dc9dc7-c7n2w"
Jul 20 13:45:19.483811 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:19.483618    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzm8t\" (UniqueName: \"kubernetes.io/projected/3167da02-df0e-4c9a-98cb-fc333e314857-kube-api-access-fzm8t\") pod \"sub-test-model-5e9fd6-kserve-cd5dc9dc7-c7n2w\" (UID: \"3167da02-df0e-4c9a-98cb-fc333e314857\") " pod="ai-tenant-e2e-shared-a-5e9fd6/sub-test-model-5e9fd6-kserve-cd5dc9dc7-c7n2w"
Jul 20 13:45:19.483811 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:19.483648    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3167da02-df0e-4c9a-98cb-fc333e314857-model-cache\") pod \"sub-test-model-5e9fd6-kserve-cd5dc9dc7-c7n2w\" (UID: \"3167da02-df0e-4c9a-98cb-fc333e314857\") " pod="ai-tenant-e2e-shared-a-5e9fd6/sub-test-model-5e9fd6-kserve-cd5dc9dc7-c7n2w"
Jul 20 13:45:19.483811 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:19.483671    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3167da02-df0e-4c9a-98cb-fc333e314857-tls-certs\") pod \"sub-test-model-5e9fd6-kserve-cd5dc9dc7-c7n2w\" (UID: \"3167da02-df0e-4c9a-98cb-fc333e314857\") " pod="ai-tenant-e2e-shared-a-5e9fd6/sub-test-model-5e9fd6-kserve-cd5dc9dc7-c7n2w"
Jul 20 13:45:19.483811 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:19.483708    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3167da02-df0e-4c9a-98cb-fc333e314857-tmp-dir\") pod \"sub-test-model-5e9fd6-kserve-cd5dc9dc7-c7n2w\" (UID: \"3167da02-df0e-4c9a-98cb-fc333e314857\") " pod="ai-tenant-e2e-shared-a-5e9fd6/sub-test-model-5e9fd6-kserve-cd5dc9dc7-c7n2w"
Jul 20 13:45:19.483811 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:19.483742    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3167da02-df0e-4c9a-98cb-fc333e314857-home\") pod \"sub-test-model-5e9fd6-kserve-cd5dc9dc7-c7n2w\" (UID: \"3167da02-df0e-4c9a-98cb-fc333e314857\") " pod="ai-tenant-e2e-shared-a-5e9fd6/sub-test-model-5e9fd6-kserve-cd5dc9dc7-c7n2w"
Jul 20 13:45:19.484126 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:19.484099    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3167da02-df0e-4c9a-98cb-fc333e314857-model-cache\") pod \"sub-test-model-5e9fd6-kserve-cd5dc9dc7-c7n2w\" (UID: \"3167da02-df0e-4c9a-98cb-fc333e314857\") " pod="ai-tenant-e2e-shared-a-5e9fd6/sub-test-model-5e9fd6-kserve-cd5dc9dc7-c7n2w"
Jul 20 13:45:19.484205 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:19.484188    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3167da02-df0e-4c9a-98cb-fc333e314857-home\") pod \"sub-test-model-5e9fd6-kserve-cd5dc9dc7-c7n2w\" (UID: \"3167da02-df0e-4c9a-98cb-fc333e314857\") " pod="ai-tenant-e2e-shared-a-5e9fd6/sub-test-model-5e9fd6-kserve-cd5dc9dc7-c7n2w"
Jul 20 13:45:19.484252 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:19.484224    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3167da02-df0e-4c9a-98cb-fc333e314857-tmp-dir\") pod \"sub-test-model-5e9fd6-kserve-cd5dc9dc7-c7n2w\" (UID: \"3167da02-df0e-4c9a-98cb-fc333e314857\") " pod="ai-tenant-e2e-shared-a-5e9fd6/sub-test-model-5e9fd6-kserve-cd5dc9dc7-c7n2w"
Jul 20 13:45:19.485916 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:19.485893    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3167da02-df0e-4c9a-98cb-fc333e314857-dshm\") pod \"sub-test-model-5e9fd6-kserve-cd5dc9dc7-c7n2w\" (UID: \"3167da02-df0e-4c9a-98cb-fc333e314857\") " pod="ai-tenant-e2e-shared-a-5e9fd6/sub-test-model-5e9fd6-kserve-cd5dc9dc7-c7n2w"
Jul 20 13:45:19.486227 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:19.486207    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3167da02-df0e-4c9a-98cb-fc333e314857-tls-certs\") pod \"sub-test-model-5e9fd6-kserve-cd5dc9dc7-c7n2w\" (UID: \"3167da02-df0e-4c9a-98cb-fc333e314857\") " pod="ai-tenant-e2e-shared-a-5e9fd6/sub-test-model-5e9fd6-kserve-cd5dc9dc7-c7n2w"
Jul 20 13:45:19.493868 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:19.493845    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzm8t\" (UniqueName: \"kubernetes.io/projected/3167da02-df0e-4c9a-98cb-fc333e314857-kube-api-access-fzm8t\") pod \"sub-test-model-5e9fd6-kserve-cd5dc9dc7-c7n2w\" (UID: \"3167da02-df0e-4c9a-98cb-fc333e314857\") " pod="ai-tenant-e2e-shared-a-5e9fd6/sub-test-model-5e9fd6-kserve-cd5dc9dc7-c7n2w"
Jul 20 13:45:19.568696 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:19.568606    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-5e9fd6/sub-test-model-5e9fd6-kserve-cd5dc9dc7-c7n2w"
Jul 20 13:45:19.710318 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:45:19.710282    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod3167da02_df0e_4c9a_98cb_fc333e314857.slice/crio-ae74d7ca01937123920b3975c36f3adca30e5c37bdbadbb909a9bc4bfe3c1043 WatchSource:0}: Error finding container ae74d7ca01937123920b3975c36f3adca30e5c37bdbadbb909a9bc4bfe3c1043: Status 404 returned error can't find the container with id ae74d7ca01937123920b3975c36f3adca30e5c37bdbadbb909a9bc4bfe3c1043
Jul 20 13:45:19.710318 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:19.710285    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-5e9fd6/sub-test-model-5e9fd6-kserve-cd5dc9dc7-c7n2w"]
Jul 20 13:45:20.011411 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:20.011372    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-5e9fd6/sub-test-model-5e9fd6-kserve-cd5dc9dc7-c7n2w" event={"ID":"3167da02-df0e-4c9a-98cb-fc333e314857","Type":"ContainerStarted","Data":"d842f22ec4ecbda412391c1dfe921aae5bc86e83f5b473f061f59aa9d13007f4"}
Jul 20 13:45:20.011623 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:20.011422    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-5e9fd6/sub-test-model-5e9fd6-kserve-cd5dc9dc7-c7n2w" event={"ID":"3167da02-df0e-4c9a-98cb-fc333e314857","Type":"ContainerStarted","Data":"ae74d7ca01937123920b3975c36f3adca30e5c37bdbadbb909a9bc4bfe3c1043"}
Jul 20 13:45:20.039862 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:20.039809    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-5e9fd6/sub-test-model-5e9fd6-kserve-cd5dc9dc7-c7n2w" podStartSLOduration=1.039793255 podStartE2EDuration="1.039793255s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:45:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:45:20.039050857 +0000 UTC m=+2626.508582976" watchObservedRunningTime="2026-07-20 13:45:20.039793255 +0000 UTC m=+2626.509325374"
Jul 20 13:45:23.890292 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:23.890253    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-5e9fd6/auth-test-model-5e9fd6-kserve-6d45bdc95-nsfkw" podUID="824187ab-d4fa-4d85-ae89-529bdf2a6d2b" containerName="main" containerID="cri-o://244d4fe634ec451062bb2a64b052b3358a6da91f92f67e2b8bd8555b2f34491f" gracePeriod=45
Jul 20 13:45:24.035176 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:24.035140    2565 generic.go:356] "Generic (PLEG): container finished" podID="824187ab-d4fa-4d85-ae89-529bdf2a6d2b" containerID="244d4fe634ec451062bb2a64b052b3358a6da91f92f67e2b8bd8555b2f34491f" exitCode=0
Jul 20 13:45:24.035337 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:24.035217    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-5e9fd6/auth-test-model-5e9fd6-kserve-6d45bdc95-nsfkw" event={"ID":"824187ab-d4fa-4d85-ae89-529bdf2a6d2b","Type":"ContainerDied","Data":"244d4fe634ec451062bb2a64b052b3358a6da91f92f67e2b8bd8555b2f34491f"}
Jul 20 13:45:24.150828 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:24.150771    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-5e9fd6/auth-test-model-5e9fd6-kserve-6d45bdc95-nsfkw"
Jul 20 13:45:24.222529 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:24.222499    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/824187ab-d4fa-4d85-ae89-529bdf2a6d2b-tmp-dir\") pod \"824187ab-d4fa-4d85-ae89-529bdf2a6d2b\" (UID: \"824187ab-d4fa-4d85-ae89-529bdf2a6d2b\") "
Jul 20 13:45:24.222730 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:24.222554    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/824187ab-d4fa-4d85-ae89-529bdf2a6d2b-home\") pod \"824187ab-d4fa-4d85-ae89-529bdf2a6d2b\" (UID: \"824187ab-d4fa-4d85-ae89-529bdf2a6d2b\") "
Jul 20 13:45:24.222730 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:24.222589    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/824187ab-d4fa-4d85-ae89-529bdf2a6d2b-model-cache\") pod \"824187ab-d4fa-4d85-ae89-529bdf2a6d2b\" (UID: \"824187ab-d4fa-4d85-ae89-529bdf2a6d2b\") "
Jul 20 13:45:24.222730 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:24.222626    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/824187ab-d4fa-4d85-ae89-529bdf2a6d2b-dshm\") pod \"824187ab-d4fa-4d85-ae89-529bdf2a6d2b\" (UID: \"824187ab-d4fa-4d85-ae89-529bdf2a6d2b\") "
Jul 20 13:45:24.222730 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:24.222651    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/824187ab-d4fa-4d85-ae89-529bdf2a6d2b-tls-certs\") pod \"824187ab-d4fa-4d85-ae89-529bdf2a6d2b\" (UID: \"824187ab-d4fa-4d85-ae89-529bdf2a6d2b\") "
Jul 20 13:45:24.222730 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:24.222675    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kn84l\" (UniqueName: \"kubernetes.io/projected/824187ab-d4fa-4d85-ae89-529bdf2a6d2b-kube-api-access-kn84l\") pod \"824187ab-d4fa-4d85-ae89-529bdf2a6d2b\" (UID: \"824187ab-d4fa-4d85-ae89-529bdf2a6d2b\") "
Jul 20 13:45:24.222963 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:24.222851    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/824187ab-d4fa-4d85-ae89-529bdf2a6d2b-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "824187ab-d4fa-4d85-ae89-529bdf2a6d2b" (UID: "824187ab-d4fa-4d85-ae89-529bdf2a6d2b"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:45:24.222963 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:24.222893    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/824187ab-d4fa-4d85-ae89-529bdf2a6d2b-home" (OuterVolumeSpecName: "home") pod "824187ab-d4fa-4d85-ae89-529bdf2a6d2b" (UID: "824187ab-d4fa-4d85-ae89-529bdf2a6d2b"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:45:24.222963 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:24.222905    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/824187ab-d4fa-4d85-ae89-529bdf2a6d2b-model-cache" (OuterVolumeSpecName: "model-cache") pod "824187ab-d4fa-4d85-ae89-529bdf2a6d2b" (UID: "824187ab-d4fa-4d85-ae89-529bdf2a6d2b"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:45:24.224956 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:24.224927    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/824187ab-d4fa-4d85-ae89-529bdf2a6d2b-kube-api-access-kn84l" (OuterVolumeSpecName: "kube-api-access-kn84l") pod "824187ab-d4fa-4d85-ae89-529bdf2a6d2b" (UID: "824187ab-d4fa-4d85-ae89-529bdf2a6d2b"). InnerVolumeSpecName "kube-api-access-kn84l". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:45:24.224956 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:24.224933    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/824187ab-d4fa-4d85-ae89-529bdf2a6d2b-dshm" (OuterVolumeSpecName: "dshm") pod "824187ab-d4fa-4d85-ae89-529bdf2a6d2b" (UID: "824187ab-d4fa-4d85-ae89-529bdf2a6d2b"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:45:24.225131 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:24.225020    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/824187ab-d4fa-4d85-ae89-529bdf2a6d2b-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "824187ab-d4fa-4d85-ae89-529bdf2a6d2b" (UID: "824187ab-d4fa-4d85-ae89-529bdf2a6d2b"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 13:45:24.324067 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:24.324034    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/824187ab-d4fa-4d85-ae89-529bdf2a6d2b-dshm\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:45:24.324067 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:24.324062    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/824187ab-d4fa-4d85-ae89-529bdf2a6d2b-tls-certs\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:45:24.324261 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:24.324084    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kn84l\" (UniqueName: \"kubernetes.io/projected/824187ab-d4fa-4d85-ae89-529bdf2a6d2b-kube-api-access-kn84l\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:45:24.324261 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:24.324096    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/824187ab-d4fa-4d85-ae89-529bdf2a6d2b-tmp-dir\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:45:24.324261 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:24.324106    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/824187ab-d4fa-4d85-ae89-529bdf2a6d2b-home\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:45:24.324261 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:24.324113    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/824187ab-d4fa-4d85-ae89-529bdf2a6d2b-model-cache\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:45:25.042475 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:25.042445    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-5e9fd6/auth-test-model-5e9fd6-kserve-6d45bdc95-nsfkw"
Jul 20 13:45:25.042872 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:25.042484    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-5e9fd6/auth-test-model-5e9fd6-kserve-6d45bdc95-nsfkw" event={"ID":"824187ab-d4fa-4d85-ae89-529bdf2a6d2b","Type":"ContainerDied","Data":"239a195c54cdaafd64f99b80def64a3bcc0082ca1fbe581db0867999668fe4bb"}
Jul 20 13:45:25.042872 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:25.042539    2565 scope.go:117] "RemoveContainer" containerID="244d4fe634ec451062bb2a64b052b3358a6da91f92f67e2b8bd8555b2f34491f"
Jul 20 13:45:25.068024 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:25.067998    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-5e9fd6/auth-test-model-5e9fd6-kserve-6d45bdc95-nsfkw"]
Jul 20 13:45:25.073871 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:25.073848    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-5e9fd6/auth-test-model-5e9fd6-kserve-6d45bdc95-nsfkw"]
Jul 20 13:45:26.146663 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:26.146631    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="824187ab-d4fa-4d85-ae89-529bdf2a6d2b" path="/var/lib/kubelet/pods/824187ab-d4fa-4d85-ae89-529bdf2a6d2b/volumes"
Jul 20 13:45:29.569761 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:29.569706    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-5e9fd6/sub-test-model-5e9fd6-kserve-cd5dc9dc7-c7n2w"
Jul 20 13:45:29.569761 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:29.569778    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-5e9fd6/sub-test-model-5e9fd6-kserve-cd5dc9dc7-c7n2w"
Jul 20 13:45:29.582292 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:29.582266    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-5e9fd6/sub-test-model-5e9fd6-kserve-cd5dc9dc7-c7n2w"
Jul 20 13:45:30.088348 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:30.088316    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-5e9fd6/sub-test-model-5e9fd6-kserve-cd5dc9dc7-c7n2w"
Jul 20 13:45:32.965882 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:32.965845    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:45:33.634295 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:33.634258    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:45:47.327592 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:47.327554    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:45:59.638535 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:45:59.638496    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:46:07.008514 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:07.008474    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:46:07.107466 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:07.107428    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:46:09.966292 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:09.966254    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:46:10.070217 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:10.070179    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:46:19.946080 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:19.946042    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:46:26.727917 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:26.727830    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-5e9fd6/sub-test-model-5e9fd6-kserve-cd5dc9dc7-c7n2w"]
Jul 20 13:46:26.744236 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:26.744188    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:46:27.661789 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:27.661742    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:46:36.466158 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:36.466122    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:46:41.140684 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:41.140632    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:46:41.747793 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:41.747728    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-5e9fd6/sub-test-model-5e9fd6-kserve-cd5dc9dc7-c7n2w" podUID="3167da02-df0e-4c9a-98cb-fc333e314857" containerName="main" containerID="cri-o://d842f22ec4ecbda412391c1dfe921aae5bc86e83f5b473f061f59aa9d13007f4" gracePeriod=45
Jul 20 13:46:42.005013 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:42.004938    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-5e9fd6/sub-test-model-5e9fd6-kserve-cd5dc9dc7-c7n2w"
Jul 20 13:46:42.113256 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:42.113220    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3167da02-df0e-4c9a-98cb-fc333e314857-model-cache\") pod \"3167da02-df0e-4c9a-98cb-fc333e314857\" (UID: \"3167da02-df0e-4c9a-98cb-fc333e314857\") "
Jul 20 13:46:42.113446 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:42.113278    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3167da02-df0e-4c9a-98cb-fc333e314857-tmp-dir\") pod \"3167da02-df0e-4c9a-98cb-fc333e314857\" (UID: \"3167da02-df0e-4c9a-98cb-fc333e314857\") "
Jul 20 13:46:42.113446 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:42.113303    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fzm8t\" (UniqueName: \"kubernetes.io/projected/3167da02-df0e-4c9a-98cb-fc333e314857-kube-api-access-fzm8t\") pod \"3167da02-df0e-4c9a-98cb-fc333e314857\" (UID: \"3167da02-df0e-4c9a-98cb-fc333e314857\") "
Jul 20 13:46:42.113446 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:42.113332    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3167da02-df0e-4c9a-98cb-fc333e314857-dshm\") pod \"3167da02-df0e-4c9a-98cb-fc333e314857\" (UID: \"3167da02-df0e-4c9a-98cb-fc333e314857\") "
Jul 20 13:46:42.113446 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:42.113382    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3167da02-df0e-4c9a-98cb-fc333e314857-tls-certs\") pod \"3167da02-df0e-4c9a-98cb-fc333e314857\" (UID: \"3167da02-df0e-4c9a-98cb-fc333e314857\") "
Jul 20 13:46:42.113678 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:42.113495    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3167da02-df0e-4c9a-98cb-fc333e314857-model-cache" (OuterVolumeSpecName: "model-cache") pod "3167da02-df0e-4c9a-98cb-fc333e314857" (UID: "3167da02-df0e-4c9a-98cb-fc333e314857"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:46:42.113678 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:42.113547    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3167da02-df0e-4c9a-98cb-fc333e314857-home\") pod \"3167da02-df0e-4c9a-98cb-fc333e314857\" (UID: \"3167da02-df0e-4c9a-98cb-fc333e314857\") "
Jul 20 13:46:42.113678 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:42.113571    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3167da02-df0e-4c9a-98cb-fc333e314857-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "3167da02-df0e-4c9a-98cb-fc333e314857" (UID: "3167da02-df0e-4c9a-98cb-fc333e314857"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:46:42.113834 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:42.113786    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3167da02-df0e-4c9a-98cb-fc333e314857-home" (OuterVolumeSpecName: "home") pod "3167da02-df0e-4c9a-98cb-fc333e314857" (UID: "3167da02-df0e-4c9a-98cb-fc333e314857"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:46:42.113946 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:42.113926    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/3167da02-df0e-4c9a-98cb-fc333e314857-home\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:46:42.114013 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:42.113952    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/3167da02-df0e-4c9a-98cb-fc333e314857-model-cache\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:46:42.114013 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:42.113969    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/3167da02-df0e-4c9a-98cb-fc333e314857-tmp-dir\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:46:42.115533 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:42.115510    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3167da02-df0e-4c9a-98cb-fc333e314857-dshm" (OuterVolumeSpecName: "dshm") pod "3167da02-df0e-4c9a-98cb-fc333e314857" (UID: "3167da02-df0e-4c9a-98cb-fc333e314857"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:46:42.115658 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:42.115559    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3167da02-df0e-4c9a-98cb-fc333e314857-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "3167da02-df0e-4c9a-98cb-fc333e314857" (UID: "3167da02-df0e-4c9a-98cb-fc333e314857"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 13:46:42.115658 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:42.115584    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3167da02-df0e-4c9a-98cb-fc333e314857-kube-api-access-fzm8t" (OuterVolumeSpecName: "kube-api-access-fzm8t") pod "3167da02-df0e-4c9a-98cb-fc333e314857" (UID: "3167da02-df0e-4c9a-98cb-fc333e314857"). InnerVolumeSpecName "kube-api-access-fzm8t". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:46:42.215412 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:42.215373    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fzm8t\" (UniqueName: \"kubernetes.io/projected/3167da02-df0e-4c9a-98cb-fc333e314857-kube-api-access-fzm8t\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:46:42.215412 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:42.215409    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/3167da02-df0e-4c9a-98cb-fc333e314857-dshm\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:46:42.215412 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:42.215420    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3167da02-df0e-4c9a-98cb-fc333e314857-tls-certs\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:46:42.478176 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:42.478142    2565 generic.go:356] "Generic (PLEG): container finished" podID="3167da02-df0e-4c9a-98cb-fc333e314857" containerID="d842f22ec4ecbda412391c1dfe921aae5bc86e83f5b473f061f59aa9d13007f4" exitCode=0
Jul 20 13:46:42.478176 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:42.478179    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-5e9fd6/sub-test-model-5e9fd6-kserve-cd5dc9dc7-c7n2w" event={"ID":"3167da02-df0e-4c9a-98cb-fc333e314857","Type":"ContainerDied","Data":"d842f22ec4ecbda412391c1dfe921aae5bc86e83f5b473f061f59aa9d13007f4"}
Jul 20 13:46:42.478485 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:42.478199    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-5e9fd6/sub-test-model-5e9fd6-kserve-cd5dc9dc7-c7n2w"
Jul 20 13:46:42.478485 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:42.478220    2565 scope.go:117] "RemoveContainer" containerID="d842f22ec4ecbda412391c1dfe921aae5bc86e83f5b473f061f59aa9d13007f4"
Jul 20 13:46:42.478485 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:42.478207    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-5e9fd6/sub-test-model-5e9fd6-kserve-cd5dc9dc7-c7n2w" event={"ID":"3167da02-df0e-4c9a-98cb-fc333e314857","Type":"ContainerDied","Data":"ae74d7ca01937123920b3975c36f3adca30e5c37bdbadbb909a9bc4bfe3c1043"}
Jul 20 13:46:42.487725 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:42.487705    2565 scope.go:117] "RemoveContainer" containerID="d842f22ec4ecbda412391c1dfe921aae5bc86e83f5b473f061f59aa9d13007f4"
Jul 20 13:46:42.488005 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:46:42.487983    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d842f22ec4ecbda412391c1dfe921aae5bc86e83f5b473f061f59aa9d13007f4\": container with ID starting with d842f22ec4ecbda412391c1dfe921aae5bc86e83f5b473f061f59aa9d13007f4 not found: ID does not exist" containerID="d842f22ec4ecbda412391c1dfe921aae5bc86e83f5b473f061f59aa9d13007f4"
Jul 20 13:46:42.488055 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:42.488014    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d842f22ec4ecbda412391c1dfe921aae5bc86e83f5b473f061f59aa9d13007f4"} err="failed to get container status \"d842f22ec4ecbda412391c1dfe921aae5bc86e83f5b473f061f59aa9d13007f4\": rpc error: code = NotFound desc = could not find container \"d842f22ec4ecbda412391c1dfe921aae5bc86e83f5b473f061f59aa9d13007f4\": container with ID starting with d842f22ec4ecbda412391c1dfe921aae5bc86e83f5b473f061f59aa9d13007f4 not found: ID does not exist"
Jul 20 13:46:42.496384 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:42.496341    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-5e9fd6/sub-test-model-5e9fd6-kserve-cd5dc9dc7-c7n2w"]
Jul 20 13:46:42.500553 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:42.500526    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-5e9fd6/sub-test-model-5e9fd6-kserve-cd5dc9dc7-c7n2w"]
Jul 20 13:46:44.148150 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:44.148113    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3167da02-df0e-4c9a-98cb-fc333e314857" path="/var/lib/kubelet/pods/3167da02-df0e-4c9a-98cb-fc333e314857/volumes"
Jul 20 13:46:51.535889 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:51.535849    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-a69896/rate-test-model-a69896-kserve-7cb879f98c-8vmkn"]
Jul 20 13:46:51.536373 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:51.536304    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="824187ab-d4fa-4d85-ae89-529bdf2a6d2b" containerName="main"
Jul 20 13:46:51.536373 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:51.536323    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="824187ab-d4fa-4d85-ae89-529bdf2a6d2b" containerName="main"
Jul 20 13:46:51.536373 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:51.536345    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3167da02-df0e-4c9a-98cb-fc333e314857" containerName="main"
Jul 20 13:46:51.536551 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:51.536382    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3167da02-df0e-4c9a-98cb-fc333e314857" containerName="main"
Jul 20 13:46:51.536551 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:51.536486    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="824187ab-d4fa-4d85-ae89-529bdf2a6d2b" containerName="main"
Jul 20 13:46:51.536551 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:51.536500    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3167da02-df0e-4c9a-98cb-fc333e314857" containerName="main"
Jul 20 13:46:51.540780 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:51.540759    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a69896/rate-test-model-a69896-kserve-7cb879f98c-8vmkn"
Jul 20 13:46:51.543983 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:51.543959    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a69896\"/\"kube-root-ca.crt\""
Jul 20 13:46:51.545207 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:51.545189    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-a69896\"/\"openshift-service-ca.crt\""
Jul 20 13:46:51.545323 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:51.545253    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a69896\"/\"rate-test-model-a69896-kserve-self-signed-certs\""
Jul 20 13:46:51.545323 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:51.545301    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-a69896\"/\"default-dockercfg-gx8z2\""
Jul 20 13:46:51.554325 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:51.554301    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:46:51.556234 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:51.556213    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a69896/rate-test-model-a69896-kserve-7cb879f98c-8vmkn"]
Jul 20 13:46:51.594763 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:51.594730    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/323fe799-21f0-4d05-bfa2-0f9142c1fb0c-home\") pod \"rate-test-model-a69896-kserve-7cb879f98c-8vmkn\" (UID: \"323fe799-21f0-4d05-bfa2-0f9142c1fb0c\") " pod="ai-tenant-e2e-shared-b-a69896/rate-test-model-a69896-kserve-7cb879f98c-8vmkn"
Jul 20 13:46:51.594902 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:51.594772    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/323fe799-21f0-4d05-bfa2-0f9142c1fb0c-dshm\") pod \"rate-test-model-a69896-kserve-7cb879f98c-8vmkn\" (UID: \"323fe799-21f0-4d05-bfa2-0f9142c1fb0c\") " pod="ai-tenant-e2e-shared-b-a69896/rate-test-model-a69896-kserve-7cb879f98c-8vmkn"
Jul 20 13:46:51.594902 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:51.594799    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/323fe799-21f0-4d05-bfa2-0f9142c1fb0c-tls-certs\") pod \"rate-test-model-a69896-kserve-7cb879f98c-8vmkn\" (UID: \"323fe799-21f0-4d05-bfa2-0f9142c1fb0c\") " pod="ai-tenant-e2e-shared-b-a69896/rate-test-model-a69896-kserve-7cb879f98c-8vmkn"
Jul 20 13:46:51.594902 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:51.594865    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/323fe799-21f0-4d05-bfa2-0f9142c1fb0c-tmp-dir\") pod \"rate-test-model-a69896-kserve-7cb879f98c-8vmkn\" (UID: \"323fe799-21f0-4d05-bfa2-0f9142c1fb0c\") " pod="ai-tenant-e2e-shared-b-a69896/rate-test-model-a69896-kserve-7cb879f98c-8vmkn"
Jul 20 13:46:51.595009 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:51.594965    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/323fe799-21f0-4d05-bfa2-0f9142c1fb0c-model-cache\") pod \"rate-test-model-a69896-kserve-7cb879f98c-8vmkn\" (UID: \"323fe799-21f0-4d05-bfa2-0f9142c1fb0c\") " pod="ai-tenant-e2e-shared-b-a69896/rate-test-model-a69896-kserve-7cb879f98c-8vmkn"
Jul 20 13:46:51.595009 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:51.594996    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fx2dp\" (UniqueName: \"kubernetes.io/projected/323fe799-21f0-4d05-bfa2-0f9142c1fb0c-kube-api-access-fx2dp\") pod \"rate-test-model-a69896-kserve-7cb879f98c-8vmkn\" (UID: \"323fe799-21f0-4d05-bfa2-0f9142c1fb0c\") " pod="ai-tenant-e2e-shared-b-a69896/rate-test-model-a69896-kserve-7cb879f98c-8vmkn"
Jul 20 13:46:51.695461 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:51.695425    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/323fe799-21f0-4d05-bfa2-0f9142c1fb0c-home\") pod \"rate-test-model-a69896-kserve-7cb879f98c-8vmkn\" (UID: \"323fe799-21f0-4d05-bfa2-0f9142c1fb0c\") " pod="ai-tenant-e2e-shared-b-a69896/rate-test-model-a69896-kserve-7cb879f98c-8vmkn"
Jul 20 13:46:51.695628 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:51.695469    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/323fe799-21f0-4d05-bfa2-0f9142c1fb0c-dshm\") pod \"rate-test-model-a69896-kserve-7cb879f98c-8vmkn\" (UID: \"323fe799-21f0-4d05-bfa2-0f9142c1fb0c\") " pod="ai-tenant-e2e-shared-b-a69896/rate-test-model-a69896-kserve-7cb879f98c-8vmkn"
Jul 20 13:46:51.695628 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:51.695491    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/323fe799-21f0-4d05-bfa2-0f9142c1fb0c-tls-certs\") pod \"rate-test-model-a69896-kserve-7cb879f98c-8vmkn\" (UID: \"323fe799-21f0-4d05-bfa2-0f9142c1fb0c\") " pod="ai-tenant-e2e-shared-b-a69896/rate-test-model-a69896-kserve-7cb879f98c-8vmkn"
Jul 20 13:46:51.695628 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:51.695523    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/323fe799-21f0-4d05-bfa2-0f9142c1fb0c-tmp-dir\") pod \"rate-test-model-a69896-kserve-7cb879f98c-8vmkn\" (UID: \"323fe799-21f0-4d05-bfa2-0f9142c1fb0c\") " pod="ai-tenant-e2e-shared-b-a69896/rate-test-model-a69896-kserve-7cb879f98c-8vmkn"
Jul 20 13:46:51.695628 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:51.695561    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/323fe799-21f0-4d05-bfa2-0f9142c1fb0c-model-cache\") pod \"rate-test-model-a69896-kserve-7cb879f98c-8vmkn\" (UID: \"323fe799-21f0-4d05-bfa2-0f9142c1fb0c\") " pod="ai-tenant-e2e-shared-b-a69896/rate-test-model-a69896-kserve-7cb879f98c-8vmkn"
Jul 20 13:46:51.695628 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:51.695591    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fx2dp\" (UniqueName: \"kubernetes.io/projected/323fe799-21f0-4d05-bfa2-0f9142c1fb0c-kube-api-access-fx2dp\") pod \"rate-test-model-a69896-kserve-7cb879f98c-8vmkn\" (UID: \"323fe799-21f0-4d05-bfa2-0f9142c1fb0c\") " pod="ai-tenant-e2e-shared-b-a69896/rate-test-model-a69896-kserve-7cb879f98c-8vmkn"
Jul 20 13:46:51.695992 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:51.695967    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/323fe799-21f0-4d05-bfa2-0f9142c1fb0c-model-cache\") pod \"rate-test-model-a69896-kserve-7cb879f98c-8vmkn\" (UID: \"323fe799-21f0-4d05-bfa2-0f9142c1fb0c\") " pod="ai-tenant-e2e-shared-b-a69896/rate-test-model-a69896-kserve-7cb879f98c-8vmkn"
Jul 20 13:46:51.696093 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:51.696000    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/323fe799-21f0-4d05-bfa2-0f9142c1fb0c-tmp-dir\") pod \"rate-test-model-a69896-kserve-7cb879f98c-8vmkn\" (UID: \"323fe799-21f0-4d05-bfa2-0f9142c1fb0c\") " pod="ai-tenant-e2e-shared-b-a69896/rate-test-model-a69896-kserve-7cb879f98c-8vmkn"
Jul 20 13:46:51.696093 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:51.696028    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/323fe799-21f0-4d05-bfa2-0f9142c1fb0c-home\") pod \"rate-test-model-a69896-kserve-7cb879f98c-8vmkn\" (UID: \"323fe799-21f0-4d05-bfa2-0f9142c1fb0c\") " pod="ai-tenant-e2e-shared-b-a69896/rate-test-model-a69896-kserve-7cb879f98c-8vmkn"
Jul 20 13:46:51.697913 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:51.697884    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/323fe799-21f0-4d05-bfa2-0f9142c1fb0c-dshm\") pod \"rate-test-model-a69896-kserve-7cb879f98c-8vmkn\" (UID: \"323fe799-21f0-4d05-bfa2-0f9142c1fb0c\") " pod="ai-tenant-e2e-shared-b-a69896/rate-test-model-a69896-kserve-7cb879f98c-8vmkn"
Jul 20 13:46:51.698202 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:51.698182    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/323fe799-21f0-4d05-bfa2-0f9142c1fb0c-tls-certs\") pod \"rate-test-model-a69896-kserve-7cb879f98c-8vmkn\" (UID: \"323fe799-21f0-4d05-bfa2-0f9142c1fb0c\") " pod="ai-tenant-e2e-shared-b-a69896/rate-test-model-a69896-kserve-7cb879f98c-8vmkn"
Jul 20 13:46:51.705009 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:51.704985    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fx2dp\" (UniqueName: \"kubernetes.io/projected/323fe799-21f0-4d05-bfa2-0f9142c1fb0c-kube-api-access-fx2dp\") pod \"rate-test-model-a69896-kserve-7cb879f98c-8vmkn\" (UID: \"323fe799-21f0-4d05-bfa2-0f9142c1fb0c\") " pod="ai-tenant-e2e-shared-b-a69896/rate-test-model-a69896-kserve-7cb879f98c-8vmkn"
Jul 20 13:46:51.856170 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:51.856133    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a69896/rate-test-model-a69896-kserve-7cb879f98c-8vmkn"
Jul 20 13:46:52.022184 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:52.022158    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-a69896/rate-test-model-a69896-kserve-7cb879f98c-8vmkn"]
Jul 20 13:46:52.024506 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:46:52.024478    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod323fe799_21f0_4d05_bfa2_0f9142c1fb0c.slice/crio-85b4fe2717275313309825453f96a0f4e73fbdd1549222b5acb49fb4e4ddc90d WatchSource:0}: Error finding container 85b4fe2717275313309825453f96a0f4e73fbdd1549222b5acb49fb4e4ddc90d: Status 404 returned error can't find the container with id 85b4fe2717275313309825453f96a0f4e73fbdd1549222b5acb49fb4e4ddc90d
Jul 20 13:46:52.535368 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:52.535331    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a69896/rate-test-model-a69896-kserve-7cb879f98c-8vmkn" event={"ID":"323fe799-21f0-4d05-bfa2-0f9142c1fb0c","Type":"ContainerStarted","Data":"cd01c1265fc82eaf54e4adb8ed4212e4b99ff77ab09c42e86f30405a6728c3b8"}
Jul 20 13:46:52.535549 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:52.535394    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a69896/rate-test-model-a69896-kserve-7cb879f98c-8vmkn" event={"ID":"323fe799-21f0-4d05-bfa2-0f9142c1fb0c","Type":"ContainerStarted","Data":"85b4fe2717275313309825453f96a0f4e73fbdd1549222b5acb49fb4e4ddc90d"}
Jul 20 13:46:52.562160 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:52.562083    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-a69896/rate-test-model-a69896-kserve-7cb879f98c-8vmkn" podStartSLOduration=1.5620578360000001 podStartE2EDuration="1.562057836s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:46:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:46:52.558303439 +0000 UTC m=+2719.027835558" watchObservedRunningTime="2026-07-20 13:46:52.562057836 +0000 UTC m=+2719.031589955"
Jul 20 13:46:53.218023 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:53.217992    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:46:59.119322 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:46:59.119275    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:47:01.856816 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:01.856776    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-a69896/rate-test-model-a69896-kserve-7cb879f98c-8vmkn"
Jul 20 13:47:01.856816 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:01.856828    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-a69896/rate-test-model-a69896-kserve-7cb879f98c-8vmkn"
Jul 20 13:47:01.869758 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:01.869728    2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-a69896/rate-test-model-a69896-kserve-7cb879f98c-8vmkn"
Jul 20 13:47:02.609252 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:02.609217    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-a69896/rate-test-model-a69896-kserve-7cb879f98c-8vmkn"
Jul 20 13:47:13.729827 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:13.729788    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:47:29.027115 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:29.027073    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:47:32.028308 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:32.028269    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:47:32.128341 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:32.128305    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:47:36.375557 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:36.375524    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:47:37.199651 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:37.199620    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a69896/rate-test-model-a69896-kserve-7cb879f98c-8vmkn"]
Jul 20 13:47:37.218683 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:37.218629    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:47:38.311646 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:38.311610    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7719-140176946269488"]
Jul 20 13:47:38.316599 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:38.316572    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7719-140176946269488"
Jul 20 13:47:38.319676 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:38.319647    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-hms82\""
Jul 20 13:47:38.322951 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:38.322931    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7719-140176946269488"]
Jul 20 13:47:38.397395 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:38.397344    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6zgz6\" (UniqueName: \"kubernetes.io/projected/0cc0b899-3a1a-4eb0-a0ad-fc1d12150586-kube-api-access-6zgz6\") pod \"test-curl-7719-140176946269488\" (UID: \"0cc0b899-3a1a-4eb0-a0ad-fc1d12150586\") " pod="opendatahub/test-curl-7719-140176946269488"
Jul 20 13:47:38.498405 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:38.498371    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6zgz6\" (UniqueName: \"kubernetes.io/projected/0cc0b899-3a1a-4eb0-a0ad-fc1d12150586-kube-api-access-6zgz6\") pod \"test-curl-7719-140176946269488\" (UID: \"0cc0b899-3a1a-4eb0-a0ad-fc1d12150586\") " pod="opendatahub/test-curl-7719-140176946269488"
Jul 20 13:47:38.508059 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:38.508028    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6zgz6\" (UniqueName: \"kubernetes.io/projected/0cc0b899-3a1a-4eb0-a0ad-fc1d12150586-kube-api-access-6zgz6\") pod \"test-curl-7719-140176946269488\" (UID: \"0cc0b899-3a1a-4eb0-a0ad-fc1d12150586\") " pod="opendatahub/test-curl-7719-140176946269488"
Jul 20 13:47:38.627021 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:38.626984    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7719-140176946269488"
Jul 20 13:47:38.758699 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:38.758669    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7719-140176946269488"]
Jul 20 13:47:38.760457 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:47:38.760420    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0cc0b899_3a1a_4eb0_a0ad_fc1d12150586.slice/crio-6f277bd425d546d395965c056d89772b4eece9ac108a753b0cc1c6304e913a09 WatchSource:0}: Error finding container 6f277bd425d546d395965c056d89772b4eece9ac108a753b0cc1c6304e913a09: Status 404 returned error can't find the container with id 6f277bd425d546d395965c056d89772b4eece9ac108a753b0cc1c6304e913a09
Jul 20 13:47:38.762190 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:38.762174    2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 20 13:47:38.793783 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:38.793750    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7719-140176946269488" event={"ID":"0cc0b899-3a1a-4eb0-a0ad-fc1d12150586","Type":"ContainerStarted","Data":"6f277bd425d546d395965c056d89772b4eece9ac108a753b0cc1c6304e913a09"}
Jul 20 13:47:39.800815 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:39.800719    2565 generic.go:356] "Generic (PLEG): container finished" podID="0cc0b899-3a1a-4eb0-a0ad-fc1d12150586" containerID="6d7018e0db2dd057db935d9493339bb8eb8bd222a87d7374a94fb76102ff75de" exitCode=0
Jul 20 13:47:39.800815 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:39.800764    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7719-140176946269488" event={"ID":"0cc0b899-3a1a-4eb0-a0ad-fc1d12150586","Type":"ContainerDied","Data":"6d7018e0db2dd057db935d9493339bb8eb8bd222a87d7374a94fb76102ff75de"}
Jul 20 13:47:40.242797 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:40.242769    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:47:40.344282 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:40.344247    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:47:40.945166 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:40.945139    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7719-140176946269488"
Jul 20 13:47:40.976944 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:40.976887    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7719-140176946269488_0cc0b899-3a1a-4eb0-a0ad-fc1d12150586/test-curl-7719-140176946269488/0.log"
Jul 20 13:47:41.007895 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:41.007868    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7719-140176946269488"]
Jul 20 13:47:41.018297 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:41.018263    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7719-140176946269488"]
Jul 20 13:47:41.019550 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:41.019525    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6zgz6\" (UniqueName: \"kubernetes.io/projected/0cc0b899-3a1a-4eb0-a0ad-fc1d12150586-kube-api-access-6zgz6\") pod \"0cc0b899-3a1a-4eb0-a0ad-fc1d12150586\" (UID: \"0cc0b899-3a1a-4eb0-a0ad-fc1d12150586\") "
Jul 20 13:47:41.021673 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:41.021651    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0cc0b899-3a1a-4eb0-a0ad-fc1d12150586-kube-api-access-6zgz6" (OuterVolumeSpecName: "kube-api-access-6zgz6") pod "0cc0b899-3a1a-4eb0-a0ad-fc1d12150586" (UID: "0cc0b899-3a1a-4eb0-a0ad-fc1d12150586"). InnerVolumeSpecName "kube-api-access-6zgz6". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:47:41.120268 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:41.120240    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6zgz6\" (UniqueName: \"kubernetes.io/projected/0cc0b899-3a1a-4eb0-a0ad-fc1d12150586-kube-api-access-6zgz6\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:47:41.151180 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:41.151149    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7719-140176946233648"]
Jul 20 13:47:41.151569 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:41.151552    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0cc0b899-3a1a-4eb0-a0ad-fc1d12150586" containerName="test-curl-7719-140176946269488"
Jul 20 13:47:41.151658 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:41.151571    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="0cc0b899-3a1a-4eb0-a0ad-fc1d12150586" containerName="test-curl-7719-140176946269488"
Jul 20 13:47:41.151716 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:41.151682    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="0cc0b899-3a1a-4eb0-a0ad-fc1d12150586" containerName="test-curl-7719-140176946269488"
Jul 20 13:47:41.154701 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:41.154683    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7719-140176946233648"
Jul 20 13:47:41.160825 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:41.160807    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7719-140176946233648"]
Jul 20 13:47:41.220768 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:41.220740    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-krd88\" (UniqueName: \"kubernetes.io/projected/92d4b38f-b1b5-495e-a160-aeb6eb89555d-kube-api-access-krd88\") pod \"test-curl-7719-140176946233648\" (UID: \"92d4b38f-b1b5-495e-a160-aeb6eb89555d\") " pod="opendatahub/test-curl-7719-140176946233648"
Jul 20 13:47:41.321526 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:41.321501    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-krd88\" (UniqueName: \"kubernetes.io/projected/92d4b38f-b1b5-495e-a160-aeb6eb89555d-kube-api-access-krd88\") pod \"test-curl-7719-140176946233648\" (UID: \"92d4b38f-b1b5-495e-a160-aeb6eb89555d\") " pod="opendatahub/test-curl-7719-140176946233648"
Jul 20 13:47:41.334031 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:41.334005    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-krd88\" (UniqueName: \"kubernetes.io/projected/92d4b38f-b1b5-495e-a160-aeb6eb89555d-kube-api-access-krd88\") pod \"test-curl-7719-140176946233648\" (UID: \"92d4b38f-b1b5-495e-a160-aeb6eb89555d\") " pod="opendatahub/test-curl-7719-140176946233648"
Jul 20 13:47:41.465278 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:41.465199    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7719-140176946233648"
Jul 20 13:47:41.596036 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:41.596011    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7719-140176946233648"]
Jul 20 13:47:41.597299 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:47:41.597276    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod92d4b38f_b1b5_495e_a160_aeb6eb89555d.slice/crio-aee5e5d2936ce3c7aa865e1bedc7fa371488356e723f7e1a1639bef48bdb88cd WatchSource:0}: Error finding container aee5e5d2936ce3c7aa865e1bedc7fa371488356e723f7e1a1639bef48bdb88cd: Status 404 returned error can't find the container with id aee5e5d2936ce3c7aa865e1bedc7fa371488356e723f7e1a1639bef48bdb88cd
Jul 20 13:47:41.813288 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:41.813198    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7719-140176946233648" event={"ID":"92d4b38f-b1b5-495e-a160-aeb6eb89555d","Type":"ContainerStarted","Data":"aee5e5d2936ce3c7aa865e1bedc7fa371488356e723f7e1a1639bef48bdb88cd"}
Jul 20 13:47:41.814444 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:41.814424    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6f277bd425d546d395965c056d89772b4eece9ac108a753b0cc1c6304e913a09"
Jul 20 13:47:41.814562 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:41.814459    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7719-140176946269488"
Jul 20 13:47:41.825634 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:47:41.825608    2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7719-140176946269488\" is forbidden: User \"system:node:ip-10-0-141-182.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-141-182.ec2.internal' and this object" podUID="0cc0b899-3a1a-4eb0-a0ad-fc1d12150586" pod="opendatahub/test-curl-7719-140176946269488"
Jul 20 13:47:42.147242 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:42.147213    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0cc0b899-3a1a-4eb0-a0ad-fc1d12150586" path="/var/lib/kubelet/pods/0cc0b899-3a1a-4eb0-a0ad-fc1d12150586/volumes"
Jul 20 13:47:42.820780 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:42.820745    2565 generic.go:356] "Generic (PLEG): container finished" podID="92d4b38f-b1b5-495e-a160-aeb6eb89555d" containerID="66c0edf3f2a0a39ff8e41bbdc812215d918537d1365ffd19135785b0d7c73c73" exitCode=0
Jul 20 13:47:42.820970 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:42.820837    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7719-140176946233648" event={"ID":"92d4b38f-b1b5-495e-a160-aeb6eb89555d","Type":"ContainerDied","Data":"66c0edf3f2a0a39ff8e41bbdc812215d918537d1365ffd19135785b0d7c73c73"}
Jul 20 13:47:43.601945 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:43.601907    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:47:43.953533 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:43.953507    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7719-140176946233648"
Jul 20 13:47:43.998375 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:43.998337    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7719-140176946233648_92d4b38f-b1b5-495e-a160-aeb6eb89555d/test-curl-7719-140176946233648/0.log"
Jul 20 13:47:44.031789 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:44.031752    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7719-140176946233648"]
Jul 20 13:47:44.041789 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:44.041758    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7719-140176946233648"]
Jul 20 13:47:44.042607 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:44.042585    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-krd88\" (UniqueName: \"kubernetes.io/projected/92d4b38f-b1b5-495e-a160-aeb6eb89555d-kube-api-access-krd88\") pod \"92d4b38f-b1b5-495e-a160-aeb6eb89555d\" (UID: \"92d4b38f-b1b5-495e-a160-aeb6eb89555d\") "
Jul 20 13:47:44.044626 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:44.044601    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/92d4b38f-b1b5-495e-a160-aeb6eb89555d-kube-api-access-krd88" (OuterVolumeSpecName: "kube-api-access-krd88") pod "92d4b38f-b1b5-495e-a160-aeb6eb89555d" (UID: "92d4b38f-b1b5-495e-a160-aeb6eb89555d"). InnerVolumeSpecName "kube-api-access-krd88". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:47:44.143220 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:44.143129    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-krd88\" (UniqueName: \"kubernetes.io/projected/92d4b38f-b1b5-495e-a160-aeb6eb89555d-kube-api-access-krd88\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:47:44.147082 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:44.147055    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="92d4b38f-b1b5-495e-a160-aeb6eb89555d" path="/var/lib/kubelet/pods/92d4b38f-b1b5-495e-a160-aeb6eb89555d/volumes"
Jul 20 13:47:44.246719 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:44.246677    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7719-140176946116336"]
Jul 20 13:47:44.247033 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:44.247020    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="92d4b38f-b1b5-495e-a160-aeb6eb89555d" containerName="test-curl-7719-140176946233648"
Jul 20 13:47:44.247083 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:44.247035    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="92d4b38f-b1b5-495e-a160-aeb6eb89555d" containerName="test-curl-7719-140176946233648"
Jul 20 13:47:44.247119 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:44.247089    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="92d4b38f-b1b5-495e-a160-aeb6eb89555d" containerName="test-curl-7719-140176946233648"
Jul 20 13:47:44.250108 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:44.250093    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7719-140176946116336"
Jul 20 13:47:44.262994 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:44.262277    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7719-140176946116336"]
Jul 20 13:47:44.344694 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:44.344664    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n554q\" (UniqueName: \"kubernetes.io/projected/821cf43a-8ee7-4d01-9d3b-27b0e939722b-kube-api-access-n554q\") pod \"test-curl-7719-140176946116336\" (UID: \"821cf43a-8ee7-4d01-9d3b-27b0e939722b\") " pod="opendatahub/test-curl-7719-140176946116336"
Jul 20 13:47:44.445267 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:44.445161    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n554q\" (UniqueName: \"kubernetes.io/projected/821cf43a-8ee7-4d01-9d3b-27b0e939722b-kube-api-access-n554q\") pod \"test-curl-7719-140176946116336\" (UID: \"821cf43a-8ee7-4d01-9d3b-27b0e939722b\") " pod="opendatahub/test-curl-7719-140176946116336"
Jul 20 13:47:44.463803 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:44.463761    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n554q\" (UniqueName: \"kubernetes.io/projected/821cf43a-8ee7-4d01-9d3b-27b0e939722b-kube-api-access-n554q\") pod \"test-curl-7719-140176946116336\" (UID: \"821cf43a-8ee7-4d01-9d3b-27b0e939722b\") " pod="opendatahub/test-curl-7719-140176946116336"
Jul 20 13:47:44.567535 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:44.567496    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7719-140176946116336"
Jul 20 13:47:44.705383 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:44.705337    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7719-140176946116336"]
Jul 20 13:47:44.706615 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:47:44.706589    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod821cf43a_8ee7_4d01_9d3b_27b0e939722b.slice/crio-b8ec5fd9b67dc1e625e7a8452d05541cddade3179a0089877e1e20bf15bd1d02 WatchSource:0}: Error finding container b8ec5fd9b67dc1e625e7a8452d05541cddade3179a0089877e1e20bf15bd1d02: Status 404 returned error can't find the container with id b8ec5fd9b67dc1e625e7a8452d05541cddade3179a0089877e1e20bf15bd1d02
Jul 20 13:47:44.837608 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:44.837576    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7719-140176946233648"
Jul 20 13:47:44.837819 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:44.837587    2565 scope.go:117] "RemoveContainer" containerID="66c0edf3f2a0a39ff8e41bbdc812215d918537d1365ffd19135785b0d7c73c73"
Jul 20 13:47:44.839192 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:44.839161    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7719-140176946116336" event={"ID":"821cf43a-8ee7-4d01-9d3b-27b0e939722b","Type":"ContainerStarted","Data":"b8ec5fd9b67dc1e625e7a8452d05541cddade3179a0089877e1e20bf15bd1d02"}
Jul 20 13:47:45.846389 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:45.846342    2565 generic.go:356] "Generic (PLEG): container finished" podID="821cf43a-8ee7-4d01-9d3b-27b0e939722b" containerID="364f25af0efc509eaaed5e2a2c0f62167dfbf6938d8ba8a886d56b69ca8448e2" exitCode=0
Jul 20 13:47:45.846818 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:45.846394    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7719-140176946116336" event={"ID":"821cf43a-8ee7-4d01-9d3b-27b0e939722b","Type":"ContainerDied","Data":"364f25af0efc509eaaed5e2a2c0f62167dfbf6938d8ba8a886d56b69ca8448e2"}
Jul 20 13:47:46.987758 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:46.987734    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7719-140176946116336"
Jul 20 13:47:47.044877 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:47.044846    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7719-140176946116336_821cf43a-8ee7-4d01-9d3b-27b0e939722b/test-curl-7719-140176946116336/0.log"
Jul 20 13:47:47.067212 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:47.067191    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n554q\" (UniqueName: \"kubernetes.io/projected/821cf43a-8ee7-4d01-9d3b-27b0e939722b-kube-api-access-n554q\") pod \"821cf43a-8ee7-4d01-9d3b-27b0e939722b\" (UID: \"821cf43a-8ee7-4d01-9d3b-27b0e939722b\") "
Jul 20 13:47:47.069353 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:47.069327    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/821cf43a-8ee7-4d01-9d3b-27b0e939722b-kube-api-access-n554q" (OuterVolumeSpecName: "kube-api-access-n554q") pod "821cf43a-8ee7-4d01-9d3b-27b0e939722b" (UID: "821cf43a-8ee7-4d01-9d3b-27b0e939722b"). InnerVolumeSpecName "kube-api-access-n554q". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:47:47.084857 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:47.084829    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7719-140176946116336"]
Jul 20 13:47:47.087087 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:47.087066    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7719-140176946116336"]
Jul 20 13:47:47.168695 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:47.168657    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n554q\" (UniqueName: \"kubernetes.io/projected/821cf43a-8ee7-4d01-9d3b-27b0e939722b-kube-api-access-n554q\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:47:47.223816 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:47.223773    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7719-140176946116336"]
Jul 20 13:47:47.224129 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:47.224116    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="821cf43a-8ee7-4d01-9d3b-27b0e939722b" containerName="test-curl-7719-140176946116336"
Jul 20 13:47:47.224188 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:47.224131    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="821cf43a-8ee7-4d01-9d3b-27b0e939722b" containerName="test-curl-7719-140176946116336"
Jul 20 13:47:47.224188 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:47.224186    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="821cf43a-8ee7-4d01-9d3b-27b0e939722b" containerName="test-curl-7719-140176946116336"
Jul 20 13:47:47.227403 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:47.227384    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7719-140176946116336"
Jul 20 13:47:47.251235 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:47.251203    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7719-140176946116336"]
Jul 20 13:47:47.269514 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:47.269478    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srgsf\" (UniqueName: \"kubernetes.io/projected/aa552899-d903-466f-84fb-415eb572f397-kube-api-access-srgsf\") pod \"test-curl-7719-140176946116336\" (UID: \"aa552899-d903-466f-84fb-415eb572f397\") " pod="opendatahub/test-curl-7719-140176946116336"
Jul 20 13:47:47.370707 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:47.370669    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srgsf\" (UniqueName: \"kubernetes.io/projected/aa552899-d903-466f-84fb-415eb572f397-kube-api-access-srgsf\") pod \"test-curl-7719-140176946116336\" (UID: \"aa552899-d903-466f-84fb-415eb572f397\") " pod="opendatahub/test-curl-7719-140176946116336"
Jul 20 13:47:47.382897 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:47.382864    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srgsf\" (UniqueName: \"kubernetes.io/projected/aa552899-d903-466f-84fb-415eb572f397-kube-api-access-srgsf\") pod \"test-curl-7719-140176946116336\" (UID: \"aa552899-d903-466f-84fb-415eb572f397\") " pod="opendatahub/test-curl-7719-140176946116336"
Jul 20 13:47:47.536324 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:47.536239    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7719-140176946116336"
Jul 20 13:47:47.670763 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:47.670737    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7719-140176946116336"]
Jul 20 13:47:47.673321 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:47:47.673293    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podaa552899_d903_466f_84fb_415eb572f397.slice/crio-1adc88c47e677a5643508362d9bf8d121563b511cf428f9eee33f803791c0085 WatchSource:0}: Error finding container 1adc88c47e677a5643508362d9bf8d121563b511cf428f9eee33f803791c0085: Status 404 returned error can't find the container with id 1adc88c47e677a5643508362d9bf8d121563b511cf428f9eee33f803791c0085
Jul 20 13:47:47.860099 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:47.860062    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7719-140176946116336"
Jul 20 13:47:47.860099 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:47.860097    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b8ec5fd9b67dc1e625e7a8452d05541cddade3179a0089877e1e20bf15bd1d02"
Jul 20 13:47:47.861416 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:47.861384    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7719-140176946116336" event={"ID":"aa552899-d903-466f-84fb-415eb572f397","Type":"ContainerStarted","Data":"1adc88c47e677a5643508362d9bf8d121563b511cf428f9eee33f803791c0085"}
Jul 20 13:47:47.876503 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:47.876474    2565 status_manager.go:1027] "Pod was deleted and then recreated, skipping status update" pod="opendatahub/test-curl-7719-140176946116336" oldPodUID="821cf43a-8ee7-4d01-9d3b-27b0e939722b" podUID="aa552899-d903-466f-84fb-415eb572f397"
Jul 20 13:47:48.147644 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:48.147575    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="821cf43a-8ee7-4d01-9d3b-27b0e939722b" path="/var/lib/kubelet/pods/821cf43a-8ee7-4d01-9d3b-27b0e939722b/volumes"
Jul 20 13:47:48.868996 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:48.868959    2565 generic.go:356] "Generic (PLEG): container finished" podID="aa552899-d903-466f-84fb-415eb572f397" containerID="7bee48ae33e0e405d46f12c0d0fb2802130a44acab1c8530b2a64497377ed997" exitCode=0
Jul 20 13:47:48.869163 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:48.869053    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7719-140176946116336" event={"ID":"aa552899-d903-466f-84fb-415eb572f397","Type":"ContainerDied","Data":"7bee48ae33e0e405d46f12c0d0fb2802130a44acab1c8530b2a64497377ed997"}
Jul 20 13:47:50.007224 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:50.007195    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7719-140176946116336"
Jul 20 13:47:50.034111 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:50.034081    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7719-140176946116336_aa552899-d903-466f-84fb-415eb572f397/test-curl-7719-140176946116336/0.log"
Jul 20 13:47:50.063921 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:50.063879    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7719-140176946116336"]
Jul 20 13:47:50.067517 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:50.067493    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7719-140176946116336"]
Jul 20 13:47:50.091639 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:50.091614    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-srgsf\" (UniqueName: \"kubernetes.io/projected/aa552899-d903-466f-84fb-415eb572f397-kube-api-access-srgsf\") pod \"aa552899-d903-466f-84fb-415eb572f397\" (UID: \"aa552899-d903-466f-84fb-415eb572f397\") "
Jul 20 13:47:50.093799 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:50.093769    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa552899-d903-466f-84fb-415eb572f397-kube-api-access-srgsf" (OuterVolumeSpecName: "kube-api-access-srgsf") pod "aa552899-d903-466f-84fb-415eb572f397" (UID: "aa552899-d903-466f-84fb-415eb572f397"). InnerVolumeSpecName "kube-api-access-srgsf". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:47:50.151743 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:50.151665    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa552899-d903-466f-84fb-415eb572f397" path="/var/lib/kubelet/pods/aa552899-d903-466f-84fb-415eb572f397/volumes"
Jul 20 13:47:50.192107 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:50.192076    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-srgsf\" (UniqueName: \"kubernetes.io/projected/aa552899-d903-466f-84fb-415eb572f397-kube-api-access-srgsf\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:47:50.882186 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:50.882157    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7719-140176946116336"
Jul 20 13:47:50.882186 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:50.882176    2565 scope.go:117] "RemoveContainer" containerID="7bee48ae33e0e405d46f12c0d0fb2802130a44acab1c8530b2a64497377ed997"
Jul 20 13:47:52.219323 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:52.219280    2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-a69896/rate-test-model-a69896-kserve-7cb879f98c-8vmkn" podUID="323fe799-21f0-4d05-bfa2-0f9142c1fb0c" containerName="main" containerID="cri-o://cd01c1265fc82eaf54e4adb8ed4212e4b99ff77ab09c42e86f30405a6728c3b8" gracePeriod=45
Jul 20 13:47:52.456576 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:52.456548    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a69896/rate-test-model-a69896-kserve-7cb879f98c-8vmkn"
Jul 20 13:47:52.511616 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:52.511543    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fx2dp\" (UniqueName: \"kubernetes.io/projected/323fe799-21f0-4d05-bfa2-0f9142c1fb0c-kube-api-access-fx2dp\") pod \"323fe799-21f0-4d05-bfa2-0f9142c1fb0c\" (UID: \"323fe799-21f0-4d05-bfa2-0f9142c1fb0c\") "
Jul 20 13:47:52.511616 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:52.511581    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/323fe799-21f0-4d05-bfa2-0f9142c1fb0c-tmp-dir\") pod \"323fe799-21f0-4d05-bfa2-0f9142c1fb0c\" (UID: \"323fe799-21f0-4d05-bfa2-0f9142c1fb0c\") "
Jul 20 13:47:52.511616 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:52.511605    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/323fe799-21f0-4d05-bfa2-0f9142c1fb0c-model-cache\") pod \"323fe799-21f0-4d05-bfa2-0f9142c1fb0c\" (UID: \"323fe799-21f0-4d05-bfa2-0f9142c1fb0c\") "
Jul 20 13:47:52.511876 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:52.511662    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/323fe799-21f0-4d05-bfa2-0f9142c1fb0c-dshm\") pod \"323fe799-21f0-4d05-bfa2-0f9142c1fb0c\" (UID: \"323fe799-21f0-4d05-bfa2-0f9142c1fb0c\") "
Jul 20 13:47:52.511876 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:52.511689    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/323fe799-21f0-4d05-bfa2-0f9142c1fb0c-tls-certs\") pod \"323fe799-21f0-4d05-bfa2-0f9142c1fb0c\" (UID: \"323fe799-21f0-4d05-bfa2-0f9142c1fb0c\") "
Jul 20 13:47:52.511876 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:52.511769    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/323fe799-21f0-4d05-bfa2-0f9142c1fb0c-home\") pod \"323fe799-21f0-4d05-bfa2-0f9142c1fb0c\" (UID: \"323fe799-21f0-4d05-bfa2-0f9142c1fb0c\") "
Jul 20 13:47:52.511876 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:52.511862    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/323fe799-21f0-4d05-bfa2-0f9142c1fb0c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "323fe799-21f0-4d05-bfa2-0f9142c1fb0c" (UID: "323fe799-21f0-4d05-bfa2-0f9142c1fb0c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:47:52.512089 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:52.511921    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/323fe799-21f0-4d05-bfa2-0f9142c1fb0c-model-cache" (OuterVolumeSpecName: "model-cache") pod "323fe799-21f0-4d05-bfa2-0f9142c1fb0c" (UID: "323fe799-21f0-4d05-bfa2-0f9142c1fb0c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:47:52.512089 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:52.512007    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/323fe799-21f0-4d05-bfa2-0f9142c1fb0c-home" (OuterVolumeSpecName: "home") pod "323fe799-21f0-4d05-bfa2-0f9142c1fb0c" (UID: "323fe799-21f0-4d05-bfa2-0f9142c1fb0c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:47:52.512089 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:52.512081    2565 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/323fe799-21f0-4d05-bfa2-0f9142c1fb0c-tmp-dir\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:47:52.512202 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:52.512104    2565 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/323fe799-21f0-4d05-bfa2-0f9142c1fb0c-model-cache\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:47:52.512202 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:52.512118    2565 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/323fe799-21f0-4d05-bfa2-0f9142c1fb0c-home\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:47:52.513884 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:52.513861    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/323fe799-21f0-4d05-bfa2-0f9142c1fb0c-dshm" (OuterVolumeSpecName: "dshm") pod "323fe799-21f0-4d05-bfa2-0f9142c1fb0c" (UID: "323fe799-21f0-4d05-bfa2-0f9142c1fb0c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 20 13:47:52.513953 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:52.513868    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/323fe799-21f0-4d05-bfa2-0f9142c1fb0c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "323fe799-21f0-4d05-bfa2-0f9142c1fb0c" (UID: "323fe799-21f0-4d05-bfa2-0f9142c1fb0c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 20 13:47:52.513953 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:52.513868    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/323fe799-21f0-4d05-bfa2-0f9142c1fb0c-kube-api-access-fx2dp" (OuterVolumeSpecName: "kube-api-access-fx2dp") pod "323fe799-21f0-4d05-bfa2-0f9142c1fb0c" (UID: "323fe799-21f0-4d05-bfa2-0f9142c1fb0c"). InnerVolumeSpecName "kube-api-access-fx2dp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:47:52.612589 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:52.612560    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fx2dp\" (UniqueName: \"kubernetes.io/projected/323fe799-21f0-4d05-bfa2-0f9142c1fb0c-kube-api-access-fx2dp\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:47:52.612589 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:52.612583    2565 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/323fe799-21f0-4d05-bfa2-0f9142c1fb0c-dshm\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:47:52.612589 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:52.612593    2565 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/323fe799-21f0-4d05-bfa2-0f9142c1fb0c-tls-certs\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:47:52.896531 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:52.896494    2565 generic.go:356] "Generic (PLEG): container finished" podID="323fe799-21f0-4d05-bfa2-0f9142c1fb0c" containerID="cd01c1265fc82eaf54e4adb8ed4212e4b99ff77ab09c42e86f30405a6728c3b8" exitCode=0
Jul 20 13:47:52.896701 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:52.896541    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-a69896/rate-test-model-a69896-kserve-7cb879f98c-8vmkn"
Jul 20 13:47:52.896701 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:52.896578    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a69896/rate-test-model-a69896-kserve-7cb879f98c-8vmkn" event={"ID":"323fe799-21f0-4d05-bfa2-0f9142c1fb0c","Type":"ContainerDied","Data":"cd01c1265fc82eaf54e4adb8ed4212e4b99ff77ab09c42e86f30405a6728c3b8"}
Jul 20 13:47:52.896701 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:52.896624    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-a69896/rate-test-model-a69896-kserve-7cb879f98c-8vmkn" event={"ID":"323fe799-21f0-4d05-bfa2-0f9142c1fb0c","Type":"ContainerDied","Data":"85b4fe2717275313309825453f96a0f4e73fbdd1549222b5acb49fb4e4ddc90d"}
Jul 20 13:47:52.896701 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:52.896641    2565 scope.go:117] "RemoveContainer" containerID="cd01c1265fc82eaf54e4adb8ed4212e4b99ff77ab09c42e86f30405a6728c3b8"
Jul 20 13:47:52.906100 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:52.906079    2565 scope.go:117] "RemoveContainer" containerID="cd01c1265fc82eaf54e4adb8ed4212e4b99ff77ab09c42e86f30405a6728c3b8"
Jul 20 13:47:52.906352 ip-10-0-141-182 kubenswrapper[2565]: E0720 13:47:52.906330    2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd01c1265fc82eaf54e4adb8ed4212e4b99ff77ab09c42e86f30405a6728c3b8\": container with ID starting with cd01c1265fc82eaf54e4adb8ed4212e4b99ff77ab09c42e86f30405a6728c3b8 not found: ID does not exist" containerID="cd01c1265fc82eaf54e4adb8ed4212e4b99ff77ab09c42e86f30405a6728c3b8"
Jul 20 13:47:52.906456 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:52.906383    2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd01c1265fc82eaf54e4adb8ed4212e4b99ff77ab09c42e86f30405a6728c3b8"} err="failed to get container status \"cd01c1265fc82eaf54e4adb8ed4212e4b99ff77ab09c42e86f30405a6728c3b8\": rpc error: code = NotFound desc = could not find container \"cd01c1265fc82eaf54e4adb8ed4212e4b99ff77ab09c42e86f30405a6728c3b8\": container with ID starting with cd01c1265fc82eaf54e4adb8ed4212e4b99ff77ab09c42e86f30405a6728c3b8 not found: ID does not exist"
Jul 20 13:47:52.920876 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:52.920845    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-a69896/rate-test-model-a69896-kserve-7cb879f98c-8vmkn"]
Jul 20 13:47:52.928818 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:52.928787    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-a69896/rate-test-model-a69896-kserve-7cb879f98c-8vmkn"]
Jul 20 13:47:53.188536 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:53.188444    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7719-140176945222976"]
Jul 20 13:47:53.188870 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:53.188851    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa552899-d903-466f-84fb-415eb572f397" containerName="test-curl-7719-140176946116336"
Jul 20 13:47:53.188962 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:53.188873    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa552899-d903-466f-84fb-415eb572f397" containerName="test-curl-7719-140176946116336"
Jul 20 13:47:53.188962 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:53.188887    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="323fe799-21f0-4d05-bfa2-0f9142c1fb0c" containerName="main"
Jul 20 13:47:53.188962 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:53.188895    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="323fe799-21f0-4d05-bfa2-0f9142c1fb0c" containerName="main"
Jul 20 13:47:53.189113 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:53.188969    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="323fe799-21f0-4d05-bfa2-0f9142c1fb0c" containerName="main"
Jul 20 13:47:53.189113 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:53.188980    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa552899-d903-466f-84fb-415eb572f397" containerName="test-curl-7719-140176946116336"
Jul 20 13:47:53.193403 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:53.193375    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7719-140176945222976"
Jul 20 13:47:53.196476 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:53.196453    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-hms82\""
Jul 20 13:47:53.197654 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:53.197629    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7719-140176945222976"]
Jul 20 13:47:53.317727 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:53.317689    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jl7qm\" (UniqueName: \"kubernetes.io/projected/e53ce20a-164b-4b6a-82c5-af9efd0d7f22-kube-api-access-jl7qm\") pod \"test-curl-7719-140176945222976\" (UID: \"e53ce20a-164b-4b6a-82c5-af9efd0d7f22\") " pod="opendatahub/test-curl-7719-140176945222976"
Jul 20 13:47:53.418990 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:53.418959    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jl7qm\" (UniqueName: \"kubernetes.io/projected/e53ce20a-164b-4b6a-82c5-af9efd0d7f22-kube-api-access-jl7qm\") pod \"test-curl-7719-140176945222976\" (UID: \"e53ce20a-164b-4b6a-82c5-af9efd0d7f22\") " pod="opendatahub/test-curl-7719-140176945222976"
Jul 20 13:47:53.428934 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:53.428909    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jl7qm\" (UniqueName: \"kubernetes.io/projected/e53ce20a-164b-4b6a-82c5-af9efd0d7f22-kube-api-access-jl7qm\") pod \"test-curl-7719-140176945222976\" (UID: \"e53ce20a-164b-4b6a-82c5-af9efd0d7f22\") " pod="opendatahub/test-curl-7719-140176945222976"
Jul 20 13:47:53.503225 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:53.503145    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7719-140176945222976"
Jul 20 13:47:53.636696 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:53.636667    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7719-140176945222976"]
Jul 20 13:47:53.638586 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:47:53.638558    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode53ce20a_164b_4b6a_82c5_af9efd0d7f22.slice/crio-1867d7a9819354398155f6a7dec8ce58a73869dae620e9ad61caa654cc6a972a WatchSource:0}: Error finding container 1867d7a9819354398155f6a7dec8ce58a73869dae620e9ad61caa654cc6a972a: Status 404 returned error can't find the container with id 1867d7a9819354398155f6a7dec8ce58a73869dae620e9ad61caa654cc6a972a
Jul 20 13:47:53.904543 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:53.904515    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7719-140176945222976" event={"ID":"e53ce20a-164b-4b6a-82c5-af9efd0d7f22","Type":"ContainerStarted","Data":"1867d7a9819354398155f6a7dec8ce58a73869dae620e9ad61caa654cc6a972a"}
Jul 20 13:47:54.147195 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:54.147160    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="323fe799-21f0-4d05-bfa2-0f9142c1fb0c" path="/var/lib/kubelet/pods/323fe799-21f0-4d05-bfa2-0f9142c1fb0c/volumes"
Jul 20 13:47:54.911228 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:54.911191    2565 generic.go:356] "Generic (PLEG): container finished" podID="e53ce20a-164b-4b6a-82c5-af9efd0d7f22" containerID="a809675553fcd91f2b7c82a741b4e6acf8840cabd27dce7c8c482a4f9624bb7d" exitCode=0
Jul 20 13:47:54.911685 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:54.911279    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7719-140176945222976" event={"ID":"e53ce20a-164b-4b6a-82c5-af9efd0d7f22","Type":"ContainerDied","Data":"a809675553fcd91f2b7c82a741b4e6acf8840cabd27dce7c8c482a4f9624bb7d"}
Jul 20 13:47:56.052674 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:56.052646    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7719-140176945222976"
Jul 20 13:47:56.088082 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:56.088049    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7719-140176945222976_e53ce20a-164b-4b6a-82c5-af9efd0d7f22/test-curl-7719-140176945222976/0.log"
Jul 20 13:47:56.123697 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:56.123663    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7719-140176945222976"]
Jul 20 13:47:56.127194 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:56.127167    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7719-140176945222976"]
Jul 20 13:47:56.141328 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:56.141310    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jl7qm\" (UniqueName: \"kubernetes.io/projected/e53ce20a-164b-4b6a-82c5-af9efd0d7f22-kube-api-access-jl7qm\") pod \"e53ce20a-164b-4b6a-82c5-af9efd0d7f22\" (UID: \"e53ce20a-164b-4b6a-82c5-af9efd0d7f22\") "
Jul 20 13:47:56.143308 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:56.143283    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e53ce20a-164b-4b6a-82c5-af9efd0d7f22-kube-api-access-jl7qm" (OuterVolumeSpecName: "kube-api-access-jl7qm") pod "e53ce20a-164b-4b6a-82c5-af9efd0d7f22" (UID: "e53ce20a-164b-4b6a-82c5-af9efd0d7f22"). InnerVolumeSpecName "kube-api-access-jl7qm". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 20 13:47:56.147839 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:56.147812    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e53ce20a-164b-4b6a-82c5-af9efd0d7f22" path="/var/lib/kubelet/pods/e53ce20a-164b-4b6a-82c5-af9efd0d7f22/volumes"
Jul 20 13:47:56.242969 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:56.242882    2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jl7qm\" (UniqueName: \"kubernetes.io/projected/e53ce20a-164b-4b6a-82c5-af9efd0d7f22-kube-api-access-jl7qm\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:47:56.400674 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:56.400637    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-5e9fd6-92jwh"]
Jul 20 13:47:56.400979 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:56.400966    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e53ce20a-164b-4b6a-82c5-af9efd0d7f22" containerName="test-curl-7719-140176945222976"
Jul 20 13:47:56.401037 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:56.400981    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="e53ce20a-164b-4b6a-82c5-af9efd0d7f22" containerName="test-curl-7719-140176945222976"
Jul 20 13:47:56.401074 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:56.401047    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="e53ce20a-164b-4b6a-82c5-af9efd0d7f22" containerName="test-curl-7719-140176945222976"
Jul 20 13:47:56.404265 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:56.404247    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-5e9fd6-92jwh"
Jul 20 13:47:56.416053 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:56.416035    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zcsfd\""
Jul 20 13:47:56.416144 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:56.416099    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 13:47:56.421575 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:56.421545    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-5e9fd6-92jwh"]
Jul 20 13:47:56.444835 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:56.444803    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d137e31-a950-43ca-acb0-3566d30ac442-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-5e9fd6-92jwh\" (UID: \"9d137e31-a950-43ca-acb0-3566d30ac442\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-5e9fd6-92jwh"
Jul 20 13:47:56.545561 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:56.545470    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d137e31-a950-43ca-acb0-3566d30ac442-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-5e9fd6-92jwh\" (UID: \"9d137e31-a950-43ca-acb0-3566d30ac442\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-5e9fd6-92jwh"
Jul 20 13:47:56.546115 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:56.546093    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d137e31-a950-43ca-acb0-3566d30ac442-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-5e9fd6-92jwh\" (UID: \"9d137e31-a950-43ca-acb0-3566d30ac442\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-5e9fd6-92jwh"
Jul 20 13:47:56.714202 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:56.714172    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-5e9fd6-92jwh"
Jul 20 13:47:56.848175 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:56.848146    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-5e9fd6-92jwh"]
Jul 20 13:47:56.849463 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:47:56.849436    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9d137e31_a950_43ca_acb0_3566d30ac442.slice/crio-10c09186970520f5bccd413f95356701fbf63e847b7f7478169f7923b1a67cc7 WatchSource:0}: Error finding container 10c09186970520f5bccd413f95356701fbf63e847b7f7478169f7923b1a67cc7: Status 404 returned error can't find the container with id 10c09186970520f5bccd413f95356701fbf63e847b7f7478169f7923b1a67cc7
Jul 20 13:47:56.922903 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:56.922878    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7719-140176945222976"
Jul 20 13:47:56.923053 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:56.922889    2565 scope.go:117] "RemoveContainer" containerID="a809675553fcd91f2b7c82a741b4e6acf8840cabd27dce7c8c482a4f9624bb7d"
Jul 20 13:47:56.924415 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:56.924391    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-5e9fd6-92jwh" event={"ID":"9d137e31-a950-43ca-acb0-3566d30ac442","Type":"ContainerStarted","Data":"10c09186970520f5bccd413f95356701fbf63e847b7f7478169f7923b1a67cc7"}
Jul 20 13:47:57.393053 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:57.392991    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:47:57.501894 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:57.501782    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:47:57.935122 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:57.935087    2565 generic.go:356] "Generic (PLEG): container finished" podID="9d137e31-a950-43ca-acb0-3566d30ac442" containerID="2ceb4233084989fbb4343266c323d969e2afb6062c97eb61c90c311dee153d36" exitCode=0
Jul 20 13:47:57.935291 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:57.935172    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-5e9fd6-92jwh" event={"ID":"9d137e31-a950-43ca-acb0-3566d30ac442","Type":"ContainerDied","Data":"2ceb4233084989fbb4343266c323d969e2afb6062c97eb61c90c311dee153d36"}
Jul 20 13:47:59.070111 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:59.070087    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-5e9fd6-92jwh"
Jul 20 13:47:59.170218 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:59.170187    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d137e31-a950-43ca-acb0-3566d30ac442-maas-api-service-ca\") pod \"9d137e31-a950-43ca-acb0-3566d30ac442\" (UID: \"9d137e31-a950-43ca-acb0-3566d30ac442\") "
Jul 20 13:47:59.170542 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:59.170521    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9d137e31-a950-43ca-acb0-3566d30ac442-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "9d137e31-a950-43ca-acb0-3566d30ac442" (UID: "9d137e31-a950-43ca-acb0-3566d30ac442"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:47:59.271818 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:59.271732    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/9d137e31-a950-43ca-acb0-3566d30ac442-maas-api-service-ca\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:47:59.947182 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:59.947154    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-5e9fd6-92jwh"
Jul 20 13:47:59.947182 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:59.947169    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-5e9fd6-92jwh" event={"ID":"9d137e31-a950-43ca-acb0-3566d30ac442","Type":"ContainerDied","Data":"10c09186970520f5bccd413f95356701fbf63e847b7f7478169f7923b1a67cc7"}
Jul 20 13:47:59.947450 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:47:59.947219    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="10c09186970520f5bccd413f95356701fbf63e847b7f7478169f7923b1a67cc7"
Jul 20 13:48:07.156570 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:07.156537    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:48:07.165642 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:07.165614    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-5e9fd6-29742585-cvrtn"]
Jul 20 13:48:07.170957 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:07.170924    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-5e9fd6-29742585-cvrtn"]
Jul 20 13:48:08.147404 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:08.147352    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2b619a47-f268-4cb4-aec4-161fc897e238" path="/var/lib/kubelet/pods/2b619a47-f268-4cb4-aec4-161fc897e238/volumes"
Jul 20 13:48:10.953672 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:10.953639    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:48:11.507691 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:11.507658    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:48:17.575553 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:17.575512    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:48:17.631913 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:17.631856    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:48:22.297773 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:22.297737    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:48:22.582845 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:22.582735    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:48:22.725936 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:22.725886    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a69896-rcw8z"]
Jul 20 13:48:22.726237 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:22.726224    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9d137e31-a950-43ca-acb0-3566d30ac442" containerName="revoke-keys"
Jul 20 13:48:22.726281 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:22.726238    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9d137e31-a950-43ca-acb0-3566d30ac442" containerName="revoke-keys"
Jul 20 13:48:22.726321 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:22.726298    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9d137e31-a950-43ca-acb0-3566d30ac442" containerName="revoke-keys"
Jul 20 13:48:22.729225 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:22.729207    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a69896-rcw8z"
Jul 20 13:48:22.732020 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:22.731991    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-zcsfd\""
Jul 20 13:48:22.732441 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:22.732420    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 20 13:48:22.740987 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:22.740965    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a69896-rcw8z"]
Jul 20 13:48:22.876407 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:22.876341    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e67f981-a2fc-4a1a-86e0-216a032603c3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-a69896-rcw8z\" (UID: \"8e67f981-a2fc-4a1a-86e0-216a032603c3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a69896-rcw8z"
Jul 20 13:48:22.977286 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:22.977257    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e67f981-a2fc-4a1a-86e0-216a032603c3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-a69896-rcw8z\" (UID: \"8e67f981-a2fc-4a1a-86e0-216a032603c3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a69896-rcw8z"
Jul 20 13:48:22.977937 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:22.977917    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e67f981-a2fc-4a1a-86e0-216a032603c3-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-a69896-rcw8z\" (UID: \"8e67f981-a2fc-4a1a-86e0-216a032603c3\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a69896-rcw8z"
Jul 20 13:48:23.040352 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:23.040305    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a69896-rcw8z"
Jul 20 13:48:23.174055 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:23.174028    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a69896-rcw8z"]
Jul 20 13:48:23.176547 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:48:23.176511    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e67f981_a2fc_4a1a_86e0_216a032603c3.slice/crio-b27f3d7009faf67cc7c2b88e4b27b94a3ab54db0e533ce35ea7db3b62d004105 WatchSource:0}: Error finding container b27f3d7009faf67cc7c2b88e4b27b94a3ab54db0e533ce35ea7db3b62d004105: Status 404 returned error can't find the container with id b27f3d7009faf67cc7c2b88e4b27b94a3ab54db0e533ce35ea7db3b62d004105
Jul 20 13:48:23.413982 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:23.413953    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:48:23.517484 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:23.517397    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:48:24.090280 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:24.090244    2565 generic.go:356] "Generic (PLEG): container finished" podID="8e67f981-a2fc-4a1a-86e0-216a032603c3" containerID="6d3adb5481031c0f0c756ba2aba99ffd0f92710dd3ffda3d3aa6405ddf7068f6" exitCode=0
Jul 20 13:48:24.090466 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:24.090331    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a69896-rcw8z" event={"ID":"8e67f981-a2fc-4a1a-86e0-216a032603c3","Type":"ContainerDied","Data":"6d3adb5481031c0f0c756ba2aba99ffd0f92710dd3ffda3d3aa6405ddf7068f6"}
Jul 20 13:48:24.090466 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:24.090406    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a69896-rcw8z" event={"ID":"8e67f981-a2fc-4a1a-86e0-216a032603c3","Type":"ContainerStarted","Data":"b27f3d7009faf67cc7c2b88e4b27b94a3ab54db0e533ce35ea7db3b62d004105"}
Jul 20 13:48:25.227227 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:25.227202    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a69896-rcw8z"
Jul 20 13:48:25.397177 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:25.397145    2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e67f981-a2fc-4a1a-86e0-216a032603c3-maas-api-service-ca\") pod \"8e67f981-a2fc-4a1a-86e0-216a032603c3\" (UID: \"8e67f981-a2fc-4a1a-86e0-216a032603c3\") "
Jul 20 13:48:25.397549 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:25.397528    2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e67f981-a2fc-4a1a-86e0-216a032603c3-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "8e67f981-a2fc-4a1a-86e0-216a032603c3" (UID: "8e67f981-a2fc-4a1a-86e0-216a032603c3"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 20 13:48:25.498185 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:25.498149    2565 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e67f981-a2fc-4a1a-86e0-216a032603c3-maas-api-service-ca\") on node \"ip-10-0-141-182.ec2.internal\" DevicePath \"\""
Jul 20 13:48:26.102429 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:26.102390    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a69896-rcw8z" event={"ID":"8e67f981-a2fc-4a1a-86e0-216a032603c3","Type":"ContainerDied","Data":"b27f3d7009faf67cc7c2b88e4b27b94a3ab54db0e533ce35ea7db3b62d004105"}
Jul 20 13:48:26.102429 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:26.102412    2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-a69896-rcw8z"
Jul 20 13:48:26.102699 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:26.102462    2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b27f3d7009faf67cc7c2b88e4b27b94a3ab54db0e533ce35ea7db3b62d004105"
Jul 20 13:48:33.232964 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:33.232911    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:48:33.233393 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:33.233190    2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-a69896-29742585-wdc2v"]
Jul 20 13:48:33.235477 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:33.235455    2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-a69896-29742585-wdc2v"]
Jul 20 13:48:34.147276 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:34.147238    2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dce2332b-a43a-442a-b573-105fed6b49b7" path="/var/lib/kubelet/pods/dce2332b-a43a-442a-b573-105fed6b49b7/volumes"
Jul 20 13:48:36.317446 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:36.317407    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-rqn5h"]
Jul 20 13:48:37.822909 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:37.822870    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:48:44.093767 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:44.093724    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:48:44.149749 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:44.149711    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:48:48.561549 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:48.561511    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:48:48.777311 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:48.777260    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:48:55.322450 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:55.322418    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-jj2ts_43326e41-9683-41e8-b6f8-4582eb4790ff/manager/0.log"
Jul 20 13:48:55.818100 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:55.818072    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85766d874c-9fqjb_a115c00e-4e1b-4c5d-9ebd-c7d6e3dcfd45/copy-manifests/0.log"
Jul 20 13:48:55.826164 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:55.826135    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85766d874c-9fqjb_a115c00e-4e1b-4c5d-9ebd-c7d6e3dcfd45/manager/0.log"
Jul 20 13:48:56.733285 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:56.733255    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29742570-nnx4v_d44b2c95-fcc8-4374-8486-dccd5ca4c5a4/cleanup/0.log"
Jul 20 13:48:56.849872 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:56.849844    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29742585-ts7gn_dbb5b220-5752-4836-9b46-bc790f4eb599/cleanup/0.log"
Jul 20 13:48:56.970325 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:56.970295    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-22b1bd43-md74d_e9ad15a1-b72b-402b-87a9-ebc997a55aa2/revoke-keys/0.log"
Jul 20 13:48:57.079934 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:57.079852    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-7291c4b7-sw5lk_4f53aef2-7f46-4a7a-8ebe-5f4f6cd4fe89/revoke-keys/1.log"
Jul 20 13:48:57.201741 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:57.201711    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-a-15a544-n8qtn_87429dfd-3e0d-46de-9e49-071c1131c61f/revoke-keys/0.log"
Jul 20 13:48:57.311079 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:57.311051    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-b-b738bb-fmhzt_6fe7883c-0115-44b3-805e-f30e6f2fe26a/revoke-keys/0.log"
Jul 20 13:48:57.430677 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:57.430653    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-derive-704386e9-wwhrx_44314865-7114-44d4-952e-446f145fcee7/revoke-keys/0.log"
Jul 20 13:48:57.549730 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:57.549700    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-a-5ce595-q59lw_be2bccc4-eddc-438a-bd93-582a4cf25fc5/revoke-keys/0.log"
Jul 20 13:48:57.671116 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:57.671090    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-b-fc9057-jmvtr_3e05423f-7085-4b1d-9986-da8ac694f9ca/revoke-keys/0.log"
Jul 20 13:48:57.784634 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:57.784555    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-migrate-dc1ba087-vktmj_caecd64e-3192-488c-a72f-cba21453886c/revoke-keys/0.log"
Jul 20 13:48:57.904256 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:57.904230    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-28e80ad8-vnmsk_301c0c19-6d54-44ee-b619-ca7ef8ab0479/revoke-keys/0.log"
Jul 20 13:48:58.030602 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:58.030572    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-aba71aa1-cr6qx_b3749aad-3a40-4d34-b4e5-4ff8ec3ce780/revoke-keys/0.log"
Jul 20 13:48:58.155895 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:58.155869    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-a-5e9fd6-92jwh_9d137e31-a950-43ca-acb0-3566d30ac442/revoke-keys/0.log"
Jul 20 13:48:58.290867 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:58.290836    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-b-a69896-rcw8z_8e67f981-a2fc-4a1a-86e0-216a032603c3/revoke-keys/0.log"
Jul 20 13:48:59.234862 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:59.234824    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592b2tj_86461128-7b52-486f-9e6f-6c557854d45e/pull/0.log"
Jul 20 13:48:59.241827 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:59.241799    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592b2tj_86461128-7b52-486f-9e6f-6c557854d45e/extract/0.log"
Jul 20 13:48:59.248573 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:59.248550    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592b2tj_86461128-7b52-486f-9e6f-6c557854d45e/util/0.log"
Jul 20 13:48:59.370998 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:59.370973    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwrlk_d02fb4bd-8b6a-4feb-9290-8c8f23e9a770/util/0.log"
Jul 20 13:48:59.378999 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:59.378974    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwrlk_d02fb4bd-8b6a-4feb-9290-8c8f23e9a770/pull/0.log"
Jul 20 13:48:59.390340 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:59.390321    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwrlk_d02fb4bd-8b6a-4feb-9290-8c8f23e9a770/extract/0.log"
Jul 20 13:48:59.514718 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:59.514651    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fbnlh_da3ca765-f6e9-4de4-b14f-da895187dc8a/util/0.log"
Jul 20 13:48:59.526248 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:59.526227    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fbnlh_da3ca765-f6e9-4de4-b14f-da895187dc8a/pull/0.log"
Jul 20 13:48:59.540097 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:59.540080    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fbnlh_da3ca765-f6e9-4de4-b14f-da895187dc8a/extract/0.log"
Jul 20 13:48:59.670056 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:59.670023    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rczz4_c69d34f8-9dd2-4b23-a74d-50ccf4908e71/util/0.log"
Jul 20 13:48:59.678455 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:59.678431    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rczz4_c69d34f8-9dd2-4b23-a74d-50ccf4908e71/pull/0.log"
Jul 20 13:48:59.686438 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:48:59.686421    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rczz4_c69d34f8-9dd2-4b23-a74d-50ccf4908e71/extract/0.log"
Jul 20 13:49:00.055814 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:00.055780    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-t4n9j_b1137bca-71d8-42ca-b067-705ccd70b38d/manager/2.log"
Jul 20 13:49:00.428611 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:00.428583    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-pkzkq_76f9c88c-c07f-4dbd-a3de-00a9f1642745/manager/0.log"
Jul 20 13:49:00.545578 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:00.545550    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-rqn5h_bbbf337f-cc05-4c32-ad56-d281516be96d/limitador/0.log"
Jul 20 13:49:00.676046 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:00.676015    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-5mrn2_c55138aa-6fb6-495e-9a24-ef1561579329/manager/0.log"
Jul 20 13:49:01.147879 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:01.147845    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-xcsst_acfd6445-aa5e-4353-ac49-245efb12fd9c/discovery/0.log"
Jul 20 13:49:01.269627 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:01.269594    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7bb65f5cb7-h75tq_6eca5b4b-df68-40f8-a84e-8c074aa8e4a3/kube-auth-proxy/0.log"
Jul 20 13:49:02.723836 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:02.723807    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-6b86dbdt95k_638ef82a-8a28-4c0b-b3d0-0cba18596be4/main/0.log"
Jul 20 13:49:08.012311 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:08.012272    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:49:08.069534 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:08.069497    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:49:09.136459 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:09.136422    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rqnpn/must-gather-9b22c"]
Jul 20 13:49:09.136884 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:09.136774    2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e67f981-a2fc-4a1a-86e0-216a032603c3" containerName="revoke-keys"
Jul 20 13:49:09.136884 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:09.136785    2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e67f981-a2fc-4a1a-86e0-216a032603c3" containerName="revoke-keys"
Jul 20 13:49:09.136884 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:09.136853    2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e67f981-a2fc-4a1a-86e0-216a032603c3" containerName="revoke-keys"
Jul 20 13:49:09.140369 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:09.140337    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rqnpn/must-gather-9b22c"
Jul 20 13:49:09.143156 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:09.143131    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rqnpn\"/\"kube-root-ca.crt\""
Jul 20 13:49:09.144546 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:09.144522    2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-rqnpn\"/\"openshift-service-ca.crt\""
Jul 20 13:49:09.144656 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:09.144534    2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-rqnpn\"/\"default-dockercfg-9dmdv\""
Jul 20 13:49:09.148220 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:09.148126    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:49:09.149405 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:09.149382    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rqnpn/must-gather-9b22c"]
Jul 20 13:49:09.247187 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:09.247152    2565 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log" limit=1024
Jul 20 13:49:09.260284 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:09.260252    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xtbzj\" (UniqueName: \"kubernetes.io/projected/e247f844-dd50-4221-8de9-5cb2ae32291b-kube-api-access-xtbzj\") pod \"must-gather-9b22c\" (UID: \"e247f844-dd50-4221-8de9-5cb2ae32291b\") " pod="openshift-must-gather-rqnpn/must-gather-9b22c"
Jul 20 13:49:09.260461 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:09.260326    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e247f844-dd50-4221-8de9-5cb2ae32291b-must-gather-output\") pod \"must-gather-9b22c\" (UID: \"e247f844-dd50-4221-8de9-5cb2ae32291b\") " pod="openshift-must-gather-rqnpn/must-gather-9b22c"
Jul 20 13:49:09.361539 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:09.361509    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xtbzj\" (UniqueName: \"kubernetes.io/projected/e247f844-dd50-4221-8de9-5cb2ae32291b-kube-api-access-xtbzj\") pod \"must-gather-9b22c\" (UID: \"e247f844-dd50-4221-8de9-5cb2ae32291b\") " pod="openshift-must-gather-rqnpn/must-gather-9b22c"
Jul 20 13:49:09.361712 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:09.361573    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e247f844-dd50-4221-8de9-5cb2ae32291b-must-gather-output\") pod \"must-gather-9b22c\" (UID: \"e247f844-dd50-4221-8de9-5cb2ae32291b\") " pod="openshift-must-gather-rqnpn/must-gather-9b22c"
Jul 20 13:49:09.361892 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:09.361870    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/e247f844-dd50-4221-8de9-5cb2ae32291b-must-gather-output\") pod \"must-gather-9b22c\" (UID: \"e247f844-dd50-4221-8de9-5cb2ae32291b\") " pod="openshift-must-gather-rqnpn/must-gather-9b22c"
Jul 20 13:49:09.370428 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:09.370407    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xtbzj\" (UniqueName: \"kubernetes.io/projected/e247f844-dd50-4221-8de9-5cb2ae32291b-kube-api-access-xtbzj\") pod \"must-gather-9b22c\" (UID: \"e247f844-dd50-4221-8de9-5cb2ae32291b\") " pod="openshift-must-gather-rqnpn/must-gather-9b22c"
Jul 20 13:49:09.451753 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:09.451674    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rqnpn/must-gather-9b22c"
Jul 20 13:49:09.581007 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:09.580979    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rqnpn/must-gather-9b22c"]
Jul 20 13:49:09.582075 ip-10-0-141-182 kubenswrapper[2565]: W0720 13:49:09.582049    2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode247f844_dd50_4221_8de9_5cb2ae32291b.slice/crio-2408f0fca7d5d1eb1a3a056fe31e0be3baaf007fe65cd8e0f3182df6ce9d7474 WatchSource:0}: Error finding container 2408f0fca7d5d1eb1a3a056fe31e0be3baaf007fe65cd8e0f3182df6ce9d7474: Status 404 returned error can't find the container with id 2408f0fca7d5d1eb1a3a056fe31e0be3baaf007fe65cd8e0f3182df6ce9d7474
Jul 20 13:49:10.356716 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:10.356672    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rqnpn/must-gather-9b22c" event={"ID":"e247f844-dd50-4221-8de9-5cb2ae32291b","Type":"ContainerStarted","Data":"2408f0fca7d5d1eb1a3a056fe31e0be3baaf007fe65cd8e0f3182df6ce9d7474"}
Jul 20 13:49:11.364351 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:11.364310    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rqnpn/must-gather-9b22c" event={"ID":"e247f844-dd50-4221-8de9-5cb2ae32291b","Type":"ContainerStarted","Data":"9fa30a013898baefbbf45f98d19fc2b4d2b1d4f054534f9bd7cc7392fedad8be"}
Jul 20 13:49:11.364843 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:11.364386    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rqnpn/must-gather-9b22c" event={"ID":"e247f844-dd50-4221-8de9-5cb2ae32291b","Type":"ContainerStarted","Data":"521b10aa25ba6de3b9ffd2ab78e50a9a758541d39326da47515d7146f5d4f6cc"}
Jul 20 13:49:11.382280 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:11.382226    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rqnpn/must-gather-9b22c" podStartSLOduration=1.405340523 podStartE2EDuration="2.382208605s" totalImagesPullingTime="976.868082ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-20 13:49:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:49:11.380059753 +0000 UTC m=+2857.849591864" watchObservedRunningTime="2026-07-20 13:49:11.382208605 +0000 UTC m=+2857.851740703"
Jul 20 13:49:12.191874 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:12.191844    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-bjz6v_52b5f0c9-be3d-4f5e-b48c-0ca9b220b03d/global-pull-secret-syncer/0.log"
Jul 20 13:49:12.296146 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:12.296119    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-7mhbt_84be7850-b3b8-49a2-899f-5d16ab5a0de4/konnectivity-agent/0.log"
Jul 20 13:49:12.438194 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:12.438158    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-141-182.ec2.internal_b9336d48ae54902b2478c38cf3608a5e/haproxy/0.log"
Jul 20 13:49:17.415028 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:17.414990    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592b2tj_86461128-7b52-486f-9e6f-6c557854d45e/extract/0.log"
Jul 20 13:49:17.447798 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:17.447589    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592b2tj_86461128-7b52-486f-9e6f-6c557854d45e/util/0.log"
Jul 20 13:49:17.469465 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:17.469434    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b7592b2tj_86461128-7b52-486f-9e6f-6c557854d45e/pull/0.log"
Jul 20 13:49:17.498701 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:17.498650    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwrlk_d02fb4bd-8b6a-4feb-9290-8c8f23e9a770/extract/0.log"
Jul 20 13:49:17.523991 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:17.523965    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwrlk_d02fb4bd-8b6a-4feb-9290-8c8f23e9a770/util/0.log"
Jul 20 13:49:17.548078 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:17.548037    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0pwrlk_d02fb4bd-8b6a-4feb-9290-8c8f23e9a770/pull/0.log"
Jul 20 13:49:17.578491 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:17.578445    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fbnlh_da3ca765-f6e9-4de4-b14f-da895187dc8a/extract/0.log"
Jul 20 13:49:17.637659 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:17.637632    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fbnlh_da3ca765-f6e9-4de4-b14f-da895187dc8a/util/0.log"
Jul 20 13:49:17.684980 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:17.684872    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73fbnlh_da3ca765-f6e9-4de4-b14f-da895187dc8a/pull/0.log"
Jul 20 13:49:17.717463 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:17.717426    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rczz4_c69d34f8-9dd2-4b23-a74d-50ccf4908e71/extract/0.log"
Jul 20 13:49:17.761052 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:17.761024    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rczz4_c69d34f8-9dd2-4b23-a74d-50ccf4908e71/util/0.log"
Jul 20 13:49:17.781569 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:17.781538    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rczz4_c69d34f8-9dd2-4b23-a74d-50ccf4908e71/pull/0.log"
Jul 20 13:49:18.158068 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:18.158030    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-t4n9j_b1137bca-71d8-42ca-b067-705ccd70b38d/manager/2.log"
Jul 20 13:49:18.167268 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:18.167234    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-t4n9j_b1137bca-71d8-42ca-b067-705ccd70b38d/manager/1.log"
Jul 20 13:49:18.656352 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:18.656306    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-pkzkq_76f9c88c-c07f-4dbd-a3de-00a9f1642745/manager/0.log"
Jul 20 13:49:18.682060 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:18.682028    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-rqn5h_bbbf337f-cc05-4c32-ad56-d281516be96d/limitador/0.log"
Jul 20 13:49:18.775613 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:18.775576    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-5mrn2_c55138aa-6fb6-495e-9a24-ef1561579329/manager/0.log"
Jul 20 13:49:20.760237 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:20.760212    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qx9vr_9abbe951-1217-4b84-9adc-eb7acd175e15/node-exporter/0.log"
Jul 20 13:49:20.787915 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:20.787887    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qx9vr_9abbe951-1217-4b84-9adc-eb7acd175e15/kube-rbac-proxy/0.log"
Jul 20 13:49:20.811399 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:20.811323    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-qx9vr_9abbe951-1217-4b84-9adc-eb7acd175e15/init-textfile/0.log"
Jul 20 13:49:21.961034 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:21.960978    2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-rqnpn/perf-node-gather-daemonset-ddzf7"]
Jul 20 13:49:21.966847 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:21.966816    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rqnpn/perf-node-gather-daemonset-ddzf7"
Jul 20 13:49:21.974642 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:21.974614    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rqnpn/perf-node-gather-daemonset-ddzf7"]
Jul 20 13:49:22.086705 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:22.086670    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spbr2\" (UniqueName: \"kubernetes.io/projected/09d4fb18-ca4c-4775-95a3-6da38cc2aa28-kube-api-access-spbr2\") pod \"perf-node-gather-daemonset-ddzf7\" (UID: \"09d4fb18-ca4c-4775-95a3-6da38cc2aa28\") " pod="openshift-must-gather-rqnpn/perf-node-gather-daemonset-ddzf7"
Jul 20 13:49:22.087018 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:22.086998    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/09d4fb18-ca4c-4775-95a3-6da38cc2aa28-proc\") pod \"perf-node-gather-daemonset-ddzf7\" (UID: \"09d4fb18-ca4c-4775-95a3-6da38cc2aa28\") " pod="openshift-must-gather-rqnpn/perf-node-gather-daemonset-ddzf7"
Jul 20 13:49:22.087181 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:22.087167    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/09d4fb18-ca4c-4775-95a3-6da38cc2aa28-podres\") pod \"perf-node-gather-daemonset-ddzf7\" (UID: \"09d4fb18-ca4c-4775-95a3-6da38cc2aa28\") " pod="openshift-must-gather-rqnpn/perf-node-gather-daemonset-ddzf7"
Jul 20 13:49:22.087327 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:22.087299    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/09d4fb18-ca4c-4775-95a3-6da38cc2aa28-sys\") pod \"perf-node-gather-daemonset-ddzf7\" (UID: \"09d4fb18-ca4c-4775-95a3-6da38cc2aa28\") " pod="openshift-must-gather-rqnpn/perf-node-gather-daemonset-ddzf7"
Jul 20 13:49:22.087511 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:22.087495    2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/09d4fb18-ca4c-4775-95a3-6da38cc2aa28-lib-modules\") pod \"perf-node-gather-daemonset-ddzf7\" (UID: \"09d4fb18-ca4c-4775-95a3-6da38cc2aa28\") " pod="openshift-must-gather-rqnpn/perf-node-gather-daemonset-ddzf7"
Jul 20 13:49:22.188612 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:22.188575    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/09d4fb18-ca4c-4775-95a3-6da38cc2aa28-lib-modules\") pod \"perf-node-gather-daemonset-ddzf7\" (UID: \"09d4fb18-ca4c-4775-95a3-6da38cc2aa28\") " pod="openshift-must-gather-rqnpn/perf-node-gather-daemonset-ddzf7"
Jul 20 13:49:22.188816 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:22.188675    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spbr2\" (UniqueName: \"kubernetes.io/projected/09d4fb18-ca4c-4775-95a3-6da38cc2aa28-kube-api-access-spbr2\") pod \"perf-node-gather-daemonset-ddzf7\" (UID: \"09d4fb18-ca4c-4775-95a3-6da38cc2aa28\") " pod="openshift-must-gather-rqnpn/perf-node-gather-daemonset-ddzf7"
Jul 20 13:49:22.188816 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:22.188724    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/09d4fb18-ca4c-4775-95a3-6da38cc2aa28-proc\") pod \"perf-node-gather-daemonset-ddzf7\" (UID: \"09d4fb18-ca4c-4775-95a3-6da38cc2aa28\") " pod="openshift-must-gather-rqnpn/perf-node-gather-daemonset-ddzf7"
Jul 20 13:49:22.188816 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:22.188771    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/09d4fb18-ca4c-4775-95a3-6da38cc2aa28-podres\") pod \"perf-node-gather-daemonset-ddzf7\" (UID: \"09d4fb18-ca4c-4775-95a3-6da38cc2aa28\") " pod="openshift-must-gather-rqnpn/perf-node-gather-daemonset-ddzf7"
Jul 20 13:49:22.188816 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:22.188800    2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/09d4fb18-ca4c-4775-95a3-6da38cc2aa28-sys\") pod \"perf-node-gather-daemonset-ddzf7\" (UID: \"09d4fb18-ca4c-4775-95a3-6da38cc2aa28\") " pod="openshift-must-gather-rqnpn/perf-node-gather-daemonset-ddzf7"
Jul 20 13:49:22.188816 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:22.188805    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/09d4fb18-ca4c-4775-95a3-6da38cc2aa28-lib-modules\") pod \"perf-node-gather-daemonset-ddzf7\" (UID: \"09d4fb18-ca4c-4775-95a3-6da38cc2aa28\") " pod="openshift-must-gather-rqnpn/perf-node-gather-daemonset-ddzf7"
Jul 20 13:49:22.189087 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:22.188881    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/09d4fb18-ca4c-4775-95a3-6da38cc2aa28-sys\") pod \"perf-node-gather-daemonset-ddzf7\" (UID: \"09d4fb18-ca4c-4775-95a3-6da38cc2aa28\") " pod="openshift-must-gather-rqnpn/perf-node-gather-daemonset-ddzf7"
Jul 20 13:49:22.189087 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:22.188884    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/09d4fb18-ca4c-4775-95a3-6da38cc2aa28-proc\") pod \"perf-node-gather-daemonset-ddzf7\" (UID: \"09d4fb18-ca4c-4775-95a3-6da38cc2aa28\") " pod="openshift-must-gather-rqnpn/perf-node-gather-daemonset-ddzf7"
Jul 20 13:49:22.189087 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:22.188969    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/09d4fb18-ca4c-4775-95a3-6da38cc2aa28-podres\") pod \"perf-node-gather-daemonset-ddzf7\" (UID: \"09d4fb18-ca4c-4775-95a3-6da38cc2aa28\") " pod="openshift-must-gather-rqnpn/perf-node-gather-daemonset-ddzf7"
Jul 20 13:49:22.197670 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:22.197643    2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-spbr2\" (UniqueName: \"kubernetes.io/projected/09d4fb18-ca4c-4775-95a3-6da38cc2aa28-kube-api-access-spbr2\") pod \"perf-node-gather-daemonset-ddzf7\" (UID: \"09d4fb18-ca4c-4775-95a3-6da38cc2aa28\") " pod="openshift-must-gather-rqnpn/perf-node-gather-daemonset-ddzf7"
Jul 20 13:49:22.281649 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:22.281564    2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-rqnpn/perf-node-gather-daemonset-ddzf7"
Jul 20 13:49:22.463688 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:22.463653    2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-rqnpn/perf-node-gather-daemonset-ddzf7"]
Jul 20 13:49:22.599633 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:22.599608    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-7bc7489cb5-6vnq5_78ce2a9b-e1a5-4df6-be68-ca04931668b0/networking-console-plugin/0.log"
Jul 20 13:49:23.474143 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:23.474103    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rqnpn/perf-node-gather-daemonset-ddzf7" event={"ID":"09d4fb18-ca4c-4775-95a3-6da38cc2aa28","Type":"ContainerStarted","Data":"65743870e3a65420f805f9583fa8e2962c48429c14d6fddd9a061e26b165a8b9"}
Jul 20 13:49:23.474741 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:23.474715    2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-rqnpn/perf-node-gather-daemonset-ddzf7" event={"ID":"09d4fb18-ca4c-4775-95a3-6da38cc2aa28","Type":"ContainerStarted","Data":"554981d08a32b46b712b3a4f33de3b767d0f21f78ca84042d119d00512388e42"}
Jul 20 13:49:23.474910 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:23.474887    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-rqnpn/perf-node-gather-daemonset-ddzf7"
Jul 20 13:49:23.495393 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:23.495328    2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-rqnpn/perf-node-gather-daemonset-ddzf7" podStartSLOduration=2.495306363 podStartE2EDuration="2.495306363s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-20 13:49:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-20 13:49:23.494032169 +0000 UTC m=+2869.963564300" watchObservedRunningTime="2026-07-20 13:49:23.495306363 +0000 UTC m=+2869.964838482"
Jul 20 13:49:23.588257 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:23.588227    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-59c54cddf5-lm4r9_f677328c-d638-4a53-8f6e-cc4db0a73962/console/0.log"
Jul 20 13:49:23.624900 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:23.624871    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-5bc67dcd46-hdrtd_57b69627-e508-4aeb-aaec-8e1b461801bd/download-server/0.log"
Jul 20 13:49:25.328460 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:25.328425    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ng67n_0156bad2-0fcf-4d37-b346-ff5f28f2890c/dns/0.log"
Jul 20 13:49:25.368348 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:25.368318    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ng67n_0156bad2-0fcf-4d37-b346-ff5f28f2890c/kube-rbac-proxy/0.log"
Jul 20 13:49:25.568465 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:25.568388    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lsrxw_bf9a432f-9b17-467c-826d-50f1ce4cfd7c/dns-node-resolver/0.log"
Jul 20 13:49:26.109951 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:26.109920    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-764fd46654-nbjvw_e0063734-fb88-4cdd-a12a-0961449f8e66/registry/0.log"
Jul 20 13:49:26.175823 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:26.175784    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-dcnn2_2e3cfb74-ae63-457e-abb7-fc0e5f459dbb/node-ca/0.log"
Jul 20 13:49:27.262542 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:27.262492    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-xcsst_acfd6445-aa5e-4353-ac49-245efb12fd9c/discovery/0.log"
Jul 20 13:49:27.282928 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:27.282903    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7bb65f5cb7-h75tq_6eca5b4b-df68-40f8-a84e-8c074aa8e4a3/kube-auth-proxy/0.log"
Jul 20 13:49:28.203876 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:28.203848    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-dnpn2_67795910-26cd-41e8-9c3d-a55eb900657e/serve-healthcheck-canary/0.log"
Jul 20 13:49:28.777088 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:28.777063    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-c4l5l_0a8fb30e-8f10-43ba-8934-017ae9f76a57/kube-rbac-proxy/0.log"
Jul 20 13:49:28.802635 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:28.802590    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-c4l5l_0a8fb30e-8f10-43ba-8934-017ae9f76a57/exporter/0.log"
Jul 20 13:49:28.827769 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:28.827717    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-c4l5l_0a8fb30e-8f10-43ba-8934-017ae9f76a57/extractor/0.log"
Jul 20 13:49:29.493227 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:29.493196    2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-rqnpn/perf-node-gather-daemonset-ddzf7"
Jul 20 13:49:31.377681 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:31.377646    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-jj2ts_43326e41-9683-41e8-b6f8-4582eb4790ff/manager/0.log"
Jul 20 13:49:31.601074 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:31.601043    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85766d874c-9fqjb_a115c00e-4e1b-4c5d-9ebd-c7d6e3dcfd45/manager/0.log"
Jul 20 13:49:31.621621 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:31.621592    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-85766d874c-9fqjb_a115c00e-4e1b-4c5d-9ebd-c7d6e3dcfd45/copy-manifests/0.log"
Jul 20 13:49:32.706426 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:32.706395    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-xcsst_acfd6445-aa5e-4353-ac49-245efb12fd9c/discovery/0.log"
Jul 20 13:49:32.716950 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:32.716900    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7bb65f5cb7-h75tq_6eca5b4b-df68-40f8-a84e-8c074aa8e4a3/kube-auth-proxy/0.log"
Jul 20 13:49:33.089905 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:33.089815    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-8cn2l_9fe30511-54c3-4aef-b591-32426a623500/openshift-lws-operator/0.log"
Jul 20 13:49:34.171557 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:34.171525    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-xcsst_acfd6445-aa5e-4353-ac49-245efb12fd9c/discovery/0.log"
Jul 20 13:49:34.183489 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:34.183456    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-7bb65f5cb7-h75tq_6eca5b4b-df68-40f8-a84e-8c074aa8e4a3/kube-auth-proxy/0.log"
Jul 20 13:49:38.069841 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:38.069810    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-m2zc7_db55a6a8-d13a-4569-b4ca-9012509b899f/migrator/0.log"
Jul 20 13:49:38.092723 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:38.092703    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-7cc9c7ffd7-m2zc7_db55a6a8-d13a-4569-b4ca-9012509b899f/graceful-termination/0.log"
Jul 20 13:49:39.587093 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:39.587068    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g47kp_4ad79612-15fd-48a7-a9cc-33f53c58ca69/kube-multus-additional-cni-plugins/0.log"
Jul 20 13:49:39.610548 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:39.610522    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g47kp_4ad79612-15fd-48a7-a9cc-33f53c58ca69/egress-router-binary-copy/0.log"
Jul 20 13:49:39.631756 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:39.631733    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g47kp_4ad79612-15fd-48a7-a9cc-33f53c58ca69/cni-plugins/0.log"
Jul 20 13:49:39.652879 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:39.652859    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g47kp_4ad79612-15fd-48a7-a9cc-33f53c58ca69/bond-cni-plugin/0.log"
Jul 20 13:49:39.675689 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:39.675658    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g47kp_4ad79612-15fd-48a7-a9cc-33f53c58ca69/routeoverride-cni/0.log"
Jul 20 13:49:39.698974 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:39.698942    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g47kp_4ad79612-15fd-48a7-a9cc-33f53c58ca69/whereabouts-cni-bincopy/0.log"
Jul 20 13:49:39.723134 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:39.723109    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-g47kp_4ad79612-15fd-48a7-a9cc-33f53c58ca69/whereabouts-cni/0.log"
Jul 20 13:49:40.099841 ip-10-0-141-182 kubenswrapper[2565]: I0720 13:49:40.099805    2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-rlmj7_002d1aca-ffaa-4461-8906-6816cdfe6274/kube-multus/0.log"