Jul 15 12:20:29.914999 ip-10-0-140-67 systemd[1]: Starting Kubernetes Kubelet...
Jul 15 12:20:30.310576 ip-10-0-140-67 kubenswrapper[2559]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 12:20:30.310576 ip-10-0-140-67 kubenswrapper[2559]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 15 12:20:30.310576 ip-10-0-140-67 kubenswrapper[2559]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 12:20:30.310576 ip-10-0-140-67 kubenswrapper[2559]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 15 12:20:30.310576 ip-10-0-140-67 kubenswrapper[2559]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 15 12:20:30.311202 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.310561    2559 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 15 12:20:30.315731 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315708    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 12:20:30.315731 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315727    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 12:20:30.315731 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315732    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 12:20:30.315731 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315735    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 12:20:30.315731 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315740    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 12:20:30.315923 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315744    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 12:20:30.315923 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315751    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 12:20:30.315923 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315754    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 12:20:30.315923 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315758    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 12:20:30.315923 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315761    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 12:20:30.315923 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315764    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 12:20:30.315923 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315767    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 12:20:30.315923 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315770    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 12:20:30.315923 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315775    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 12:20:30.315923 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315779    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 12:20:30.315923 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315782    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 12:20:30.315923 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315785    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 12:20:30.315923 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315788    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 12:20:30.315923 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315795    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 12:20:30.315923 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315798    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 12:20:30.315923 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315811    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 12:20:30.315923 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315814    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 12:20:30.315923 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315817    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 12:20:30.315923 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315820    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 12:20:30.315923 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315823    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 12:20:30.316403 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315826    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 12:20:30.316403 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315829    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 12:20:30.316403 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315833    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 12:20:30.316403 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315837    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 12:20:30.316403 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315840    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 12:20:30.316403 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315845    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 12:20:30.316403 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315848    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 12:20:30.316403 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315851    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 12:20:30.316403 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315855    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 12:20:30.316403 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315858    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 12:20:30.316403 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315861    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 12:20:30.316403 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315863    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 12:20:30.316403 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315866    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 12:20:30.316403 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315870    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 12:20:30.316403 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315873    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 12:20:30.316403 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315876    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 12:20:30.316403 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315879    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 12:20:30.316403 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315881    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 12:20:30.316403 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315887    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 12:20:30.316843 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315890    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 12:20:30.316843 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315892    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 12:20:30.316843 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315895    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 12:20:30.316843 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315898    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 12:20:30.316843 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315902    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 12:20:30.316843 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315907    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 12:20:30.316843 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315910    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 12:20:30.316843 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315913    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 12:20:30.316843 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315916    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 12:20:30.316843 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315920    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 12:20:30.316843 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315924    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 12:20:30.316843 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315930    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 12:20:30.316843 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315933    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 12:20:30.316843 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315936    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 12:20:30.316843 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315939    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 12:20:30.316843 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315942    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 12:20:30.316843 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315946    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 12:20:30.316843 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315949    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 12:20:30.316843 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315952    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 12:20:30.317285 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315955    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 12:20:30.317285 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315958    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 12:20:30.317285 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315961    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 12:20:30.317285 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315964    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 12:20:30.317285 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315970    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 12:20:30.317285 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315973    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 12:20:30.317285 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315976    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 12:20:30.317285 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315979    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 12:20:30.317285 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315982    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 12:20:30.317285 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315985    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 12:20:30.317285 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315988    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 12:20:30.317285 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315991    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 12:20:30.317285 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315994    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 12:20:30.317285 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315996    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 12:20:30.317285 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.315999    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 12:20:30.317285 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.316005    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 12:20:30.317285 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.316010    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 12:20:30.317285 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.316013    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 12:20:30.317285 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.316016    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 12:20:30.317285 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.316019    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 12:20:30.317788 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.316022    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 12:20:30.317788 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.316025    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 12:20:30.317788 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.316028    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 12:20:30.317788 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.316031    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 12:20:30.317788 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.316034    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 12:20:30.317788 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.316037    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 12:20:30.317788 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.316040    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 12:20:30.317788 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.316042    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 12:20:30.317788 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.316048    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 12:20:30.317788 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.316050    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 12:20:30.317788 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.316053    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 12:20:30.317788 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.316056    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 12:20:30.317788 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.316059    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 12:20:30.317788 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.316062    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 12:20:30.317788 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.316064    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 12:20:30.317788 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.316067    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 12:20:30.317788 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317218    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 12:20:30.317788 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317225    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 12:20:30.317788 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317229    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 12:20:30.317788 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317233    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 12:20:30.318249 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317235    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 12:20:30.318249 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317238    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 12:20:30.318249 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317241    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 12:20:30.318249 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317244    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 12:20:30.318249 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317247    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 12:20:30.318249 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317250    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 12:20:30.318249 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317257    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 12:20:30.318249 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317261    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 12:20:30.318249 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317267    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 12:20:30.318249 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317271    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 12:20:30.318249 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317274    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 12:20:30.318249 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317277    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 12:20:30.318249 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317280    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 12:20:30.318249 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317283    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 12:20:30.318249 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317286    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 12:20:30.318249 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317290    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 12:20:30.318249 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317293    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 12:20:30.318249 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317297    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 12:20:30.318249 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317303    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 12:20:30.318768 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317306    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 12:20:30.318768 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317309    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 12:20:30.318768 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317311    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 12:20:30.318768 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317314    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 12:20:30.318768 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317316    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 12:20:30.318768 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317319    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 12:20:30.318768 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317322    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 12:20:30.318768 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317325    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 12:20:30.318768 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317328    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 12:20:30.318768 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317331    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 12:20:30.318768 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317334    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 12:20:30.318768 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317337    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 12:20:30.318768 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317342    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 12:20:30.318768 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317345    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 12:20:30.318768 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317348    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 12:20:30.318768 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317351    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 12:20:30.318768 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317353    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 12:20:30.318768 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317356    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 12:20:30.318768 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317359    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 12:20:30.319222 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317377    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 12:20:30.319222 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317380    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 12:20:30.319222 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317383    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 12:20:30.319222 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317388    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 12:20:30.319222 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317394    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 12:20:30.319222 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317397    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 12:20:30.319222 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317400    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 12:20:30.319222 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317403    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 12:20:30.319222 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317407    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 12:20:30.319222 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317409    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 12:20:30.319222 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317412    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 12:20:30.319222 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317415    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 12:20:30.319222 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317418    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 12:20:30.319222 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317421    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 12:20:30.319222 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317424    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 12:20:30.319222 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317426    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 12:20:30.319222 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317429    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 12:20:30.319222 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317434    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 12:20:30.319222 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317437    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 12:20:30.319222 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317439    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 12:20:30.319714 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317442    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 12:20:30.319714 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317445    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 12:20:30.319714 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317447    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 12:20:30.319714 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317460    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 12:20:30.319714 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317465    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 12:20:30.319714 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317468    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 12:20:30.319714 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317471    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 12:20:30.319714 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317474    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 12:20:30.319714 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317476    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 12:20:30.319714 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317482    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 12:20:30.319714 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317484    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 12:20:30.319714 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317487    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 12:20:30.319714 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317490    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 12:20:30.319714 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317493    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 12:20:30.319714 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317495    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 12:20:30.319714 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317498    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 12:20:30.319714 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317501    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 12:20:30.319714 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317504    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 12:20:30.319714 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317506    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 12:20:30.319714 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317509    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 12:20:30.320185 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317512    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 12:20:30.320185 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317517    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 12:20:30.320185 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317519    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 12:20:30.320185 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317522    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 12:20:30.320185 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317530    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 12:20:30.320185 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317533    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 12:20:30.320185 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317536    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 12:20:30.320185 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317539    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 12:20:30.320185 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317542    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 12:20:30.320185 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317544    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 12:20:30.320185 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317547    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 12:20:30.320185 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317550    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 12:20:30.320185 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317553    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 12:20:30.320185 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317555    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 12:20:30.320185 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317560    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 12:20:30.320185 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317563    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 12:20:30.320185 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.317566    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 12:20:30.320185 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318242    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 12:20:30.320185 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318250    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 12:20:30.320185 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318259    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 12:20:30.320661 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318268    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 12:20:30.320661 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318272    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 12:20:30.320661 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318275    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 12:20:30.320661 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318278    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 12:20:30.320661 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318280    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 12:20:30.320661 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318284    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 12:20:30.320661 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318287    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 12:20:30.320661 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318291    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 12:20:30.320661 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318293    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 12:20:30.320661 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318296    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 12:20:30.320661 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318299    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 12:20:30.320661 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318302    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 12:20:30.320661 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318321    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 12:20:30.320661 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318324    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 12:20:30.320661 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318326    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 12:20:30.320661 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318330    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 12:20:30.320661 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318334    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 12:20:30.320661 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318339    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 12:20:30.320661 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318359    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 12:20:30.320661 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318481    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 12:20:30.321144 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318486    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 12:20:30.321144 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318490    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 12:20:30.321144 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318495    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 12:20:30.321144 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318499    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 12:20:30.321144 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318505    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 12:20:30.321144 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318511    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 12:20:30.321144 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318516    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 12:20:30.321144 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318519    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 12:20:30.321144 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318522    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 12:20:30.321144 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318526    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 12:20:30.321144 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318529    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 12:20:30.321144 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318532    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 12:20:30.321144 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318534    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 12:20:30.321144 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318537    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 12:20:30.321144 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318539    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 12:20:30.321144 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318542    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 12:20:30.321144 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318544    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 12:20:30.321144 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318547    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 12:20:30.321144 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318551    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 12:20:30.321628 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318554    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 12:20:30.321628 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318556    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 12:20:30.321628 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318559    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 12:20:30.321628 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318561    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 12:20:30.321628 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318564    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 12:20:30.321628 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318568    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 12:20:30.321628 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318571    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 12:20:30.321628 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318574    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 12:20:30.321628 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318576    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 12:20:30.321628 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318580    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 12:20:30.321628 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318584    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 12:20:30.321628 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318588    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 12:20:30.321628 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318593    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 12:20:30.321628 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318597    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 12:20:30.321628 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318600    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 12:20:30.321628 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318603    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 12:20:30.321628 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318608    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 12:20:30.321628 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318611    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 12:20:30.321628 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318613    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 12:20:30.321628 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318616    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 12:20:30.322136 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318619    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 12:20:30.322136 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318622    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 12:20:30.322136 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318625    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 12:20:30.322136 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318628    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 12:20:30.322136 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318631    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 12:20:30.322136 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318633    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 12:20:30.322136 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318636    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 12:20:30.322136 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318638    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 12:20:30.322136 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318641    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 12:20:30.322136 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318643    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 12:20:30.322136 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318646    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 12:20:30.322136 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318649    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 12:20:30.322136 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318652    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 12:20:30.322136 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318656    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 12:20:30.322136 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318661    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 12:20:30.322136 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318666    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 12:20:30.322136 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318670    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 12:20:30.322136 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318674    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 12:20:30.322136 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318679    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 12:20:30.322593 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318683    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 12:20:30.322593 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318688    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 12:20:30.322593 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318690    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 12:20:30.322593 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318693    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 12:20:30.322593 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318696    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 12:20:30.322593 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318699    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 12:20:30.322593 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318703    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 12:20:30.322593 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318706    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 12:20:30.322593 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318709    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 12:20:30.322593 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318713    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 12:20:30.322593 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318716    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 12:20:30.322593 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318719    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 12:20:30.322593 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318722    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 12:20:30.322593 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318725    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 12:20:30.322593 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318728    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 12:20:30.322593 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318731    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 12:20:30.322593 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318733    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 12:20:30.322593 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.318736    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 12:20:30.322593 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.318807    2559 flags.go:64] FLAG: --address="0.0.0.0"
Jul 15 12:20:30.322593 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.318815    2559 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 15 12:20:30.323077 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.318821    2559 flags.go:64] FLAG: --anonymous-auth="true"
Jul 15 12:20:30.323077 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.318828    2559 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 15 12:20:30.323077 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.318836    2559 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 15 12:20:30.323077 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.318841    2559 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 15 12:20:30.323077 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.318846    2559 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 15 12:20:30.323077 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.318850    2559 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 15 12:20:30.323077 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.318853    2559 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 15 12:20:30.323077 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.318856    2559 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 15 12:20:30.323077 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.318859    2559 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 15 12:20:30.323077 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.318863    2559 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 15 12:20:30.323077 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.318866    2559 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 15 12:20:30.323077 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.318869    2559 flags.go:64] FLAG: --cgroup-root=""
Jul 15 12:20:30.323077 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.318872    2559 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 15 12:20:30.323077 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.318875    2559 flags.go:64] FLAG: --client-ca-file=""
Jul 15 12:20:30.323077 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.318878    2559 flags.go:64] FLAG: --cloud-provider="external"
Jul 15 12:20:30.323077 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.318882    2559 flags.go:64] FLAG: --cluster-dns="[]"
Jul 15 12:20:30.323077 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.318886    2559 flags.go:64] FLAG: --cluster-domain=""
Jul 15 12:20:30.323077 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.318889    2559 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 15 12:20:30.323077 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.318892    2559 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 15 12:20:30.323077 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.318896    2559 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 15 12:20:30.323077 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.318899    2559 flags.go:64] FLAG: --container-log-max-files="5"
Jul 15 12:20:30.323077 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.318905    2559 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 15 12:20:30.323077 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.318910    2559 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 15 12:20:30.323676 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.318915    2559 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 15 12:20:30.323676 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.318920    2559 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 15 12:20:30.323676 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.318926    2559 flags.go:64] FLAG: --contention-profiling="false"
Jul 15 12:20:30.323676 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.318929    2559 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 15 12:20:30.323676 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.318932    2559 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 15 12:20:30.323676 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.318935    2559 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 15 12:20:30.323676 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.318938    2559 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 15 12:20:30.323676 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.318942    2559 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 15 12:20:30.323676 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.318946    2559 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 15 12:20:30.323676 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.318949    2559 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 15 12:20:30.323676 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.318952    2559 flags.go:64] FLAG: --enable-load-reader="false"
Jul 15 12:20:30.323676 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.318955    2559 flags.go:64] FLAG: --enable-server="true"
Jul 15 12:20:30.323676 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.318958    2559 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 15 12:20:30.323676 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.318963    2559 flags.go:64] FLAG: --event-burst="100"
Jul 15 12:20:30.323676 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.318966    2559 flags.go:64] FLAG: --event-qps="50"
Jul 15 12:20:30.323676 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.318968    2559 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 15 12:20:30.323676 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.318971    2559 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 15 12:20:30.323676 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.318974    2559 flags.go:64] FLAG: --eviction-hard=""
Jul 15 12:20:30.323676 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.318978    2559 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 15 12:20:30.323676 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.318982    2559 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 15 12:20:30.323676 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.318987    2559 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 15 12:20:30.323676 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.318991    2559 flags.go:64] FLAG: --eviction-soft=""
Jul 15 12:20:30.323676 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.318996    2559 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 15 12:20:30.323676 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.318999    2559 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 15 12:20:30.323676 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319004    2559 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 15 12:20:30.324314 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319007    2559 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 15 12:20:30.324314 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319010    2559 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 15 12:20:30.324314 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319013    2559 flags.go:64] FLAG: --fail-swap-on="true"
Jul 15 12:20:30.324314 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319016    2559 flags.go:64] FLAG: --feature-gates=""
Jul 15 12:20:30.324314 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319020    2559 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 15 12:20:30.324314 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319023    2559 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 15 12:20:30.324314 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319026    2559 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 15 12:20:30.324314 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319029    2559 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 15 12:20:30.324314 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319032    2559 flags.go:64] FLAG: --healthz-port="10248"
Jul 15 12:20:30.324314 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319036    2559 flags.go:64] FLAG: --help="false"
Jul 15 12:20:30.324314 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319039    2559 flags.go:64] FLAG: --hostname-override="ip-10-0-140-67.ec2.internal"
Jul 15 12:20:30.324314 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319042    2559 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 15 12:20:30.324314 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319045    2559 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 15 12:20:30.324314 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319048    2559 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 15 12:20:30.324314 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319051    2559 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 15 12:20:30.324314 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319054    2559 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 15 12:20:30.324314 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319057    2559 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 15 12:20:30.324314 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319061    2559 flags.go:64] FLAG: --image-service-endpoint=""
Jul 15 12:20:30.324314 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319066    2559 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 15 12:20:30.324314 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319070    2559 flags.go:64] FLAG: --kube-api-burst="100"
Jul 15 12:20:30.324314 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319075    2559 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 15 12:20:30.324314 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319079    2559 flags.go:64] FLAG: --kube-api-qps="50"
Jul 15 12:20:30.324314 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319082    2559 flags.go:64] FLAG: --kube-reserved=""
Jul 15 12:20:30.324314 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319085    2559 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 15 12:20:30.324907 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319087    2559 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 15 12:20:30.324907 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319090    2559 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 15 12:20:30.324907 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319093    2559 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 15 12:20:30.324907 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319096    2559 flags.go:64] FLAG: --lock-file=""
Jul 15 12:20:30.324907 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319098    2559 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 15 12:20:30.324907 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319101    2559 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 15 12:20:30.324907 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319104    2559 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 15 12:20:30.324907 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319109    2559 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 15 12:20:30.324907 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319113    2559 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 15 12:20:30.324907 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319116    2559 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 15 12:20:30.324907 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319118    2559 flags.go:64] FLAG: --logging-format="text"
Jul 15 12:20:30.324907 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319121    2559 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 15 12:20:30.324907 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319124    2559 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 15 12:20:30.324907 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319127    2559 flags.go:64] FLAG: --manifest-url=""
Jul 15 12:20:30.324907 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319130    2559 flags.go:64] FLAG: --manifest-url-header=""
Jul 15 12:20:30.324907 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319135    2559 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 15 12:20:30.324907 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319138    2559 flags.go:64] FLAG: --max-open-files="1000000"
Jul 15 12:20:30.324907 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319146    2559 flags.go:64] FLAG: --max-pods="110"
Jul 15 12:20:30.324907 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319151    2559 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 15 12:20:30.324907 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319155    2559 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 15 12:20:30.324907 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319159    2559 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 15 12:20:30.324907 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319161    2559 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 15 12:20:30.324907 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319164    2559 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 15 12:20:30.324907 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319168    2559 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 15 12:20:30.324907 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319171    2559 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 15 12:20:30.325617 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319179    2559 flags.go:64] FLAG: --node-status-max-images="50"
Jul 15 12:20:30.325617 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319182    2559 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 15 12:20:30.325617 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319185    2559 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 15 12:20:30.325617 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319188    2559 flags.go:64] FLAG: --pod-cidr=""
Jul 15 12:20:30.325617 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319191    2559 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926"
Jul 15 12:20:30.325617 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319196    2559 flags.go:64] FLAG: --pod-manifest-path=""
Jul 15 12:20:30.325617 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319199    2559 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 15 12:20:30.325617 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319202    2559 flags.go:64] FLAG: --pods-per-core="0"
Jul 15 12:20:30.325617 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319205    2559 flags.go:64] FLAG: --port="10250"
Jul 15 12:20:30.325617 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319209    2559 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 15 12:20:30.325617 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319212    2559 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-058b9a037b6258e6f"
Jul 15 12:20:30.325617 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319215    2559 flags.go:64] FLAG: --qos-reserved=""
Jul 15 12:20:30.325617 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319218    2559 flags.go:64] FLAG: --read-only-port="10255"
Jul 15 12:20:30.325617 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319223    2559 flags.go:64] FLAG: --register-node="true"
Jul 15 12:20:30.325617 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319228    2559 flags.go:64] FLAG: --register-with-taints=""
Jul 15 12:20:30.325617 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319240    2559 flags.go:64] FLAG: --registry-burst="10"
Jul 15 12:20:30.325617 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319244    2559 flags.go:64] FLAG: --registry-qps="5"
Jul 15 12:20:30.325617 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319246    2559 flags.go:64] FLAG: --reserved-cpus=""
Jul 15 12:20:30.325617 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319249    2559 flags.go:64] FLAG: --reserved-memory=""
Jul 15 12:20:30.325617 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319257    2559 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 15 12:20:30.325617 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319260    2559 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 15 12:20:30.325617 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319263    2559 flags.go:64] FLAG: --rotate-certificates="false"
Jul 15 12:20:30.325617 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319266    2559 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 15 12:20:30.325617 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319269    2559 flags.go:64] FLAG: --runonce="false"
Jul 15 12:20:30.325617 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319273    2559 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 15 12:20:30.326207 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319276    2559 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 15 12:20:30.326207 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319279    2559 flags.go:64] FLAG: --seccomp-default="false"
Jul 15 12:20:30.326207 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319282    2559 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 15 12:20:30.326207 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319285    2559 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 15 12:20:30.326207 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319288    2559 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 15 12:20:30.326207 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319291    2559 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 15 12:20:30.326207 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319294    2559 flags.go:64] FLAG: --storage-driver-password="root"
Jul 15 12:20:30.326207 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319297    2559 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 15 12:20:30.326207 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319301    2559 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 15 12:20:30.326207 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319306    2559 flags.go:64] FLAG: --storage-driver-user="root"
Jul 15 12:20:30.326207 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319310    2559 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 15 12:20:30.326207 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319314    2559 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 15 12:20:30.326207 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319319    2559 flags.go:64] FLAG: --system-cgroups=""
Jul 15 12:20:30.326207 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319322    2559 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 15 12:20:30.326207 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319328    2559 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 15 12:20:30.326207 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319331    2559 flags.go:64] FLAG: --tls-cert-file=""
Jul 15 12:20:30.326207 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319333    2559 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 15 12:20:30.326207 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319338    2559 flags.go:64] FLAG: --tls-min-version=""
Jul 15 12:20:30.326207 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319341    2559 flags.go:64] FLAG: --tls-private-key-file=""
Jul 15 12:20:30.326207 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319344    2559 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 15 12:20:30.326207 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319347    2559 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 15 12:20:30.326207 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319349    2559 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 15 12:20:30.326207 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319352    2559 flags.go:64] FLAG: --v="2"
Jul 15 12:20:30.326207 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319356    2559 flags.go:64] FLAG: --version="false"
Jul 15 12:20:30.326207 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319376    2559 flags.go:64] FLAG: --vmodule=""
Jul 15 12:20:30.326877 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319381    2559 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 15 12:20:30.326877 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.319387    2559 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 15 12:20:30.326877 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319526    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 12:20:30.326877 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319532    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 12:20:30.326877 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319535    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 12:20:30.326877 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319539    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 12:20:30.326877 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319546    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 12:20:30.326877 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319551    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 12:20:30.326877 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319555    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 12:20:30.326877 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319558    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 12:20:30.326877 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319560    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 12:20:30.326877 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319563    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 12:20:30.326877 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319566    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 12:20:30.326877 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319568    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 12:20:30.326877 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319571    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 12:20:30.326877 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319574    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 12:20:30.326877 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319578    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 12:20:30.326877 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319581    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 12:20:30.326877 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319584    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 12:20:30.327393 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319587    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 12:20:30.327393 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319590    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 12:20:30.327393 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319593    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 12:20:30.327393 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319596    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 12:20:30.327393 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319598    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 12:20:30.327393 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319601    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 12:20:30.327393 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319604    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 12:20:30.327393 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319606    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 12:20:30.327393 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319609    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 12:20:30.327393 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319612    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 12:20:30.327393 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319614    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 12:20:30.327393 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319617    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 12:20:30.327393 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319622    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 12:20:30.327393 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319630    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 12:20:30.327393 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319635    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 12:20:30.327393 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319637    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 12:20:30.327393 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319641    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 12:20:30.327393 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319644    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 12:20:30.327393 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319648    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 12:20:30.327857 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319653    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 12:20:30.327857 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319656    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 12:20:30.327857 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319659    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 12:20:30.327857 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319662    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 12:20:30.327857 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319665    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 12:20:30.327857 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319667    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 12:20:30.327857 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319670    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 12:20:30.327857 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319672    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 12:20:30.327857 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319675    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 12:20:30.327857 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319677    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 12:20:30.327857 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319680    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 12:20:30.327857 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319683    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 12:20:30.327857 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319686    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 12:20:30.327857 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319689    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 12:20:30.327857 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319691    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 12:20:30.327857 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319694    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 12:20:30.327857 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319697    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 12:20:30.327857 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319702    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 12:20:30.327857 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319706    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 12:20:30.327857 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319711    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 12:20:30.328339 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319715    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 12:20:30.328339 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319718    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 12:20:30.328339 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319720    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 12:20:30.328339 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319723    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 12:20:30.328339 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319726    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 12:20:30.328339 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319728    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 12:20:30.328339 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319731    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 12:20:30.328339 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319735    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 12:20:30.328339 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319737    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 12:20:30.328339 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319741    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 12:20:30.328339 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319743    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 12:20:30.328339 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319746    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 12:20:30.328339 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319750    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 12:20:30.328339 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319753    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 12:20:30.328339 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319755    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 12:20:30.328339 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319758    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 12:20:30.328339 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319761    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 12:20:30.328339 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319763    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 12:20:30.328339 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319766    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 12:20:30.328339 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319768    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 12:20:30.328836 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319771    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 12:20:30.328836 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319773    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 12:20:30.328836 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319776    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 12:20:30.328836 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319781    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 12:20:30.328836 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319785    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 12:20:30.328836 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319789    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 12:20:30.328836 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319793    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 12:20:30.328836 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319796    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 12:20:30.328836 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319798    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 12:20:30.328836 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319800    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 12:20:30.328836 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319803    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 12:20:30.328836 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319805    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 12:20:30.328836 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319808    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 12:20:30.328836 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319810    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 12:20:30.328836 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319813    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 12:20:30.328836 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319815    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 12:20:30.328836 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319818    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 12:20:30.328836 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319821    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 12:20:30.328836 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319823    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 12:20:30.328836 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319826    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 12:20:30.329311 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319829    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 12:20:30.329311 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319832    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 12:20:30.329311 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.319835    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 12:20:30.329311 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.320427    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 12:20:30.329311 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.327744    2559 server.go:529] "Kubelet version" kubeletVersion="v1.34.9"
Jul 15 12:20:30.329311 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.327759    2559 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 15 12:20:30.329311 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.327779    2559 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 15 12:20:30.329311 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.327785    2559 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 15 12:20:30.329311 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.327841    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 12:20:30.329311 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.327846    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 12:20:30.329311 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.327850    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 12:20:30.329311 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.327853    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 12:20:30.329311 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.327856    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 12:20:30.329311 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.327859    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 12:20:30.329311 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.327862    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 12:20:30.329707 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.327866    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 12:20:30.329707 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.327870    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 12:20:30.329707 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.327874    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 12:20:30.329707 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.327876    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 12:20:30.329707 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.327879    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 12:20:30.329707 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.327882    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 12:20:30.329707 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.327884    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 12:20:30.329707 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.327887    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 12:20:30.329707 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.327889    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 12:20:30.329707 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.327892    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 12:20:30.329707 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.327895    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 12:20:30.329707 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.327897    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 12:20:30.329707 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.327900    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 12:20:30.329707 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.327903    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 12:20:30.329707 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.327905    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 12:20:30.329707 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.327909    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 12:20:30.329707 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.327912    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 12:20:30.329707 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.327916    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 12:20:30.329707 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.327919    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 12:20:30.330153 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.327922    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 12:20:30.330153 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.327925    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 12:20:30.330153 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.327929    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 12:20:30.330153 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.327933    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 12:20:30.330153 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.327936    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 12:20:30.330153 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.327939    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 12:20:30.330153 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.327942    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 12:20:30.330153 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.327945    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 12:20:30.330153 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.327948    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 12:20:30.330153 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.327951    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 12:20:30.330153 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.327954    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 12:20:30.330153 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.327957    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 12:20:30.330153 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.327960    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 12:20:30.330153 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.327962    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 12:20:30.330153 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.327965    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 12:20:30.330153 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.327967    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 12:20:30.330153 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.327970    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 12:20:30.330153 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.327974    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 12:20:30.330153 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.327977    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 12:20:30.330624 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.327981    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 12:20:30.330624 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.327984    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 12:20:30.330624 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.327986    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 12:20:30.330624 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.327989    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 12:20:30.330624 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.327992    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 12:20:30.330624 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.327995    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 12:20:30.330624 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.327998    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 12:20:30.330624 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328000    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 12:20:30.330624 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328003    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 12:20:30.330624 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328006    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 12:20:30.330624 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328008    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 12:20:30.330624 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328011    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 12:20:30.330624 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328013    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 12:20:30.330624 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328016    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 12:20:30.330624 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328019    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 12:20:30.330624 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328022    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 12:20:30.330624 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328024    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 12:20:30.330624 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328027    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 12:20:30.330624 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328030    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 12:20:30.330624 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328033    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 12:20:30.331103 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328035    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 12:20:30.331103 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328038    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 12:20:30.331103 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328040    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 12:20:30.331103 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328043    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 12:20:30.331103 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328045    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 12:20:30.331103 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328048    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 12:20:30.331103 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328050    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 12:20:30.331103 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328052    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 12:20:30.331103 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328055    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 12:20:30.331103 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328057    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 12:20:30.331103 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328060    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 12:20:30.331103 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328062    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 12:20:30.331103 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328065    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 12:20:30.331103 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328067    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 12:20:30.331103 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328069    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 12:20:30.331103 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328072    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 12:20:30.331103 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328075    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 12:20:30.331103 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328077    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 12:20:30.331103 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328080    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 12:20:30.331103 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328082    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 12:20:30.331597 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328085    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 12:20:30.331597 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328087    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 12:20:30.331597 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328090    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 12:20:30.331597 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328092    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 12:20:30.331597 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328095    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 12:20:30.331597 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328097    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 12:20:30.331597 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328100    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 12:20:30.331597 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328102    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 12:20:30.331597 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328105    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 12:20:30.331597 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328107    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 12:20:30.331597 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328110    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 12:20:30.331597 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328113    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 12:20:30.331597 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328115    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 12:20:30.331597 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328118    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 12:20:30.331597 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.328123    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 12:20:30.331967 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328242    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 15 12:20:30.331967 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328247    2559 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 15 12:20:30.331967 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328250    2559 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 15 12:20:30.331967 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328253    2559 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 15 12:20:30.331967 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328256    2559 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 15 12:20:30.331967 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328258    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 15 12:20:30.331967 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328262    2559 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 15 12:20:30.331967 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328264    2559 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 15 12:20:30.331967 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328267    2559 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 15 12:20:30.331967 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328270    2559 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 15 12:20:30.331967 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328273    2559 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 15 12:20:30.331967 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328275    2559 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 15 12:20:30.331967 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328278    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 15 12:20:30.331967 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328280    2559 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 15 12:20:30.331967 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328283    2559 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 15 12:20:30.331967 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328285    2559 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 15 12:20:30.331967 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328288    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 15 12:20:30.331967 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328291    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 15 12:20:30.331967 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328293    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 15 12:20:30.331967 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328295    2559 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 15 12:20:30.332468 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328298    2559 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 15 12:20:30.332468 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328301    2559 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 15 12:20:30.332468 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328303    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 15 12:20:30.332468 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328306    2559 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 15 12:20:30.332468 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328308    2559 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 15 12:20:30.332468 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328311    2559 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 15 12:20:30.332468 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328314    2559 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 15 12:20:30.332468 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328316    2559 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 15 12:20:30.332468 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328319    2559 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 15 12:20:30.332468 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328322    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 15 12:20:30.332468 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328325    2559 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 15 12:20:30.332468 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328327    2559 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 15 12:20:30.332468 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328330    2559 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 15 12:20:30.332468 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328332    2559 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 15 12:20:30.332468 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328335    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 15 12:20:30.332468 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328338    2559 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 15 12:20:30.332468 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328341    2559 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 15 12:20:30.332468 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328345    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 15 12:20:30.332468 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328348    2559 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 15 12:20:30.332468 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328350    2559 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 15 12:20:30.332946 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328353    2559 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 15 12:20:30.332946 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328355    2559 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 15 12:20:30.332946 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328358    2559 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 15 12:20:30.332946 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328380    2559 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 15 12:20:30.332946 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328384    2559 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 15 12:20:30.332946 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328387    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 15 12:20:30.332946 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328389    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 15 12:20:30.332946 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328392    2559 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 15 12:20:30.332946 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328395    2559 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 15 12:20:30.332946 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328398    2559 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 15 12:20:30.332946 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328400    2559 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 15 12:20:30.332946 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328403    2559 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 15 12:20:30.332946 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328405    2559 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 15 12:20:30.332946 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328408    2559 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 15 12:20:30.332946 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328410    2559 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 15 12:20:30.332946 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328413    2559 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 15 12:20:30.332946 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328416    2559 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 15 12:20:30.332946 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328419    2559 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 15 12:20:30.332946 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328422    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 15 12:20:30.332946 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328424    2559 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 15 12:20:30.333539 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328427    2559 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 15 12:20:30.333539 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328430    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 15 12:20:30.333539 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328433    2559 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 15 12:20:30.333539 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328436    2559 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 15 12:20:30.333539 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328438    2559 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 15 12:20:30.333539 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328441    2559 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 15 12:20:30.333539 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328443    2559 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 15 12:20:30.333539 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328446    2559 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 15 12:20:30.333539 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328448    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 15 12:20:30.333539 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328451    2559 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 15 12:20:30.333539 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328454    2559 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 15 12:20:30.333539 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328456    2559 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 15 12:20:30.333539 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328459    2559 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 15 12:20:30.333539 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328463    2559 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 15 12:20:30.333539 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328466    2559 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 15 12:20:30.333539 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328470    2559 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 15 12:20:30.333539 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328473    2559 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 15 12:20:30.333539 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328476    2559 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 15 12:20:30.333539 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328479    2559 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 15 12:20:30.334045 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328481    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 15 12:20:30.334045 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328484    2559 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 15 12:20:30.334045 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328489    2559 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 15 12:20:30.334045 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328492    2559 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 15 12:20:30.334045 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328495    2559 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 15 12:20:30.334045 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328497    2559 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 15 12:20:30.334045 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328500    2559 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 15 12:20:30.334045 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328502    2559 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 15 12:20:30.334045 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328505    2559 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 15 12:20:30.334045 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328507    2559 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 15 12:20:30.334045 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328510    2559 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 15 12:20:30.334045 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328513    2559 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 15 12:20:30.334045 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328515    2559 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 15 12:20:30.334045 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328518    2559 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 15 12:20:30.334045 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328520    2559 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 15 12:20:30.334045 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328523    2559 feature_gate.go:328] unrecognized feature gate: Example
Jul 15 12:20:30.334045 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328526    2559 feature_gate.go:328] unrecognized feature gate: Example2
Jul 15 12:20:30.334045 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328528    2559 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 15 12:20:30.334045 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328531    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 15 12:20:30.334045 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.328533    2559 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 15 12:20:30.334536 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.328538    2559 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 15 12:20:30.334536 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.328659    2559 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 15 12:20:30.334536 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.330809    2559 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 15 12:20:30.334536 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.332057    2559 server.go:1019] "Starting client certificate rotation"
Jul 15 12:20:30.334536 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.332152    2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 12:20:30.334536 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.332180    2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 15 12:20:30.334689 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.334573    2559 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 12:20:30.335931 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.335918    2559 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 15 12:20:30.347284 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.347262    2559 log.go:25] "Validated CRI v1 runtime API"
Jul 15 12:20:30.350607 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.350585    2559 log.go:25] "Validated CRI v1 image API"
Jul 15 12:20:30.352518 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.352502    2559 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 15 12:20:30.358334 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.358314    2559 fs.go:135] Filesystem UUIDs: map[7B77-95E7:/dev/nvme0n1p2 81025ebb-7ce1-4ded-980a-ec6fe7dc16ac:/dev/nvme0n1p4 bbcf8beb-a556-4a66-95bf-f23a97f36bc0:/dev/nvme0n1p3]
Jul 15 12:20:30.358412 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.358333    2559 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 15 12:20:30.362932 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.362912    2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 12:20:30.363284 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.363172    2559 manager.go:216] Machine: {Timestamp:2026-07-15 12:20:30.361985727 +0000 UTC m=+0.334556879 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099029 MemoryCapacity:33164492800 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2afc8980fbd1c35cbf5d7945f1c4fe SystemUUID:ec2afc89-80fb-d1c3-5cbf-5d7945f1c4fe BootID:ee1a7871-f447-4682-a47c-b3b4aa2befee Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582246400 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632898560 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:23:3e:cb:92:25 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:23:3e:cb:92:25 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b2:f8:2c:06:a0:13 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164492800 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 15 12:20:30.363284 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.363280    2559 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 15 12:20:30.363417 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.363404    2559 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 15 12:20:30.366206 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.366184    2559 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 15 12:20:30.366347 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.366209    2559 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-67.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 15 12:20:30.366844 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.366835    2559 topology_manager.go:138] "Creating topology manager with none policy"
Jul 15 12:20:30.366886 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.366846    2559 container_manager_linux.go:309] "Creating device plugin manager"
Jul 15 12:20:30.366886 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.366854    2559 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 12:20:30.367637 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.367626    2559 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 15 12:20:30.368768 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.368759    2559 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 15 12:20:30.372495 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.372483    2559 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 12:20:30.372602 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.372593    2559 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 15 12:20:30.372639 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.372621    2559 kubelet.go:486] "Attempting to sync node with API server"
Jul 15 12:20:30.372639 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.372630    2559 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 15 12:20:30.372713 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.372641    2559 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 15 12:20:30.372713 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.372651    2559 kubelet.go:398] "Adding apiserver pod source"
Jul 15 12:20:30.372713 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.372659    2559 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 15 12:20:30.372993 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.372980    2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 12:20:30.373027 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.373002    2559 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 15 12:20:30.376286 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.376265    2559 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1"
Jul 15 12:20:30.378058 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.378045    2559 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 15 12:20:30.378108 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.378075    2559 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 15 12:20:30.378233 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.378223    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 15 12:20:30.378285 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.378237    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 15 12:20:30.378285 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.378249    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 15 12:20:30.378285 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.378255    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 15 12:20:30.378285 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.378263    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 15 12:20:30.378285 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.378269    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 15 12:20:30.378946 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.378932    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 15 12:20:30.378982 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.378949    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 15 12:20:30.378982 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.378961    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 15 12:20:30.378982 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.378970    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 15 12:20:30.379053 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.378984    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 15 12:20:30.379053 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.378992    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 15 12:20:30.379647 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.379634    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 15 12:20:30.379677 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.379651    2559 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 15 12:20:30.382804 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.382790    2559 server.go:1268] "Started kubelet"
Jul 15 12:20:30.383102 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.382879    2559 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 15 12:20:30.383102 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.382933    2559 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 15 12:20:30.383102 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.383015    2559 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 15 12:20:30.383710 ip-10-0-140-67 systemd[1]: Started Kubernetes Kubelet.
Jul 15 12:20:30.384238 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.384207    2559 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 15 12:20:30.385065 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.385049    2559 server.go:310] "Adding debug handlers to kubelet server"
Jul 15 12:20:30.386331 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.386314    2559 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-67.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 15 12:20:30.386331 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:30.386318    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 15 12:20:30.386463 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:30.386421    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-67.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 15 12:20:30.388268 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:30.388248    2559 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 15 12:20:30.389235 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.389215    2559 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 15 12:20:30.390089 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.389926    2559 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 15 12:20:30.390181 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.389970    2559 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 15 12:20:30.390181 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.390117    2559 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 15 12:20:30.390419 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.390403    2559 reconstruct.go:97] "Volume reconstruction finished"
Jul 15 12:20:30.390419 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.390419    2559 reconciler.go:29] "Reconciler: start to sync state"
Jul 15 12:20:30.390519 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:30.390340    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-67.ec2.internal\" not found"
Jul 15 12:20:30.390560 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.390517    2559 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 15 12:20:30.391077 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.390920    2559 factory.go:55] Registering systemd factory
Jul 15 12:20:30.391077 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.390955    2559 factory.go:223] Registration of the systemd container factory successfully
Jul 15 12:20:30.391246 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.391228    2559 factory.go:153] Registering CRI-O factory
Jul 15 12:20:30.391304 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.391250    2559 factory.go:223] Registration of the crio container factory successfully
Jul 15 12:20:30.391304 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.391303    2559 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 15 12:20:30.391414 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.391338    2559 factory.go:103] Registering Raw factory
Jul 15 12:20:30.391414 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.391355    2559 manager.go:1196] Started watching for new ooms in manager
Jul 15 12:20:30.392252 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.392229    2559 manager.go:349] Starting recovery of all containers
Jul 15 12:20:30.393817 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:30.393773    2559 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-67.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 15 12:20:30.394205 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:30.394179    2559 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 15 12:20:30.396831 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:30.393849    2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-67.ec2.internal.18c275e55e557c45  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-67.ec2.internal,UID:ip-10-0-140-67.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-67.ec2.internal,},FirstTimestamp:2026-07-15 12:20:30.382758981 +0000 UTC m=+0.355330188,LastTimestamp:2026-07-15 12:20:30.382758981 +0000 UTC m=+0.355330188,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-67.ec2.internal,}"
Jul 15 12:20:30.398779 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.398749    2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 15 12:20:30.405108 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.405092    2559 manager.go:354] Recovery completed
Jul 15 12:20:30.406747 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:30.406721    2559 watcher.go:152] Failed to watch directory "/sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service": inotify_add_watch /sys/fs/cgroup/system.slice/systemd-update-utmp-runlevel.service: no such file or directory
Jul 15 12:20:30.409873 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.409860    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 12:20:30.411781 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.411754    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 12:20:30.411837 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.411794    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 12:20:30.411837 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.411805    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasSufficientPID"
Jul 15 12:20:30.412379 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.412365    2559 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 15 12:20:30.412379 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.412376    2559 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 15 12:20:30.412492 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.412392    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 12:20:30.412492 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.412395    2559 state_mem.go:36] "Initialized new in-memory state store"
Jul 15 12:20:30.413147 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.413122    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 12:20:30.413204 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.413151    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 12:20:30.413204 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.413166    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasSufficientPID"
Jul 15 12:20:30.414587 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:30.414521    2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-67.ec2.internal.18c275e5601051cb  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-67.ec2.internal,UID:ip-10-0-140-67.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-67.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-67.ec2.internal,},FirstTimestamp:2026-07-15 12:20:30.411780555 +0000 UTC m=+0.384351706,LastTimestamp:2026-07-15 12:20:30.411780555 +0000 UTC m=+0.384351706,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-67.ec2.internal,}"
Jul 15 12:20:30.414717 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.414702    2559 policy_none.go:49] "None policy: Start"
Jul 15 12:20:30.414751 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.414728    2559 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 15 12:20:30.414751 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.414745    2559 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 15 12:20:30.414990 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.414974    2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bzlp2"
Jul 15 12:20:30.416801 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.416788    2559 policy_none.go:47] "Start"
Jul 15 12:20:30.423079 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.423059    2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-bzlp2"
Jul 15 12:20:30.424512 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:30.424431    2559 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-67.ec2.internal.18c275e560109b4a  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-67.ec2.internal,UID:ip-10-0-140-67.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-140-67.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-140-67.ec2.internal,},FirstTimestamp:2026-07-15 12:20:30.41179937 +0000 UTC m=+0.384370522,LastTimestamp:2026-07-15 12:20:30.41179937 +0000 UTC m=+0.384370522,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-67.ec2.internal,}"
Jul 15 12:20:30.456191 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.456000    2559 manager.go:337] "Starting Device Plugin manager"
Jul 15 12:20:30.456275 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:30.456215    2559 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 15 12:20:30.456275 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.456230    2559 server.go:87] "Starting device plugin registration server"
Jul 15 12:20:30.456477 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.456463    2559 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 15 12:20:30.456537 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.456480    2559 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 15 12:20:30.456602 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.456575    2559 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 15 12:20:30.456677 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.456664    2559 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 15 12:20:30.456727 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.456678    2559 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 15 12:20:30.457304 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:30.457286    2559 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 15 12:20:30.457375 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:30.457335    2559 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-67.ec2.internal\" not found"
Jul 15 12:20:30.557112 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.557068    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 12:20:30.559404 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.558146    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 12:20:30.559404 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.558178    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 12:20:30.559404 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.558194    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasSufficientPID"
Jul 15 12:20:30.559404 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.558229    2559 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-67.ec2.internal"
Jul 15 12:20:30.565647 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.565589    2559 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-67.ec2.internal"
Jul 15 12:20:30.565647 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:30.565615    2559 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-67.ec2.internal\": node \"ip-10-0-140-67.ec2.internal\" not found"
Jul 15 12:20:30.577035 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.577014    2559 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 15 12:20:30.577137 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.577058    2559 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 15 12:20:30.577137 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.577080    2559 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 15 12:20:30.577137 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:30.577121    2559 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 15 12:20:30.578538 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:30.578520    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-67.ec2.internal\" not found"
Jul 15 12:20:30.580823 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.580807    2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 12:20:30.680271 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.680207    2559 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-67.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-67.ec2.internal"]
Jul 15 12:20:30.680271 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:30.680232    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-67.ec2.internal\" not found"
Jul 15 12:20:30.680516 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.680320    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 12:20:30.682019 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.682002    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 12:20:30.682096 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.682036    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 12:20:30.682096 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.682052    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasSufficientPID"
Jul 15 12:20:30.684745 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.684732    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 12:20:30.684892 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.684864    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-67.ec2.internal"
Jul 15 12:20:30.684933 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.684907    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 12:20:30.685562 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.685542    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 12:20:30.685654 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.685578    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 12:20:30.685654 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.685590    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasSufficientPID"
Jul 15 12:20:30.685654 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.685542    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 12:20:30.685751 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.685666    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 12:20:30.685751 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.685679    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasSufficientPID"
Jul 15 12:20:30.688287 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.688269    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-67.ec2.internal"
Jul 15 12:20:30.688363 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.688306    2559 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 15 12:20:30.689041 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.689024    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasSufficientMemory"
Jul 15 12:20:30.689107 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.689045    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasNoDiskPressure"
Jul 15 12:20:30.689107 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.689057    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeHasSufficientPID"
Jul 15 12:20:30.692389 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.692367    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ad0297be557f741a11c730c41d1f8356-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-67.ec2.internal\" (UID: \"ad0297be557f741a11c730c41d1f8356\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-67.ec2.internal"
Jul 15 12:20:30.692583 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.692563    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad0297be557f741a11c730c41d1f8356-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-67.ec2.internal\" (UID: \"ad0297be557f741a11c730c41d1f8356\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-67.ec2.internal"
Jul 15 12:20:30.692857 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.692803    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/52d9088551c115f98811f24856a62fc9-config\") pod \"kube-apiserver-proxy-ip-10-0-140-67.ec2.internal\" (UID: \"52d9088551c115f98811f24856a62fc9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-67.ec2.internal"
Jul 15 12:20:30.693389 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:30.693366    2559 helpers.go:245] readString: Failed to read "/sys/fs/cgroup/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad0297be557f741a11c730c41d1f8356.slice/cpu.weight": read /sys/fs/cgroup/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad0297be557f741a11c730c41d1f8356.slice/cpu.weight: no such device
Jul 15 12:20:30.715238 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:30.715212    2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-67.ec2.internal\" not found" node="ip-10-0-140-67.ec2.internal"
Jul 15 12:20:30.719898 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:30.719881    2559 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-67.ec2.internal\" not found" node="ip-10-0-140-67.ec2.internal"
Jul 15 12:20:30.781056 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:30.781022    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-67.ec2.internal\" not found"
Jul 15 12:20:30.794002 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.793973    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad0297be557f741a11c730c41d1f8356-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-67.ec2.internal\" (UID: \"ad0297be557f741a11c730c41d1f8356\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-67.ec2.internal"
Jul 15 12:20:30.794092 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.794012    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/52d9088551c115f98811f24856a62fc9-config\") pod \"kube-apiserver-proxy-ip-10-0-140-67.ec2.internal\" (UID: \"52d9088551c115f98811f24856a62fc9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-67.ec2.internal"
Jul 15 12:20:30.794092 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.794038    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ad0297be557f741a11c730c41d1f8356-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-67.ec2.internal\" (UID: \"ad0297be557f741a11c730c41d1f8356\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-67.ec2.internal"
Jul 15 12:20:30.794193 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.794097    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/ad0297be557f741a11c730c41d1f8356-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-67.ec2.internal\" (UID: \"ad0297be557f741a11c730c41d1f8356\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-67.ec2.internal"
Jul 15 12:20:30.794193 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.794164    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/52d9088551c115f98811f24856a62fc9-config\") pod \"kube-apiserver-proxy-ip-10-0-140-67.ec2.internal\" (UID: \"52d9088551c115f98811f24856a62fc9\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-67.ec2.internal"
Jul 15 12:20:30.794273 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:30.794208    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/ad0297be557f741a11c730c41d1f8356-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-67.ec2.internal\" (UID: \"ad0297be557f741a11c730c41d1f8356\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-67.ec2.internal"
Jul 15 12:20:30.881657 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:30.881562    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-67.ec2.internal\" not found"
Jul 15 12:20:30.988234 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:30.988189    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-67.ec2.internal\" not found"
Jul 15 12:20:31.017826 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:31.017791    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-67.ec2.internal"
Jul 15 12:20:31.022947 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:31.022919    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-67.ec2.internal"
Jul 15 12:20:31.090336 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:31.090288    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-67.ec2.internal\" not found"
Jul 15 12:20:31.196972 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:31.196865    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-67.ec2.internal\" not found"
Jul 15 12:20:31.209269 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:31.209238    2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 12:20:31.297708 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:31.297661    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-67.ec2.internal\" not found"
Jul 15 12:20:31.331411 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:31.331385    2559 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 15 12:20:31.331852 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:31.331541    2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 15 12:20:31.331852 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:31.331553    2559 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 15 12:20:31.398106 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:31.398069    2559 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-67.ec2.internal\" not found"
Jul 15 12:20:31.423087 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:31.423059    2559 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 12:20:31.427581 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:31.427559    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-14 12:15:31 +0000 UTC" deadline="2028-01-30 01:12:12.172516851 +0000 UTC"
Jul 15 12:20:31.427637 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:31.427581    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13524h51m40.744938177s"
Jul 15 12:20:31.490536 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:31.490470    2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-67.ec2.internal"
Jul 15 12:20:31.514295 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:31.514268    2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 12:20:31.515347 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:31.515327    2559 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-67.ec2.internal"
Jul 15 12:20:31.548856 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:31.548826    2559 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 15 12:20:31.559820 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:31.559796    2559 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 12:20:31.628514 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:31.628465    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52d9088551c115f98811f24856a62fc9.slice/crio-e0da6a87fa9b4910d5b852565419c97af9d7371763b8f8b374f0e51ff1698e97 WatchSource:0}: Error finding container e0da6a87fa9b4910d5b852565419c97af9d7371763b8f8b374f0e51ff1698e97: Status 404 returned error can't find the container with id e0da6a87fa9b4910d5b852565419c97af9d7371763b8f8b374f0e51ff1698e97
Jul 15 12:20:31.635560 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:31.635543    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 12:20:31.877943 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:31.877914    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podad0297be557f741a11c730c41d1f8356.slice/crio-38458be6430af901d84ca6118d3e68aee19b29649a4c1eaf251ed2ef379d7c5a WatchSource:0}: Error finding container 38458be6430af901d84ca6118d3e68aee19b29649a4c1eaf251ed2ef379d7c5a: Status 404 returned error can't find the container with id 38458be6430af901d84ca6118d3e68aee19b29649a4c1eaf251ed2ef379d7c5a
Jul 15 12:20:32.374852 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.374762    2559 apiserver.go:52] "Watching apiserver"
Jul 15 12:20:32.382699 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.382668    2559 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 15 12:20:32.383137 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.383112    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-8ghwr","kube-system/konnectivity-agent-ckzbm","kube-system/kube-apiserver-proxy-ip-10-0-140-67.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j46gp","openshift-cluster-node-tuning-operator/tuned-rcf9z","openshift-dns/node-resolver-qfb4c","openshift-image-registry/node-ca-bctct","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-67.ec2.internal","openshift-multus/multus-additional-cni-plugins-wj5d4","openshift-multus/multus-cv2md","openshift-multus/network-metrics-daemon-ndhnr","openshift-network-diagnostics/network-check-target-7jz7w","openshift-network-operator/iptables-alerter-4dvc2","openshift-ovn-kubernetes/ovnkube-node-2vp8z"]
Jul 15 12:20:32.386033 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.386011    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bctct"
Jul 15 12:20:32.388499 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.388476    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4dvc2"
Jul 15 12:20:32.390136 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.390097    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-82g49\""
Jul 15 12:20:32.390460 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.390419    2559 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 15 12:20:32.391178 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.390995    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 15 12:20:32.391280 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.391184    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 15 12:20:32.391477 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.391387    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 15 12:20:32.391477 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.391436    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 15 12:20:32.393500 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.392172    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 15 12:20:32.393500 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.392192    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z"
Jul 15 12:20:32.393500 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.393086    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-smkjm\""
Jul 15 12:20:32.394253 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.393735    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 15 12:20:32.394253 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.393815    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j46gp"
Jul 15 12:20:32.396666 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.396642    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rcf9z"
Jul 15 12:20:32.398686 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.398659    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 15 12:20:32.399323 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.398957    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 15 12:20:32.399323 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.399019    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 15 12:20:32.399323 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.399049    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 15 12:20:32.399323 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.399086    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 15 12:20:32.399323 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.398957    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 15 12:20:32.399323 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.399314    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 15 12:20:32.399612 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.399384    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 15 12:20:32.399612 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.399411    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qfb4c"
Jul 15 12:20:32.399612 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.399426    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 15 12:20:32.399612 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.399388    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 15 12:20:32.399612 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.399517    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-b2zh5\""
Jul 15 12:20:32.399788 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.399651    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-6llfh\""
Jul 15 12:20:32.399788 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.399753    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 15 12:20:32.399893 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.399816    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hldt9\""
Jul 15 12:20:32.401656 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.401636    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wj5d4"
Jul 15 12:20:32.406196 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.406177    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/009c50dc-2f9e-455b-95f2-a03e7ed3defd-host-kubelet\") pod \"ovnkube-node-2vp8z\" (UID: \"009c50dc-2f9e-455b-95f2-a03e7ed3defd\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z"
Jul 15 12:20:32.406309 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.406209    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/009c50dc-2f9e-455b-95f2-a03e7ed3defd-node-log\") pod \"ovnkube-node-2vp8z\" (UID: \"009c50dc-2f9e-455b-95f2-a03e7ed3defd\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z"
Jul 15 12:20:32.406309 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.406235    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/009c50dc-2f9e-455b-95f2-a03e7ed3defd-host-cni-netd\") pod \"ovnkube-node-2vp8z\" (UID: \"009c50dc-2f9e-455b-95f2-a03e7ed3defd\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z"
Jul 15 12:20:32.406309 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.406262    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/009c50dc-2f9e-455b-95f2-a03e7ed3defd-env-overrides\") pod \"ovnkube-node-2vp8z\" (UID: \"009c50dc-2f9e-455b-95f2-a03e7ed3defd\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z"
Jul 15 12:20:32.406309 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.406288    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/009c50dc-2f9e-455b-95f2-a03e7ed3defd-ovnkube-script-lib\") pod \"ovnkube-node-2vp8z\" (UID: \"009c50dc-2f9e-455b-95f2-a03e7ed3defd\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z"
Jul 15 12:20:32.406546 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.406360    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/009c50dc-2f9e-455b-95f2-a03e7ed3defd-run-ovn\") pod \"ovnkube-node-2vp8z\" (UID: \"009c50dc-2f9e-455b-95f2-a03e7ed3defd\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z"
Jul 15 12:20:32.406546 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.406393    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/009c50dc-2f9e-455b-95f2-a03e7ed3defd-ovnkube-config\") pod \"ovnkube-node-2vp8z\" (UID: \"009c50dc-2f9e-455b-95f2-a03e7ed3defd\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z"
Jul 15 12:20:32.406546 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.406420    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f2f64511-8f06-4610-a112-0cd46f0fd503-serviceca\") pod \"node-ca-bctct\" (UID: \"f2f64511-8f06-4610-a112-0cd46f0fd503\") " pod="openshift-image-registry/node-ca-bctct"
Jul 15 12:20:32.406546 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.406465    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zhq8s\" (UniqueName: \"kubernetes.io/projected/f2f64511-8f06-4610-a112-0cd46f0fd503-kube-api-access-zhq8s\") pod \"node-ca-bctct\" (UID: \"f2f64511-8f06-4610-a112-0cd46f0fd503\") " pod="openshift-image-registry/node-ca-bctct"
Jul 15 12:20:32.406546 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.406489    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/009c50dc-2f9e-455b-95f2-a03e7ed3defd-host-slash\") pod \"ovnkube-node-2vp8z\" (UID: \"009c50dc-2f9e-455b-95f2-a03e7ed3defd\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z"
Jul 15 12:20:32.406546 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.406512    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/009c50dc-2f9e-455b-95f2-a03e7ed3defd-host-run-netns\") pod \"ovnkube-node-2vp8z\" (UID: \"009c50dc-2f9e-455b-95f2-a03e7ed3defd\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z"
Jul 15 12:20:32.406546 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.406535    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/009c50dc-2f9e-455b-95f2-a03e7ed3defd-run-openvswitch\") pod \"ovnkube-node-2vp8z\" (UID: \"009c50dc-2f9e-455b-95f2-a03e7ed3defd\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z"
Jul 15 12:20:32.406546 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.406545    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8ghwr"
Jul 15 12:20:32.406989 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.406560    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/009c50dc-2f9e-455b-95f2-a03e7ed3defd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2vp8z\" (UID: \"009c50dc-2f9e-455b-95f2-a03e7ed3defd\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z"
Jul 15 12:20:32.406989 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.406614    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/57925e62-a062-44df-bb9f-4b77fd8931d5-iptables-alerter-script\") pod \"iptables-alerter-4dvc2\" (UID: \"57925e62-a062-44df-bb9f-4b77fd8931d5\") " pod="openshift-network-operator/iptables-alerter-4dvc2"
Jul 15 12:20:32.406989 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.406637    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/57925e62-a062-44df-bb9f-4b77fd8931d5-host-slash\") pod \"iptables-alerter-4dvc2\" (UID: \"57925e62-a062-44df-bb9f-4b77fd8931d5\") " pod="openshift-network-operator/iptables-alerter-4dvc2"
Jul 15 12:20:32.406989 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.406662    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/009c50dc-2f9e-455b-95f2-a03e7ed3defd-host-cni-bin\") pod \"ovnkube-node-2vp8z\" (UID: \"009c50dc-2f9e-455b-95f2-a03e7ed3defd\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z"
Jul 15 12:20:32.406989 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.406686    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/009c50dc-2f9e-455b-95f2-a03e7ed3defd-ovn-node-metrics-cert\") pod \"ovnkube-node-2vp8z\" (UID: \"009c50dc-2f9e-455b-95f2-a03e7ed3defd\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z"
Jul 15 12:20:32.406989 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:32.406680    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8ghwr" podUID="df4bf5c7-9413-4a70-8d17-9eaca62b4373"
Jul 15 12:20:32.406989 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.406712    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m6xmz\" (UniqueName: \"kubernetes.io/projected/57925e62-a062-44df-bb9f-4b77fd8931d5-kube-api-access-m6xmz\") pod \"iptables-alerter-4dvc2\" (UID: \"57925e62-a062-44df-bb9f-4b77fd8931d5\") " pod="openshift-network-operator/iptables-alerter-4dvc2"
Jul 15 12:20:32.406989 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.406736    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f2f64511-8f06-4610-a112-0cd46f0fd503-host\") pod \"node-ca-bctct\" (UID: \"f2f64511-8f06-4610-a112-0cd46f0fd503\") " pod="openshift-image-registry/node-ca-bctct"
Jul 15 12:20:32.406989 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.406760    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/009c50dc-2f9e-455b-95f2-a03e7ed3defd-log-socket\") pod \"ovnkube-node-2vp8z\" (UID: \"009c50dc-2f9e-455b-95f2-a03e7ed3defd\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z"
Jul 15 12:20:32.406989 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.406786    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mc4j4\" (UniqueName: \"kubernetes.io/projected/009c50dc-2f9e-455b-95f2-a03e7ed3defd-kube-api-access-mc4j4\") pod \"ovnkube-node-2vp8z\" (UID: \"009c50dc-2f9e-455b-95f2-a03e7ed3defd\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z"
Jul 15 12:20:32.406989 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.406811    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/009c50dc-2f9e-455b-95f2-a03e7ed3defd-systemd-units\") pod \"ovnkube-node-2vp8z\" (UID: \"009c50dc-2f9e-455b-95f2-a03e7ed3defd\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z"
Jul 15 12:20:32.406989 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.406842    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/009c50dc-2f9e-455b-95f2-a03e7ed3defd-run-systemd\") pod \"ovnkube-node-2vp8z\" (UID: \"009c50dc-2f9e-455b-95f2-a03e7ed3defd\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z"
Jul 15 12:20:32.406989 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.406866    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/009c50dc-2f9e-455b-95f2-a03e7ed3defd-var-lib-openvswitch\") pod \"ovnkube-node-2vp8z\" (UID: \"009c50dc-2f9e-455b-95f2-a03e7ed3defd\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z"
Jul 15 12:20:32.406989 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.406917    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/009c50dc-2f9e-455b-95f2-a03e7ed3defd-etc-openvswitch\") pod \"ovnkube-node-2vp8z\" (UID: \"009c50dc-2f9e-455b-95f2-a03e7ed3defd\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z"
Jul 15 12:20:32.406989 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.406957    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/009c50dc-2f9e-455b-95f2-a03e7ed3defd-host-run-ovn-kubernetes\") pod \"ovnkube-node-2vp8z\" (UID: \"009c50dc-2f9e-455b-95f2-a03e7ed3defd\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z"
Jul 15 12:20:32.407743 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.407020    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 15 12:20:32.407743 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.407024    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 15 12:20:32.407743 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.407202    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 15 12:20:32.407743 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.407250    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 15 12:20:32.407743 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.407250    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-wrdf9\""
Jul 15 12:20:32.407743 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.407296    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 15 12:20:32.407743 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.407394    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 15 12:20:32.407743 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.407436    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-7sqrn\""
Jul 15 12:20:32.407743 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.407521    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 15 12:20:32.408834 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.408814    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ckzbm"
Jul 15 12:20:32.411536 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.411516    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cv2md"
Jul 15 12:20:32.412016 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.411996    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 15 12:20:32.412118 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.412041    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 15 12:20:32.412118 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.411998    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-4cm72\""
Jul 15 12:20:32.412621 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.412484    2559 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 15 12:20:32.414006 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.413923    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 15 12:20:32.414006 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.413957    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-856tb\""
Jul 15 12:20:32.415215 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.415194    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndhnr"
Jul 15 12:20:32.415317 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:32.415265    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ndhnr" podUID="6a7be93c-3ae8-4f57-8bb9-ffb11e116493"
Jul 15 12:20:32.417800 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.417780    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jz7w"
Jul 15 12:20:32.417897 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:32.417851    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jz7w" podUID="6aeeccdd-6c28-44fd-99e8-d6426f00525b"
Jul 15 12:20:32.451111 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.451077    2559 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-5p58j"
Jul 15 12:20:32.461495 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.461466    2559 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-5p58j"
Jul 15 12:20:32.491624 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.491600    2559 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 15 12:20:32.507815 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.507777    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g68xz\" (UniqueName: \"kubernetes.io/projected/6a7be93c-3ae8-4f57-8bb9-ffb11e116493-kube-api-access-g68xz\") pod \"network-metrics-daemon-ndhnr\" (UID: \"6a7be93c-3ae8-4f57-8bb9-ffb11e116493\") " pod="openshift-multus/network-metrics-daemon-ndhnr"
Jul 15 12:20:32.507969 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.507823    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3aaf289f-60cb-4031-9062-8cbaff2fe9f0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j46gp\" (UID: \"3aaf289f-60cb-4031-9062-8cbaff2fe9f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j46gp"
Jul 15 12:20:32.507969 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.507856    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b7a79dc6-aa77-49fa-87dd-08ed78b9f4f5-tmp-dir\") pod \"node-resolver-qfb4c\" (UID: \"b7a79dc6-aa77-49fa-87dd-08ed78b9f4f5\") " pod="openshift-dns/node-resolver-qfb4c"
Jul 15 12:20:32.507969 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.507888    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/009c50dc-2f9e-455b-95f2-a03e7ed3defd-host-kubelet\") pod \"ovnkube-node-2vp8z\" (UID: \"009c50dc-2f9e-455b-95f2-a03e7ed3defd\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z"
Jul 15 12:20:32.507969 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.507909    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/009c50dc-2f9e-455b-95f2-a03e7ed3defd-node-log\") pod \"ovnkube-node-2vp8z\" (UID: \"009c50dc-2f9e-455b-95f2-a03e7ed3defd\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z"
Jul 15 12:20:32.507969 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.507962    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/009c50dc-2f9e-455b-95f2-a03e7ed3defd-node-log\") pod \"ovnkube-node-2vp8z\" (UID: \"009c50dc-2f9e-455b-95f2-a03e7ed3defd\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z"
Jul 15 12:20:32.508153 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.507975    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/009c50dc-2f9e-455b-95f2-a03e7ed3defd-host-kubelet\") pod \"ovnkube-node-2vp8z\" (UID: \"009c50dc-2f9e-455b-95f2-a03e7ed3defd\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z"
Jul 15 12:20:32.508153 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.508023    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/009c50dc-2f9e-455b-95f2-a03e7ed3defd-host-cni-netd\") pod \"ovnkube-node-2vp8z\" (UID: \"009c50dc-2f9e-455b-95f2-a03e7ed3defd\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z"
Jul 15 12:20:32.508153 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.508055    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/009c50dc-2f9e-455b-95f2-a03e7ed3defd-ovnkube-script-lib\") pod \"ovnkube-node-2vp8z\" (UID: \"009c50dc-2f9e-455b-95f2-a03e7ed3defd\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z"
Jul 15 12:20:32.508153 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.508087    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c0df3610-e8fe-48b2-ba14-4ed9d65f8965-cnibin\") pod \"multus-additional-cni-plugins-wj5d4\" (UID: \"c0df3610-e8fe-48b2-ba14-4ed9d65f8965\") " pod="openshift-multus/multus-additional-cni-plugins-wj5d4"
Jul 15 12:20:32.508153 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.508090    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/009c50dc-2f9e-455b-95f2-a03e7ed3defd-host-cni-netd\") pod \"ovnkube-node-2vp8z\" (UID: \"009c50dc-2f9e-455b-95f2-a03e7ed3defd\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z"
Jul 15 12:20:32.508153 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.508123    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c0df3610-e8fe-48b2-ba14-4ed9d65f8965-cni-binary-copy\") pod \"multus-additional-cni-plugins-wj5d4\" (UID: \"c0df3610-e8fe-48b2-ba14-4ed9d65f8965\") " pod="openshift-multus/multus-additional-cni-plugins-wj5d4"
Jul 15 12:20:32.508623 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.508238    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/712fac2c-94a4-4863-84b0-d251b4fcd155-konnectivity-ca\") pod \"konnectivity-agent-ckzbm\" (UID: \"712fac2c-94a4-4863-84b0-d251b4fcd155\") " pod="kube-system/konnectivity-agent-ckzbm"
Jul 15 12:20:32.508623 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.508277    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f74223ea-de13-44ca-86b5-555b5a30abef-etc-tuned\") pod \"tuned-rcf9z\" (UID: \"f74223ea-de13-44ca-86b5-555b5a30abef\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf9z"
Jul 15 12:20:32.508623 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.508309    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/009c50dc-2f9e-455b-95f2-a03e7ed3defd-ovnkube-config\") pod \"ovnkube-node-2vp8z\" (UID: \"009c50dc-2f9e-455b-95f2-a03e7ed3defd\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z"
Jul 15 12:20:32.508623 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.508335    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f2f64511-8f06-4610-a112-0cd46f0fd503-serviceca\") pod \"node-ca-bctct\" (UID: \"f2f64511-8f06-4610-a112-0cd46f0fd503\") " pod="openshift-image-registry/node-ca-bctct"
Jul 15 12:20:32.508623 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.508365    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zhq8s\" (UniqueName: \"kubernetes.io/projected/f2f64511-8f06-4610-a112-0cd46f0fd503-kube-api-access-zhq8s\") pod \"node-ca-bctct\" (UID: \"f2f64511-8f06-4610-a112-0cd46f0fd503\") " pod="openshift-image-registry/node-ca-bctct"
Jul 15 12:20:32.508623 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.508412    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/009c50dc-2f9e-455b-95f2-a03e7ed3defd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2vp8z\" (UID: \"009c50dc-2f9e-455b-95f2-a03e7ed3defd\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z"
Jul 15 12:20:32.508623 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.508441    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c0df3610-e8fe-48b2-ba14-4ed9d65f8965-system-cni-dir\") pod \"multus-additional-cni-plugins-wj5d4\" (UID: \"c0df3610-e8fe-48b2-ba14-4ed9d65f8965\") " pod="openshift-multus/multus-additional-cni-plugins-wj5d4"
Jul 15 12:20:32.508623 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.508468    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sxv7m\" (UniqueName: \"kubernetes.io/projected/c0df3610-e8fe-48b2-ba14-4ed9d65f8965-kube-api-access-sxv7m\") pod \"multus-additional-cni-plugins-wj5d4\" (UID: \"c0df3610-e8fe-48b2-ba14-4ed9d65f8965\") " pod="openshift-multus/multus-additional-cni-plugins-wj5d4"
Jul 15 12:20:32.508623 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.508494    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd-host-run-netns\") pod \"multus-cv2md\" (UID: \"7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd\") " pod="openshift-multus/multus-cv2md"
Jul 15 12:20:32.508623 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.508510    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/009c50dc-2f9e-455b-95f2-a03e7ed3defd-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-2vp8z\" (UID: \"009c50dc-2f9e-455b-95f2-a03e7ed3defd\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z"
Jul 15 12:20:32.508623 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.508520    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd-multus-conf-dir\") pod \"multus-cv2md\" (UID: \"7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd\") " pod="openshift-multus/multus-cv2md"
Jul 15 12:20:32.508623 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.508555    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3aaf289f-60cb-4031-9062-8cbaff2fe9f0-registration-dir\") pod \"aws-ebs-csi-driver-node-j46gp\" (UID: \"3aaf289f-60cb-4031-9062-8cbaff2fe9f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j46gp"
Jul 15 12:20:32.508623 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.508586    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/57925e62-a062-44df-bb9f-4b77fd8931d5-iptables-alerter-script\") pod \"iptables-alerter-4dvc2\" (UID: \"57925e62-a062-44df-bb9f-4b77fd8931d5\") " pod="openshift-network-operator/iptables-alerter-4dvc2"
Jul 15 12:20:32.508623 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.508616    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/009c50dc-2f9e-455b-95f2-a03e7ed3defd-ovn-node-metrics-cert\") pod \"ovnkube-node-2vp8z\" (UID: \"009c50dc-2f9e-455b-95f2-a03e7ed3defd\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z"
Jul 15 12:20:32.508623 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.508647    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f74223ea-de13-44ca-86b5-555b5a30abef-etc-kubernetes\") pod \"tuned-rcf9z\" (UID: \"f74223ea-de13-44ca-86b5-555b5a30abef\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf9z"
Jul 15 12:20:32.508623 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.508673    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd-system-cni-dir\") pod \"multus-cv2md\" (UID: \"7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd\") " pod="openshift-multus/multus-cv2md"
Jul 15 12:20:32.509590 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.508698    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd-host-var-lib-kubelet\") pod \"multus-cv2md\" (UID: \"7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd\") " pod="openshift-multus/multus-cv2md"
Jul 15 12:20:32.509590 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.508723    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vk5dd\" (UniqueName: \"kubernetes.io/projected/6aeeccdd-6c28-44fd-99e8-d6426f00525b-kube-api-access-vk5dd\") pod \"network-check-target-7jz7w\" (UID: \"6aeeccdd-6c28-44fd-99e8-d6426f00525b\") " pod="openshift-network-diagnostics/network-check-target-7jz7w"
Jul 15 12:20:32.509590 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.508752    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m6xmz\" (UniqueName: \"kubernetes.io/projected/57925e62-a062-44df-bb9f-4b77fd8931d5-kube-api-access-m6xmz\") pod \"iptables-alerter-4dvc2\" (UID: \"57925e62-a062-44df-bb9f-4b77fd8931d5\") " pod="openshift-network-operator/iptables-alerter-4dvc2"
Jul 15 12:20:32.509590 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.508778    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c0df3610-e8fe-48b2-ba14-4ed9d65f8965-os-release\") pod \"multus-additional-cni-plugins-wj5d4\" (UID: \"c0df3610-e8fe-48b2-ba14-4ed9d65f8965\") " pod="openshift-multus/multus-additional-cni-plugins-wj5d4"
Jul 15 12:20:32.509590 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.508780    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/009c50dc-2f9e-455b-95f2-a03e7ed3defd-ovnkube-script-lib\") pod \"ovnkube-node-2vp8z\" (UID: \"009c50dc-2f9e-455b-95f2-a03e7ed3defd\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z"
Jul 15 12:20:32.509590 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.508804    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7f75\" (UniqueName: \"kubernetes.io/projected/7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd-kube-api-access-m7f75\") pod \"multus-cv2md\" (UID: \"7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd\") " pod="openshift-multus/multus-cv2md"
Jul 15 12:20:32.509590 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.508844    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a7be93c-3ae8-4f57-8bb9-ffb11e116493-metrics-certs\") pod \"network-metrics-daemon-ndhnr\" (UID: \"6a7be93c-3ae8-4f57-8bb9-ffb11e116493\") " pod="openshift-multus/network-metrics-daemon-ndhnr"
Jul 15 12:20:32.509590 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.508859    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/f2f64511-8f06-4610-a112-0cd46f0fd503-serviceca\") pod \"node-ca-bctct\" (UID: \"f2f64511-8f06-4610-a112-0cd46f0fd503\") " pod="openshift-image-registry/node-ca-bctct"
Jul 15 12:20:32.509590 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.508880    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f2f64511-8f06-4610-a112-0cd46f0fd503-host\") pod \"node-ca-bctct\" (UID: \"f2f64511-8f06-4610-a112-0cd46f0fd503\") " pod="openshift-image-registry/node-ca-bctct"
Jul 15 12:20:32.509590 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.508916    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/009c50dc-2f9e-455b-95f2-a03e7ed3defd-log-socket\") pod \"ovnkube-node-2vp8z\" (UID: \"009c50dc-2f9e-455b-95f2-a03e7ed3defd\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z"
Jul 15 12:20:32.509590 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.508961    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f2f64511-8f06-4610-a112-0cd46f0fd503-host\") pod \"node-ca-bctct\" (UID: \"f2f64511-8f06-4610-a112-0cd46f0fd503\") " pod="openshift-image-registry/node-ca-bctct"
Jul 15 12:20:32.509590 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.508989    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd-hostroot\") pod \"multus-cv2md\" (UID: \"7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd\") " pod="openshift-multus/multus-cv2md"
Jul 15 12:20:32.509590 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.509033    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/009c50dc-2f9e-455b-95f2-a03e7ed3defd-log-socket\") pod \"ovnkube-node-2vp8z\" (UID: \"009c50dc-2f9e-455b-95f2-a03e7ed3defd\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z"
Jul 15 12:20:32.509590 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.509095    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c0df3610-e8fe-48b2-ba14-4ed9d65f8965-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wj5d4\" (UID: \"c0df3610-e8fe-48b2-ba14-4ed9d65f8965\") " pod="openshift-multus/multus-additional-cni-plugins-wj5d4"
Jul 15 12:20:32.509590 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.509125    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f74223ea-de13-44ca-86b5-555b5a30abef-lib-modules\") pod \"tuned-rcf9z\" (UID: \"f74223ea-de13-44ca-86b5-555b5a30abef\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf9z"
Jul 15 12:20:32.509590 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.509149    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f74223ea-de13-44ca-86b5-555b5a30abef-tmp\") pod \"tuned-rcf9z\" (UID: \"f74223ea-de13-44ca-86b5-555b5a30abef\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf9z"
Jul 15 12:20:32.509590 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.509156    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/009c50dc-2f9e-455b-95f2-a03e7ed3defd-ovnkube-config\") pod \"ovnkube-node-2vp8z\" (UID: \"009c50dc-2f9e-455b-95f2-a03e7ed3defd\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z"
Jul 15 12:20:32.510637 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.509175    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd-multus-daemon-config\") pod \"multus-cv2md\" (UID: \"7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd\") " pod="openshift-multus/multus-cv2md"
Jul 15 12:20:32.510637 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.509191    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/57925e62-a062-44df-bb9f-4b77fd8931d5-iptables-alerter-script\") pod \"iptables-alerter-4dvc2\" (UID: \"57925e62-a062-44df-bb9f-4b77fd8931d5\") " pod="openshift-network-operator/iptables-alerter-4dvc2"
Jul 15 12:20:32.510637 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.509204    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/009c50dc-2f9e-455b-95f2-a03e7ed3defd-run-systemd\") pod \"ovnkube-node-2vp8z\" (UID: \"009c50dc-2f9e-455b-95f2-a03e7ed3defd\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z"
Jul 15 12:20:32.510637 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.509172    2559 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 15 12:20:32.510637 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.509249    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/009c50dc-2f9e-455b-95f2-a03e7ed3defd-run-systemd\") pod \"ovnkube-node-2vp8z\" (UID: \"009c50dc-2f9e-455b-95f2-a03e7ed3defd\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z"
Jul 15 12:20:32.510637 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.509254    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/009c50dc-2f9e-455b-95f2-a03e7ed3defd-etc-openvswitch\") pod \"ovnkube-node-2vp8z\" (UID: \"009c50dc-2f9e-455b-95f2-a03e7ed3defd\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z"
Jul 15 12:20:32.510637 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.509301    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/009c50dc-2f9e-455b-95f2-a03e7ed3defd-etc-openvswitch\") pod \"ovnkube-node-2vp8z\" (UID: \"009c50dc-2f9e-455b-95f2-a03e7ed3defd\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z"
Jul 15 12:20:32.510637 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.509298    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/009c50dc-2f9e-455b-95f2-a03e7ed3defd-host-run-ovn-kubernetes\") pod \"ovnkube-node-2vp8z\" (UID: \"009c50dc-2f9e-455b-95f2-a03e7ed3defd\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z"
Jul 15 12:20:32.510637 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.509350    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/009c50dc-2f9e-455b-95f2-a03e7ed3defd-host-run-ovn-kubernetes\") pod \"ovnkube-node-2vp8z\" (UID: \"009c50dc-2f9e-455b-95f2-a03e7ed3defd\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z"
Jul 15 12:20:32.510637 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.509413    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd-os-release\") pod \"multus-cv2md\" (UID: \"7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd\") " pod="openshift-multus/multus-cv2md"
Jul 15 12:20:32.510637 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.509440    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3aaf289f-60cb-4031-9062-8cbaff2fe9f0-socket-dir\") pod \"aws-ebs-csi-driver-node-j46gp\" (UID: \"3aaf289f-60cb-4031-9062-8cbaff2fe9f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j46gp"
Jul 15 12:20:32.510637 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.509466    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3aaf289f-60cb-4031-9062-8cbaff2fe9f0-sys-fs\") pod \"aws-ebs-csi-driver-node-j46gp\" (UID: \"3aaf289f-60cb-4031-9062-8cbaff2fe9f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j46gp"
Jul 15 12:20:32.510637 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.509492    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/009c50dc-2f9e-455b-95f2-a03e7ed3defd-env-overrides\") pod \"ovnkube-node-2vp8z\" (UID: \"009c50dc-2f9e-455b-95f2-a03e7ed3defd\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z"
Jul 15 12:20:32.510637 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.509517    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f74223ea-de13-44ca-86b5-555b5a30abef-var-lib-kubelet\") pod \"tuned-rcf9z\" (UID: \"f74223ea-de13-44ca-86b5-555b5a30abef\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf9z"
Jul 15 12:20:32.510637 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.509542    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fzkk8\" (UniqueName: \"kubernetes.io/projected/3aaf289f-60cb-4031-9062-8cbaff2fe9f0-kube-api-access-fzkk8\") pod \"aws-ebs-csi-driver-node-j46gp\" (UID: \"3aaf289f-60cb-4031-9062-8cbaff2fe9f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j46gp"
Jul 15 12:20:32.510637 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.509571    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/009c50dc-2f9e-455b-95f2-a03e7ed3defd-run-ovn\") pod \"ovnkube-node-2vp8z\" (UID: \"009c50dc-2f9e-455b-95f2-a03e7ed3defd\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z"
Jul 15 12:20:32.510637 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.509597    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c0df3610-e8fe-48b2-ba14-4ed9d65f8965-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wj5d4\" (UID: \"c0df3610-e8fe-48b2-ba14-4ed9d65f8965\") " pod="openshift-multus/multus-additional-cni-plugins-wj5d4"
Jul 15 12:20:32.511273 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.509620    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd-cnibin\") pod \"multus-cv2md\" (UID: \"7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd\") " pod="openshift-multus/multus-cv2md"
Jul 15 12:20:32.511273 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.509648    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd-cni-binary-copy\") pod \"multus-cv2md\" (UID: \"7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd\") " pod="openshift-multus/multus-cv2md"
Jul 15 12:20:32.511273 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.509672    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd-host-run-k8s-cni-cncf-io\") pod \"multus-cv2md\" (UID: \"7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd\") " pod="openshift-multus/multus-cv2md"
Jul 15 12:20:32.511273 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.509682    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/009c50dc-2f9e-455b-95f2-a03e7ed3defd-run-ovn\") pod \"ovnkube-node-2vp8z\" (UID: \"009c50dc-2f9e-455b-95f2-a03e7ed3defd\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z"
Jul 15 12:20:32.511273 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.509698    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd-host-var-lib-cni-multus\") pod \"multus-cv2md\" (UID: \"7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd\") " pod="openshift-multus/multus-cv2md"
Jul 15 12:20:32.511273 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.509722    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd-etc-kubernetes\") pod \"multus-cv2md\" (UID: \"7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd\") " pod="openshift-multus/multus-cv2md"
Jul 15 12:20:32.511273 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.509748    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b7a79dc6-aa77-49fa-87dd-08ed78b9f4f5-hosts-file\") pod \"node-resolver-qfb4c\" (UID: \"b7a79dc6-aa77-49fa-87dd-08ed78b9f4f5\") " pod="openshift-dns/node-resolver-qfb4c"
Jul 15 12:20:32.511273 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.509777    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/009c50dc-2f9e-455b-95f2-a03e7ed3defd-host-slash\") pod \"ovnkube-node-2vp8z\" (UID: \"009c50dc-2f9e-455b-95f2-a03e7ed3defd\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z"
Jul 15 12:20:32.511273 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.509812    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/009c50dc-2f9e-455b-95f2-a03e7ed3defd-host-run-netns\") pod \"ovnkube-node-2vp8z\" (UID: \"009c50dc-2f9e-455b-95f2-a03e7ed3defd\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z"
Jul 15 12:20:32.511273 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.509834    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/009c50dc-2f9e-455b-95f2-a03e7ed3defd-host-slash\") pod \"ovnkube-node-2vp8z\" (UID: \"009c50dc-2f9e-455b-95f2-a03e7ed3defd\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z"
Jul 15 12:20:32.511273 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.509872    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/009c50dc-2f9e-455b-95f2-a03e7ed3defd-run-openvswitch\") pod \"ovnkube-node-2vp8z\" (UID: \"009c50dc-2f9e-455b-95f2-a03e7ed3defd\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z"
Jul 15 12:20:32.511273 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.509901    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f74223ea-de13-44ca-86b5-555b5a30abef-etc-sysctl-d\") pod \"tuned-rcf9z\" (UID: \"f74223ea-de13-44ca-86b5-555b5a30abef\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf9z"
Jul 15 12:20:32.511273 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.509936    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/009c50dc-2f9e-455b-95f2-a03e7ed3defd-env-overrides\") pod \"ovnkube-node-2vp8z\" (UID: \"009c50dc-2f9e-455b-95f2-a03e7ed3defd\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z"
Jul 15 12:20:32.511273 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.509952    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/009c50dc-2f9e-455b-95f2-a03e7ed3defd-run-openvswitch\") pod \"ovnkube-node-2vp8z\" (UID: \"009c50dc-2f9e-455b-95f2-a03e7ed3defd\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z"
Jul 15 12:20:32.511273 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.509947    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f74223ea-de13-44ca-86b5-555b5a30abef-etc-systemd\") pod \"tuned-rcf9z\" (UID: \"f74223ea-de13-44ca-86b5-555b5a30abef\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf9z"
Jul 15 12:20:32.511273 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.509991    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/009c50dc-2f9e-455b-95f2-a03e7ed3defd-host-run-netns\") pod \"ovnkube-node-2vp8z\" (UID: \"009c50dc-2f9e-455b-95f2-a03e7ed3defd\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z"
Jul 15 12:20:32.511273 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.510034    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f74223ea-de13-44ca-86b5-555b5a30abef-sys\") pod \"tuned-rcf9z\" (UID: \"f74223ea-de13-44ca-86b5-555b5a30abef\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf9z"
Jul 15 12:20:32.511985 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.510063    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd-multus-socket-dir-parent\") pod \"multus-cv2md\" (UID: \"7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd\") " pod="openshift-multus/multus-cv2md"
Jul 15 12:20:32.511985 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.510093    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3aaf289f-60cb-4031-9062-8cbaff2fe9f0-etc-selinux\") pod \"aws-ebs-csi-driver-node-j46gp\" (UID: \"3aaf289f-60cb-4031-9062-8cbaff2fe9f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j46gp"
Jul 15 12:20:32.511985 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.510124    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/57925e62-a062-44df-bb9f-4b77fd8931d5-host-slash\") pod \"iptables-alerter-4dvc2\" (UID: \"57925e62-a062-44df-bb9f-4b77fd8931d5\") " pod="openshift-network-operator/iptables-alerter-4dvc2"
Jul 15 12:20:32.511985 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.510148    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/009c50dc-2f9e-455b-95f2-a03e7ed3defd-host-cni-bin\") pod \"ovnkube-node-2vp8z\" (UID: \"009c50dc-2f9e-455b-95f2-a03e7ed3defd\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z"
Jul 15 12:20:32.511985 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.510173    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/df4bf5c7-9413-4a70-8d17-9eaca62b4373-kubelet-config\") pod \"global-pull-secret-syncer-8ghwr\" (UID: \"df4bf5c7-9413-4a70-8d17-9eaca62b4373\") " pod="kube-system/global-pull-secret-syncer-8ghwr"
Jul 15 12:20:32.511985 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.510190    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/57925e62-a062-44df-bb9f-4b77fd8931d5-host-slash\") pod \"iptables-alerter-4dvc2\" (UID: \"57925e62-a062-44df-bb9f-4b77fd8931d5\") " pod="openshift-network-operator/iptables-alerter-4dvc2"
Jul 15 12:20:32.511985 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.510201    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/df4bf5c7-9413-4a70-8d17-9eaca62b4373-original-pull-secret\") pod \"global-pull-secret-syncer-8ghwr\" (UID: \"df4bf5c7-9413-4a70-8d17-9eaca62b4373\") " pod="kube-system/global-pull-secret-syncer-8ghwr"
Jul 15 12:20:32.511985 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.510212    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/009c50dc-2f9e-455b-95f2-a03e7ed3defd-host-cni-bin\") pod \"ovnkube-node-2vp8z\" (UID: \"009c50dc-2f9e-455b-95f2-a03e7ed3defd\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z"
Jul 15 12:20:32.511985 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.510227    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f74223ea-de13-44ca-86b5-555b5a30abef-etc-sysctl-conf\") pod \"tuned-rcf9z\" (UID: \"f74223ea-de13-44ca-86b5-555b5a30abef\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf9z"
Jul 15 12:20:32.511985 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.510253    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5p2x\" (UniqueName: \"kubernetes.io/projected/b7a79dc6-aa77-49fa-87dd-08ed78b9f4f5-kube-api-access-f5p2x\") pod \"node-resolver-qfb4c\" (UID: \"b7a79dc6-aa77-49fa-87dd-08ed78b9f4f5\") " pod="openshift-dns/node-resolver-qfb4c"
Jul 15 12:20:32.511985 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.510278    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/df4bf5c7-9413-4a70-8d17-9eaca62b4373-dbus\") pod \"global-pull-secret-syncer-8ghwr\" (UID: \"df4bf5c7-9413-4a70-8d17-9eaca62b4373\") " pod="kube-system/global-pull-secret-syncer-8ghwr"
Jul 15 12:20:32.511985 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.510303    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/712fac2c-94a4-4863-84b0-d251b4fcd155-agent-certs\") pod \"konnectivity-agent-ckzbm\" (UID: \"712fac2c-94a4-4863-84b0-d251b4fcd155\") " pod="kube-system/konnectivity-agent-ckzbm"
Jul 15 12:20:32.511985 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.510326    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f74223ea-de13-44ca-86b5-555b5a30abef-etc-sysconfig\") pod \"tuned-rcf9z\" (UID: \"f74223ea-de13-44ca-86b5-555b5a30abef\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf9z"
Jul 15 12:20:32.511985 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.510351    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-877md\" (UniqueName: \"kubernetes.io/projected/f74223ea-de13-44ca-86b5-555b5a30abef-kube-api-access-877md\") pod \"tuned-rcf9z\" (UID: \"f74223ea-de13-44ca-86b5-555b5a30abef\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf9z"
Jul 15 12:20:32.511985 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.510375    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3aaf289f-60cb-4031-9062-8cbaff2fe9f0-device-dir\") pod \"aws-ebs-csi-driver-node-j46gp\" (UID: \"3aaf289f-60cb-4031-9062-8cbaff2fe9f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j46gp"
Jul 15 12:20:32.511985 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.510403    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c0df3610-e8fe-48b2-ba14-4ed9d65f8965-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wj5d4\" (UID: \"c0df3610-e8fe-48b2-ba14-4ed9d65f8965\") " pod="openshift-multus/multus-additional-cni-plugins-wj5d4"
Jul 15 12:20:32.512632 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.510430    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f74223ea-de13-44ca-86b5-555b5a30abef-etc-modprobe-d\") pod \"tuned-rcf9z\" (UID: \"f74223ea-de13-44ca-86b5-555b5a30abef\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf9z"
Jul 15 12:20:32.512632 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.510481    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f74223ea-de13-44ca-86b5-555b5a30abef-run\") pod \"tuned-rcf9z\" (UID: \"f74223ea-de13-44ca-86b5-555b5a30abef\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf9z"
Jul 15 12:20:32.512632 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.510510    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mc4j4\" (UniqueName: \"kubernetes.io/projected/009c50dc-2f9e-455b-95f2-a03e7ed3defd-kube-api-access-mc4j4\") pod \"ovnkube-node-2vp8z\" (UID: \"009c50dc-2f9e-455b-95f2-a03e7ed3defd\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z"
Jul 15 12:20:32.512632 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.510534    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f74223ea-de13-44ca-86b5-555b5a30abef-host\") pod \"tuned-rcf9z\" (UID: \"f74223ea-de13-44ca-86b5-555b5a30abef\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf9z"
Jul 15 12:20:32.512632 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.510557    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd-multus-cni-dir\") pod \"multus-cv2md\" (UID: \"7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd\") " pod="openshift-multus/multus-cv2md"
Jul 15 12:20:32.512632 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.510583    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd-host-var-lib-cni-bin\") pod \"multus-cv2md\" (UID: \"7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd\") " pod="openshift-multus/multus-cv2md"
Jul 15 12:20:32.512632 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.510607    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd-host-run-multus-certs\") pod \"multus-cv2md\" (UID: \"7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd\") " pod="openshift-multus/multus-cv2md"
Jul 15 12:20:32.512632 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.510633    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/009c50dc-2f9e-455b-95f2-a03e7ed3defd-systemd-units\") pod \"ovnkube-node-2vp8z\" (UID: \"009c50dc-2f9e-455b-95f2-a03e7ed3defd\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z"
Jul 15 12:20:32.512632 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.510658    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/009c50dc-2f9e-455b-95f2-a03e7ed3defd-var-lib-openvswitch\") pod \"ovnkube-node-2vp8z\" (UID: \"009c50dc-2f9e-455b-95f2-a03e7ed3defd\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z"
Jul 15 12:20:32.512632 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.510750    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/009c50dc-2f9e-455b-95f2-a03e7ed3defd-systemd-units\") pod \"ovnkube-node-2vp8z\" (UID: \"009c50dc-2f9e-455b-95f2-a03e7ed3defd\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z"
Jul 15 12:20:32.512632 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.510761    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/009c50dc-2f9e-455b-95f2-a03e7ed3defd-var-lib-openvswitch\") pod \"ovnkube-node-2vp8z\" (UID: \"009c50dc-2f9e-455b-95f2-a03e7ed3defd\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z"
Jul 15 12:20:32.513398 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.513348    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/009c50dc-2f9e-455b-95f2-a03e7ed3defd-ovn-node-metrics-cert\") pod \"ovnkube-node-2vp8z\" (UID: \"009c50dc-2f9e-455b-95f2-a03e7ed3defd\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z"
Jul 15 12:20:32.518840 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.518785    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m6xmz\" (UniqueName: \"kubernetes.io/projected/57925e62-a062-44df-bb9f-4b77fd8931d5-kube-api-access-m6xmz\") pod \"iptables-alerter-4dvc2\" (UID: \"57925e62-a062-44df-bb9f-4b77fd8931d5\") " pod="openshift-network-operator/iptables-alerter-4dvc2"
Jul 15 12:20:32.518840 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.518805    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zhq8s\" (UniqueName: \"kubernetes.io/projected/f2f64511-8f06-4610-a112-0cd46f0fd503-kube-api-access-zhq8s\") pod \"node-ca-bctct\" (UID: \"f2f64511-8f06-4610-a112-0cd46f0fd503\") " pod="openshift-image-registry/node-ca-bctct"
Jul 15 12:20:32.519204 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.519184    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mc4j4\" (UniqueName: \"kubernetes.io/projected/009c50dc-2f9e-455b-95f2-a03e7ed3defd-kube-api-access-mc4j4\") pod \"ovnkube-node-2vp8z\" (UID: \"009c50dc-2f9e-455b-95f2-a03e7ed3defd\") " pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z"
Jul 15 12:20:32.583132 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.583064    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-67.ec2.internal" event={"ID":"ad0297be557f741a11c730c41d1f8356","Type":"ContainerStarted","Data":"38458be6430af901d84ca6118d3e68aee19b29649a4c1eaf251ed2ef379d7c5a"}
Jul 15 12:20:32.587526 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.585987    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-67.ec2.internal" event={"ID":"52d9088551c115f98811f24856a62fc9","Type":"ContainerStarted","Data":"e0da6a87fa9b4910d5b852565419c97af9d7371763b8f8b374f0e51ff1698e97"}
Jul 15 12:20:32.611273 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.611235    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd-host-run-netns\") pod \"multus-cv2md\" (UID: \"7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd\") " pod="openshift-multus/multus-cv2md"
Jul 15 12:20:32.611490 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.611284    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd-multus-conf-dir\") pod \"multus-cv2md\" (UID: \"7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd\") " pod="openshift-multus/multus-cv2md"
Jul 15 12:20:32.611490 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.611329    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3aaf289f-60cb-4031-9062-8cbaff2fe9f0-registration-dir\") pod \"aws-ebs-csi-driver-node-j46gp\" (UID: \"3aaf289f-60cb-4031-9062-8cbaff2fe9f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j46gp"
Jul 15 12:20:32.611490 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.611360    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f74223ea-de13-44ca-86b5-555b5a30abef-etc-kubernetes\") pod \"tuned-rcf9z\" (UID: \"f74223ea-de13-44ca-86b5-555b5a30abef\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf9z"
Jul 15 12:20:32.611490 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.611410    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd-system-cni-dir\") pod \"multus-cv2md\" (UID: \"7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd\") " pod="openshift-multus/multus-cv2md"
Jul 15 12:20:32.611490 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.611451    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd-host-var-lib-kubelet\") pod \"multus-cv2md\" (UID: \"7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd\") " pod="openshift-multus/multus-cv2md"
Jul 15 12:20:32.611704 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.611540    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vk5dd\" (UniqueName: \"kubernetes.io/projected/6aeeccdd-6c28-44fd-99e8-d6426f00525b-kube-api-access-vk5dd\") pod \"network-check-target-7jz7w\" (UID: \"6aeeccdd-6c28-44fd-99e8-d6426f00525b\") " pod="openshift-network-diagnostics/network-check-target-7jz7w"
Jul 15 12:20:32.611704 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.611569    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c0df3610-e8fe-48b2-ba14-4ed9d65f8965-os-release\") pod \"multus-additional-cni-plugins-wj5d4\" (UID: \"c0df3610-e8fe-48b2-ba14-4ed9d65f8965\") " pod="openshift-multus/multus-additional-cni-plugins-wj5d4"
Jul 15 12:20:32.611704 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.611603    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7f75\" (UniqueName: \"kubernetes.io/projected/7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd-kube-api-access-m7f75\") pod \"multus-cv2md\" (UID: \"7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd\") " pod="openshift-multus/multus-cv2md"
Jul 15 12:20:32.611704 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.611648    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a7be93c-3ae8-4f57-8bb9-ffb11e116493-metrics-certs\") pod \"network-metrics-daemon-ndhnr\" (UID: \"6a7be93c-3ae8-4f57-8bb9-ffb11e116493\") " pod="openshift-multus/network-metrics-daemon-ndhnr"
Jul 15 12:20:32.611704 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.611684    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd-hostroot\") pod \"multus-cv2md\" (UID: \"7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd\") " pod="openshift-multus/multus-cv2md"
Jul 15 12:20:32.611911 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.611711    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c0df3610-e8fe-48b2-ba14-4ed9d65f8965-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wj5d4\" (UID: \"c0df3610-e8fe-48b2-ba14-4ed9d65f8965\") " pod="openshift-multus/multus-additional-cni-plugins-wj5d4"
Jul 15 12:20:32.611911 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.611737    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f74223ea-de13-44ca-86b5-555b5a30abef-lib-modules\") pod \"tuned-rcf9z\" (UID: \"f74223ea-de13-44ca-86b5-555b5a30abef\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf9z"
Jul 15 12:20:32.611911 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.611762    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f74223ea-de13-44ca-86b5-555b5a30abef-tmp\") pod \"tuned-rcf9z\" (UID: \"f74223ea-de13-44ca-86b5-555b5a30abef\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf9z"
Jul 15 12:20:32.611911 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.611790    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd-multus-daemon-config\") pod \"multus-cv2md\" (UID: \"7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd\") " pod="openshift-multus/multus-cv2md"
Jul 15 12:20:32.611911 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.611817    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd-os-release\") pod \"multus-cv2md\" (UID: \"7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd\") " pod="openshift-multus/multus-cv2md"
Jul 15 12:20:32.611911 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.611841    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3aaf289f-60cb-4031-9062-8cbaff2fe9f0-socket-dir\") pod \"aws-ebs-csi-driver-node-j46gp\" (UID: \"3aaf289f-60cb-4031-9062-8cbaff2fe9f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j46gp"
Jul 15 12:20:32.611911 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.611865    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3aaf289f-60cb-4031-9062-8cbaff2fe9f0-sys-fs\") pod \"aws-ebs-csi-driver-node-j46gp\" (UID: \"3aaf289f-60cb-4031-9062-8cbaff2fe9f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j46gp"
Jul 15 12:20:32.611911 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.611890    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f74223ea-de13-44ca-86b5-555b5a30abef-var-lib-kubelet\") pod \"tuned-rcf9z\" (UID: \"f74223ea-de13-44ca-86b5-555b5a30abef\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf9z"
Jul 15 12:20:32.612267 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.611916    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fzkk8\" (UniqueName: \"kubernetes.io/projected/3aaf289f-60cb-4031-9062-8cbaff2fe9f0-kube-api-access-fzkk8\") pod \"aws-ebs-csi-driver-node-j46gp\" (UID: \"3aaf289f-60cb-4031-9062-8cbaff2fe9f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j46gp"
Jul 15 12:20:32.612267 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.611943    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c0df3610-e8fe-48b2-ba14-4ed9d65f8965-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wj5d4\" (UID: \"c0df3610-e8fe-48b2-ba14-4ed9d65f8965\") " pod="openshift-multus/multus-additional-cni-plugins-wj5d4"
Jul 15 12:20:32.612267 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.611973    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd-cnibin\") pod \"multus-cv2md\" (UID: \"7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd\") " pod="openshift-multus/multus-cv2md"
Jul 15 12:20:32.612267 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.612009    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd-cni-binary-copy\") pod \"multus-cv2md\" (UID: \"7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd\") " pod="openshift-multus/multus-cv2md"
Jul 15 12:20:32.612267 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.612034    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd-host-run-k8s-cni-cncf-io\") pod \"multus-cv2md\" (UID: \"7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd\") " pod="openshift-multus/multus-cv2md"
Jul 15 12:20:32.612267 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.612061    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd-host-var-lib-cni-multus\") pod \"multus-cv2md\" (UID: \"7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd\") " pod="openshift-multus/multus-cv2md"
Jul 15 12:20:32.612267 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.612087    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd-etc-kubernetes\") pod \"multus-cv2md\" (UID: \"7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd\") " pod="openshift-multus/multus-cv2md"
Jul 15 12:20:32.612267 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.612112    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b7a79dc6-aa77-49fa-87dd-08ed78b9f4f5-hosts-file\") pod \"node-resolver-qfb4c\" (UID: \"b7a79dc6-aa77-49fa-87dd-08ed78b9f4f5\") " pod="openshift-dns/node-resolver-qfb4c"
Jul 15 12:20:32.612267 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.612139    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f74223ea-de13-44ca-86b5-555b5a30abef-etc-sysctl-d\") pod \"tuned-rcf9z\" (UID: \"f74223ea-de13-44ca-86b5-555b5a30abef\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf9z"
Jul 15 12:20:32.612267 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.612163    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f74223ea-de13-44ca-86b5-555b5a30abef-etc-systemd\") pod \"tuned-rcf9z\" (UID: \"f74223ea-de13-44ca-86b5-555b5a30abef\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf9z"
Jul 15 12:20:32.612267 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.612192    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f74223ea-de13-44ca-86b5-555b5a30abef-sys\") pod \"tuned-rcf9z\" (UID: \"f74223ea-de13-44ca-86b5-555b5a30abef\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf9z"
Jul 15 12:20:32.612267 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.612221    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd-multus-socket-dir-parent\") pod \"multus-cv2md\" (UID: \"7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd\") " pod="openshift-multus/multus-cv2md"
Jul 15 12:20:32.612267 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.612247    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3aaf289f-60cb-4031-9062-8cbaff2fe9f0-etc-selinux\") pod \"aws-ebs-csi-driver-node-j46gp\" (UID: \"3aaf289f-60cb-4031-9062-8cbaff2fe9f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j46gp"
Jul 15 12:20:32.612870 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.612278    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/df4bf5c7-9413-4a70-8d17-9eaca62b4373-kubelet-config\") pod \"global-pull-secret-syncer-8ghwr\" (UID: \"df4bf5c7-9413-4a70-8d17-9eaca62b4373\") " pod="kube-system/global-pull-secret-syncer-8ghwr"
Jul 15 12:20:32.612870 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.612304    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/df4bf5c7-9413-4a70-8d17-9eaca62b4373-original-pull-secret\") pod \"global-pull-secret-syncer-8ghwr\" (UID: \"df4bf5c7-9413-4a70-8d17-9eaca62b4373\") " pod="kube-system/global-pull-secret-syncer-8ghwr"
Jul 15 12:20:32.612870 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.612332    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f74223ea-de13-44ca-86b5-555b5a30abef-etc-sysctl-conf\") pod \"tuned-rcf9z\" (UID: \"f74223ea-de13-44ca-86b5-555b5a30abef\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf9z"
Jul 15 12:20:32.612870 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.612359    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5p2x\" (UniqueName: \"kubernetes.io/projected/b7a79dc6-aa77-49fa-87dd-08ed78b9f4f5-kube-api-access-f5p2x\") pod \"node-resolver-qfb4c\" (UID: \"b7a79dc6-aa77-49fa-87dd-08ed78b9f4f5\") " pod="openshift-dns/node-resolver-qfb4c"
Jul 15 12:20:32.612870 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.612384    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/df4bf5c7-9413-4a70-8d17-9eaca62b4373-dbus\") pod \"global-pull-secret-syncer-8ghwr\" (UID: \"df4bf5c7-9413-4a70-8d17-9eaca62b4373\") " pod="kube-system/global-pull-secret-syncer-8ghwr"
Jul 15 12:20:32.612870 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.612408    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/712fac2c-94a4-4863-84b0-d251b4fcd155-agent-certs\") pod \"konnectivity-agent-ckzbm\" (UID: \"712fac2c-94a4-4863-84b0-d251b4fcd155\") " pod="kube-system/konnectivity-agent-ckzbm"
Jul 15 12:20:32.612870 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.612434    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f74223ea-de13-44ca-86b5-555b5a30abef-etc-sysconfig\") pod \"tuned-rcf9z\" (UID: \"f74223ea-de13-44ca-86b5-555b5a30abef\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf9z"
Jul 15 12:20:32.612870 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.612463    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3aaf289f-60cb-4031-9062-8cbaff2fe9f0-sys-fs\") pod \"aws-ebs-csi-driver-node-j46gp\" (UID: \"3aaf289f-60cb-4031-9062-8cbaff2fe9f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j46gp"
Jul 15 12:20:32.612870 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.612498    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-877md\" (UniqueName: \"kubernetes.io/projected/f74223ea-de13-44ca-86b5-555b5a30abef-kube-api-access-877md\") pod \"tuned-rcf9z\" (UID: \"f74223ea-de13-44ca-86b5-555b5a30abef\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf9z"
Jul 15 12:20:32.612870 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.612525    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3aaf289f-60cb-4031-9062-8cbaff2fe9f0-device-dir\") pod \"aws-ebs-csi-driver-node-j46gp\" (UID: \"3aaf289f-60cb-4031-9062-8cbaff2fe9f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j46gp"
Jul 15 12:20:32.612870 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.612554    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c0df3610-e8fe-48b2-ba14-4ed9d65f8965-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wj5d4\" (UID: \"c0df3610-e8fe-48b2-ba14-4ed9d65f8965\") " pod="openshift-multus/multus-additional-cni-plugins-wj5d4"
Jul 15 12:20:32.612870 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.612560    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd-multus-conf-dir\") pod \"multus-cv2md\" (UID: \"7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd\") " pod="openshift-multus/multus-cv2md"
Jul 15 12:20:32.612870 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.612582    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f74223ea-de13-44ca-86b5-555b5a30abef-etc-modprobe-d\") pod \"tuned-rcf9z\" (UID: \"f74223ea-de13-44ca-86b5-555b5a30abef\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf9z"
Jul 15 12:20:32.612870 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.612608    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f74223ea-de13-44ca-86b5-555b5a30abef-run\") pod \"tuned-rcf9z\" (UID: \"f74223ea-de13-44ca-86b5-555b5a30abef\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf9z"
Jul 15 12:20:32.612870 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.612612    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f74223ea-de13-44ca-86b5-555b5a30abef-sys\") pod \"tuned-rcf9z\" (UID: \"f74223ea-de13-44ca-86b5-555b5a30abef\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf9z"
Jul 15 12:20:32.612870 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.612633    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f74223ea-de13-44ca-86b5-555b5a30abef-host\") pod \"tuned-rcf9z\" (UID: \"f74223ea-de13-44ca-86b5-555b5a30abef\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf9z"
Jul 15 12:20:32.612870 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.612616    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3aaf289f-60cb-4031-9062-8cbaff2fe9f0-registration-dir\") pod \"aws-ebs-csi-driver-node-j46gp\" (UID: \"3aaf289f-60cb-4031-9062-8cbaff2fe9f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j46gp"
Jul 15 12:20:32.613708 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.612654    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f74223ea-de13-44ca-86b5-555b5a30abef-etc-kubernetes\") pod \"tuned-rcf9z\" (UID: \"f74223ea-de13-44ca-86b5-555b5a30abef\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf9z"
Jul 15 12:20:32.613708 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.612661    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd-multus-cni-dir\") pod \"multus-cv2md\" (UID: \"7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd\") " pod="openshift-multus/multus-cv2md"
Jul 15 12:20:32.613708 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.612695    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f74223ea-de13-44ca-86b5-555b5a30abef-var-lib-kubelet\") pod \"tuned-rcf9z\" (UID: \"f74223ea-de13-44ca-86b5-555b5a30abef\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf9z"
Jul 15 12:20:32.613708 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.612706    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd-system-cni-dir\") pod \"multus-cv2md\" (UID: \"7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd\") " pod="openshift-multus/multus-cv2md"
Jul 15 12:20:32.613708 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.612733    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd-host-var-lib-cni-bin\") pod \"multus-cv2md\" (UID: \"7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd\") " pod="openshift-multus/multus-cv2md"
Jul 15 12:20:32.613708 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.612756    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd-host-run-multus-certs\") pod \"multus-cv2md\" (UID: \"7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd\") " pod="openshift-multus/multus-cv2md"
Jul 15 12:20:32.613708 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.612783    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g68xz\" (UniqueName: \"kubernetes.io/projected/6a7be93c-3ae8-4f57-8bb9-ffb11e116493-kube-api-access-g68xz\") pod \"network-metrics-daemon-ndhnr\" (UID: \"6a7be93c-3ae8-4f57-8bb9-ffb11e116493\") " pod="openshift-multus/network-metrics-daemon-ndhnr"
Jul 15 12:20:32.613708 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.612812    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3aaf289f-60cb-4031-9062-8cbaff2fe9f0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j46gp\" (UID: \"3aaf289f-60cb-4031-9062-8cbaff2fe9f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j46gp"
Jul 15 12:20:32.613708 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.612818    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd-multus-socket-dir-parent\") pod \"multus-cv2md\" (UID: \"7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd\") " pod="openshift-multus/multus-cv2md"
Jul 15 12:20:32.613708 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.612866    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd-host-var-lib-kubelet\") pod \"multus-cv2md\" (UID: \"7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd\") " pod="openshift-multus/multus-cv2md"
Jul 15 12:20:32.613708 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.612867    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3aaf289f-60cb-4031-9062-8cbaff2fe9f0-kubelet-dir\") pod \"aws-ebs-csi-driver-node-j46gp\" (UID: \"3aaf289f-60cb-4031-9062-8cbaff2fe9f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j46gp"
Jul 15 12:20:32.613708 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.612954    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3aaf289f-60cb-4031-9062-8cbaff2fe9f0-etc-selinux\") pod \"aws-ebs-csi-driver-node-j46gp\" (UID: \"3aaf289f-60cb-4031-9062-8cbaff2fe9f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j46gp"
Jul 15 12:20:32.613708 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.612526    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd-host-run-netns\") pod \"multus-cv2md\" (UID: \"7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd\") " pod="openshift-multus/multus-cv2md"
Jul 15 12:20:32.613708 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.613026    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3aaf289f-60cb-4031-9062-8cbaff2fe9f0-device-dir\") pod \"aws-ebs-csi-driver-node-j46gp\" (UID: \"3aaf289f-60cb-4031-9062-8cbaff2fe9f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j46gp"
Jul 15 12:20:32.613708 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.613032    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b7a79dc6-aa77-49fa-87dd-08ed78b9f4f5-tmp-dir\") pod \"node-resolver-qfb4c\" (UID: \"b7a79dc6-aa77-49fa-87dd-08ed78b9f4f5\") " pod="openshift-dns/node-resolver-qfb4c"
Jul 15 12:20:32.613708 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.613128    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/c0df3610-e8fe-48b2-ba14-4ed9d65f8965-tuning-conf-dir\") pod \"multus-additional-cni-plugins-wj5d4\" (UID: \"c0df3610-e8fe-48b2-ba14-4ed9d65f8965\") " pod="openshift-multus/multus-additional-cni-plugins-wj5d4"
Jul 15 12:20:32.613708 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.613137    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f74223ea-de13-44ca-86b5-555b5a30abef-run\") pod \"tuned-rcf9z\" (UID: \"f74223ea-de13-44ca-86b5-555b5a30abef\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf9z"
Jul 15 12:20:32.613708 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.613194    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/c0df3610-e8fe-48b2-ba14-4ed9d65f8965-os-release\") pod \"multus-additional-cni-plugins-wj5d4\" (UID: \"c0df3610-e8fe-48b2-ba14-4ed9d65f8965\") " pod="openshift-multus/multus-additional-cni-plugins-wj5d4"
Jul 15 12:20:32.614684 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.613201    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd-cnibin\") pod \"multus-cv2md\" (UID: \"7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd\") " pod="openshift-multus/multus-cv2md"
Jul 15 12:20:32.614684 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.613247    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f74223ea-de13-44ca-86b5-555b5a30abef-host\") pod \"tuned-rcf9z\" (UID: \"f74223ea-de13-44ca-86b5-555b5a30abef\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf9z"
Jul 15 12:20:32.614684 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.613389    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f74223ea-de13-44ca-86b5-555b5a30abef-etc-modprobe-d\") pod \"tuned-rcf9z\" (UID: \"f74223ea-de13-44ca-86b5-555b5a30abef\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf9z"
Jul 15 12:20:32.614684 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.613395    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd-multus-cni-dir\") pod \"multus-cv2md\" (UID: \"7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd\") " pod="openshift-multus/multus-cv2md"
Jul 15 12:20:32.614684 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:32.613550    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 12:20:32.614684 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.613608    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd-etc-kubernetes\") pod \"multus-cv2md\" (UID: \"7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd\") " pod="openshift-multus/multus-cv2md"
Jul 15 12:20:32.614684 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.613619    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd-host-run-k8s-cni-cncf-io\") pod \"multus-cv2md\" (UID: \"7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd\") " pod="openshift-multus/multus-cv2md"
Jul 15 12:20:32.614684 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.613659    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd-host-var-lib-cni-multus\") pod \"multus-cv2md\" (UID: \"7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd\") " pod="openshift-multus/multus-cv2md"
Jul 15 12:20:32.614684 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:32.613701    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df4bf5c7-9413-4a70-8d17-9eaca62b4373-original-pull-secret podName:df4bf5c7-9413-4a70-8d17-9eaca62b4373 nodeName:}" failed. No retries permitted until 2026-07-15 12:20:33.113674208 +0000 UTC m=+3.086245375 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/df4bf5c7-9413-4a70-8d17-9eaca62b4373-original-pull-secret") pod "global-pull-secret-syncer-8ghwr" (UID: "df4bf5c7-9413-4a70-8d17-9eaca62b4373") : object "kube-system"/"original-pull-secret" not registered
Jul 15 12:20:32.614684 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.613723    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/c0df3610-e8fe-48b2-ba14-4ed9d65f8965-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-wj5d4\" (UID: \"c0df3610-e8fe-48b2-ba14-4ed9d65f8965\") " pod="openshift-multus/multus-additional-cni-plugins-wj5d4"
Jul 15 12:20:32.614684 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.613792    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f74223ea-de13-44ca-86b5-555b5a30abef-etc-sysctl-conf\") pod \"tuned-rcf9z\" (UID: \"f74223ea-de13-44ca-86b5-555b5a30abef\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf9z"
Jul 15 12:20:32.614684 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.613795    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd-cni-binary-copy\") pod \"multus-cv2md\" (UID: \"7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd\") " pod="openshift-multus/multus-cv2md"
Jul 15 12:20:32.614684 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.613848    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b7a79dc6-aa77-49fa-87dd-08ed78b9f4f5-hosts-file\") pod \"node-resolver-qfb4c\" (UID: \"b7a79dc6-aa77-49fa-87dd-08ed78b9f4f5\") " pod="openshift-dns/node-resolver-qfb4c"
Jul 15 12:20:32.614684 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.613950    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3aaf289f-60cb-4031-9062-8cbaff2fe9f0-socket-dir\") pod \"aws-ebs-csi-driver-node-j46gp\" (UID: \"3aaf289f-60cb-4031-9062-8cbaff2fe9f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j46gp"
Jul 15 12:20:32.614684 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.614061    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f74223ea-de13-44ca-86b5-555b5a30abef-etc-sysctl-d\") pod \"tuned-rcf9z\" (UID: \"f74223ea-de13-44ca-86b5-555b5a30abef\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf9z"
Jul 15 12:20:32.614684 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.614112    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/df4bf5c7-9413-4a70-8d17-9eaca62b4373-dbus\") pod \"global-pull-secret-syncer-8ghwr\" (UID: \"df4bf5c7-9413-4a70-8d17-9eaca62b4373\") " pod="kube-system/global-pull-secret-syncer-8ghwr"
Jul 15 12:20:32.614684 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.614161    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/df4bf5c7-9413-4a70-8d17-9eaca62b4373-kubelet-config\") pod \"global-pull-secret-syncer-8ghwr\" (UID: \"df4bf5c7-9413-4a70-8d17-9eaca62b4373\") " pod="kube-system/global-pull-secret-syncer-8ghwr"
Jul 15 12:20:32.614684 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.614166    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd-multus-daemon-config\") pod \"multus-cv2md\" (UID: \"7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd\") " pod="openshift-multus/multus-cv2md"
Jul 15 12:20:32.615623 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.614176    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd-host-var-lib-cni-bin\") pod \"multus-cv2md\" (UID: \"7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd\") " pod="openshift-multus/multus-cv2md"
Jul 15 12:20:32.615623 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.614208    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c0df3610-e8fe-48b2-ba14-4ed9d65f8965-cnibin\") pod \"multus-additional-cni-plugins-wj5d4\" (UID: \"c0df3610-e8fe-48b2-ba14-4ed9d65f8965\") " pod="openshift-multus/multus-additional-cni-plugins-wj5d4"
Jul 15 12:20:32.615623 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.614221    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd-host-run-multus-certs\") pod \"multus-cv2md\" (UID: \"7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd\") " pod="openshift-multus/multus-cv2md"
Jul 15 12:20:32.615623 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.614237    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f74223ea-de13-44ca-86b5-555b5a30abef-etc-systemd\") pod \"tuned-rcf9z\" (UID: \"f74223ea-de13-44ca-86b5-555b5a30abef\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf9z"
Jul 15 12:20:32.615623 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.614269    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f74223ea-de13-44ca-86b5-555b5a30abef-etc-sysconfig\") pod \"tuned-rcf9z\" (UID: \"f74223ea-de13-44ca-86b5-555b5a30abef\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf9z"
Jul 15 12:20:32.615623 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:32.614284    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 12:20:32.615623 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.614326    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c0df3610-e8fe-48b2-ba14-4ed9d65f8965-cni-binary-copy\") pod \"multus-additional-cni-plugins-wj5d4\" (UID: \"c0df3610-e8fe-48b2-ba14-4ed9d65f8965\") " pod="openshift-multus/multus-additional-cni-plugins-wj5d4"
Jul 15 12:20:32.615623 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.614356    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd-hostroot\") pod \"multus-cv2md\" (UID: \"7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd\") " pod="openshift-multus/multus-cv2md"
Jul 15 12:20:32.615623 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.614359    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/712fac2c-94a4-4863-84b0-d251b4fcd155-konnectivity-ca\") pod \"konnectivity-agent-ckzbm\" (UID: \"712fac2c-94a4-4863-84b0-d251b4fcd155\") " pod="kube-system/konnectivity-agent-ckzbm"
Jul 15 12:20:32.615623 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.614328    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/c0df3610-e8fe-48b2-ba14-4ed9d65f8965-cnibin\") pod \"multus-additional-cni-plugins-wj5d4\" (UID: \"c0df3610-e8fe-48b2-ba14-4ed9d65f8965\") " pod="openshift-multus/multus-additional-cni-plugins-wj5d4"
Jul 15 12:20:32.615623 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.614363    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b7a79dc6-aa77-49fa-87dd-08ed78b9f4f5-tmp-dir\") pod \"node-resolver-qfb4c\" (UID: \"b7a79dc6-aa77-49fa-87dd-08ed78b9f4f5\") " pod="openshift-dns/node-resolver-qfb4c"
Jul 15 12:20:32.615623 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.614358    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/c0df3610-e8fe-48b2-ba14-4ed9d65f8965-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-wj5d4\" (UID: \"c0df3610-e8fe-48b2-ba14-4ed9d65f8965\") " pod="openshift-multus/multus-additional-cni-plugins-wj5d4"
Jul 15 12:20:32.615623 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:32.614422    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a7be93c-3ae8-4f57-8bb9-ffb11e116493-metrics-certs podName:6a7be93c-3ae8-4f57-8bb9-ffb11e116493 nodeName:}" failed. No retries permitted until 2026-07-15 12:20:33.11440443 +0000 UTC m=+3.086975575 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6a7be93c-3ae8-4f57-8bb9-ffb11e116493-metrics-certs") pod "network-metrics-daemon-ndhnr" (UID: "6a7be93c-3ae8-4f57-8bb9-ffb11e116493") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 12:20:32.615623 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.614497    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f74223ea-de13-44ca-86b5-555b5a30abef-lib-modules\") pod \"tuned-rcf9z\" (UID: \"f74223ea-de13-44ca-86b5-555b5a30abef\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf9z"
Jul 15 12:20:32.615623 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.614501    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd-os-release\") pod \"multus-cv2md\" (UID: \"7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd\") " pod="openshift-multus/multus-cv2md"
Jul 15 12:20:32.615623 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.614519    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f74223ea-de13-44ca-86b5-555b5a30abef-etc-tuned\") pod \"tuned-rcf9z\" (UID: \"f74223ea-de13-44ca-86b5-555b5a30abef\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf9z"
Jul 15 12:20:32.615623 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.614654    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c0df3610-e8fe-48b2-ba14-4ed9d65f8965-system-cni-dir\") pod \"multus-additional-cni-plugins-wj5d4\" (UID: \"c0df3610-e8fe-48b2-ba14-4ed9d65f8965\") " pod="openshift-multus/multus-additional-cni-plugins-wj5d4"
Jul 15 12:20:32.616538 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.614697    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sxv7m\" (UniqueName: \"kubernetes.io/projected/c0df3610-e8fe-48b2-ba14-4ed9d65f8965-kube-api-access-sxv7m\") pod \"multus-additional-cni-plugins-wj5d4\" (UID: \"c0df3610-e8fe-48b2-ba14-4ed9d65f8965\") " pod="openshift-multus/multus-additional-cni-plugins-wj5d4"
Jul 15 12:20:32.616538 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.614731    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/c0df3610-e8fe-48b2-ba14-4ed9d65f8965-system-cni-dir\") pod \"multus-additional-cni-plugins-wj5d4\" (UID: \"c0df3610-e8fe-48b2-ba14-4ed9d65f8965\") " pod="openshift-multus/multus-additional-cni-plugins-wj5d4"
Jul 15 12:20:32.616538 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.614859    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/c0df3610-e8fe-48b2-ba14-4ed9d65f8965-cni-binary-copy\") pod \"multus-additional-cni-plugins-wj5d4\" (UID: \"c0df3610-e8fe-48b2-ba14-4ed9d65f8965\") " pod="openshift-multus/multus-additional-cni-plugins-wj5d4"
Jul 15 12:20:32.616538 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.615018    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/712fac2c-94a4-4863-84b0-d251b4fcd155-konnectivity-ca\") pod \"konnectivity-agent-ckzbm\" (UID: \"712fac2c-94a4-4863-84b0-d251b4fcd155\") " pod="kube-system/konnectivity-agent-ckzbm"
Jul 15 12:20:32.617469 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.617250    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f74223ea-de13-44ca-86b5-555b5a30abef-etc-tuned\") pod \"tuned-rcf9z\" (UID: \"f74223ea-de13-44ca-86b5-555b5a30abef\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf9z"
Jul 15 12:20:32.617469 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.617412    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/712fac2c-94a4-4863-84b0-d251b4fcd155-agent-certs\") pod \"konnectivity-agent-ckzbm\" (UID: \"712fac2c-94a4-4863-84b0-d251b4fcd155\") " pod="kube-system/konnectivity-agent-ckzbm"
Jul 15 12:20:32.618826 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.618757    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f74223ea-de13-44ca-86b5-555b5a30abef-tmp\") pod \"tuned-rcf9z\" (UID: \"f74223ea-de13-44ca-86b5-555b5a30abef\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf9z"
Jul 15 12:20:32.622151 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:32.622071    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 12:20:32.622151 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:32.622095    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 12:20:32.622151 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:32.622109    2559 projected.go:196] Error preparing data for projected volume kube-api-access-vk5dd for pod openshift-network-diagnostics/network-check-target-7jz7w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 12:20:32.622363 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:32.622191    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6aeeccdd-6c28-44fd-99e8-d6426f00525b-kube-api-access-vk5dd podName:6aeeccdd-6c28-44fd-99e8-d6426f00525b nodeName:}" failed. No retries permitted until 2026-07-15 12:20:33.122172663 +0000 UTC m=+3.094743822 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-vk5dd" (UniqueName: "kubernetes.io/projected/6aeeccdd-6c28-44fd-99e8-d6426f00525b-kube-api-access-vk5dd") pod "network-check-target-7jz7w" (UID: "6aeeccdd-6c28-44fd-99e8-d6426f00525b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 12:20:32.622721 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.622690    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fzkk8\" (UniqueName: \"kubernetes.io/projected/3aaf289f-60cb-4031-9062-8cbaff2fe9f0-kube-api-access-fzkk8\") pod \"aws-ebs-csi-driver-node-j46gp\" (UID: \"3aaf289f-60cb-4031-9062-8cbaff2fe9f0\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j46gp"
Jul 15 12:20:32.625843 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.625630    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-877md\" (UniqueName: \"kubernetes.io/projected/f74223ea-de13-44ca-86b5-555b5a30abef-kube-api-access-877md\") pod \"tuned-rcf9z\" (UID: \"f74223ea-de13-44ca-86b5-555b5a30abef\") " pod="openshift-cluster-node-tuning-operator/tuned-rcf9z"
Jul 15 12:20:32.627951 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.627853    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7f75\" (UniqueName: \"kubernetes.io/projected/7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd-kube-api-access-m7f75\") pod \"multus-cv2md\" (UID: \"7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd\") " pod="openshift-multus/multus-cv2md"
Jul 15 12:20:32.627951 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.627876    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sxv7m\" (UniqueName: \"kubernetes.io/projected/c0df3610-e8fe-48b2-ba14-4ed9d65f8965-kube-api-access-sxv7m\") pod \"multus-additional-cni-plugins-wj5d4\" (UID: \"c0df3610-e8fe-48b2-ba14-4ed9d65f8965\") " pod="openshift-multus/multus-additional-cni-plugins-wj5d4"
Jul 15 12:20:32.630912 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.628417    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5p2x\" (UniqueName: \"kubernetes.io/projected/b7a79dc6-aa77-49fa-87dd-08ed78b9f4f5-kube-api-access-f5p2x\") pod \"node-resolver-qfb4c\" (UID: \"b7a79dc6-aa77-49fa-87dd-08ed78b9f4f5\") " pod="openshift-dns/node-resolver-qfb4c"
Jul 15 12:20:32.630912 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.629924    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g68xz\" (UniqueName: \"kubernetes.io/projected/6a7be93c-3ae8-4f57-8bb9-ffb11e116493-kube-api-access-g68xz\") pod \"network-metrics-daemon-ndhnr\" (UID: \"6a7be93c-3ae8-4f57-8bb9-ffb11e116493\") " pod="openshift-multus/network-metrics-daemon-ndhnr"
Jul 15 12:20:32.699463 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.699182    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-bctct"
Jul 15 12:20:32.710283 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.710082    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4dvc2"
Jul 15 12:20:32.718954 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.718752    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z"
Jul 15 12:20:32.726710 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.726625    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j46gp"
Jul 15 12:20:32.733943 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.733918    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-rcf9z"
Jul 15 12:20:32.741195 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.741175    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-qfb4c"
Jul 15 12:20:32.748221 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.748199    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-wj5d4"
Jul 15 12:20:32.755176 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.755092    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-ckzbm"
Jul 15 12:20:32.761011 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.760983    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-cv2md"
Jul 15 12:20:32.815929 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:32.815885    2559 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 12:20:33.119095 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:33.119008    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a7be93c-3ae8-4f57-8bb9-ffb11e116493-metrics-certs\") pod \"network-metrics-daemon-ndhnr\" (UID: \"6a7be93c-3ae8-4f57-8bb9-ffb11e116493\") " pod="openshift-multus/network-metrics-daemon-ndhnr"
Jul 15 12:20:33.119095 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:33.119074    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/df4bf5c7-9413-4a70-8d17-9eaca62b4373-original-pull-secret\") pod \"global-pull-secret-syncer-8ghwr\" (UID: \"df4bf5c7-9413-4a70-8d17-9eaca62b4373\") " pod="kube-system/global-pull-secret-syncer-8ghwr"
Jul 15 12:20:33.119341 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:33.119192    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 12:20:33.119341 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:33.119196    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 12:20:33.119341 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:33.119265    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df4bf5c7-9413-4a70-8d17-9eaca62b4373-original-pull-secret podName:df4bf5c7-9413-4a70-8d17-9eaca62b4373 nodeName:}" failed. No retries permitted until 2026-07-15 12:20:34.119245177 +0000 UTC m=+4.091816336 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/df4bf5c7-9413-4a70-8d17-9eaca62b4373-original-pull-secret") pod "global-pull-secret-syncer-8ghwr" (UID: "df4bf5c7-9413-4a70-8d17-9eaca62b4373") : object "kube-system"/"original-pull-secret" not registered
Jul 15 12:20:33.119341 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:33.119282    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a7be93c-3ae8-4f57-8bb9-ffb11e116493-metrics-certs podName:6a7be93c-3ae8-4f57-8bb9-ffb11e116493 nodeName:}" failed. No retries permitted until 2026-07-15 12:20:34.119274391 +0000 UTC m=+4.091845528 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6a7be93c-3ae8-4f57-8bb9-ffb11e116493-metrics-certs") pod "network-metrics-daemon-ndhnr" (UID: "6a7be93c-3ae8-4f57-8bb9-ffb11e116493") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 12:20:33.219876 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:33.219839    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vk5dd\" (UniqueName: \"kubernetes.io/projected/6aeeccdd-6c28-44fd-99e8-d6426f00525b-kube-api-access-vk5dd\") pod \"network-check-target-7jz7w\" (UID: \"6aeeccdd-6c28-44fd-99e8-d6426f00525b\") " pod="openshift-network-diagnostics/network-check-target-7jz7w"
Jul 15 12:20:33.220124 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:33.220083    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 12:20:33.220124 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:33.220122    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 12:20:33.220301 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:33.220138    2559 projected.go:196] Error preparing data for projected volume kube-api-access-vk5dd for pod openshift-network-diagnostics/network-check-target-7jz7w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 12:20:33.220301 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:33.220222    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6aeeccdd-6c28-44fd-99e8-d6426f00525b-kube-api-access-vk5dd podName:6aeeccdd-6c28-44fd-99e8-d6426f00525b nodeName:}" failed. No retries permitted until 2026-07-15 12:20:34.220197744 +0000 UTC m=+4.192768882 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-vk5dd" (UniqueName: "kubernetes.io/projected/6aeeccdd-6c28-44fd-99e8-d6426f00525b-kube-api-access-vk5dd") pod "network-check-target-7jz7w" (UID: "6aeeccdd-6c28-44fd-99e8-d6426f00525b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 12:20:33.464923 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:33.464798    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 12:15:33 +0000 UTC" deadline="2028-04-03 22:13:56.377923932 +0000 UTC"
Jul 15 12:20:33.464923 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:33.464865    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15081h53m22.913063925s"
Jul 15 12:20:33.577802 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:33.577769    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8ghwr"
Jul 15 12:20:33.577999 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:33.577771    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndhnr"
Jul 15 12:20:33.577999 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:33.577885    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8ghwr" podUID="df4bf5c7-9413-4a70-8d17-9eaca62b4373"
Jul 15 12:20:33.578097 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:33.577999    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ndhnr" podUID="6a7be93c-3ae8-4f57-8bb9-ffb11e116493"
Jul 15 12:20:33.752461 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:33.752414    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf2f64511_8f06_4610_a112_0cd46f0fd503.slice/crio-bd1efb1972acd0dc48719e64fa534437938130f7ccbd1572485a96b41cc1a307 WatchSource:0}: Error finding container bd1efb1972acd0dc48719e64fa534437938130f7ccbd1572485a96b41cc1a307: Status 404 returned error can't find the container with id bd1efb1972acd0dc48719e64fa534437938130f7ccbd1572485a96b41cc1a307
Jul 15 12:20:33.754554 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:33.754482    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57925e62_a062_44df_bb9f_4b77fd8931d5.slice/crio-420f9a031962c4018366b5bb419cacafcdec4b1b049aa1feba13f160fe6995c9 WatchSource:0}: Error finding container 420f9a031962c4018366b5bb419cacafcdec4b1b049aa1feba13f160fe6995c9: Status 404 returned error can't find the container with id 420f9a031962c4018366b5bb419cacafcdec4b1b049aa1feba13f160fe6995c9
Jul 15 12:20:33.759036 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:33.759004    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod009c50dc_2f9e_455b_95f2_a03e7ed3defd.slice/crio-90d856afa517d6a94de2f08aacd912e6c58a4f6a933e3b2f7ad581238ee2ebf8 WatchSource:0}: Error finding container 90d856afa517d6a94de2f08aacd912e6c58a4f6a933e3b2f7ad581238ee2ebf8: Status 404 returned error can't find the container with id 90d856afa517d6a94de2f08aacd912e6c58a4f6a933e3b2f7ad581238ee2ebf8
Jul 15 12:20:33.760503 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:33.760396    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7a79dc6_aa77_49fa_87dd_08ed78b9f4f5.slice/crio-f80cf95f29a958959bfd97b6808712d37844ce740a803dcc9ef567f348c75ada WatchSource:0}: Error finding container f80cf95f29a958959bfd97b6808712d37844ce740a803dcc9ef567f348c75ada: Status 404 returned error can't find the container with id f80cf95f29a958959bfd97b6808712d37844ce740a803dcc9ef567f348c75ada
Jul 15 12:20:33.761121 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:33.761098    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3aaf289f_60cb_4031_9062_8cbaff2fe9f0.slice/crio-376ce7a2d2c13cb3286849e3cf76dca5c89ab1f42de56b9d1c97218b36c493f6 WatchSource:0}: Error finding container 376ce7a2d2c13cb3286849e3cf76dca5c89ab1f42de56b9d1c97218b36c493f6: Status 404 returned error can't find the container with id 376ce7a2d2c13cb3286849e3cf76dca5c89ab1f42de56b9d1c97218b36c493f6
Jul 15 12:20:33.769123 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:20:33.768917    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b2f73f0_4b0d_418f_8dc8_3d20b06a12bd.slice/crio-1cd75fcd4c5207c236223ebb0082b192fb01df32f9cb1dd21dcf509accdacbbe WatchSource:0}: Error finding container 1cd75fcd4c5207c236223ebb0082b192fb01df32f9cb1dd21dcf509accdacbbe: Status 404 returned error can't find the container with id 1cd75fcd4c5207c236223ebb0082b192fb01df32f9cb1dd21dcf509accdacbbe
Jul 15 12:20:34.130302 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:34.129316    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a7be93c-3ae8-4f57-8bb9-ffb11e116493-metrics-certs\") pod \"network-metrics-daemon-ndhnr\" (UID: \"6a7be93c-3ae8-4f57-8bb9-ffb11e116493\") " pod="openshift-multus/network-metrics-daemon-ndhnr"
Jul 15 12:20:34.130302 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:34.129426    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/df4bf5c7-9413-4a70-8d17-9eaca62b4373-original-pull-secret\") pod \"global-pull-secret-syncer-8ghwr\" (UID: \"df4bf5c7-9413-4a70-8d17-9eaca62b4373\") " pod="kube-system/global-pull-secret-syncer-8ghwr"
Jul 15 12:20:34.130302 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:34.129588    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 12:20:34.130302 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:34.129679    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df4bf5c7-9413-4a70-8d17-9eaca62b4373-original-pull-secret podName:df4bf5c7-9413-4a70-8d17-9eaca62b4373 nodeName:}" failed. No retries permitted until 2026-07-15 12:20:36.129658353 +0000 UTC m=+6.102229490 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/df4bf5c7-9413-4a70-8d17-9eaca62b4373-original-pull-secret") pod "global-pull-secret-syncer-8ghwr" (UID: "df4bf5c7-9413-4a70-8d17-9eaca62b4373") : object "kube-system"/"original-pull-secret" not registered
Jul 15 12:20:34.130302 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:34.130197    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 12:20:34.130302 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:34.130261    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a7be93c-3ae8-4f57-8bb9-ffb11e116493-metrics-certs podName:6a7be93c-3ae8-4f57-8bb9-ffb11e116493 nodeName:}" failed. No retries permitted until 2026-07-15 12:20:36.130235998 +0000 UTC m=+6.102807138 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6a7be93c-3ae8-4f57-8bb9-ffb11e116493-metrics-certs") pod "network-metrics-daemon-ndhnr" (UID: "6a7be93c-3ae8-4f57-8bb9-ffb11e116493") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 12:20:34.231281 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:34.231237    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vk5dd\" (UniqueName: \"kubernetes.io/projected/6aeeccdd-6c28-44fd-99e8-d6426f00525b-kube-api-access-vk5dd\") pod \"network-check-target-7jz7w\" (UID: \"6aeeccdd-6c28-44fd-99e8-d6426f00525b\") " pod="openshift-network-diagnostics/network-check-target-7jz7w"
Jul 15 12:20:34.231561 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:34.231534    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 12:20:34.231656 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:34.231603    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 12:20:34.231656 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:34.231622    2559 projected.go:196] Error preparing data for projected volume kube-api-access-vk5dd for pod openshift-network-diagnostics/network-check-target-7jz7w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 12:20:34.231761 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:34.231720    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6aeeccdd-6c28-44fd-99e8-d6426f00525b-kube-api-access-vk5dd podName:6aeeccdd-6c28-44fd-99e8-d6426f00525b nodeName:}" failed. No retries permitted until 2026-07-15 12:20:36.231677215 +0000 UTC m=+6.204248363 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-vk5dd" (UniqueName: "kubernetes.io/projected/6aeeccdd-6c28-44fd-99e8-d6426f00525b-kube-api-access-vk5dd") pod "network-check-target-7jz7w" (UID: "6aeeccdd-6c28-44fd-99e8-d6426f00525b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 12:20:34.465506 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:34.465336    2559 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 12:15:33 +0000 UTC" deadline="2028-02-23 17:04:22.23320856 +0000 UTC"
Jul 15 12:20:34.465506 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:34.465416    2559 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14116h43m47.76779729s"
Jul 15 12:20:34.504994 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:34.504636    2559 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 15 12:20:34.581062 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:34.580396    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jz7w"
Jul 15 12:20:34.581062 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:34.580635    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jz7w" podUID="6aeeccdd-6c28-44fd-99e8-d6426f00525b"
Jul 15 12:20:34.595646 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:34.595570    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qfb4c" event={"ID":"b7a79dc6-aa77-49fa-87dd-08ed78b9f4f5","Type":"ContainerStarted","Data":"f80cf95f29a958959bfd97b6808712d37844ce740a803dcc9ef567f348c75ada"}
Jul 15 12:20:34.602943 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:34.602901    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z" event={"ID":"009c50dc-2f9e-455b-95f2-a03e7ed3defd","Type":"ContainerStarted","Data":"90d856afa517d6a94de2f08aacd912e6c58a4f6a933e3b2f7ad581238ee2ebf8"}
Jul 15 12:20:34.611134 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:34.610359    2559 generic.go:356] "Generic (PLEG): container finished" podID="ad0297be557f741a11c730c41d1f8356" containerID="4b7ce6d439646b57f26b5c552cb38180009740448c48d1efd6ec9f88dcdc0886" exitCode=0
Jul 15 12:20:34.611134 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:34.610476    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-67.ec2.internal" event={"ID":"ad0297be557f741a11c730c41d1f8356","Type":"ContainerDied","Data":"4b7ce6d439646b57f26b5c552cb38180009740448c48d1efd6ec9f88dcdc0886"}
Jul 15 12:20:34.638682 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:34.638277    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-67.ec2.internal" event={"ID":"52d9088551c115f98811f24856a62fc9","Type":"ContainerStarted","Data":"bd97545b460307859e1491f46ee44cfb55dcfb9383159e32c63f607b24405940"}
Jul 15 12:20:34.651460 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:34.651416    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wj5d4" event={"ID":"c0df3610-e8fe-48b2-ba14-4ed9d65f8965","Type":"ContainerStarted","Data":"fcc8b540152f25ec9be7180f86e1b8dbf817e35650c2813a81e2e8b8c86489d9"}
Jul 15 12:20:34.656296 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:34.656255    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j46gp" event={"ID":"3aaf289f-60cb-4031-9062-8cbaff2fe9f0","Type":"ContainerStarted","Data":"376ce7a2d2c13cb3286849e3cf76dca5c89ab1f42de56b9d1c97218b36c493f6"}
Jul 15 12:20:34.664584 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:34.660721    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4dvc2" event={"ID":"57925e62-a062-44df-bb9f-4b77fd8931d5","Type":"ContainerStarted","Data":"420f9a031962c4018366b5bb419cacafcdec4b1b049aa1feba13f160fe6995c9"}
Jul 15 12:20:34.666645 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:34.666607    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bctct" event={"ID":"f2f64511-8f06-4610-a112-0cd46f0fd503","Type":"ContainerStarted","Data":"bd1efb1972acd0dc48719e64fa534437938130f7ccbd1572485a96b41cc1a307"}
Jul 15 12:20:34.682566 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:34.682517    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cv2md" event={"ID":"7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd","Type":"ContainerStarted","Data":"1cd75fcd4c5207c236223ebb0082b192fb01df32f9cb1dd21dcf509accdacbbe"}
Jul 15 12:20:34.685003 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:34.684974    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rcf9z" event={"ID":"f74223ea-de13-44ca-86b5-555b5a30abef","Type":"ContainerStarted","Data":"b12d738757deeb346e86bcb1a2c9dbdeaf57057be23bb0e02b6890d4a31bf2cd"}
Jul 15 12:20:34.688311 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:34.688282    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ckzbm" event={"ID":"712fac2c-94a4-4863-84b0-d251b4fcd155","Type":"ContainerStarted","Data":"25609407fc55f2f196e8b4aed5688395ac1b21d271891bc3ce3c8eb1a9694ceb"}
Jul 15 12:20:35.578106 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:35.578067    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndhnr"
Jul 15 12:20:35.578649 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:35.578234    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ndhnr" podUID="6a7be93c-3ae8-4f57-8bb9-ffb11e116493"
Jul 15 12:20:35.578649 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:35.578323    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8ghwr"
Jul 15 12:20:35.578649 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:35.578400    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8ghwr" podUID="df4bf5c7-9413-4a70-8d17-9eaca62b4373"
Jul 15 12:20:35.724801 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:35.724763    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-67.ec2.internal" event={"ID":"ad0297be557f741a11c730c41d1f8356","Type":"ContainerStarted","Data":"4fef5e8d0df859a6069a6bc5d1588382d62962fc839f3cb738ad5e5e3857c861"}
Jul 15 12:20:35.743608 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:35.743542    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-67.ec2.internal" podStartSLOduration=3.743518678 podStartE2EDuration="3.743518678s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 12:20:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:20:34.655020378 +0000 UTC m=+4.627591539" watchObservedRunningTime="2026-07-15 12:20:35.743518678 +0000 UTC m=+5.716089840"
Jul 15 12:20:35.743972 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:35.743943    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-67.ec2.internal" podStartSLOduration=3.743934037 podStartE2EDuration="3.743934037s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 12:20:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:20:35.743681179 +0000 UTC m=+5.716252342" watchObservedRunningTime="2026-07-15 12:20:35.743934037 +0000 UTC m=+5.716505200"
Jul 15 12:20:36.145876 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:36.145829    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/df4bf5c7-9413-4a70-8d17-9eaca62b4373-original-pull-secret\") pod \"global-pull-secret-syncer-8ghwr\" (UID: \"df4bf5c7-9413-4a70-8d17-9eaca62b4373\") " pod="kube-system/global-pull-secret-syncer-8ghwr"
Jul 15 12:20:36.146086 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:36.145926    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a7be93c-3ae8-4f57-8bb9-ffb11e116493-metrics-certs\") pod \"network-metrics-daemon-ndhnr\" (UID: \"6a7be93c-3ae8-4f57-8bb9-ffb11e116493\") " pod="openshift-multus/network-metrics-daemon-ndhnr"
Jul 15 12:20:36.146086 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:36.146065    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 12:20:36.146202 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:36.146131    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a7be93c-3ae8-4f57-8bb9-ffb11e116493-metrics-certs podName:6a7be93c-3ae8-4f57-8bb9-ffb11e116493 nodeName:}" failed. No retries permitted until 2026-07-15 12:20:40.146110819 +0000 UTC m=+10.118681958 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6a7be93c-3ae8-4f57-8bb9-ffb11e116493-metrics-certs") pod "network-metrics-daemon-ndhnr" (UID: "6a7be93c-3ae8-4f57-8bb9-ffb11e116493") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 12:20:36.146574 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:36.146476    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 12:20:36.146574 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:36.146548    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df4bf5c7-9413-4a70-8d17-9eaca62b4373-original-pull-secret podName:df4bf5c7-9413-4a70-8d17-9eaca62b4373 nodeName:}" failed. No retries permitted until 2026-07-15 12:20:40.146530171 +0000 UTC m=+10.119101319 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/df4bf5c7-9413-4a70-8d17-9eaca62b4373-original-pull-secret") pod "global-pull-secret-syncer-8ghwr" (UID: "df4bf5c7-9413-4a70-8d17-9eaca62b4373") : object "kube-system"/"original-pull-secret" not registered
Jul 15 12:20:36.247850 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:36.247044    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vk5dd\" (UniqueName: \"kubernetes.io/projected/6aeeccdd-6c28-44fd-99e8-d6426f00525b-kube-api-access-vk5dd\") pod \"network-check-target-7jz7w\" (UID: \"6aeeccdd-6c28-44fd-99e8-d6426f00525b\") " pod="openshift-network-diagnostics/network-check-target-7jz7w"
Jul 15 12:20:36.247850 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:36.247337    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 12:20:36.247850 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:36.247362    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 12:20:36.247850 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:36.247376    2559 projected.go:196] Error preparing data for projected volume kube-api-access-vk5dd for pod openshift-network-diagnostics/network-check-target-7jz7w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 12:20:36.247850 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:36.247456    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6aeeccdd-6c28-44fd-99e8-d6426f00525b-kube-api-access-vk5dd podName:6aeeccdd-6c28-44fd-99e8-d6426f00525b nodeName:}" failed. No retries permitted until 2026-07-15 12:20:40.247435149 +0000 UTC m=+10.220006290 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-vk5dd" (UniqueName: "kubernetes.io/projected/6aeeccdd-6c28-44fd-99e8-d6426f00525b-kube-api-access-vk5dd") pod "network-check-target-7jz7w" (UID: "6aeeccdd-6c28-44fd-99e8-d6426f00525b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 12:20:36.584958 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:36.584875    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jz7w"
Jul 15 12:20:36.585458 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:36.585040    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jz7w" podUID="6aeeccdd-6c28-44fd-99e8-d6426f00525b"
Jul 15 12:20:37.578297 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:37.578258    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8ghwr"
Jul 15 12:20:37.578489 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:37.578429    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8ghwr" podUID="df4bf5c7-9413-4a70-8d17-9eaca62b4373"
Jul 15 12:20:37.578913 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:37.578891    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndhnr"
Jul 15 12:20:37.579034 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:37.579013    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ndhnr" podUID="6a7be93c-3ae8-4f57-8bb9-ffb11e116493"
Jul 15 12:20:38.577673 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:38.577542    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jz7w"
Jul 15 12:20:38.578242 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:38.577704    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jz7w" podUID="6aeeccdd-6c28-44fd-99e8-d6426f00525b"
Jul 15 12:20:39.578404 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:39.578318    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndhnr"
Jul 15 12:20:39.579004 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:39.578422    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8ghwr"
Jul 15 12:20:39.579004 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:39.578487    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ndhnr" podUID="6a7be93c-3ae8-4f57-8bb9-ffb11e116493"
Jul 15 12:20:39.579004 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:39.578574    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8ghwr" podUID="df4bf5c7-9413-4a70-8d17-9eaca62b4373"
Jul 15 12:20:40.180856 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:40.180810    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/df4bf5c7-9413-4a70-8d17-9eaca62b4373-original-pull-secret\") pod \"global-pull-secret-syncer-8ghwr\" (UID: \"df4bf5c7-9413-4a70-8d17-9eaca62b4373\") " pod="kube-system/global-pull-secret-syncer-8ghwr"
Jul 15 12:20:40.181081 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:40.180915    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a7be93c-3ae8-4f57-8bb9-ffb11e116493-metrics-certs\") pod \"network-metrics-daemon-ndhnr\" (UID: \"6a7be93c-3ae8-4f57-8bb9-ffb11e116493\") " pod="openshift-multus/network-metrics-daemon-ndhnr"
Jul 15 12:20:40.181081 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:40.181003    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 12:20:40.181081 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:40.181027    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 12:20:40.181243 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:40.181088    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df4bf5c7-9413-4a70-8d17-9eaca62b4373-original-pull-secret podName:df4bf5c7-9413-4a70-8d17-9eaca62b4373 nodeName:}" failed. No retries permitted until 2026-07-15 12:20:48.181066344 +0000 UTC m=+18.153637484 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/df4bf5c7-9413-4a70-8d17-9eaca62b4373-original-pull-secret") pod "global-pull-secret-syncer-8ghwr" (UID: "df4bf5c7-9413-4a70-8d17-9eaca62b4373") : object "kube-system"/"original-pull-secret" not registered
Jul 15 12:20:40.181243 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:40.181107    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a7be93c-3ae8-4f57-8bb9-ffb11e116493-metrics-certs podName:6a7be93c-3ae8-4f57-8bb9-ffb11e116493 nodeName:}" failed. No retries permitted until 2026-07-15 12:20:48.181099525 +0000 UTC m=+18.153670663 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6a7be93c-3ae8-4f57-8bb9-ffb11e116493-metrics-certs") pod "network-metrics-daemon-ndhnr" (UID: "6a7be93c-3ae8-4f57-8bb9-ffb11e116493") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 12:20:40.281735 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:40.281338    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vk5dd\" (UniqueName: \"kubernetes.io/projected/6aeeccdd-6c28-44fd-99e8-d6426f00525b-kube-api-access-vk5dd\") pod \"network-check-target-7jz7w\" (UID: \"6aeeccdd-6c28-44fd-99e8-d6426f00525b\") " pod="openshift-network-diagnostics/network-check-target-7jz7w"
Jul 15 12:20:40.281735 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:40.281538    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 12:20:40.281735 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:40.281560    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 12:20:40.281735 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:40.281574    2559 projected.go:196] Error preparing data for projected volume kube-api-access-vk5dd for pod openshift-network-diagnostics/network-check-target-7jz7w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 12:20:40.281735 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:40.281641    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6aeeccdd-6c28-44fd-99e8-d6426f00525b-kube-api-access-vk5dd podName:6aeeccdd-6c28-44fd-99e8-d6426f00525b nodeName:}" failed. No retries permitted until 2026-07-15 12:20:48.281620493 +0000 UTC m=+18.254191649 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-vk5dd" (UniqueName: "kubernetes.io/projected/6aeeccdd-6c28-44fd-99e8-d6426f00525b-kube-api-access-vk5dd") pod "network-check-target-7jz7w" (UID: "6aeeccdd-6c28-44fd-99e8-d6426f00525b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 12:20:40.579644 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:40.579381    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jz7w"
Jul 15 12:20:40.579644 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:40.579508    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jz7w" podUID="6aeeccdd-6c28-44fd-99e8-d6426f00525b"
Jul 15 12:20:41.578316 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:41.578220    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8ghwr"
Jul 15 12:20:41.578510 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:41.578233    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndhnr"
Jul 15 12:20:41.578510 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:41.578382    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8ghwr" podUID="df4bf5c7-9413-4a70-8d17-9eaca62b4373"
Jul 15 12:20:41.578510 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:41.578491    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ndhnr" podUID="6a7be93c-3ae8-4f57-8bb9-ffb11e116493"
Jul 15 12:20:42.581032 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:42.580940    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jz7w"
Jul 15 12:20:42.581593 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:42.581065    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jz7w" podUID="6aeeccdd-6c28-44fd-99e8-d6426f00525b"
Jul 15 12:20:43.577883 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:43.577849    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndhnr"
Jul 15 12:20:43.578110 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:43.577892    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8ghwr"
Jul 15 12:20:43.578110 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:43.578012    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ndhnr" podUID="6a7be93c-3ae8-4f57-8bb9-ffb11e116493"
Jul 15 12:20:43.578217 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:43.578105    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8ghwr" podUID="df4bf5c7-9413-4a70-8d17-9eaca62b4373"
Jul 15 12:20:44.578242 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:44.578173    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jz7w"
Jul 15 12:20:44.578756 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:44.578477    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jz7w" podUID="6aeeccdd-6c28-44fd-99e8-d6426f00525b"
Jul 15 12:20:45.577425 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:45.577389    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndhnr"
Jul 15 12:20:45.577425 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:45.577417    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8ghwr"
Jul 15 12:20:45.577665 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:45.577536    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ndhnr" podUID="6a7be93c-3ae8-4f57-8bb9-ffb11e116493"
Jul 15 12:20:45.577725 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:45.577659    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8ghwr" podUID="df4bf5c7-9413-4a70-8d17-9eaca62b4373"
Jul 15 12:20:46.578188 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:46.578146    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jz7w"
Jul 15 12:20:46.578668 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:46.578290    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jz7w" podUID="6aeeccdd-6c28-44fd-99e8-d6426f00525b"
Jul 15 12:20:47.577701 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:47.577666    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndhnr"
Jul 15 12:20:47.577701 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:47.577698    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8ghwr"
Jul 15 12:20:47.578029 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:47.577803    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ndhnr" podUID="6a7be93c-3ae8-4f57-8bb9-ffb11e116493"
Jul 15 12:20:47.578029 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:47.577858    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8ghwr" podUID="df4bf5c7-9413-4a70-8d17-9eaca62b4373"
Jul 15 12:20:48.240017 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:48.239981    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a7be93c-3ae8-4f57-8bb9-ffb11e116493-metrics-certs\") pod \"network-metrics-daemon-ndhnr\" (UID: \"6a7be93c-3ae8-4f57-8bb9-ffb11e116493\") " pod="openshift-multus/network-metrics-daemon-ndhnr"
Jul 15 12:20:48.240485 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:48.240035    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/df4bf5c7-9413-4a70-8d17-9eaca62b4373-original-pull-secret\") pod \"global-pull-secret-syncer-8ghwr\" (UID: \"df4bf5c7-9413-4a70-8d17-9eaca62b4373\") " pod="kube-system/global-pull-secret-syncer-8ghwr"
Jul 15 12:20:48.240485 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:48.240138    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 12:20:48.240485 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:48.240198    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df4bf5c7-9413-4a70-8d17-9eaca62b4373-original-pull-secret podName:df4bf5c7-9413-4a70-8d17-9eaca62b4373 nodeName:}" failed. No retries permitted until 2026-07-15 12:21:04.240184149 +0000 UTC m=+34.212755286 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/df4bf5c7-9413-4a70-8d17-9eaca62b4373-original-pull-secret") pod "global-pull-secret-syncer-8ghwr" (UID: "df4bf5c7-9413-4a70-8d17-9eaca62b4373") : object "kube-system"/"original-pull-secret" not registered
Jul 15 12:20:48.240485 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:48.240142    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 12:20:48.240485 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:48.240284    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a7be93c-3ae8-4f57-8bb9-ffb11e116493-metrics-certs podName:6a7be93c-3ae8-4f57-8bb9-ffb11e116493 nodeName:}" failed. No retries permitted until 2026-07-15 12:21:04.24027119 +0000 UTC m=+34.212842328 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6a7be93c-3ae8-4f57-8bb9-ffb11e116493-metrics-certs") pod "network-metrics-daemon-ndhnr" (UID: "6a7be93c-3ae8-4f57-8bb9-ffb11e116493") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 12:20:48.341178 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:48.341141    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vk5dd\" (UniqueName: \"kubernetes.io/projected/6aeeccdd-6c28-44fd-99e8-d6426f00525b-kube-api-access-vk5dd\") pod \"network-check-target-7jz7w\" (UID: \"6aeeccdd-6c28-44fd-99e8-d6426f00525b\") " pod="openshift-network-diagnostics/network-check-target-7jz7w"
Jul 15 12:20:48.341446 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:48.341317    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 12:20:48.341446 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:48.341334    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 12:20:48.341446 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:48.341346    2559 projected.go:196] Error preparing data for projected volume kube-api-access-vk5dd for pod openshift-network-diagnostics/network-check-target-7jz7w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 12:20:48.341446 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:48.341422    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6aeeccdd-6c28-44fd-99e8-d6426f00525b-kube-api-access-vk5dd podName:6aeeccdd-6c28-44fd-99e8-d6426f00525b nodeName:}" failed. No retries permitted until 2026-07-15 12:21:04.341403845 +0000 UTC m=+34.313974982 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-vk5dd" (UniqueName: "kubernetes.io/projected/6aeeccdd-6c28-44fd-99e8-d6426f00525b-kube-api-access-vk5dd") pod "network-check-target-7jz7w" (UID: "6aeeccdd-6c28-44fd-99e8-d6426f00525b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 12:20:48.578359 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:48.578267    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jz7w"
Jul 15 12:20:48.578534 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:48.578420    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jz7w" podUID="6aeeccdd-6c28-44fd-99e8-d6426f00525b"
Jul 15 12:20:49.577738 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:49.577707    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8ghwr"
Jul 15 12:20:49.578194 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:49.577839    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8ghwr" podUID="df4bf5c7-9413-4a70-8d17-9eaca62b4373"
Jul 15 12:20:49.578194 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:49.577894    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndhnr"
Jul 15 12:20:49.578194 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:49.578022    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ndhnr" podUID="6a7be93c-3ae8-4f57-8bb9-ffb11e116493"
Jul 15 12:20:50.578675 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:50.578632    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jz7w"
Jul 15 12:20:50.579158 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:50.578762    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jz7w" podUID="6aeeccdd-6c28-44fd-99e8-d6426f00525b"
Jul 15 12:20:51.577599 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:51.577539    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndhnr"
Jul 15 12:20:51.577599 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:51.577583    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8ghwr"
Jul 15 12:20:51.577791 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:51.577699    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ndhnr" podUID="6a7be93c-3ae8-4f57-8bb9-ffb11e116493"
Jul 15 12:20:51.577853 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:51.577820    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8ghwr" podUID="df4bf5c7-9413-4a70-8d17-9eaca62b4373"
Jul 15 12:20:52.578205 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:52.578171    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jz7w"
Jul 15 12:20:52.578691 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:52.578298    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jz7w" podUID="6aeeccdd-6c28-44fd-99e8-d6426f00525b"
Jul 15 12:20:53.577613 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:53.577446    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndhnr"
Jul 15 12:20:53.577742 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:53.577441    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8ghwr"
Jul 15 12:20:53.577742 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:53.577708    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ndhnr" podUID="6a7be93c-3ae8-4f57-8bb9-ffb11e116493"
Jul 15 12:20:53.577816 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:53.577754    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8ghwr" podUID="df4bf5c7-9413-4a70-8d17-9eaca62b4373"
Jul 15 12:20:53.764020 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:53.763850    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-ckzbm" event={"ID":"712fac2c-94a4-4863-84b0-d251b4fcd155","Type":"ContainerStarted","Data":"e6afc0b58ba0be8c1c29efd47f0a2130cd706700d82002dd670a223aac9f5272"}
Jul 15 12:20:53.765818 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:53.765768    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-qfb4c" event={"ID":"b7a79dc6-aa77-49fa-87dd-08ed78b9f4f5","Type":"ContainerStarted","Data":"2b6527bc29dad5170b397363e64412315b6b55d26eafdb3d730b69acdac281bd"}
Jul 15 12:20:53.770690 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:53.770665    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vp8z_009c50dc-2f9e-455b-95f2-a03e7ed3defd/ovn-acl-logging/0.log"
Jul 15 12:20:53.771063 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:53.771032    2559 generic.go:356] "Generic (PLEG): container finished" podID="009c50dc-2f9e-455b-95f2-a03e7ed3defd" containerID="406ffc5a7bff480ffb6b91b233738dabb0365376c61b8af8c71e7d9167f85b33" exitCode=1
Jul 15 12:20:53.771118 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:53.771089    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z" event={"ID":"009c50dc-2f9e-455b-95f2-a03e7ed3defd","Type":"ContainerStarted","Data":"585230dcb2ceb5c7c6a69352995fb3eeee595f5a2bf2d2dcd4c43aa421201c6c"}
Jul 15 12:20:53.771154 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:53.771143    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z" event={"ID":"009c50dc-2f9e-455b-95f2-a03e7ed3defd","Type":"ContainerStarted","Data":"dfa85b9c95b8e5250bee967263dcdeb74833369680e68127aab99c717287c655"}
Jul 15 12:20:53.771205 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:53.771190    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z" event={"ID":"009c50dc-2f9e-455b-95f2-a03e7ed3defd","Type":"ContainerStarted","Data":"d84eeb52035498b56b4e342fb6e0783c80724bd945452da34c16372f070eba1c"}
Jul 15 12:20:53.771255 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:53.771242    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z" event={"ID":"009c50dc-2f9e-455b-95f2-a03e7ed3defd","Type":"ContainerStarted","Data":"7c634e404df58f54aa2e0c91e38428773bed6f1b452f049c1f1d55c8af31085b"}
Jul 15 12:20:53.771307 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:53.771292    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z" event={"ID":"009c50dc-2f9e-455b-95f2-a03e7ed3defd","Type":"ContainerDied","Data":"406ffc5a7bff480ffb6b91b233738dabb0365376c61b8af8c71e7d9167f85b33"}
Jul 15 12:20:53.771357 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:53.771345    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z" event={"ID":"009c50dc-2f9e-455b-95f2-a03e7ed3defd","Type":"ContainerStarted","Data":"f34b164eb003e3124025bb29f383a72aa228563352a871090584844f1c05c565"}
Jul 15 12:20:53.772659 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:53.772633    2559 generic.go:356] "Generic (PLEG): container finished" podID="c0df3610-e8fe-48b2-ba14-4ed9d65f8965" containerID="69a17819290d1d88cb8fa657dbdc09060673b8b0e23258ecda757ed4d568df65" exitCode=0
Jul 15 12:20:53.772762 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:53.772711    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wj5d4" event={"ID":"c0df3610-e8fe-48b2-ba14-4ed9d65f8965","Type":"ContainerDied","Data":"69a17819290d1d88cb8fa657dbdc09060673b8b0e23258ecda757ed4d568df65"}
Jul 15 12:20:53.774159 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:53.774135    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j46gp" event={"ID":"3aaf289f-60cb-4031-9062-8cbaff2fe9f0","Type":"ContainerStarted","Data":"23bdff49fe81a6907cbc53223c1a20cf79c6cbc29270068fb1e2a0d9eb68a8ea"}
Jul 15 12:20:53.775529 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:53.775509    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-bctct" event={"ID":"f2f64511-8f06-4610-a112-0cd46f0fd503","Type":"ContainerStarted","Data":"3a306b53def2846b83b6fb5c86233aadb1a00d61d5ba552cb5be44092bb8d9f9"}
Jul 15 12:20:53.776766 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:53.776745    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-cv2md" event={"ID":"7b2f73f0-4b0d-418f-8dc8-3d20b06a12bd","Type":"ContainerStarted","Data":"ecab9fd4e0d9b8bb0188940cc69354a77419b3d0089654cedafe47d2dfe3575b"}
Jul 15 12:20:53.778045 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:53.778028    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-rcf9z" event={"ID":"f74223ea-de13-44ca-86b5-555b5a30abef","Type":"ContainerStarted","Data":"c9cbde840769b7631de68f5fdfbbab04463bfa83a986a76fff03aecda539395f"}
Jul 15 12:20:53.809279 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:53.809239    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-ckzbm" podStartSLOduration=7.575264054 podStartE2EDuration="22.809226482s" totalImagesPullingTime="15.233962428s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:20:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:20:53.783429516 +0000 UTC m=+23.756000671" watchObservedRunningTime="2026-07-15 12:20:53.809226482 +0000 UTC m=+23.781797640"
Jul 15 12:20:53.809421 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:53.809400    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-rcf9z" podStartSLOduration=3.727314316 podStartE2EDuration="22.809394248s" totalImagesPullingTime="19.082079932s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 12:20:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:20:53.80914753 +0000 UTC m=+23.781718688" watchObservedRunningTime="2026-07-15 12:20:53.809394248 +0000 UTC m=+23.781965405"
Jul 15 12:20:53.851460 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:53.851418    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-qfb4c" podStartSLOduration=3.7974415500000003 podStartE2EDuration="22.851405538s" totalImagesPullingTime="19.053963988s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 12:20:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:20:53.828032121 +0000 UTC m=+23.800603278" watchObservedRunningTime="2026-07-15 12:20:53.851405538 +0000 UTC m=+23.823976696"
Jul 15 12:20:53.851632 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:53.851609    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-cv2md" podStartSLOduration=3.743730516 podStartE2EDuration="22.851601492s" totalImagesPullingTime="19.107870976s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 12:20:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:20:53.850701805 +0000 UTC m=+23.823272963" watchObservedRunningTime="2026-07-15 12:20:53.851601492 +0000 UTC m=+23.824172650"
Jul 15 12:20:53.914883 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:53.914837    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-bctct" podStartSLOduration=3.854488164 podStartE2EDuration="22.914824117s" totalImagesPullingTime="19.060335953s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 12:20:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:20:53.876620238 +0000 UTC m=+23.849191397" watchObservedRunningTime="2026-07-15 12:20:53.914824117 +0000 UTC m=+23.887395274"
Jul 15 12:20:54.040912 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:54.040833    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:20:54.120056 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:54.120031    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:20:54.234941 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:54.234910    2559 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 15 12:20:54.251761 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:54.251730    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:20:54.350423 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:54.350384    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:20:54.467545 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:54.467417    2559 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-15T12:20:54.234940763Z","UUID":"41f3823a-04e5-42fb-bb60-3581de080569","Handler":null,"Name":"","Endpoint":""}
Jul 15 12:20:54.468775 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:54.468754    2559 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 15 12:20:54.468886 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:54.468790    2559 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 15 12:20:54.581409 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:54.581282    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jz7w"
Jul 15 12:20:54.581589 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:54.581409    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jz7w" podUID="6aeeccdd-6c28-44fd-99e8-d6426f00525b"
Jul 15 12:20:54.783009 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:54.782971    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j46gp" event={"ID":"3aaf289f-60cb-4031-9062-8cbaff2fe9f0","Type":"ContainerStarted","Data":"53b369941422ed8de7f5ce6d913a47d75fdbdb0e8db8561254af7636a5361772"}
Jul 15 12:20:54.784747 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:54.784667    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4dvc2" event={"ID":"57925e62-a062-44df-bb9f-4b77fd8931d5","Type":"ContainerStarted","Data":"2b83e2e53d5c8364019dcc52aa531e6a1c5f2d388294d0b1282994347e95ddff"}
Jul 15 12:20:54.804237 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:54.804190    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4dvc2" podStartSLOduration=4.738391992 podStartE2EDuration="23.804174361s" totalImagesPullingTime="19.065782369s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 12:20:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:20:54.803839173 +0000 UTC m=+24.776410333" watchObservedRunningTime="2026-07-15 12:20:54.804174361 +0000 UTC m=+24.776745518"
Jul 15 12:20:54.820753 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:54.820723    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:20:54.934677 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:54.934599    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:20:55.035086 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:55.035037    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:20:55.102657 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:55.102580    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:20:55.509800 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:55.509774    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:20:55.578249 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:55.578219    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndhnr"
Jul 15 12:20:55.578422 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:55.578262    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8ghwr"
Jul 15 12:20:55.578422 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:55.578359    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ndhnr" podUID="6a7be93c-3ae8-4f57-8bb9-ffb11e116493"
Jul 15 12:20:55.578548 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:55.578479    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8ghwr" podUID="df4bf5c7-9413-4a70-8d17-9eaca62b4373"
Jul 15 12:20:55.611513 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:55.611489    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:20:55.791345 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:55.791144    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vp8z_009c50dc-2f9e-455b-95f2-a03e7ed3defd/ovn-acl-logging/0.log"
Jul 15 12:20:55.792073 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:55.792033    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z" event={"ID":"009c50dc-2f9e-455b-95f2-a03e7ed3defd","Type":"ContainerStarted","Data":"c9254c17ad53e8c3de1e4a1053b0a77dbeff452e68ade30ef521f1d4fb82d283"}
Jul 15 12:20:55.795688 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:55.794679    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j46gp" event={"ID":"3aaf289f-60cb-4031-9062-8cbaff2fe9f0","Type":"ContainerStarted","Data":"333c5c4d495ad268e7f2582fa18d31d52a7b7eaef697936daa9c9eb0d47f03c4"}
Jul 15 12:20:55.795688 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:55.795655    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:20:55.822359 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:55.822295    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-j46gp" podStartSLOduration=3.411793086 podStartE2EDuration="24.822273328s" totalImagesPullingTime="21.410480242s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 12:20:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:20:55.821808258 +0000 UTC m=+25.794379416" watchObservedRunningTime="2026-07-15 12:20:55.822273328 +0000 UTC m=+25.794844487"
Jul 15 12:20:55.886922 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:55.886878    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:20:56.578045 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:56.578009    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jz7w"
Jul 15 12:20:56.578339 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:56.578220    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jz7w" podUID="6aeeccdd-6c28-44fd-99e8-d6426f00525b"
Jul 15 12:20:56.909259 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:56.909185    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:20:57.016001 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:57.015963    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:20:57.439849 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:57.439817    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:20:57.457996 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:57.457959    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-ckzbm"
Jul 15 12:20:57.458667 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:57.458645    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-ckzbm"
Jul 15 12:20:57.499315 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:57.499285    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:20:57.577301 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:57.577270    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8ghwr"
Jul 15 12:20:57.577495 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:57.577386    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8ghwr" podUID="df4bf5c7-9413-4a70-8d17-9eaca62b4373"
Jul 15 12:20:57.577495 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:57.577438    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndhnr"
Jul 15 12:20:57.577618 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:57.577557    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ndhnr" podUID="6a7be93c-3ae8-4f57-8bb9-ffb11e116493"
Jul 15 12:20:57.799741 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:57.799708    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-ckzbm"
Jul 15 12:20:57.800270 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:57.800244    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-ckzbm"
Jul 15 12:20:57.867681 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:57.867647    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:20:58.448350 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:58.448182    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:20:58.580380 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:58.580341    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jz7w"
Jul 15 12:20:58.580532 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:58.580451    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jz7w" podUID="6aeeccdd-6c28-44fd-99e8-d6426f00525b"
Jul 15 12:20:58.803193 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:58.803156    2559 generic.go:356] "Generic (PLEG): container finished" podID="c0df3610-e8fe-48b2-ba14-4ed9d65f8965" containerID="5638156864df3ce91cac656713500d1a3d6a0353d2ca5e5ad9391c8ffe9f7329" exitCode=0
Jul 15 12:20:58.803396 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:58.803246    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wj5d4" event={"ID":"c0df3610-e8fe-48b2-ba14-4ed9d65f8965","Type":"ContainerDied","Data":"5638156864df3ce91cac656713500d1a3d6a0353d2ca5e5ad9391c8ffe9f7329"}
Jul 15 12:20:58.806772 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:58.806757    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vp8z_009c50dc-2f9e-455b-95f2-a03e7ed3defd/ovn-acl-logging/0.log"
Jul 15 12:20:58.807095 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:58.807076    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z" event={"ID":"009c50dc-2f9e-455b-95f2-a03e7ed3defd","Type":"ContainerStarted","Data":"844ee9351ad89c48c28098d4c6c5127a8b1852017e0971bfad4efae9e737c02b"}
Jul 15 12:20:58.807581 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:58.807567    2559 scope.go:117] "RemoveContainer" containerID="406ffc5a7bff480ffb6b91b233738dabb0365376c61b8af8c71e7d9167f85b33"
Jul 15 12:20:59.172440 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:59.172341    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:20:59.489105 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:59.489072    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:20:59.577560 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:59.577518    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndhnr"
Jul 15 12:20:59.577560 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:59.577563    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8ghwr"
Jul 15 12:20:59.577748 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:59.577632    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ndhnr" podUID="6a7be93c-3ae8-4f57-8bb9-ffb11e116493"
Jul 15 12:20:59.577784 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:20:59.577748    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8ghwr" podUID="df4bf5c7-9413-4a70-8d17-9eaca62b4373"
Jul 15 12:20:59.588990 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:59.588964    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:20:59.690179 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:59.690138    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:20:59.812564 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:59.812497    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vp8z_009c50dc-2f9e-455b-95f2-a03e7ed3defd/ovn-acl-logging/0.log"
Jul 15 12:20:59.812955 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:59.812916    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z" event={"ID":"009c50dc-2f9e-455b-95f2-a03e7ed3defd","Type":"ContainerStarted","Data":"fe780979de54a62711381ee7a008f195d1f97f32d8a3783278fe8974015619ba"}
Jul 15 12:20:59.813194 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:59.813167    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z"
Jul 15 12:20:59.813273 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:59.813247    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z"
Jul 15 12:20:59.813333 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:59.813294    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z"
Jul 15 12:20:59.828023 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:59.827996    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z"
Jul 15 12:20:59.828179 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:59.828096    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z"
Jul 15 12:20:59.832210 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:59.832186    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:20:59.860123 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:59.860066    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z" podStartSLOduration=9.736816945 podStartE2EDuration="28.8600521s" totalImagesPullingTime="19.123235155s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 12:20:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:20:59.858934428 +0000 UTC m=+29.831505586" watchObservedRunningTime="2026-07-15 12:20:59.8600521 +0000 UTC m=+29.832623259"
Jul 15 12:20:59.919350 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:20:59.919319    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:00.020255 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:00.020216    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:00.519201 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:00.519164    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:00.578331 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:00.578300    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jz7w"
Jul 15 12:21:00.578500 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:21:00.578398    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jz7w" podUID="6aeeccdd-6c28-44fd-99e8-d6426f00525b"
Jul 15 12:21:00.817809 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:00.817724    2559 generic.go:356] "Generic (PLEG): container finished" podID="c0df3610-e8fe-48b2-ba14-4ed9d65f8965" containerID="1d851f8e2e31a9d921a00b55168c4cfe630216597c09456440beeda41d39d190" exitCode=0
Jul 15 12:21:00.817953 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:00.817806    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wj5d4" event={"ID":"c0df3610-e8fe-48b2-ba14-4ed9d65f8965","Type":"ContainerDied","Data":"1d851f8e2e31a9d921a00b55168c4cfe630216597c09456440beeda41d39d190"}
Jul 15 12:21:01.112061 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:01.111986    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:01.527314 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:01.527273    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:01.577694 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:01.577658    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndhnr"
Jul 15 12:21:01.577869 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:01.577658    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8ghwr"
Jul 15 12:21:01.577869 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:21:01.577799    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ndhnr" podUID="6a7be93c-3ae8-4f57-8bb9-ffb11e116493"
Jul 15 12:21:01.577869 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:21:01.577841    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8ghwr" podUID="df4bf5c7-9413-4a70-8d17-9eaca62b4373"
Jul 15 12:21:01.995563 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:01.995528    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:02.095870 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:02.093233    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:02.306417 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:02.306383    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:02.577564 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:02.577528    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jz7w"
Jul 15 12:21:02.578003 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:21:02.577667    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jz7w" podUID="6aeeccdd-6c28-44fd-99e8-d6426f00525b"
Jul 15 12:21:02.705506 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:02.705476    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:02.813273 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:02.813237    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:02.824087 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:02.824062    2559 generic.go:356] "Generic (PLEG): container finished" podID="c0df3610-e8fe-48b2-ba14-4ed9d65f8965" containerID="26ab184b33fcffa62f8255a7f132c1801bdf8d1231727b03ae2cb8098ee94178" exitCode=0
Jul 15 12:21:02.824215 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:02.824108    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wj5d4" event={"ID":"c0df3610-e8fe-48b2-ba14-4ed9d65f8965","Type":"ContainerDied","Data":"26ab184b33fcffa62f8255a7f132c1801bdf8d1231727b03ae2cb8098ee94178"}
Jul 15 12:21:02.964581 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:02.964557    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:03.399487 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:03.399407    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:03.509452 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:03.509420    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:03.578059 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:03.578016    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndhnr"
Jul 15 12:21:03.578059 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:03.578054    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8ghwr"
Jul 15 12:21:03.578501 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:21:03.578187    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ndhnr" podUID="6a7be93c-3ae8-4f57-8bb9-ffb11e116493"
Jul 15 12:21:03.578501 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:21:03.578317    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8ghwr" podUID="df4bf5c7-9413-4a70-8d17-9eaca62b4373"
Jul 15 12:21:04.107517 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:04.107475    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:04.230172 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:04.230119    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:04.265014 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:04.264976    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/df4bf5c7-9413-4a70-8d17-9eaca62b4373-original-pull-secret\") pod \"global-pull-secret-syncer-8ghwr\" (UID: \"df4bf5c7-9413-4a70-8d17-9eaca62b4373\") " pod="kube-system/global-pull-secret-syncer-8ghwr"
Jul 15 12:21:04.265200 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:04.265038    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a7be93c-3ae8-4f57-8bb9-ffb11e116493-metrics-certs\") pod \"network-metrics-daemon-ndhnr\" (UID: \"6a7be93c-3ae8-4f57-8bb9-ffb11e116493\") " pod="openshift-multus/network-metrics-daemon-ndhnr"
Jul 15 12:21:04.265200 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:21:04.265142    2559 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 15 12:21:04.265314 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:21:04.265222    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/df4bf5c7-9413-4a70-8d17-9eaca62b4373-original-pull-secret podName:df4bf5c7-9413-4a70-8d17-9eaca62b4373 nodeName:}" failed. No retries permitted until 2026-07-15 12:21:36.265201246 +0000 UTC m=+66.237772400 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/df4bf5c7-9413-4a70-8d17-9eaca62b4373-original-pull-secret") pod "global-pull-secret-syncer-8ghwr" (UID: "df4bf5c7-9413-4a70-8d17-9eaca62b4373") : object "kube-system"/"original-pull-secret" not registered
Jul 15 12:21:04.265314 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:21:04.265144    2559 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 12:21:04.265314 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:21:04.265293    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/6a7be93c-3ae8-4f57-8bb9-ffb11e116493-metrics-certs podName:6a7be93c-3ae8-4f57-8bb9-ffb11e116493 nodeName:}" failed. No retries permitted until 2026-07-15 12:21:36.265276958 +0000 UTC m=+66.237848094 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/6a7be93c-3ae8-4f57-8bb9-ffb11e116493-metrics-certs") pod "network-metrics-daemon-ndhnr" (UID: "6a7be93c-3ae8-4f57-8bb9-ffb11e116493") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 15 12:21:04.365599 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:04.365512    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vk5dd\" (UniqueName: \"kubernetes.io/projected/6aeeccdd-6c28-44fd-99e8-d6426f00525b-kube-api-access-vk5dd\") pod \"network-check-target-7jz7w\" (UID: \"6aeeccdd-6c28-44fd-99e8-d6426f00525b\") " pod="openshift-network-diagnostics/network-check-target-7jz7w"
Jul 15 12:21:04.365762 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:21:04.365657    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 15 12:21:04.365762 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:21:04.365677    2559 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 15 12:21:04.365762 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:21:04.365689    2559 projected.go:196] Error preparing data for projected volume kube-api-access-vk5dd for pod openshift-network-diagnostics/network-check-target-7jz7w: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 12:21:04.365762 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:21:04.365744    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/6aeeccdd-6c28-44fd-99e8-d6426f00525b-kube-api-access-vk5dd podName:6aeeccdd-6c28-44fd-99e8-d6426f00525b nodeName:}" failed. No retries permitted until 2026-07-15 12:21:36.365729984 +0000 UTC m=+66.338301120 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-vk5dd" (UniqueName: "kubernetes.io/projected/6aeeccdd-6c28-44fd-99e8-d6426f00525b-kube-api-access-vk5dd") pod "network-check-target-7jz7w" (UID: "6aeeccdd-6c28-44fd-99e8-d6426f00525b") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 15 12:21:04.500853 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:04.500821    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:04.578162 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:04.578128    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jz7w"
Jul 15 12:21:04.578613 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:21:04.578260    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jz7w" podUID="6aeeccdd-6c28-44fd-99e8-d6426f00525b"
Jul 15 12:21:05.020087 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:05.020055    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:05.118747 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:05.118706    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:05.180670 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:05.180639    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:05.577698 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:05.577662    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8ghwr"
Jul 15 12:21:05.577879 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:05.577669    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndhnr"
Jul 15 12:21:05.580596 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:21:05.578108    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8ghwr" podUID="df4bf5c7-9413-4a70-8d17-9eaca62b4373"
Jul 15 12:21:05.580596 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:21:05.578223    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ndhnr" podUID="6a7be93c-3ae8-4f57-8bb9-ffb11e116493"
Jul 15 12:21:06.296656 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:06.296618    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:06.427699 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:06.427639    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:06.518192 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:06.518138    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:06.578486 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:06.578402    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jz7w"
Jul 15 12:21:06.578656 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:21:06.578548    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jz7w" podUID="6aeeccdd-6c28-44fd-99e8-d6426f00525b"
Jul 15 12:21:06.696704 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:06.696666    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:06.908076 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:06.907985    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:07.099956 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:07.099930    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:07.200347 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:07.200322    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:07.301067 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:07.301040    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:07.577946 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:07.577917    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndhnr"
Jul 15 12:21:07.577946 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:07.577950    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8ghwr"
Jul 15 12:21:07.578148 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:21:07.578035    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ndhnr" podUID="6a7be93c-3ae8-4f57-8bb9-ffb11e116493"
Jul 15 12:21:07.578227 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:21:07.578164    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8ghwr" podUID="df4bf5c7-9413-4a70-8d17-9eaca62b4373"
Jul 15 12:21:07.837717 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:07.837628    2559 generic.go:356] "Generic (PLEG): container finished" podID="c0df3610-e8fe-48b2-ba14-4ed9d65f8965" containerID="2ab5b5d5884354d465b9022166815d961141de2d8ba020ffbb551ceae798c5d1" exitCode=0
Jul 15 12:21:07.837717 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:07.837680    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wj5d4" event={"ID":"c0df3610-e8fe-48b2-ba14-4ed9d65f8965","Type":"ContainerDied","Data":"2ab5b5d5884354d465b9022166815d961141de2d8ba020ffbb551ceae798c5d1"}
Jul 15 12:21:08.292639 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:08.292609    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:08.483647 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:08.483613    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:08.577621 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:08.577543    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jz7w"
Jul 15 12:21:08.577758 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:21:08.577697    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jz7w" podUID="6aeeccdd-6c28-44fd-99e8-d6426f00525b"
Jul 15 12:21:08.700091 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:08.700061    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:08.843127 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:08.843032    2559 generic.go:356] "Generic (PLEG): container finished" podID="c0df3610-e8fe-48b2-ba14-4ed9d65f8965" containerID="b964de238dc0e28863070574bf4cc1f6a3b3caed7cc82f340e09fcb48185cbad" exitCode=0
Jul 15 12:21:08.843127 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:08.843090    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wj5d4" event={"ID":"c0df3610-e8fe-48b2-ba14-4ed9d65f8965","Type":"ContainerDied","Data":"b964de238dc0e28863070574bf4cc1f6a3b3caed7cc82f340e09fcb48185cbad"}
Jul 15 12:21:08.890456 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:08.890425    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:09.080702 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:09.080671    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:09.493196 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:09.493164    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:09.577684 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:09.577637    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8ghwr"
Jul 15 12:21:09.577832 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:09.577637    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndhnr"
Jul 15 12:21:09.577832 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:21:09.577767    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8ghwr" podUID="df4bf5c7-9413-4a70-8d17-9eaca62b4373"
Jul 15 12:21:09.577924 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:21:09.577829    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ndhnr" podUID="6a7be93c-3ae8-4f57-8bb9-ffb11e116493"
Jul 15 12:21:09.848307 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:09.848232    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-wj5d4" event={"ID":"c0df3610-e8fe-48b2-ba14-4ed9d65f8965","Type":"ContainerStarted","Data":"123468fe19b3be4572991eab8678defe123c79ee524f25abfb6ab6b4353db978"}
Jul 15 12:21:09.874599 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:09.874549    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-wj5d4" podStartSLOduration=8.966369916 podStartE2EDuration="38.874532882s" totalImagesPullingTime="29.908162966s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 12:20:31 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:21:09.874154352 +0000 UTC m=+39.846725510" watchObservedRunningTime="2026-07-15 12:21:09.874532882 +0000 UTC m=+39.847104039"
Jul 15 12:21:10.202918 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:10.202841    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:10.578191 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:10.578157    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jz7w"
Jul 15 12:21:10.578355 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:21:10.578244    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jz7w" podUID="6aeeccdd-6c28-44fd-99e8-d6426f00525b"
Jul 15 12:21:11.577708 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:11.577668    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndhnr"
Jul 15 12:21:11.578166 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:21:11.577794    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ndhnr" podUID="6a7be93c-3ae8-4f57-8bb9-ffb11e116493"
Jul 15 12:21:11.578166 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:11.577844    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8ghwr"
Jul 15 12:21:11.578166 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:21:11.577929    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8ghwr" podUID="df4bf5c7-9413-4a70-8d17-9eaca62b4373"
Jul 15 12:21:12.578095 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:12.578061    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jz7w"
Jul 15 12:21:12.578511 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:21:12.578160    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jz7w" podUID="6aeeccdd-6c28-44fd-99e8-d6426f00525b"
Jul 15 12:21:13.577964 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:13.577931    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndhnr"
Jul 15 12:21:13.577964 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:13.577958    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8ghwr"
Jul 15 12:21:13.578437 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:21:13.578032    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ndhnr" podUID="6a7be93c-3ae8-4f57-8bb9-ffb11e116493"
Jul 15 12:21:13.578437 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:21:13.578144    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8ghwr" podUID="df4bf5c7-9413-4a70-8d17-9eaca62b4373"
Jul 15 12:21:14.577652 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:14.577618    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jz7w"
Jul 15 12:21:14.577795 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:21:14.577718    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jz7w" podUID="6aeeccdd-6c28-44fd-99e8-d6426f00525b"
Jul 15 12:21:15.577837 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:15.577799    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndhnr"
Jul 15 12:21:15.578232 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:15.577848    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8ghwr"
Jul 15 12:21:15.578232 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:21:15.577938    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ndhnr" podUID="6a7be93c-3ae8-4f57-8bb9-ffb11e116493"
Jul 15 12:21:15.578232 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:21:15.577997    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8ghwr" podUID="df4bf5c7-9413-4a70-8d17-9eaca62b4373"
Jul 15 12:21:16.577956 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:16.577916    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jz7w"
Jul 15 12:21:16.578423 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:21:16.578020    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jz7w" podUID="6aeeccdd-6c28-44fd-99e8-d6426f00525b"
Jul 15 12:21:17.578224 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:17.578184    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndhnr"
Jul 15 12:21:17.578623 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:17.578184    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8ghwr"
Jul 15 12:21:17.578623 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:21:17.578320    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ndhnr" podUID="6a7be93c-3ae8-4f57-8bb9-ffb11e116493"
Jul 15 12:21:17.578623 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:21:17.578357    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8ghwr" podUID="df4bf5c7-9413-4a70-8d17-9eaca62b4373"
Jul 15 12:21:18.569582 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:18.569552    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:18.577706 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:18.577691    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jz7w"
Jul 15 12:21:18.577798 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:21:18.577783    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jz7w" podUID="6aeeccdd-6c28-44fd-99e8-d6426f00525b"
Jul 15 12:21:18.797715 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:18.797677    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:19.054969 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:19.054936    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:19.256481 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:19.256449    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:19.577922 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:19.577884    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndhnr"
Jul 15 12:21:19.577922 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:19.577907    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8ghwr"
Jul 15 12:21:19.578136 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:21:19.578005    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ndhnr" podUID="6a7be93c-3ae8-4f57-8bb9-ffb11e116493"
Jul 15 12:21:19.578172 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:21:19.578147    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8ghwr" podUID="df4bf5c7-9413-4a70-8d17-9eaca62b4373"
Jul 15 12:21:19.747575 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:19.747543    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:19.913564 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:19.913530    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:20.006595 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:20.006560    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8ghwr"]
Jul 15 12:21:20.006766 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:20.006661    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8ghwr"
Jul 15 12:21:20.006766 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:21:20.006747    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8ghwr" podUID="df4bf5c7-9413-4a70-8d17-9eaca62b4373"
Jul 15 12:21:20.010644 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:20.010541    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ndhnr"]
Jul 15 12:21:20.010771 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:20.010660    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndhnr"
Jul 15 12:21:20.010829 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:21:20.010780    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ndhnr" podUID="6a7be93c-3ae8-4f57-8bb9-ffb11e116493"
Jul 15 12:21:20.011207 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:20.011186    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7jz7w"]
Jul 15 12:21:20.011296 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:20.011272    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jz7w"
Jul 15 12:21:20.011401 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:21:20.011379    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jz7w" podUID="6aeeccdd-6c28-44fd-99e8-d6426f00525b"
Jul 15 12:21:20.207409 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:20.207312    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:20.362296 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:20.362238    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:21.577764 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:21.577732    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jz7w"
Jul 15 12:21:21.578142 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:21.577821    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8ghwr"
Jul 15 12:21:21.578142 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:21:21.577830    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jz7w" podUID="6aeeccdd-6c28-44fd-99e8-d6426f00525b"
Jul 15 12:21:21.578142 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:21.577848    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndhnr"
Jul 15 12:21:21.578142 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:21:21.577912    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8ghwr" podUID="df4bf5c7-9413-4a70-8d17-9eaca62b4373"
Jul 15 12:21:21.578142 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:21:21.577975    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ndhnr" podUID="6a7be93c-3ae8-4f57-8bb9-ffb11e116493"
Jul 15 12:21:23.577484 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:23.577279    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndhnr"
Jul 15 12:21:23.577866 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:23.577278    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jz7w"
Jul 15 12:21:23.577866 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:21:23.577573    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ndhnr" podUID="6a7be93c-3ae8-4f57-8bb9-ffb11e116493"
Jul 15 12:21:23.577866 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:23.577279    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8ghwr"
Jul 15 12:21:23.577866 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:21:23.577625    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7jz7w" podUID="6aeeccdd-6c28-44fd-99e8-d6426f00525b"
Jul 15 12:21:23.577866 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:21:23.577697    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-8ghwr" podUID="df4bf5c7-9413-4a70-8d17-9eaca62b4373"
Jul 15 12:21:23.905458 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:23.905433    2559 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-67.ec2.internal" event="NodeReady"
Jul 15 12:21:23.905637 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:23.905550    2559 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 15 12:21:24.014003 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:24.013973    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-95f4q"]
Jul 15 12:21:24.026415 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:24.026391    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-95f4q"
Jul 15 12:21:24.028945 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:24.028909    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-vk2s9"]
Jul 15 12:21:24.031015 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:24.030992    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 15 12:21:24.038348 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:24.038324    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vk2s9"
Jul 15 12:21:24.042258 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:24.042240    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 15 12:21:24.043815 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:24.043798    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 15 12:21:24.044473 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:24.044457    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-bx6xw\""
Jul 15 12:21:24.044692 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:24.044661    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-hw8dx\""
Jul 15 12:21:24.044776 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:24.044759    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 15 12:21:24.045199 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:24.045186    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 15 12:21:24.058546 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:24.058518    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-95f4q"]
Jul 15 12:21:24.063421 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:24.063394    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vk2s9"]
Jul 15 12:21:24.114478 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:24.114448    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/30e01808-eee5-4f36-b335-fbb9a7d9b9db-config-volume\") pod \"dns-default-95f4q\" (UID: \"30e01808-eee5-4f36-b335-fbb9a7d9b9db\") " pod="openshift-dns/dns-default-95f4q"
Jul 15 12:21:24.114478 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:24.114485    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/30e01808-eee5-4f36-b335-fbb9a7d9b9db-metrics-tls\") pod \"dns-default-95f4q\" (UID: \"30e01808-eee5-4f36-b335-fbb9a7d9b9db\") " pod="openshift-dns/dns-default-95f4q"
Jul 15 12:21:24.114677 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:24.114525    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/17004ef7-ba8a-417e-b928-f9b789137824-cert\") pod \"ingress-canary-vk2s9\" (UID: \"17004ef7-ba8a-417e-b928-f9b789137824\") " pod="openshift-ingress-canary/ingress-canary-vk2s9"
Jul 15 12:21:24.114677 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:24.114556    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qzkvp\" (UniqueName: \"kubernetes.io/projected/30e01808-eee5-4f36-b335-fbb9a7d9b9db-kube-api-access-qzkvp\") pod \"dns-default-95f4q\" (UID: \"30e01808-eee5-4f36-b335-fbb9a7d9b9db\") " pod="openshift-dns/dns-default-95f4q"
Jul 15 12:21:24.114677 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:24.114576    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30e01808-eee5-4f36-b335-fbb9a7d9b9db-tmp-dir\") pod \"dns-default-95f4q\" (UID: \"30e01808-eee5-4f36-b335-fbb9a7d9b9db\") " pod="openshift-dns/dns-default-95f4q"
Jul 15 12:21:24.114677 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:24.114600    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5qn2\" (UniqueName: \"kubernetes.io/projected/17004ef7-ba8a-417e-b928-f9b789137824-kube-api-access-h5qn2\") pod \"ingress-canary-vk2s9\" (UID: \"17004ef7-ba8a-417e-b928-f9b789137824\") " pod="openshift-ingress-canary/ingress-canary-vk2s9"
Jul 15 12:21:24.215440 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:24.215404    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30e01808-eee5-4f36-b335-fbb9a7d9b9db-tmp-dir\") pod \"dns-default-95f4q\" (UID: \"30e01808-eee5-4f36-b335-fbb9a7d9b9db\") " pod="openshift-dns/dns-default-95f4q"
Jul 15 12:21:24.215619 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:24.215457    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5qn2\" (UniqueName: \"kubernetes.io/projected/17004ef7-ba8a-417e-b928-f9b789137824-kube-api-access-h5qn2\") pod \"ingress-canary-vk2s9\" (UID: \"17004ef7-ba8a-417e-b928-f9b789137824\") " pod="openshift-ingress-canary/ingress-canary-vk2s9"
Jul 15 12:21:24.215619 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:24.215522    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/30e01808-eee5-4f36-b335-fbb9a7d9b9db-config-volume\") pod \"dns-default-95f4q\" (UID: \"30e01808-eee5-4f36-b335-fbb9a7d9b9db\") " pod="openshift-dns/dns-default-95f4q"
Jul 15 12:21:24.215619 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:24.215553    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/30e01808-eee5-4f36-b335-fbb9a7d9b9db-metrics-tls\") pod \"dns-default-95f4q\" (UID: \"30e01808-eee5-4f36-b335-fbb9a7d9b9db\") " pod="openshift-dns/dns-default-95f4q"
Jul 15 12:21:24.215619 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:24.215597    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/17004ef7-ba8a-417e-b928-f9b789137824-cert\") pod \"ingress-canary-vk2s9\" (UID: \"17004ef7-ba8a-417e-b928-f9b789137824\") " pod="openshift-ingress-canary/ingress-canary-vk2s9"
Jul 15 12:21:24.215824 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:24.215632    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qzkvp\" (UniqueName: \"kubernetes.io/projected/30e01808-eee5-4f36-b335-fbb9a7d9b9db-kube-api-access-qzkvp\") pod \"dns-default-95f4q\" (UID: \"30e01808-eee5-4f36-b335-fbb9a7d9b9db\") " pod="openshift-dns/dns-default-95f4q"
Jul 15 12:21:24.215824 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:24.215805    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/30e01808-eee5-4f36-b335-fbb9a7d9b9db-tmp-dir\") pod \"dns-default-95f4q\" (UID: \"30e01808-eee5-4f36-b335-fbb9a7d9b9db\") " pod="openshift-dns/dns-default-95f4q"
Jul 15 12:21:24.216202 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:24.216177    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/30e01808-eee5-4f36-b335-fbb9a7d9b9db-config-volume\") pod \"dns-default-95f4q\" (UID: \"30e01808-eee5-4f36-b335-fbb9a7d9b9db\") " pod="openshift-dns/dns-default-95f4q"
Jul 15 12:21:24.217066 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:24.217020    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:24.219572 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:24.219550    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/30e01808-eee5-4f36-b335-fbb9a7d9b9db-metrics-tls\") pod \"dns-default-95f4q\" (UID: \"30e01808-eee5-4f36-b335-fbb9a7d9b9db\") " pod="openshift-dns/dns-default-95f4q"
Jul 15 12:21:24.219647 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:24.219597    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/17004ef7-ba8a-417e-b928-f9b789137824-cert\") pod \"ingress-canary-vk2s9\" (UID: \"17004ef7-ba8a-417e-b928-f9b789137824\") " pod="openshift-ingress-canary/ingress-canary-vk2s9"
Jul 15 12:21:24.224093 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:24.224068    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qzkvp\" (UniqueName: \"kubernetes.io/projected/30e01808-eee5-4f36-b335-fbb9a7d9b9db-kube-api-access-qzkvp\") pod \"dns-default-95f4q\" (UID: \"30e01808-eee5-4f36-b335-fbb9a7d9b9db\") " pod="openshift-dns/dns-default-95f4q"
Jul 15 12:21:24.224292 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:24.224271    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5qn2\" (UniqueName: \"kubernetes.io/projected/17004ef7-ba8a-417e-b928-f9b789137824-kube-api-access-h5qn2\") pod \"ingress-canary-vk2s9\" (UID: \"17004ef7-ba8a-417e-b928-f9b789137824\") " pod="openshift-ingress-canary/ingress-canary-vk2s9"
Jul 15 12:21:24.291254 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:24.291213    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:24.336559 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:24.336524    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-95f4q"
Jul 15 12:21:24.346004 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:24.345788    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-vk2s9"
Jul 15 12:21:24.488328 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:24.488251    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-vk2s9"]
Jul 15 12:21:24.492377 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:24.492327    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-95f4q"]
Jul 15 12:21:24.496243 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:21:24.496215    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30e01808_eee5_4f36_b335_fbb9a7d9b9db.slice/crio-b8e6f9da01d84c64c3ed03196dfbd7ab196ff34a7bdaf238d170bdc13befd393 WatchSource:0}: Error finding container b8e6f9da01d84c64c3ed03196dfbd7ab196ff34a7bdaf238d170bdc13befd393: Status 404 returned error can't find the container with id b8e6f9da01d84c64c3ed03196dfbd7ab196ff34a7bdaf238d170bdc13befd393
Jul 15 12:21:24.880711 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:24.880629    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vk2s9" event={"ID":"17004ef7-ba8a-417e-b928-f9b789137824","Type":"ContainerStarted","Data":"72ba386a4c09c5e76506c56f7b9aa898e111ffd4c9743ca81ff12ce23a9dbfc6"}
Jul 15 12:21:24.881682 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:24.881654    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-95f4q" event={"ID":"30e01808-eee5-4f36-b335-fbb9a7d9b9db","Type":"ContainerStarted","Data":"b8e6f9da01d84c64c3ed03196dfbd7ab196ff34a7bdaf238d170bdc13befd393"}
Jul 15 12:21:25.578285 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:25.578250    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8ghwr"
Jul 15 12:21:25.578488 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:25.578250    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jz7w"
Jul 15 12:21:25.578625 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:25.578258    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndhnr"
Jul 15 12:21:25.581524 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:25.581500    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 12:21:25.582876 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:25.582544    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 12:21:25.582876 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:25.582574    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pcnmv\""
Jul 15 12:21:25.582876 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:25.582613    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 12:21:25.582876 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:25.582621    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nnkkc\""
Jul 15 12:21:25.582876 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:25.582776    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 12:21:27.074538 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:27.074286    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:27.174031 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:27.174003    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:27.276430 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:27.276388    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:27.377605 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:27.377519    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:27.890878 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:27.890843    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-95f4q" event={"ID":"30e01808-eee5-4f36-b335-fbb9a7d9b9db","Type":"ContainerStarted","Data":"f0b2937de90581df3037328068a1a73618e401811faf52e0a01a2a80089341fd"}
Jul 15 12:21:27.891064 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:27.890937    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-95f4q"
Jul 15 12:21:27.891064 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:27.890964    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-95f4q" event={"ID":"30e01808-eee5-4f36-b335-fbb9a7d9b9db","Type":"ContainerStarted","Data":"2314851d96c24779a6ce8d2094227cda0d68ab237e72b05b7bcb074d58a79e46"}
Jul 15 12:21:27.892457 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:27.892434    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-vk2s9" event={"ID":"17004ef7-ba8a-417e-b928-f9b789137824","Type":"ContainerStarted","Data":"3660e6697de3880499ad377cb7a4f25dd68ece085c3ba7e2dc6afc050b7b927a"}
Jul 15 12:21:27.928712 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:27.928661    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-vk2s9" podStartSLOduration=2.338960592 podStartE2EDuration="4.928646816s" totalImagesPullingTime="2.589686224s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:21:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:21:27.928505246 +0000 UTC m=+57.901076405" watchObservedRunningTime="2026-07-15 12:21:27.928646816 +0000 UTC m=+57.901217965"
Jul 15 12:21:27.929236 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:27.929166    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-95f4q" podStartSLOduration=2.348424133 podStartE2EDuration="4.929154797s" totalImagesPullingTime="2.580730664s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:21:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:21:27.911866197 +0000 UTC m=+57.884437354" watchObservedRunningTime="2026-07-15 12:21:27.929154797 +0000 UTC m=+57.901725955"
Jul 15 12:21:28.890534 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:28.890492    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:28.990743 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:28.990710    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:30.043219 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:30.043183    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:30.161244 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:30.161209    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:30.261428 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:30.261399    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:30.290459 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:30.290429    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-5kvn4"]
Jul 15 12:21:30.292393 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:30.292357    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-5kvn4"
Jul 15 12:21:30.295244 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:30.295186    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-fjppj\""
Jul 15 12:21:30.295449 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:30.295431    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 15 12:21:30.307525 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:30.307501    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-5kvn4"]
Jul 15 12:21:30.358468 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:30.358441    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:30.361564 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:30.361535    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c0c7b146-9d0d-4ff6-8fba-6628314b35dc-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-5kvn4\" (UID: \"c0c7b146-9d0d-4ff6-8fba-6628314b35dc\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-5kvn4"
Jul 15 12:21:30.462012 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:30.461985    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c0c7b146-9d0d-4ff6-8fba-6628314b35dc-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-5kvn4\" (UID: \"c0c7b146-9d0d-4ff6-8fba-6628314b35dc\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-5kvn4"
Jul 15 12:21:30.465414 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:30.465398    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-tls\""
Jul 15 12:21:30.473028 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:21:30.473005    2559 secret.go:189] Couldn't get secret openshift-monitoring/prometheus-operator-admission-webhook-tls: secret "prometheus-operator-admission-webhook-tls" not found
Jul 15 12:21:30.473139 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:21:30.473070    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c0c7b146-9d0d-4ff6-8fba-6628314b35dc-tls-certificates podName:c0c7b146-9d0d-4ff6-8fba-6628314b35dc nodeName:}" failed. No retries permitted until 2026-07-15 12:21:30.973052498 +0000 UTC m=+60.945623645 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certificates" (UniqueName: "kubernetes.io/secret/c0c7b146-9d0d-4ff6-8fba-6628314b35dc-tls-certificates") pod "prometheus-operator-admission-webhook-77d98bc786-5kvn4" (UID: "c0c7b146-9d0d-4ff6-8fba-6628314b35dc") : secret "prometheus-operator-admission-webhook-tls" not found
Jul 15 12:21:30.615098 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:30.615026    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:30.739377 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:30.739349    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:30.829152 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:30.829120    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-n6j58"]
Jul 15 12:21:30.831015 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:30.830998    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-n6j58"
Jul 15 12:21:30.834698 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:30.834670    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 15 12:21:30.834801 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:30.834710    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-h4gbb\""
Jul 15 12:21:30.835082 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:30.835063    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 15 12:21:30.852616 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:30.852593    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-n6j58"]
Jul 15 12:21:30.865870 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:30.865809    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9xcmj\" (UniqueName: \"kubernetes.io/projected/40930240-d18f-4a26-a9fe-37807e26fc01-kube-api-access-9xcmj\") pod \"downloads-68c9cbb497-n6j58\" (UID: \"40930240-d18f-4a26-a9fe-37807e26fc01\") " pod="openshift-console/downloads-68c9cbb497-n6j58"
Jul 15 12:21:30.966967 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:30.966928    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9xcmj\" (UniqueName: \"kubernetes.io/projected/40930240-d18f-4a26-a9fe-37807e26fc01-kube-api-access-9xcmj\") pod \"downloads-68c9cbb497-n6j58\" (UID: \"40930240-d18f-4a26-a9fe-37807e26fc01\") " pod="openshift-console/downloads-68c9cbb497-n6j58"
Jul 15 12:21:30.977692 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:30.977642    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:30.981645 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:30.981623    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9xcmj\" (UniqueName: \"kubernetes.io/projected/40930240-d18f-4a26-a9fe-37807e26fc01-kube-api-access-9xcmj\") pod \"downloads-68c9cbb497-n6j58\" (UID: \"40930240-d18f-4a26-a9fe-37807e26fc01\") " pod="openshift-console/downloads-68c9cbb497-n6j58"
Jul 15 12:21:31.067378 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:31.067325    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c0c7b146-9d0d-4ff6-8fba-6628314b35dc-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-5kvn4\" (UID: \"c0c7b146-9d0d-4ff6-8fba-6628314b35dc\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-5kvn4"
Jul 15 12:21:31.069678 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:31.069655    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certificates\" (UniqueName: \"kubernetes.io/secret/c0c7b146-9d0d-4ff6-8fba-6628314b35dc-tls-certificates\") pod \"prometheus-operator-admission-webhook-77d98bc786-5kvn4\" (UID: \"c0c7b146-9d0d-4ff6-8fba-6628314b35dc\") " pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-5kvn4"
Jul 15 12:21:31.094250 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:31.094225    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-wgkkl"]
Jul 15 12:21:31.096250 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:31.096236    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wgkkl"
Jul 15 12:21:31.098971 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:31.098947    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 15 12:21:31.101166 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:31.101147    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 15 12:21:31.101276 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:31.101152    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 15 12:21:31.101276 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:31.101232    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 15 12:21:31.101381 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:31.101272    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8wtrb\""
Jul 15 12:21:31.118024 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:31.117958    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wgkkl"]
Jul 15 12:21:31.139313 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:31.139288    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-n6j58"
Jul 15 12:21:31.142918 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:31.142890    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:31.167851 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:31.167821    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/caf85504-b314-4a69-a6e2-e4fb79f5a561-crio-socket\") pod \"insights-runtime-extractor-wgkkl\" (UID: \"caf85504-b314-4a69-a6e2-e4fb79f5a561\") " pod="openshift-insights/insights-runtime-extractor-wgkkl"
Jul 15 12:21:31.167995 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:31.167910    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/caf85504-b314-4a69-a6e2-e4fb79f5a561-data-volume\") pod \"insights-runtime-extractor-wgkkl\" (UID: \"caf85504-b314-4a69-a6e2-e4fb79f5a561\") " pod="openshift-insights/insights-runtime-extractor-wgkkl"
Jul 15 12:21:31.167995 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:31.167949    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/caf85504-b314-4a69-a6e2-e4fb79f5a561-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wgkkl\" (UID: \"caf85504-b314-4a69-a6e2-e4fb79f5a561\") " pod="openshift-insights/insights-runtime-extractor-wgkkl"
Jul 15 12:21:31.167995 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:31.167973    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lx5w2\" (UniqueName: \"kubernetes.io/projected/caf85504-b314-4a69-a6e2-e4fb79f5a561-kube-api-access-lx5w2\") pod \"insights-runtime-extractor-wgkkl\" (UID: \"caf85504-b314-4a69-a6e2-e4fb79f5a561\") " pod="openshift-insights/insights-runtime-extractor-wgkkl"
Jul 15 12:21:31.168213 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:31.168006    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/caf85504-b314-4a69-a6e2-e4fb79f5a561-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wgkkl\" (UID: \"caf85504-b314-4a69-a6e2-e4fb79f5a561\") " pod="openshift-insights/insights-runtime-extractor-wgkkl"
Jul 15 12:21:31.211562 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:31.211533    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-admission-webhook-dockercfg-fjppj\""
Jul 15 12:21:31.237650 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:31.223462    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-5kvn4"
Jul 15 12:21:31.268913 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:31.268885    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/caf85504-b314-4a69-a6e2-e4fb79f5a561-crio-socket\") pod \"insights-runtime-extractor-wgkkl\" (UID: \"caf85504-b314-4a69-a6e2-e4fb79f5a561\") " pod="openshift-insights/insights-runtime-extractor-wgkkl"
Jul 15 12:21:31.269070 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:31.268944    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/caf85504-b314-4a69-a6e2-e4fb79f5a561-data-volume\") pod \"insights-runtime-extractor-wgkkl\" (UID: \"caf85504-b314-4a69-a6e2-e4fb79f5a561\") " pod="openshift-insights/insights-runtime-extractor-wgkkl"
Jul 15 12:21:31.269070 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:31.268969    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/caf85504-b314-4a69-a6e2-e4fb79f5a561-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wgkkl\" (UID: \"caf85504-b314-4a69-a6e2-e4fb79f5a561\") " pod="openshift-insights/insights-runtime-extractor-wgkkl"
Jul 15 12:21:31.269070 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:31.268984    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lx5w2\" (UniqueName: \"kubernetes.io/projected/caf85504-b314-4a69-a6e2-e4fb79f5a561-kube-api-access-lx5w2\") pod \"insights-runtime-extractor-wgkkl\" (UID: \"caf85504-b314-4a69-a6e2-e4fb79f5a561\") " pod="openshift-insights/insights-runtime-extractor-wgkkl"
Jul 15 12:21:31.269070 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:31.269005    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/caf85504-b314-4a69-a6e2-e4fb79f5a561-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wgkkl\" (UID: \"caf85504-b314-4a69-a6e2-e4fb79f5a561\") " pod="openshift-insights/insights-runtime-extractor-wgkkl"
Jul 15 12:21:31.269070 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:31.269019    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/caf85504-b314-4a69-a6e2-e4fb79f5a561-crio-socket\") pod \"insights-runtime-extractor-wgkkl\" (UID: \"caf85504-b314-4a69-a6e2-e4fb79f5a561\") " pod="openshift-insights/insights-runtime-extractor-wgkkl"
Jul 15 12:21:31.269294 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:21:31.269119    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 12:21:31.269294 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:21:31.269163    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 12:21:31.269294 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:21:31.269195    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/caf85504-b314-4a69-a6e2-e4fb79f5a561-insights-runtime-extractor-tls podName:caf85504-b314-4a69-a6e2-e4fb79f5a561 nodeName:}" failed. No retries permitted until 2026-07-15 12:21:31.769172297 +0000 UTC m=+61.741743436 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/caf85504-b314-4a69-a6e2-e4fb79f5a561-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wgkkl" (UID: "caf85504-b314-4a69-a6e2-e4fb79f5a561") : secret "insights-runtime-extractor-tls" not found
Jul 15 12:21:31.269462 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:21:31.269448    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/caf85504-b314-4a69-a6e2-e4fb79f5a561-kube-rbac-proxy-cm podName:caf85504-b314-4a69-a6e2-e4fb79f5a561 nodeName:}" failed. No retries permitted until 2026-07-15 12:21:31.769202022 +0000 UTC m=+61.741773158 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/caf85504-b314-4a69-a6e2-e4fb79f5a561-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wgkkl" (UID: "caf85504-b314-4a69-a6e2-e4fb79f5a561") : configmap "kube-rbac-proxy" not found
Jul 15 12:21:31.269625 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:31.269591    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/caf85504-b314-4a69-a6e2-e4fb79f5a561-data-volume\") pod \"insights-runtime-extractor-wgkkl\" (UID: \"caf85504-b314-4a69-a6e2-e4fb79f5a561\") " pod="openshift-insights/insights-runtime-extractor-wgkkl"
Jul 15 12:21:31.283733 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:31.283706    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-n6j58"]
Jul 15 12:21:31.287708 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:21:31.287683    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40930240_d18f_4a26_a9fe_37807e26fc01.slice/crio-b1587a41215a14d71f215dc96609749eb9b1ee7e41ea89c4c2cbb21dd9059a9f WatchSource:0}: Error finding container b1587a41215a14d71f215dc96609749eb9b1ee7e41ea89c4c2cbb21dd9059a9f: Status 404 returned error can't find the container with id b1587a41215a14d71f215dc96609749eb9b1ee7e41ea89c4c2cbb21dd9059a9f
Jul 15 12:21:31.289238 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:31.289199    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lx5w2\" (UniqueName: \"kubernetes.io/projected/caf85504-b314-4a69-a6e2-e4fb79f5a561-kube-api-access-lx5w2\") pod \"insights-runtime-extractor-wgkkl\" (UID: \"caf85504-b314-4a69-a6e2-e4fb79f5a561\") " pod="openshift-insights/insights-runtime-extractor-wgkkl"
Jul 15 12:21:31.303066 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:31.303032    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:31.376729 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:31.376652    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-5kvn4"]
Jul 15 12:21:31.380130 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:21:31.380106    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc0c7b146_9d0d_4ff6_8fba_6628314b35dc.slice/crio-0a8baa91c1d5a9de2b7720a9af48e2becec09de64b4fe2685f1d91887b301324 WatchSource:0}: Error finding container 0a8baa91c1d5a9de2b7720a9af48e2becec09de64b4fe2685f1d91887b301324: Status 404 returned error can't find the container with id 0a8baa91c1d5a9de2b7720a9af48e2becec09de64b4fe2685f1d91887b301324
Jul 15 12:21:31.463611 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:31.463579    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:31.607630 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:31.607599    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:31.730601 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:31.730571    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:31.772772 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:31.772741    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/caf85504-b314-4a69-a6e2-e4fb79f5a561-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wgkkl\" (UID: \"caf85504-b314-4a69-a6e2-e4fb79f5a561\") " pod="openshift-insights/insights-runtime-extractor-wgkkl"
Jul 15 12:21:31.772932 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:31.772779    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/caf85504-b314-4a69-a6e2-e4fb79f5a561-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wgkkl\" (UID: \"caf85504-b314-4a69-a6e2-e4fb79f5a561\") " pod="openshift-insights/insights-runtime-extractor-wgkkl"
Jul 15 12:21:31.772932 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:21:31.772894    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 12:21:31.773032 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:21:31.772969    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/caf85504-b314-4a69-a6e2-e4fb79f5a561-insights-runtime-extractor-tls podName:caf85504-b314-4a69-a6e2-e4fb79f5a561 nodeName:}" failed. No retries permitted until 2026-07-15 12:21:32.772952217 +0000 UTC m=+62.745523353 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/caf85504-b314-4a69-a6e2-e4fb79f5a561-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wgkkl" (UID: "caf85504-b314-4a69-a6e2-e4fb79f5a561") : secret "insights-runtime-extractor-tls" not found
Jul 15 12:21:31.773032 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:21:31.772898    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 12:21:31.773129 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:21:31.773050    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/caf85504-b314-4a69-a6e2-e4fb79f5a561-kube-rbac-proxy-cm podName:caf85504-b314-4a69-a6e2-e4fb79f5a561 nodeName:}" failed. No retries permitted until 2026-07-15 12:21:32.773033841 +0000 UTC m=+62.745604976 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/caf85504-b314-4a69-a6e2-e4fb79f5a561-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wgkkl" (UID: "caf85504-b314-4a69-a6e2-e4fb79f5a561") : configmap "kube-rbac-proxy" not found
Jul 15 12:21:31.837039 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:31.837011    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-2vp8z"
Jul 15 12:21:31.903631 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:31.903595    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-5kvn4" event={"ID":"c0c7b146-9d0d-4ff6-8fba-6628314b35dc","Type":"ContainerStarted","Data":"0a8baa91c1d5a9de2b7720a9af48e2becec09de64b4fe2685f1d91887b301324"}
Jul 15 12:21:31.904651 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:31.904628    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-n6j58" event={"ID":"40930240-d18f-4a26-a9fe-37807e26fc01","Type":"ContainerStarted","Data":"b1587a41215a14d71f215dc96609749eb9b1ee7e41ea89c4c2cbb21dd9059a9f"}
Jul 15 12:21:31.986065 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:31.985989    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:32.055903 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:32.055867    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-95f4q_30e01808-eee5-4f36-b335-fbb9a7d9b9db/dns/0.log"
Jul 15 12:21:32.095106 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:32.095072    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:32.212957 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:32.212908    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:32.252592 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:32.252526    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-95f4q_30e01808-eee5-4f36-b335-fbb9a7d9b9db/kube-rbac-proxy/0.log"
Jul 15 12:21:32.539607 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:32.539526    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:32.698706 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:32.698671    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:32.779881 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:32.779847    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/caf85504-b314-4a69-a6e2-e4fb79f5a561-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wgkkl\" (UID: \"caf85504-b314-4a69-a6e2-e4fb79f5a561\") " pod="openshift-insights/insights-runtime-extractor-wgkkl"
Jul 15 12:21:32.779881 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:32.779885    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/caf85504-b314-4a69-a6e2-e4fb79f5a561-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wgkkl\" (UID: \"caf85504-b314-4a69-a6e2-e4fb79f5a561\") " pod="openshift-insights/insights-runtime-extractor-wgkkl"
Jul 15 12:21:32.780099 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:21:32.779953    2559 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 15 12:21:32.780099 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:21:32.779985    2559 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 15 12:21:32.780099 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:21:32.780001    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/caf85504-b314-4a69-a6e2-e4fb79f5a561-kube-rbac-proxy-cm podName:caf85504-b314-4a69-a6e2-e4fb79f5a561 nodeName:}" failed. No retries permitted until 2026-07-15 12:21:34.779987845 +0000 UTC m=+64.752558980 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/caf85504-b314-4a69-a6e2-e4fb79f5a561-kube-rbac-proxy-cm") pod "insights-runtime-extractor-wgkkl" (UID: "caf85504-b314-4a69-a6e2-e4fb79f5a561") : configmap "kube-rbac-proxy" not found
Jul 15 12:21:32.780099 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:21:32.780037    2559 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/caf85504-b314-4a69-a6e2-e4fb79f5a561-insights-runtime-extractor-tls podName:caf85504-b314-4a69-a6e2-e4fb79f5a561 nodeName:}" failed. No retries permitted until 2026-07-15 12:21:34.780023718 +0000 UTC m=+64.752594856 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/caf85504-b314-4a69-a6e2-e4fb79f5a561-insights-runtime-extractor-tls") pod "insights-runtime-extractor-wgkkl" (UID: "caf85504-b314-4a69-a6e2-e4fb79f5a561") : secret "insights-runtime-extractor-tls" not found
Jul 15 12:21:33.036841 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:33.036806    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:33.159467 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:33.159423    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:33.250943 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:33.250905    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qfb4c_b7a79dc6-aa77-49fa-87dd-08ed78b9f4f5/dns-node-resolver/0.log"
Jul 15 12:21:33.259264 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:33.259203    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:33.585218 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:33.585179    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:33.712320 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:33.712290    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:33.849164 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:33.849085    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bctct_f2f64511-8f06-4610-a112-0cd46f0fd503/node-ca/0.log"
Jul 15 12:21:34.308185 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:34.308148    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7cc65599dd-qjmkj"]
Jul 15 12:21:34.310523 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:34.310423    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cc65599dd-qjmkj"
Jul 15 12:21:34.313066 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:34.313044    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 15 12:21:34.313973 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:34.313938    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 15 12:21:34.314100 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:34.314034    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 15 12:21:34.314100 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:34.314048    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 15 12:21:34.314220 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:34.314119    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 15 12:21:34.314220 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:34.314165    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-w4w5h\""
Jul 15 12:21:34.323895 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:34.323874    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cc65599dd-qjmkj"]
Jul 15 12:21:34.398031 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:34.396953    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e0795e72-5074-47f8-bb5a-143d24109705-console-config\") pod \"console-7cc65599dd-qjmkj\" (UID: \"e0795e72-5074-47f8-bb5a-143d24109705\") " pod="openshift-console/console-7cc65599dd-qjmkj"
Jul 15 12:21:34.398031 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:34.397015    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2r8jv\" (UniqueName: \"kubernetes.io/projected/e0795e72-5074-47f8-bb5a-143d24109705-kube-api-access-2r8jv\") pod \"console-7cc65599dd-qjmkj\" (UID: \"e0795e72-5074-47f8-bb5a-143d24109705\") " pod="openshift-console/console-7cc65599dd-qjmkj"
Jul 15 12:21:34.398031 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:34.397217    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e0795e72-5074-47f8-bb5a-143d24109705-service-ca\") pod \"console-7cc65599dd-qjmkj\" (UID: \"e0795e72-5074-47f8-bb5a-143d24109705\") " pod="openshift-console/console-7cc65599dd-qjmkj"
Jul 15 12:21:34.398031 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:34.397273    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e0795e72-5074-47f8-bb5a-143d24109705-console-oauth-config\") pod \"console-7cc65599dd-qjmkj\" (UID: \"e0795e72-5074-47f8-bb5a-143d24109705\") " pod="openshift-console/console-7cc65599dd-qjmkj"
Jul 15 12:21:34.398031 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:34.397302    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e0795e72-5074-47f8-bb5a-143d24109705-console-serving-cert\") pod \"console-7cc65599dd-qjmkj\" (UID: \"e0795e72-5074-47f8-bb5a-143d24109705\") " pod="openshift-console/console-7cc65599dd-qjmkj"
Jul 15 12:21:34.398031 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:34.397403    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e0795e72-5074-47f8-bb5a-143d24109705-oauth-serving-cert\") pod \"console-7cc65599dd-qjmkj\" (UID: \"e0795e72-5074-47f8-bb5a-143d24109705\") " pod="openshift-console/console-7cc65599dd-qjmkj"
Jul 15 12:21:34.498128 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:34.498090    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e0795e72-5074-47f8-bb5a-143d24109705-service-ca\") pod \"console-7cc65599dd-qjmkj\" (UID: \"e0795e72-5074-47f8-bb5a-143d24109705\") " pod="openshift-console/console-7cc65599dd-qjmkj"
Jul 15 12:21:34.498311 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:34.498147    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e0795e72-5074-47f8-bb5a-143d24109705-console-oauth-config\") pod \"console-7cc65599dd-qjmkj\" (UID: \"e0795e72-5074-47f8-bb5a-143d24109705\") " pod="openshift-console/console-7cc65599dd-qjmkj"
Jul 15 12:21:34.498311 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:34.498174    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e0795e72-5074-47f8-bb5a-143d24109705-console-serving-cert\") pod \"console-7cc65599dd-qjmkj\" (UID: \"e0795e72-5074-47f8-bb5a-143d24109705\") " pod="openshift-console/console-7cc65599dd-qjmkj"
Jul 15 12:21:34.498311 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:34.498205    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e0795e72-5074-47f8-bb5a-143d24109705-oauth-serving-cert\") pod \"console-7cc65599dd-qjmkj\" (UID: \"e0795e72-5074-47f8-bb5a-143d24109705\") " pod="openshift-console/console-7cc65599dd-qjmkj"
Jul 15 12:21:34.498311 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:34.498229    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e0795e72-5074-47f8-bb5a-143d24109705-console-config\") pod \"console-7cc65599dd-qjmkj\" (UID: \"e0795e72-5074-47f8-bb5a-143d24109705\") " pod="openshift-console/console-7cc65599dd-qjmkj"
Jul 15 12:21:34.498311 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:34.498251    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2r8jv\" (UniqueName: \"kubernetes.io/projected/e0795e72-5074-47f8-bb5a-143d24109705-kube-api-access-2r8jv\") pod \"console-7cc65599dd-qjmkj\" (UID: \"e0795e72-5074-47f8-bb5a-143d24109705\") " pod="openshift-console/console-7cc65599dd-qjmkj"
Jul 15 12:21:34.498954 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:34.498919    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e0795e72-5074-47f8-bb5a-143d24109705-service-ca\") pod \"console-7cc65599dd-qjmkj\" (UID: \"e0795e72-5074-47f8-bb5a-143d24109705\") " pod="openshift-console/console-7cc65599dd-qjmkj"
Jul 15 12:21:34.499071 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:34.498979    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e0795e72-5074-47f8-bb5a-143d24109705-console-config\") pod \"console-7cc65599dd-qjmkj\" (UID: \"e0795e72-5074-47f8-bb5a-143d24109705\") " pod="openshift-console/console-7cc65599dd-qjmkj"
Jul 15 12:21:34.499136 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:34.499077    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e0795e72-5074-47f8-bb5a-143d24109705-oauth-serving-cert\") pod \"console-7cc65599dd-qjmkj\" (UID: \"e0795e72-5074-47f8-bb5a-143d24109705\") " pod="openshift-console/console-7cc65599dd-qjmkj"
Jul 15 12:21:34.500993 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:34.500972    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e0795e72-5074-47f8-bb5a-143d24109705-console-oauth-config\") pod \"console-7cc65599dd-qjmkj\" (UID: \"e0795e72-5074-47f8-bb5a-143d24109705\") " pod="openshift-console/console-7cc65599dd-qjmkj"
Jul 15 12:21:34.501102 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:34.501081    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e0795e72-5074-47f8-bb5a-143d24109705-console-serving-cert\") pod \"console-7cc65599dd-qjmkj\" (UID: \"e0795e72-5074-47f8-bb5a-143d24109705\") " pod="openshift-console/console-7cc65599dd-qjmkj"
Jul 15 12:21:34.508172 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:34.508142    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2r8jv\" (UniqueName: \"kubernetes.io/projected/e0795e72-5074-47f8-bb5a-143d24109705-kube-api-access-2r8jv\") pod \"console-7cc65599dd-qjmkj\" (UID: \"e0795e72-5074-47f8-bb5a-143d24109705\") " pod="openshift-console/console-7cc65599dd-qjmkj"
Jul 15 12:21:34.624297 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:34.624206    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cc65599dd-qjmkj"
Jul 15 12:21:34.766119 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:34.766082    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7cc65599dd-qjmkj"]
Jul 15 12:21:34.770551 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:21:34.770523    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode0795e72_5074_47f8_bb5a_143d24109705.slice/crio-5e0a5ff1a9a6b272e1c4a330069af640df2ee6d2f1ba4fd32b543a4264905eb7 WatchSource:0}: Error finding container 5e0a5ff1a9a6b272e1c4a330069af640df2ee6d2f1ba4fd32b543a4264905eb7: Status 404 returned error can't find the container with id 5e0a5ff1a9a6b272e1c4a330069af640df2ee6d2f1ba4fd32b543a4264905eb7
Jul 15 12:21:34.800904 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:34.800872    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/caf85504-b314-4a69-a6e2-e4fb79f5a561-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wgkkl\" (UID: \"caf85504-b314-4a69-a6e2-e4fb79f5a561\") " pod="openshift-insights/insights-runtime-extractor-wgkkl"
Jul 15 12:21:34.801041 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:34.800924    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/caf85504-b314-4a69-a6e2-e4fb79f5a561-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wgkkl\" (UID: \"caf85504-b314-4a69-a6e2-e4fb79f5a561\") " pod="openshift-insights/insights-runtime-extractor-wgkkl"
Jul 15 12:21:34.801548 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:34.801524    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/caf85504-b314-4a69-a6e2-e4fb79f5a561-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-wgkkl\" (UID: \"caf85504-b314-4a69-a6e2-e4fb79f5a561\") " pod="openshift-insights/insights-runtime-extractor-wgkkl"
Jul 15 12:21:34.803506 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:34.803482    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/caf85504-b314-4a69-a6e2-e4fb79f5a561-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-wgkkl\" (UID: \"caf85504-b314-4a69-a6e2-e4fb79f5a561\") " pod="openshift-insights/insights-runtime-extractor-wgkkl"
Jul 15 12:21:34.914956 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:34.914856    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-5kvn4" event={"ID":"c0c7b146-9d0d-4ff6-8fba-6628314b35dc","Type":"ContainerStarted","Data":"9041b2fefdd23452e1d21d2e39cff8b3aa66518e8265fa4bc076ff048aa1f2f7"}
Jul 15 12:21:34.915275 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:34.915228    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-5kvn4"
Jul 15 12:21:34.916249 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:34.916228    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cc65599dd-qjmkj" event={"ID":"e0795e72-5074-47f8-bb5a-143d24109705","Type":"ContainerStarted","Data":"5e0a5ff1a9a6b272e1c4a330069af640df2ee6d2f1ba4fd32b543a4264905eb7"}
Jul 15 12:21:34.920636 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:34.920611    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-5kvn4"
Jul 15 12:21:34.932691 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:34.932647    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-admission-webhook-77d98bc786-5kvn4" podStartSLOduration=1.940510407 podStartE2EDuration="4.932631806s" totalImagesPullingTime="2.992121399s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:21:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:21:34.932424176 +0000 UTC m=+64.904995333" watchObservedRunningTime="2026-07-15 12:21:34.932631806 +0000 UTC m=+64.905202966"
Jul 15 12:21:34.958794 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:34.958754    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:35.005183 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:35.005156    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-wgkkl"
Jul 15 12:21:35.048605 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:35.048570    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vk2s9_17004ef7-ba8a-417e-b928-f9b789137824/serve-healthcheck-canary/0.log"
Jul 15 12:21:35.052419 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:35.052388    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:35.145292 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:35.145263    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-wgkkl"]
Jul 15 12:21:35.148540 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:21:35.148511    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaf85504_b314_4a69_a6e2_e4fb79f5a561.slice/crio-489f2b9ff4fdb3b9f90006fda51503ef6e53a348d123a7e27dbd6d155ca9a764 WatchSource:0}: Error finding container 489f2b9ff4fdb3b9f90006fda51503ef6e53a348d123a7e27dbd6d155ca9a764: Status 404 returned error can't find the container with id 489f2b9ff4fdb3b9f90006fda51503ef6e53a348d123a7e27dbd6d155ca9a764
Jul 15 12:21:35.307891 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:35.307845    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:35.347021 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:35.346988    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-wwt49"]
Jul 15 12:21:35.349633 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:35.349616    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-wwt49"
Jul 15 12:21:35.357340 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:35.357314    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\""
Jul 15 12:21:35.358053 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:35.358027    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 15 12:21:35.358186 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:35.358153    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 15 12:21:35.358254 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:35.358182    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 15 12:21:35.358402 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:35.358380    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\""
Jul 15 12:21:35.358555 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:35.358540    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-rvkcg\""
Jul 15 12:21:35.363241 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:35.363195    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-wwt49"]
Jul 15 12:21:35.405245 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:35.405163    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/19aaff9c-cf93-40c2-bbcb-d22df6cc0c20-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-wwt49\" (UID: \"19aaff9c-cf93-40c2-bbcb-d22df6cc0c20\") " pod="openshift-monitoring/prometheus-operator-64785b6675-wwt49"
Jul 15 12:21:35.405245 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:35.405206    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/19aaff9c-cf93-40c2-bbcb-d22df6cc0c20-metrics-client-ca\") pod \"prometheus-operator-64785b6675-wwt49\" (UID: \"19aaff9c-cf93-40c2-bbcb-d22df6cc0c20\") " pod="openshift-monitoring/prometheus-operator-64785b6675-wwt49"
Jul 15 12:21:35.405514 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:35.405352    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d579j\" (UniqueName: \"kubernetes.io/projected/19aaff9c-cf93-40c2-bbcb-d22df6cc0c20-kube-api-access-d579j\") pod \"prometheus-operator-64785b6675-wwt49\" (UID: \"19aaff9c-cf93-40c2-bbcb-d22df6cc0c20\") " pod="openshift-monitoring/prometheus-operator-64785b6675-wwt49"
Jul 15 12:21:35.405514 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:35.405404    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/19aaff9c-cf93-40c2-bbcb-d22df6cc0c20-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-wwt49\" (UID: \"19aaff9c-cf93-40c2-bbcb-d22df6cc0c20\") " pod="openshift-monitoring/prometheus-operator-64785b6675-wwt49"
Jul 15 12:21:35.410378 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:35.410334    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:35.506833 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:35.506682    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d579j\" (UniqueName: \"kubernetes.io/projected/19aaff9c-cf93-40c2-bbcb-d22df6cc0c20-kube-api-access-d579j\") pod \"prometheus-operator-64785b6675-wwt49\" (UID: \"19aaff9c-cf93-40c2-bbcb-d22df6cc0c20\") " pod="openshift-monitoring/prometheus-operator-64785b6675-wwt49"
Jul 15 12:21:35.506833 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:35.506729    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/19aaff9c-cf93-40c2-bbcb-d22df6cc0c20-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-wwt49\" (UID: \"19aaff9c-cf93-40c2-bbcb-d22df6cc0c20\") " pod="openshift-monitoring/prometheus-operator-64785b6675-wwt49"
Jul 15 12:21:35.506833 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:35.506799    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/19aaff9c-cf93-40c2-bbcb-d22df6cc0c20-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-wwt49\" (UID: \"19aaff9c-cf93-40c2-bbcb-d22df6cc0c20\") " pod="openshift-monitoring/prometheus-operator-64785b6675-wwt49"
Jul 15 12:21:35.507128 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:35.506826    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/19aaff9c-cf93-40c2-bbcb-d22df6cc0c20-metrics-client-ca\") pod \"prometheus-operator-64785b6675-wwt49\" (UID: \"19aaff9c-cf93-40c2-bbcb-d22df6cc0c20\") " pod="openshift-monitoring/prometheus-operator-64785b6675-wwt49"
Jul 15 12:21:35.508284 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:35.508199    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/19aaff9c-cf93-40c2-bbcb-d22df6cc0c20-metrics-client-ca\") pod \"prometheus-operator-64785b6675-wwt49\" (UID: \"19aaff9c-cf93-40c2-bbcb-d22df6cc0c20\") " pod="openshift-monitoring/prometheus-operator-64785b6675-wwt49"
Jul 15 12:21:35.510431 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:35.510380    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/19aaff9c-cf93-40c2-bbcb-d22df6cc0c20-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-wwt49\" (UID: \"19aaff9c-cf93-40c2-bbcb-d22df6cc0c20\") " pod="openshift-monitoring/prometheus-operator-64785b6675-wwt49"
Jul 15 12:21:35.510723 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:35.510680    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/19aaff9c-cf93-40c2-bbcb-d22df6cc0c20-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-wwt49\" (UID: \"19aaff9c-cf93-40c2-bbcb-d22df6cc0c20\") " pod="openshift-monitoring/prometheus-operator-64785b6675-wwt49"
Jul 15 12:21:35.520674 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:35.520645    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d579j\" (UniqueName: \"kubernetes.io/projected/19aaff9c-cf93-40c2-bbcb-d22df6cc0c20-kube-api-access-d579j\") pod \"prometheus-operator-64785b6675-wwt49\" (UID: \"19aaff9c-cf93-40c2-bbcb-d22df6cc0c20\") " pod="openshift-monitoring/prometheus-operator-64785b6675-wwt49"
Jul 15 12:21:35.564244 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:35.564166    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:35.659171 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:35.659132    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-wwt49"
Jul 15 12:21:35.815388 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:35.815256    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-wwt49"]
Jul 15 12:21:35.818881 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:21:35.818843    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19aaff9c_cf93_40c2_bbcb_d22df6cc0c20.slice/crio-41b274df3f21b21fcc45903788391c5f3394073623126578cdf3d3ed98eeb61a WatchSource:0}: Error finding container 41b274df3f21b21fcc45903788391c5f3394073623126578cdf3d3ed98eeb61a: Status 404 returned error can't find the container with id 41b274df3f21b21fcc45903788391c5f3394073623126578cdf3d3ed98eeb61a
Jul 15 12:21:35.920680 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:35.920594    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wgkkl" event={"ID":"caf85504-b314-4a69-a6e2-e4fb79f5a561","Type":"ContainerStarted","Data":"489f2b9ff4fdb3b9f90006fda51503ef6e53a348d123a7e27dbd6d155ca9a764"}
Jul 15 12:21:35.922262 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:35.922232    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-wwt49" event={"ID":"19aaff9c-cf93-40c2-bbcb-d22df6cc0c20","Type":"ContainerStarted","Data":"41b274df3f21b21fcc45903788391c5f3394073623126578cdf3d3ed98eeb61a"}
Jul 15 12:21:36.314720 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:36.314675    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/df4bf5c7-9413-4a70-8d17-9eaca62b4373-original-pull-secret\") pod \"global-pull-secret-syncer-8ghwr\" (UID: \"df4bf5c7-9413-4a70-8d17-9eaca62b4373\") " pod="kube-system/global-pull-secret-syncer-8ghwr"
Jul 15 12:21:36.314903 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:36.314776    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a7be93c-3ae8-4f57-8bb9-ffb11e116493-metrics-certs\") pod \"network-metrics-daemon-ndhnr\" (UID: \"6a7be93c-3ae8-4f57-8bb9-ffb11e116493\") " pod="openshift-multus/network-metrics-daemon-ndhnr"
Jul 15 12:21:36.319408 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:36.319383    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 15 12:21:36.319543 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:36.319492    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 15 12:21:36.327961 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:36.327872    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/6a7be93c-3ae8-4f57-8bb9-ffb11e116493-metrics-certs\") pod \"network-metrics-daemon-ndhnr\" (UID: \"6a7be93c-3ae8-4f57-8bb9-ffb11e116493\") " pod="openshift-multus/network-metrics-daemon-ndhnr"
Jul 15 12:21:36.328227 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:36.328207    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/df4bf5c7-9413-4a70-8d17-9eaca62b4373-original-pull-secret\") pod \"global-pull-secret-syncer-8ghwr\" (UID: \"df4bf5c7-9413-4a70-8d17-9eaca62b4373\") " pod="kube-system/global-pull-secret-syncer-8ghwr"
Jul 15 12:21:36.393102 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:36.393061    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-8ghwr"
Jul 15 12:21:36.410818 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:36.410792    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-pcnmv\""
Jul 15 12:21:36.415433 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:36.415383    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vk5dd\" (UniqueName: \"kubernetes.io/projected/6aeeccdd-6c28-44fd-99e8-d6426f00525b-kube-api-access-vk5dd\") pod \"network-check-target-7jz7w\" (UID: \"6aeeccdd-6c28-44fd-99e8-d6426f00525b\") " pod="openshift-network-diagnostics/network-check-target-7jz7w"
Jul 15 12:21:36.418377 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:36.418158    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 15 12:21:36.418377 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:36.418229    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ndhnr"
Jul 15 12:21:36.430415 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:36.430387    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 15 12:21:36.443667 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:36.443637    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vk5dd\" (UniqueName: \"kubernetes.io/projected/6aeeccdd-6c28-44fd-99e8-d6426f00525b-kube-api-access-vk5dd\") pod \"network-check-target-7jz7w\" (UID: \"6aeeccdd-6c28-44fd-99e8-d6426f00525b\") " pod="openshift-network-diagnostics/network-check-target-7jz7w"
Jul 15 12:21:36.567037 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:36.566945    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-8ghwr"]
Jul 15 12:21:36.570779 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:21:36.570738    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf4bf5c7_9413_4a70_8d17_9eaca62b4373.slice/crio-7bc77a877b8b4a9bd665c3c00db5cf816faf89774fba46ed557e585d58ed7b2e WatchSource:0}: Error finding container 7bc77a877b8b4a9bd665c3c00db5cf816faf89774fba46ed557e585d58ed7b2e: Status 404 returned error can't find the container with id 7bc77a877b8b4a9bd665c3c00db5cf816faf89774fba46ed557e585d58ed7b2e
Jul 15 12:21:36.593251 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:36.593225    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ndhnr"]
Jul 15 12:21:36.597447 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:21:36.597417    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6a7be93c_3ae8_4f57_8bb9_ffb11e116493.slice/crio-2a763da837a6127839b7ef306ce69a021f9eccbbed7af9b7310e3d9917ae7a57 WatchSource:0}: Error finding container 2a763da837a6127839b7ef306ce69a021f9eccbbed7af9b7310e3d9917ae7a57: Status 404 returned error can't find the container with id 2a763da837a6127839b7ef306ce69a021f9eccbbed7af9b7310e3d9917ae7a57
Jul 15 12:21:36.705278 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:36.705033    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-nnkkc\""
Jul 15 12:21:36.713501 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:36.713205    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7jz7w"
Jul 15 12:21:36.716831 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:36.716467    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:36.723937 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:36.723911    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-65596ddc78-fcm8b"]
Jul 15 12:21:36.733589 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:36.733561    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65596ddc78-fcm8b"
Jul 15 12:21:36.752823 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:36.752797    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65596ddc78-fcm8b"]
Jul 15 12:21:36.760846 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:36.760821    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 15 12:21:36.823748 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:36.823668    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4681cea0-9388-45e1-9d99-d1f9c2933c5b-trusted-ca-bundle\") pod \"console-65596ddc78-fcm8b\" (UID: \"4681cea0-9388-45e1-9d99-d1f9c2933c5b\") " pod="openshift-console/console-65596ddc78-fcm8b"
Jul 15 12:21:36.823748 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:36.823725    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4681cea0-9388-45e1-9d99-d1f9c2933c5b-console-serving-cert\") pod \"console-65596ddc78-fcm8b\" (UID: \"4681cea0-9388-45e1-9d99-d1f9c2933c5b\") " pod="openshift-console/console-65596ddc78-fcm8b"
Jul 15 12:21:36.823942 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:36.823808    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4681cea0-9388-45e1-9d99-d1f9c2933c5b-console-oauth-config\") pod \"console-65596ddc78-fcm8b\" (UID: \"4681cea0-9388-45e1-9d99-d1f9c2933c5b\") " pod="openshift-console/console-65596ddc78-fcm8b"
Jul 15 12:21:36.823942 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:36.823847    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4681cea0-9388-45e1-9d99-d1f9c2933c5b-console-config\") pod \"console-65596ddc78-fcm8b\" (UID: \"4681cea0-9388-45e1-9d99-d1f9c2933c5b\") " pod="openshift-console/console-65596ddc78-fcm8b"
Jul 15 12:21:36.823942 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:36.823874    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m26df\" (UniqueName: \"kubernetes.io/projected/4681cea0-9388-45e1-9d99-d1f9c2933c5b-kube-api-access-m26df\") pod \"console-65596ddc78-fcm8b\" (UID: \"4681cea0-9388-45e1-9d99-d1f9c2933c5b\") " pod="openshift-console/console-65596ddc78-fcm8b"
Jul 15 12:21:36.824085 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:36.823946    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4681cea0-9388-45e1-9d99-d1f9c2933c5b-service-ca\") pod \"console-65596ddc78-fcm8b\" (UID: \"4681cea0-9388-45e1-9d99-d1f9c2933c5b\") " pod="openshift-console/console-65596ddc78-fcm8b"
Jul 15 12:21:36.824085 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:36.823973    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4681cea0-9388-45e1-9d99-d1f9c2933c5b-oauth-serving-cert\") pod \"console-65596ddc78-fcm8b\" (UID: \"4681cea0-9388-45e1-9d99-d1f9c2933c5b\") " pod="openshift-console/console-65596ddc78-fcm8b"
Jul 15 12:21:36.838232 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:36.838199    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:36.911620 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:36.911586    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7jz7w"]
Jul 15 12:21:36.916838 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:21:36.916800    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6aeeccdd_6c28_44fd_99e8_d6426f00525b.slice/crio-da22bbdcea7b9317925eda8338bd23928df0927365cbcbc347914c262c3592bb WatchSource:0}: Error finding container da22bbdcea7b9317925eda8338bd23928df0927365cbcbc347914c262c3592bb: Status 404 returned error can't find the container with id da22bbdcea7b9317925eda8338bd23928df0927365cbcbc347914c262c3592bb
Jul 15 12:21:36.924700 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:36.924671    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4681cea0-9388-45e1-9d99-d1f9c2933c5b-trusted-ca-bundle\") pod \"console-65596ddc78-fcm8b\" (UID: \"4681cea0-9388-45e1-9d99-d1f9c2933c5b\") " pod="openshift-console/console-65596ddc78-fcm8b"
Jul 15 12:21:36.924801 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:36.924720    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4681cea0-9388-45e1-9d99-d1f9c2933c5b-console-serving-cert\") pod \"console-65596ddc78-fcm8b\" (UID: \"4681cea0-9388-45e1-9d99-d1f9c2933c5b\") " pod="openshift-console/console-65596ddc78-fcm8b"
Jul 15 12:21:36.924801 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:36.924747    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4681cea0-9388-45e1-9d99-d1f9c2933c5b-console-oauth-config\") pod \"console-65596ddc78-fcm8b\" (UID: \"4681cea0-9388-45e1-9d99-d1f9c2933c5b\") " pod="openshift-console/console-65596ddc78-fcm8b"
Jul 15 12:21:36.924801 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:36.924770    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4681cea0-9388-45e1-9d99-d1f9c2933c5b-console-config\") pod \"console-65596ddc78-fcm8b\" (UID: \"4681cea0-9388-45e1-9d99-d1f9c2933c5b\") " pod="openshift-console/console-65596ddc78-fcm8b"
Jul 15 12:21:36.924801 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:36.924794    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m26df\" (UniqueName: \"kubernetes.io/projected/4681cea0-9388-45e1-9d99-d1f9c2933c5b-kube-api-access-m26df\") pod \"console-65596ddc78-fcm8b\" (UID: \"4681cea0-9388-45e1-9d99-d1f9c2933c5b\") " pod="openshift-console/console-65596ddc78-fcm8b"
Jul 15 12:21:36.925000 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:36.924850    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4681cea0-9388-45e1-9d99-d1f9c2933c5b-service-ca\") pod \"console-65596ddc78-fcm8b\" (UID: \"4681cea0-9388-45e1-9d99-d1f9c2933c5b\") " pod="openshift-console/console-65596ddc78-fcm8b"
Jul 15 12:21:36.925000 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:36.924873    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4681cea0-9388-45e1-9d99-d1f9c2933c5b-oauth-serving-cert\") pod \"console-65596ddc78-fcm8b\" (UID: \"4681cea0-9388-45e1-9d99-d1f9c2933c5b\") " pod="openshift-console/console-65596ddc78-fcm8b"
Jul 15 12:21:36.927626 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:36.925628    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4681cea0-9388-45e1-9d99-d1f9c2933c5b-oauth-serving-cert\") pod \"console-65596ddc78-fcm8b\" (UID: \"4681cea0-9388-45e1-9d99-d1f9c2933c5b\") " pod="openshift-console/console-65596ddc78-fcm8b"
Jul 15 12:21:36.927626 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:36.926862    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4681cea0-9388-45e1-9d99-d1f9c2933c5b-trusted-ca-bundle\") pod \"console-65596ddc78-fcm8b\" (UID: \"4681cea0-9388-45e1-9d99-d1f9c2933c5b\") " pod="openshift-console/console-65596ddc78-fcm8b"
Jul 15 12:21:36.927626 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:36.927263    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4681cea0-9388-45e1-9d99-d1f9c2933c5b-console-config\") pod \"console-65596ddc78-fcm8b\" (UID: \"4681cea0-9388-45e1-9d99-d1f9c2933c5b\") " pod="openshift-console/console-65596ddc78-fcm8b"
Jul 15 12:21:36.927829 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:36.927715    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4681cea0-9388-45e1-9d99-d1f9c2933c5b-service-ca\") pod \"console-65596ddc78-fcm8b\" (UID: \"4681cea0-9388-45e1-9d99-d1f9c2933c5b\") " pod="openshift-console/console-65596ddc78-fcm8b"
Jul 15 12:21:36.929820 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:36.929732    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7jz7w" event={"ID":"6aeeccdd-6c28-44fd-99e8-d6426f00525b","Type":"ContainerStarted","Data":"da22bbdcea7b9317925eda8338bd23928df0927365cbcbc347914c262c3592bb"}
Jul 15 12:21:36.931611 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:36.931568    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4681cea0-9388-45e1-9d99-d1f9c2933c5b-console-oauth-config\") pod \"console-65596ddc78-fcm8b\" (UID: \"4681cea0-9388-45e1-9d99-d1f9c2933c5b\") " pod="openshift-console/console-65596ddc78-fcm8b"
Jul 15 12:21:36.933282 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:36.933257    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4681cea0-9388-45e1-9d99-d1f9c2933c5b-console-serving-cert\") pod \"console-65596ddc78-fcm8b\" (UID: \"4681cea0-9388-45e1-9d99-d1f9c2933c5b\") " pod="openshift-console/console-65596ddc78-fcm8b"
Jul 15 12:21:36.934621 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:36.934592    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ndhnr" event={"ID":"6a7be93c-3ae8-4f57-8bb9-ffb11e116493","Type":"ContainerStarted","Data":"2a763da837a6127839b7ef306ce69a021f9eccbbed7af9b7310e3d9917ae7a57"}
Jul 15 12:21:36.944282 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:36.944256    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8ghwr" event={"ID":"df4bf5c7-9413-4a70-8d17-9eaca62b4373","Type":"ContainerStarted","Data":"7bc77a877b8b4a9bd665c3c00db5cf816faf89774fba46ed557e585d58ed7b2e"}
Jul 15 12:21:36.977476 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:36.977427    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m26df\" (UniqueName: \"kubernetes.io/projected/4681cea0-9388-45e1-9d99-d1f9c2933c5b-kube-api-access-m26df\") pod \"console-65596ddc78-fcm8b\" (UID: \"4681cea0-9388-45e1-9d99-d1f9c2933c5b\") " pod="openshift-console/console-65596ddc78-fcm8b"
Jul 15 12:21:37.051024 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:37.050994    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65596ddc78-fcm8b"
Jul 15 12:21:37.898808 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:37.897921    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-95f4q"
Jul 15 12:21:41.443602 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:41.443566    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:41.540496 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:41.540402    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:41.985885 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:41.985816    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:42.061724 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:42.061686    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:42.271998 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:42.271910    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:42.337870 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:42.337795    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:42.639525 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:42.639439    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:42.779531 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:42.779491    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:43.112784 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:43.112745    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:43.324116 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:43.324078    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:45.542717 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:45.542677    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:45.643646 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:45.643605    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:46.979273 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:46.979239    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:47.063930 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:47.063900    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:49.317630 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:49.317581    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:49.422280 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:49.422233    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:51.216748 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:51.216712    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:51.301218 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:51.301179    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:51.963621 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:51.963588    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:52.035219 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:52.035093    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:52.865176 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:52.865141    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-65596ddc78-fcm8b"]
Jul 15 12:21:53.843286 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:53.843241    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:54.002545 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:54.002503    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-8ghwr" event={"ID":"df4bf5c7-9413-4a70-8d17-9eaca62b4373","Type":"ContainerStarted","Data":"4be5f8a4d7ac5ddd736656a5215e0d92f7203516936ae142ecbb51b6c9ab4ba7"}
Jul 15 12:21:54.004885 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:54.004849    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-n6j58" event={"ID":"40930240-d18f-4a26-a9fe-37807e26fc01","Type":"ContainerStarted","Data":"fdb3c3691a929018502f4b65c25620346a75eda32882054c2efc9f11e49d087e"}
Jul 15 12:21:54.005054 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:54.004989    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-n6j58"
Jul 15 12:21:54.006804 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:54.006744    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wgkkl" event={"ID":"caf85504-b314-4a69-a6e2-e4fb79f5a561","Type":"ContainerStarted","Data":"3687d248a10e488bbf926669afb3c18fadc3939209b2888c6963d6f446b6a264"}
Jul 15 12:21:54.008517 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:54.008490    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65596ddc78-fcm8b" event={"ID":"4681cea0-9388-45e1-9d99-d1f9c2933c5b","Type":"ContainerStarted","Data":"8789aa6ec4dd7bcc91601831c75450f248774635a4934fc5698064865921e772"}
Jul 15 12:21:54.008618 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:54.008529    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65596ddc78-fcm8b" event={"ID":"4681cea0-9388-45e1-9d99-d1f9c2933c5b","Type":"ContainerStarted","Data":"30867e387ab075050c7512e064f2409adbacd1ae0ed91a3827ff160b20f799fe"}
Jul 15 12:21:54.010282 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:54.010256    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cc65599dd-qjmkj" event={"ID":"e0795e72-5074-47f8-bb5a-143d24109705","Type":"ContainerStarted","Data":"756b3477d10bcce319d7c079c1ff5963657f2373fc11a105d8b50bce85a8a074"}
Jul 15 12:21:54.012356 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:54.012333    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-wwt49" event={"ID":"19aaff9c-cf93-40c2-bbcb-d22df6cc0c20","Type":"ContainerStarted","Data":"b7c45abfd98d0c4b7155e62a5b0d20b69d8b386a0a08251f3f60dc17dd5e702f"}
Jul 15 12:21:54.012490 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:54.012394    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-wwt49" event={"ID":"19aaff9c-cf93-40c2-bbcb-d22df6cc0c20","Type":"ContainerStarted","Data":"9e8d900076f5c762e63e34c56d6df843d85e8dd2143af19842efaaf0868f41a5"}
Jul 15 12:21:54.014011 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:54.013990    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7jz7w" event={"ID":"6aeeccdd-6c28-44fd-99e8-d6426f00525b","Type":"ContainerStarted","Data":"1827770ad95b39a7b94093976a880d5e49aa115b64faa45ccf686b98a3525dbe"}
Jul 15 12:21:54.014127 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:54.014056    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7jz7w"
Jul 15 12:21:54.015930 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:54.015907    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ndhnr" event={"ID":"6a7be93c-3ae8-4f57-8bb9-ffb11e116493","Type":"ContainerStarted","Data":"570c05e309970ff12c677570d7aa926f0ecca7d7cd815e4af4457cb58842b1d2"}
Jul 15 12:21:54.016034 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:54.015954    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ndhnr" event={"ID":"6a7be93c-3ae8-4f57-8bb9-ffb11e116493","Type":"ContainerStarted","Data":"585fa5f1d9d904b0b52a7aa036648d1907cc4c29713086eb3b7ee98b6e7618e0"}
Jul 15 12:21:54.017041 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:54.017024    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-n6j58"
Jul 15 12:21:54.025283 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:54.025231    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-8ghwr" podStartSLOduration=66.257989475 podStartE2EDuration="1m23.025213453s" totalImagesPullingTime="16.767223978s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 12:20:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:21:54.024348091 +0000 UTC m=+83.996919250" watchObservedRunningTime="2026-07-15 12:21:54.025213453 +0000 UTC m=+83.997784593"
Jul 15 12:21:54.069914 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:54.069821    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7cc65599dd-qjmkj" podStartSLOduration=10.426170608 podStartE2EDuration="20.069797173s" totalImagesPullingTime="9.643626565s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:21:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:21:54.049338175 +0000 UTC m=+84.021909335" watchObservedRunningTime="2026-07-15 12:21:54.069797173 +0000 UTC m=+84.042368333"
Jul 15 12:21:54.070593 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:54.070537    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-ndhnr" podStartSLOduration=66.96150858 podStartE2EDuration="1m23.070522027s" totalImagesPullingTime="16.109013447s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:20:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:21:54.068127622 +0000 UTC m=+84.040698835" watchObservedRunningTime="2026-07-15 12:21:54.070522027 +0000 UTC m=+84.043093185"
Jul 15 12:21:54.116591 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:54.115591    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-65596ddc78-fcm8b" podStartSLOduration=18.11556809 podStartE2EDuration="18.11556809s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:21:36 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:21:54.114797882 +0000 UTC m=+84.087369041" watchObservedRunningTime="2026-07-15 12:21:54.11556809 +0000 UTC m=+84.088139231"
Jul 15 12:21:54.116591 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:54.116381    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-n6j58" podStartSLOduration=1.995554981 podStartE2EDuration="24.116356178s" totalImagesPullingTime="22.120801197s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:21:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:21:54.088841673 +0000 UTC m=+84.061412832" watchObservedRunningTime="2026-07-15 12:21:54.116356178 +0000 UTC m=+84.088927338"
Jul 15 12:21:54.138523 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:54.137901    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7jz7w" podStartSLOduration=66.708601132 podStartE2EDuration="1m23.137881162s" totalImagesPullingTime="16.42928003s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:20:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:21:54.137139147 +0000 UTC m=+84.109710334" watchObservedRunningTime="2026-07-15 12:21:54.137881162 +0000 UTC m=+84.110452320"
Jul 15 12:21:54.164927 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:54.164864    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-wwt49" podStartSLOduration=9.294698902 podStartE2EDuration="19.164845576s" totalImagesPullingTime="9.870146674s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:21:35 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:21:54.163877303 +0000 UTC m=+84.136448482" watchObservedRunningTime="2026-07-15 12:21:54.164845576 +0000 UTC m=+84.137416735"
Jul 15 12:21:54.191853 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:54.191268    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:54.317968 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:54.314280    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:54.379087 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:54.378972    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:54.624793 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:54.624700    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7cc65599dd-qjmkj"
Jul 15 12:21:54.624793 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:54.624766    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7cc65599dd-qjmkj"
Jul 15 12:21:54.633097 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:54.632803    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7cc65599dd-qjmkj"
Jul 15 12:21:55.029388 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:55.029004    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7cc65599dd-qjmkj"
Jul 15 12:21:55.459661 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:55.459592    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:55.681963 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:55.681921    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:55.773410 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:55.773274    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-9bjhz"]
Jul 15 12:21:55.807792 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:55.807686    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:55.848338 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:55.848300    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9bjhz"
Jul 15 12:21:55.852427 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:55.852400    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 15 12:21:55.852549 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:55.852535    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 15 12:21:55.852973 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:55.852809    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 15 12:21:55.853087 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:55.853038    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-g745z\""
Jul 15 12:21:55.928647 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:55.928580    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:55.990201 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:55.990159    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7590b1af-34ef-4426-bad8-b6267195e1ff-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9bjhz\" (UID: \"7590b1af-34ef-4426-bad8-b6267195e1ff\") " pod="openshift-monitoring/node-exporter-9bjhz"
Jul 15 12:21:55.990201 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:55.990212    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7590b1af-34ef-4426-bad8-b6267195e1ff-node-exporter-textfile\") pod \"node-exporter-9bjhz\" (UID: \"7590b1af-34ef-4426-bad8-b6267195e1ff\") " pod="openshift-monitoring/node-exporter-9bjhz"
Jul 15 12:21:55.990473 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:55.990247    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxwwr\" (UniqueName: \"kubernetes.io/projected/7590b1af-34ef-4426-bad8-b6267195e1ff-kube-api-access-cxwwr\") pod \"node-exporter-9bjhz\" (UID: \"7590b1af-34ef-4426-bad8-b6267195e1ff\") " pod="openshift-monitoring/node-exporter-9bjhz"
Jul 15 12:21:55.990473 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:55.990285    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7590b1af-34ef-4426-bad8-b6267195e1ff-sys\") pod \"node-exporter-9bjhz\" (UID: \"7590b1af-34ef-4426-bad8-b6267195e1ff\") " pod="openshift-monitoring/node-exporter-9bjhz"
Jul 15 12:21:55.990473 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:55.990310    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7590b1af-34ef-4426-bad8-b6267195e1ff-node-exporter-tls\") pod \"node-exporter-9bjhz\" (UID: \"7590b1af-34ef-4426-bad8-b6267195e1ff\") " pod="openshift-monitoring/node-exporter-9bjhz"
Jul 15 12:21:55.990473 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:55.990345    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7590b1af-34ef-4426-bad8-b6267195e1ff-root\") pod \"node-exporter-9bjhz\" (UID: \"7590b1af-34ef-4426-bad8-b6267195e1ff\") " pod="openshift-monitoring/node-exporter-9bjhz"
Jul 15 12:21:55.990473 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:55.990388    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7590b1af-34ef-4426-bad8-b6267195e1ff-metrics-client-ca\") pod \"node-exporter-9bjhz\" (UID: \"7590b1af-34ef-4426-bad8-b6267195e1ff\") " pod="openshift-monitoring/node-exporter-9bjhz"
Jul 15 12:21:55.990473 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:55.990448    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7590b1af-34ef-4426-bad8-b6267195e1ff-node-exporter-wtmp\") pod \"node-exporter-9bjhz\" (UID: \"7590b1af-34ef-4426-bad8-b6267195e1ff\") " pod="openshift-monitoring/node-exporter-9bjhz"
Jul 15 12:21:55.990808 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:55.990477    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7590b1af-34ef-4426-bad8-b6267195e1ff-node-exporter-accelerators-collector-config\") pod \"node-exporter-9bjhz\" (UID: \"7590b1af-34ef-4426-bad8-b6267195e1ff\") " pod="openshift-monitoring/node-exporter-9bjhz"
Jul 15 12:21:56.091688 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:56.091492    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7590b1af-34ef-4426-bad8-b6267195e1ff-sys\") pod \"node-exporter-9bjhz\" (UID: \"7590b1af-34ef-4426-bad8-b6267195e1ff\") " pod="openshift-monitoring/node-exporter-9bjhz"
Jul 15 12:21:56.091688 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:56.091543    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7590b1af-34ef-4426-bad8-b6267195e1ff-node-exporter-tls\") pod \"node-exporter-9bjhz\" (UID: \"7590b1af-34ef-4426-bad8-b6267195e1ff\") " pod="openshift-monitoring/node-exporter-9bjhz"
Jul 15 12:21:56.091688 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:56.091580    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7590b1af-34ef-4426-bad8-b6267195e1ff-root\") pod \"node-exporter-9bjhz\" (UID: \"7590b1af-34ef-4426-bad8-b6267195e1ff\") " pod="openshift-monitoring/node-exporter-9bjhz"
Jul 15 12:21:56.091688 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:56.091607    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7590b1af-34ef-4426-bad8-b6267195e1ff-metrics-client-ca\") pod \"node-exporter-9bjhz\" (UID: \"7590b1af-34ef-4426-bad8-b6267195e1ff\") " pod="openshift-monitoring/node-exporter-9bjhz"
Jul 15 12:21:56.091688 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:56.091657    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7590b1af-34ef-4426-bad8-b6267195e1ff-node-exporter-wtmp\") pod \"node-exporter-9bjhz\" (UID: \"7590b1af-34ef-4426-bad8-b6267195e1ff\") " pod="openshift-monitoring/node-exporter-9bjhz"
Jul 15 12:21:56.091688 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:56.091685    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7590b1af-34ef-4426-bad8-b6267195e1ff-node-exporter-accelerators-collector-config\") pod \"node-exporter-9bjhz\" (UID: \"7590b1af-34ef-4426-bad8-b6267195e1ff\") " pod="openshift-monitoring/node-exporter-9bjhz"
Jul 15 12:21:56.092419 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:56.091730    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7590b1af-34ef-4426-bad8-b6267195e1ff-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9bjhz\" (UID: \"7590b1af-34ef-4426-bad8-b6267195e1ff\") " pod="openshift-monitoring/node-exporter-9bjhz"
Jul 15 12:21:56.092419 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:56.091754    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7590b1af-34ef-4426-bad8-b6267195e1ff-node-exporter-textfile\") pod \"node-exporter-9bjhz\" (UID: \"7590b1af-34ef-4426-bad8-b6267195e1ff\") " pod="openshift-monitoring/node-exporter-9bjhz"
Jul 15 12:21:56.092419 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:56.091783    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxwwr\" (UniqueName: \"kubernetes.io/projected/7590b1af-34ef-4426-bad8-b6267195e1ff-kube-api-access-cxwwr\") pod \"node-exporter-9bjhz\" (UID: \"7590b1af-34ef-4426-bad8-b6267195e1ff\") " pod="openshift-monitoring/node-exporter-9bjhz"
Jul 15 12:21:56.092419 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:56.092380    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7590b1af-34ef-4426-bad8-b6267195e1ff-node-exporter-wtmp\") pod \"node-exporter-9bjhz\" (UID: \"7590b1af-34ef-4426-bad8-b6267195e1ff\") " pod="openshift-monitoring/node-exporter-9bjhz"
Jul 15 12:21:56.092637 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:56.092440    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7590b1af-34ef-4426-bad8-b6267195e1ff-sys\") pod \"node-exporter-9bjhz\" (UID: \"7590b1af-34ef-4426-bad8-b6267195e1ff\") " pod="openshift-monitoring/node-exporter-9bjhz"
Jul 15 12:21:56.093476 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:56.092610    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7590b1af-34ef-4426-bad8-b6267195e1ff-root\") pod \"node-exporter-9bjhz\" (UID: \"7590b1af-34ef-4426-bad8-b6267195e1ff\") " pod="openshift-monitoring/node-exporter-9bjhz"
Jul 15 12:21:56.094533 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:56.093396    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7590b1af-34ef-4426-bad8-b6267195e1ff-metrics-client-ca\") pod \"node-exporter-9bjhz\" (UID: \"7590b1af-34ef-4426-bad8-b6267195e1ff\") " pod="openshift-monitoring/node-exporter-9bjhz"
Jul 15 12:21:56.095185 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:56.094716    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7590b1af-34ef-4426-bad8-b6267195e1ff-node-exporter-textfile\") pod \"node-exporter-9bjhz\" (UID: \"7590b1af-34ef-4426-bad8-b6267195e1ff\") " pod="openshift-monitoring/node-exporter-9bjhz"
Jul 15 12:21:56.095951 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:56.095925    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:56.095951 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:56.095942    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7590b1af-34ef-4426-bad8-b6267195e1ff-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-9bjhz\" (UID: \"7590b1af-34ef-4426-bad8-b6267195e1ff\") " pod="openshift-monitoring/node-exporter-9bjhz"
Jul 15 12:21:56.096399 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:56.096282    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7590b1af-34ef-4426-bad8-b6267195e1ff-node-exporter-accelerators-collector-config\") pod \"node-exporter-9bjhz\" (UID: \"7590b1af-34ef-4426-bad8-b6267195e1ff\") " pod="openshift-monitoring/node-exporter-9bjhz"
Jul 15 12:21:56.097032 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:56.097007    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7590b1af-34ef-4426-bad8-b6267195e1ff-node-exporter-tls\") pod \"node-exporter-9bjhz\" (UID: \"7590b1af-34ef-4426-bad8-b6267195e1ff\") " pod="openshift-monitoring/node-exporter-9bjhz"
Jul 15 12:21:56.120961 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:56.120825    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxwwr\" (UniqueName: \"kubernetes.io/projected/7590b1af-34ef-4426-bad8-b6267195e1ff-kube-api-access-cxwwr\") pod \"node-exporter-9bjhz\" (UID: \"7590b1af-34ef-4426-bad8-b6267195e1ff\") " pod="openshift-monitoring/node-exporter-9bjhz"
Jul 15 12:21:56.161667 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:56.161632    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-9bjhz"
Jul 15 12:21:56.273088 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:56.273018    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:56.366595 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:56.366498    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:56.667621 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:56.667504    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:56.772845 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:56.772811    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:56.785111 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:56.783953    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 12:21:56.873819 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:56.873777    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:56.923872 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:56.923789    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 12:21:56.924039 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:56.923973    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:21:56.927310 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:56.927239    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\""
Jul 15 12:21:56.927873 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:56.927624    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-h44t4\""
Jul 15 12:21:56.927873 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:56.927630    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\""
Jul 15 12:21:56.927873 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:56.927736    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\""
Jul 15 12:21:56.928071 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:56.928002    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\""
Jul 15 12:21:56.928071 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:56.928041    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\""
Jul 15 12:21:56.928178 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:56.928119    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\""
Jul 15 12:21:56.928232 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:56.928197    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\""
Jul 15 12:21:56.928442 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:56.928422    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\""
Jul 15 12:21:56.928546 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:56.928460    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\""
Jul 15 12:21:57.051908 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:57.051873    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-65596ddc78-fcm8b"
Jul 15 12:21:57.052089 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:57.052035    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-65596ddc78-fcm8b"
Jul 15 12:21:57.057226 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:57.057198    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-65596ddc78-fcm8b"
Jul 15 12:21:57.101190 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:57.101153    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-config-out\") pod \"alertmanager-main-0\" (UID: \"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:21:57.101190 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:57.101193    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-web-config\") pod \"alertmanager-main-0\" (UID: \"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:21:57.101671 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:57.101224    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:21:57.101671 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:57.101270    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:21:57.101671 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:57.101295    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-config-volume\") pod \"alertmanager-main-0\" (UID: \"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:21:57.101671 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:57.101354    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:21:57.101671 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:57.101405    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:21:57.101671 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:57.101437    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:21:57.101671 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:57.101461    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xlbbr\" (UniqueName: \"kubernetes.io/projected/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-kube-api-access-xlbbr\") pod \"alertmanager-main-0\" (UID: \"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:21:57.101671 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:57.101489    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:21:57.101671 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:57.101513    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:21:57.101671 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:57.101541    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:21:57.101671 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:57.101625    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:21:57.202827 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:57.202734    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-config-volume\") pod \"alertmanager-main-0\" (UID: \"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:21:57.202827 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:57.202787    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:21:57.202827 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:57.202821    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:21:57.203047 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:57.202856    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:21:57.203047 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:57.202881    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xlbbr\" (UniqueName: \"kubernetes.io/projected/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-kube-api-access-xlbbr\") pod \"alertmanager-main-0\" (UID: \"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:21:57.203047 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:57.202907    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:21:57.203047 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:57.202933    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:21:57.203047 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:57.202966    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:21:57.203250 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:57.203074    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:21:57.203250 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:57.203109    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-config-out\") pod \"alertmanager-main-0\" (UID: \"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:21:57.203250 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:57.203136    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-web-config\") pod \"alertmanager-main-0\" (UID: \"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:21:57.203422 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:57.203314    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:21:57.203422 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:57.203399    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:21:57.205595 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:57.203927    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:21:57.205595 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:57.204403    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:21:57.205595 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:57.204987    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:21:57.205828 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:57.205712    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-config-out\") pod \"alertmanager-main-0\" (UID: \"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:21:57.206323 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:57.206144    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-tls-assets\") pod \"alertmanager-main-0\" (UID: \"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:21:57.206323 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:57.206289    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-config-volume\") pod \"alertmanager-main-0\" (UID: \"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:21:57.207330 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:57.206946    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:21:57.207330 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:57.206963    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:21:57.207330 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:57.207320    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:21:57.207557 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:57.207334    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:21:57.208567 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:57.208546    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:21:57.208666 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:57.208582    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-web-config\") pod \"alertmanager-main-0\" (UID: \"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:21:57.212011 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:57.211988    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xlbbr\" (UniqueName: \"kubernetes.io/projected/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-kube-api-access-xlbbr\") pod \"alertmanager-main-0\" (UID: \"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6\") " pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:21:57.237065 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:57.237017    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:21:58.039402 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:58.039171    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-65596ddc78-fcm8b"
Jul 15 12:21:58.107855 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:58.107821    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7cc65599dd-qjmkj"]
Jul 15 12:21:58.149379 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:21:58.149329    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7590b1af_34ef_4426_bad8_b6267195e1ff.slice/crio-0b9410322604ff395cee4a40b5434c3b7e2662b8ae0a37d4ffed2a1cd643731a WatchSource:0}: Error finding container 0b9410322604ff395cee4a40b5434c3b7e2662b8ae0a37d4ffed2a1cd643731a: Status 404 returned error can't find the container with id 0b9410322604ff395cee4a40b5434c3b7e2662b8ae0a37d4ffed2a1cd643731a
Jul 15 12:21:58.304352 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:58.303929    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 12:21:58.481963 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:21:58.481923    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24bd57be_9d1f_4e5e_9f42_7ee9ba9158c6.slice/crio-229d8d6233642ac4e19c29916b3344cabff32405a08e064a3ea9b0c7bfb24567 WatchSource:0}: Error finding container 229d8d6233642ac4e19c29916b3344cabff32405a08e064a3ea9b0c7bfb24567: Status 404 returned error can't find the container with id 229d8d6233642ac4e19c29916b3344cabff32405a08e064a3ea9b0c7bfb24567
Jul 15 12:21:58.786506 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:58.786344    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:58.880508 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:58.880386    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:58.963926 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:58.963826    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:59.043653 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:59.043609    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wgkkl" event={"ID":"caf85504-b314-4a69-a6e2-e4fb79f5a561","Type":"ContainerStarted","Data":"adad1e243e373fa4be7989d2d19ea8cdd0f62f08231ce097e4df392965f96cdd"}
Jul 15 12:21:59.045820 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:59.045756    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9bjhz" event={"ID":"7590b1af-34ef-4426-bad8-b6267195e1ff","Type":"ContainerStarted","Data":"0b9410322604ff395cee4a40b5434c3b7e2662b8ae0a37d4ffed2a1cd643731a"}
Jul 15 12:21:59.048835 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:59.048805    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6","Type":"ContainerStarted","Data":"229d8d6233642ac4e19c29916b3344cabff32405a08e064a3ea9b0c7bfb24567"}
Jul 15 12:21:59.168644 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:59.168557    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:59.307132 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:59.307094    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:21:59.403698 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:21:59.403667    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:22:00.367587 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:00.367080    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:22:00.444173 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:00.444142    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:22:00.510330 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:00.510290    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-lz79j"]
Jul 15 12:22:00.522943 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:00.522918    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-lz79j"
Jul 15 12:22:00.525844 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:00.525633    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\""
Jul 15 12:22:00.526341 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:00.526121    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-xf69n\""
Jul 15 12:22:00.527954 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:00.527322    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-lz79j"]
Jul 15 12:22:00.535334 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:00.534703    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:22:00.619952 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:00.619824    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:22:00.637633 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:00.637597    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2dce94f6-6164-470e-b10e-11c38e8d9079-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-lz79j\" (UID: \"2dce94f6-6164-470e-b10e-11c38e8d9079\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-lz79j"
Jul 15 12:22:00.638038 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:00.637665    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6pbq\" (UniqueName: \"kubernetes.io/projected/2dce94f6-6164-470e-b10e-11c38e8d9079-kube-api-access-w6pbq\") pod \"monitoring-plugin-5f68df7f58-lz79j\" (UID: \"2dce94f6-6164-470e-b10e-11c38e8d9079\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-lz79j"
Jul 15 12:22:00.714534 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:00.714496    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:22:00.741681 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:00.741641    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2dce94f6-6164-470e-b10e-11c38e8d9079-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-lz79j\" (UID: \"2dce94f6-6164-470e-b10e-11c38e8d9079\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-lz79j"
Jul 15 12:22:00.741858 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:00.741713    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6pbq\" (UniqueName: \"kubernetes.io/projected/2dce94f6-6164-470e-b10e-11c38e8d9079-kube-api-access-w6pbq\") pod \"monitoring-plugin-5f68df7f58-lz79j\" (UID: \"2dce94f6-6164-470e-b10e-11c38e8d9079\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-lz79j"
Jul 15 12:22:00.746185 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:00.746157    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2dce94f6-6164-470e-b10e-11c38e8d9079-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-lz79j\" (UID: \"2dce94f6-6164-470e-b10e-11c38e8d9079\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-lz79j"
Jul 15 12:22:00.753356 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:00.753325    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6pbq\" (UniqueName: \"kubernetes.io/projected/2dce94f6-6164-470e-b10e-11c38e8d9079-kube-api-access-w6pbq\") pod \"monitoring-plugin-5f68df7f58-lz79j\" (UID: \"2dce94f6-6164-470e-b10e-11c38e8d9079\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-lz79j"
Jul 15 12:22:00.841890 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:00.841847    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-lz79j"
Jul 15 12:22:01.060936 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:01.060898    2559 generic.go:356] "Generic (PLEG): container finished" podID="7590b1af-34ef-4426-bad8-b6267195e1ff" containerID="d72961b0a00c8fefc6b84d93f999f53f970ce9c95f454cc880fd7a5ca26f72e6" exitCode=0
Jul 15 12:22:01.061121 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:01.061004    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9bjhz" event={"ID":"7590b1af-34ef-4426-bad8-b6267195e1ff","Type":"ContainerDied","Data":"d72961b0a00c8fefc6b84d93f999f53f970ce9c95f454cc880fd7a5ca26f72e6"}
Jul 15 12:22:01.065188 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:01.065130    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-lz79j"]
Jul 15 12:22:01.065322 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:01.065218    2559 generic.go:356] "Generic (PLEG): container finished" podID="24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6" containerID="a54cf876c98f4c8e3a434bf40577f6b9e8a9aa4aae086d8f3456402ec413f3dc" exitCode=0
Jul 15 12:22:01.065322 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:01.065254    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6","Type":"ContainerDied","Data":"a54cf876c98f4c8e3a434bf40577f6b9e8a9aa4aae086d8f3456402ec413f3dc"}
Jul 15 12:22:01.070494 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:22:01.070176    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2dce94f6_6164_470e_b10e_11c38e8d9079.slice/crio-920759e614d5dd0e3b895dd8dc7a1e6875897475230ccb0200fb3c358443be08 WatchSource:0}: Error finding container 920759e614d5dd0e3b895dd8dc7a1e6875897475230ccb0200fb3c358443be08: Status 404 returned error can't find the container with id 920759e614d5dd0e3b895dd8dc7a1e6875897475230ccb0200fb3c358443be08
Jul 15 12:22:02.033421 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.033388    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:22:02.076180 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.075922    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9bjhz" event={"ID":"7590b1af-34ef-4426-bad8-b6267195e1ff","Type":"ContainerStarted","Data":"d050a339e6166116d39f0f2b18e349359a9501968734d9c4e2cd11e07fa3ed20"}
Jul 15 12:22:02.076180 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.076023    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-9bjhz" event={"ID":"7590b1af-34ef-4426-bad8-b6267195e1ff","Type":"ContainerStarted","Data":"f8c9c7401770059f8d788624c02e401a75b77a366086230d925b93a38f6a3a46"}
Jul 15 12:22:02.078837 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.078691    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-lz79j" event={"ID":"2dce94f6-6164-470e-b10e-11c38e8d9079","Type":"ContainerStarted","Data":"920759e614d5dd0e3b895dd8dc7a1e6875897475230ccb0200fb3c358443be08"}
Jul 15 12:22:02.111953 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.111862    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-9bjhz" podStartSLOduration=5.053368265 podStartE2EDuration="7.111839412s" totalImagesPullingTime="1.950600145s" totalInitContainerRuntime="107.871002ms" isStatefulPod=true podCreationTimestamp="2026-07-15 12:21:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:22:02.110824228 +0000 UTC m=+92.083395411" watchObservedRunningTime="2026-07-15 12:22:02.111839412 +0000 UTC m=+92.084410571"
Jul 15 12:22:02.124151 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.124104    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:22:02.305357 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.305277    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:22:02.307476 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.305590    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 12:22:02.336444 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.335587    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:22:02.344510 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.344479    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 12:22:02.354984 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.354450    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 15 12:22:02.354984 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.354589    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 15 12:22:02.354984 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.354705    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 15 12:22:02.354984 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.354821    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 15 12:22:02.354984 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.354878    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 15 12:22:02.355464 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.355102    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 15 12:22:02.355808 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.355672    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 15 12:22:02.362084 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.360897    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 15 12:22:02.362084 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.361821    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 15 12:22:02.364400 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.362630    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-fw4n5\""
Jul 15 12:22:02.364400 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.362853    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 15 12:22:02.364400 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.363080    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 15 12:22:02.364400 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.363149    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 15 12:22:02.364400 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.363283    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 15 12:22:02.364400 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.363797    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5aad2a0f-8632-418d-9eee-1fed88395597-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:22:02.364400 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.363837    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5aad2a0f-8632-418d-9eee-1fed88395597-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:22:02.364400 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.363881    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5aad2a0f-8632-418d-9eee-1fed88395597-config-out\") pod \"prometheus-k8s-0\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:22:02.364400 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.363908    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5aad2a0f-8632-418d-9eee-1fed88395597-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:22:02.364400 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.363943    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5aad2a0f-8632-418d-9eee-1fed88395597-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:22:02.364400 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.363991    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5aad2a0f-8632-418d-9eee-1fed88395597-web-config\") pod \"prometheus-k8s-0\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:22:02.364400 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.364019    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5aad2a0f-8632-418d-9eee-1fed88395597-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:22:02.364400 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.364052    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5aad2a0f-8632-418d-9eee-1fed88395597-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:22:02.364400 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.364076    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5aad2a0f-8632-418d-9eee-1fed88395597-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:22:02.364400 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.364110    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5aad2a0f-8632-418d-9eee-1fed88395597-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:22:02.364400 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.364132    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5aad2a0f-8632-418d-9eee-1fed88395597-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:22:02.364400 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.364156    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5aad2a0f-8632-418d-9eee-1fed88395597-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:22:02.364400 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.364180    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5aad2a0f-8632-418d-9eee-1fed88395597-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:22:02.364400 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.364206    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-66l5x\" (UniqueName: \"kubernetes.io/projected/5aad2a0f-8632-418d-9eee-1fed88395597-kube-api-access-66l5x\") pod \"prometheus-k8s-0\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:22:02.365531 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.364236    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5aad2a0f-8632-418d-9eee-1fed88395597-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:22:02.365531 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.364287    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5aad2a0f-8632-418d-9eee-1fed88395597-config\") pod \"prometheus-k8s-0\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:22:02.365531 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.364314    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5aad2a0f-8632-418d-9eee-1fed88395597-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:22:02.365531 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.364343    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5aad2a0f-8632-418d-9eee-1fed88395597-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:22:02.365531 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.364774    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-a0vlcb2cqmsk8\""
Jul 15 12:22:02.365531 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.365297    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 15 12:22:02.366405 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.366348    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5aad2a0f-8632-418d-9eee-1fed88395597-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:22:02.366511 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.366425    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5aad2a0f-8632-418d-9eee-1fed88395597-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:22:02.366831 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.366811    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 15 12:22:02.425346 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.425305    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:22:02.469789 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.468243    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5aad2a0f-8632-418d-9eee-1fed88395597-config-out\") pod \"prometheus-k8s-0\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:22:02.469789 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.468305    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5aad2a0f-8632-418d-9eee-1fed88395597-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:22:02.469789 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.468344    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5aad2a0f-8632-418d-9eee-1fed88395597-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:22:02.469789 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.468383    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5aad2a0f-8632-418d-9eee-1fed88395597-web-config\") pod \"prometheus-k8s-0\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:22:02.469789 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.468884    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5aad2a0f-8632-418d-9eee-1fed88395597-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:22:02.469789 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.468918    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5aad2a0f-8632-418d-9eee-1fed88395597-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:22:02.469789 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.468954    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5aad2a0f-8632-418d-9eee-1fed88395597-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:22:02.469789 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.468993    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5aad2a0f-8632-418d-9eee-1fed88395597-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:22:02.469789 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.469018    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5aad2a0f-8632-418d-9eee-1fed88395597-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:22:02.469789 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.469044    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5aad2a0f-8632-418d-9eee-1fed88395597-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:22:02.469789 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.469068    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5aad2a0f-8632-418d-9eee-1fed88395597-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:22:02.469789 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.469095    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-66l5x\" (UniqueName: \"kubernetes.io/projected/5aad2a0f-8632-418d-9eee-1fed88395597-kube-api-access-66l5x\") pod \"prometheus-k8s-0\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:22:02.469789 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.469128    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5aad2a0f-8632-418d-9eee-1fed88395597-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:22:02.469789 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.469158    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5aad2a0f-8632-418d-9eee-1fed88395597-config\") pod \"prometheus-k8s-0\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:22:02.469789 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.469186    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5aad2a0f-8632-418d-9eee-1fed88395597-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:22:02.469789 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.469216    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5aad2a0f-8632-418d-9eee-1fed88395597-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:22:02.469789 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.469240    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5aad2a0f-8632-418d-9eee-1fed88395597-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:22:02.470998 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.469267    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5aad2a0f-8632-418d-9eee-1fed88395597-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:22:02.470998 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.469318    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5aad2a0f-8632-418d-9eee-1fed88395597-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:22:02.470998 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.469355    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5aad2a0f-8632-418d-9eee-1fed88395597-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:22:02.474496 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.473348    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5aad2a0f-8632-418d-9eee-1fed88395597-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:22:02.474496 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.473453    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5aad2a0f-8632-418d-9eee-1fed88395597-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:22:02.474496 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.474444    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5aad2a0f-8632-418d-9eee-1fed88395597-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:22:02.476356 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.475767    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5aad2a0f-8632-418d-9eee-1fed88395597-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:22:02.476356 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.476032    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5aad2a0f-8632-418d-9eee-1fed88395597-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:22:02.476969 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.476465    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5aad2a0f-8632-418d-9eee-1fed88395597-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:22:02.477042 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.476971    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5aad2a0f-8632-418d-9eee-1fed88395597-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:22:02.479706 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.479669    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5aad2a0f-8632-418d-9eee-1fed88395597-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:22:02.483833 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.483788    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5aad2a0f-8632-418d-9eee-1fed88395597-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:22:02.484638 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.484613    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/5aad2a0f-8632-418d-9eee-1fed88395597-config\") pod \"prometheus-k8s-0\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:22:02.484785 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.484760    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5aad2a0f-8632-418d-9eee-1fed88395597-web-config\") pod \"prometheus-k8s-0\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:22:02.485223 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.485200    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5aad2a0f-8632-418d-9eee-1fed88395597-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:22:02.487663 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.487611    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5aad2a0f-8632-418d-9eee-1fed88395597-config-out\") pod \"prometheus-k8s-0\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:22:02.488137 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.488111    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5aad2a0f-8632-418d-9eee-1fed88395597-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:22:02.488233 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.488148    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5aad2a0f-8632-418d-9eee-1fed88395597-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:22:02.488649 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.488604    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5aad2a0f-8632-418d-9eee-1fed88395597-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:22:02.489336 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.489232    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5aad2a0f-8632-418d-9eee-1fed88395597-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:22:02.490332 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.490281    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5aad2a0f-8632-418d-9eee-1fed88395597-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:22:02.490752 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.490723    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5aad2a0f-8632-418d-9eee-1fed88395597-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:22:02.504793 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.504737    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-66l5x\" (UniqueName: \"kubernetes.io/projected/5aad2a0f-8632-418d-9eee-1fed88395597-kube-api-access-66l5x\") pod \"prometheus-k8s-0\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:22:02.656008 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:02.655922    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:22:04.141157 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:04.141120    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 12:22:04.144493 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:22:04.144466    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5aad2a0f_8632_418d_9eee_1fed88395597.slice/crio-26c796e88ff3a29dddc82b220e13d40c4dbfb2d5fdc480826867d08e26ad515b WatchSource:0}: Error finding container 26c796e88ff3a29dddc82b220e13d40c4dbfb2d5fdc480826867d08e26ad515b: Status 404 returned error can't find the container with id 26c796e88ff3a29dddc82b220e13d40c4dbfb2d5fdc480826867d08e26ad515b
Jul 15 12:22:05.093032 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:05.093000    2559 generic.go:356] "Generic (PLEG): container finished" podID="5aad2a0f-8632-418d-9eee-1fed88395597" containerID="70a0893360ad684e3394cc6f3e482e02737e580d23fabad552a8c77eb6b74543" exitCode=0
Jul 15 12:22:05.093211 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:05.093063    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5aad2a0f-8632-418d-9eee-1fed88395597","Type":"ContainerDied","Data":"70a0893360ad684e3394cc6f3e482e02737e580d23fabad552a8c77eb6b74543"}
Jul 15 12:22:05.093211 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:05.093153    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5aad2a0f-8632-418d-9eee-1fed88395597","Type":"ContainerStarted","Data":"26c796e88ff3a29dddc82b220e13d40c4dbfb2d5fdc480826867d08e26ad515b"}
Jul 15 12:22:06.101117 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:06.101084    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6","Type":"ContainerStarted","Data":"c30312f4dc267d67fe8e205c65088b1e32fdfc86150497b6ef66b364db7330fa"}
Jul 15 12:22:06.101513 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:06.101206    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6","Type":"ContainerStarted","Data":"7a5d3b2ce48ae84331a4dd9bfbc9e972e3b64c707a0fe23c12b74588aa92e503"}
Jul 15 12:22:06.101513 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:06.101262    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6","Type":"ContainerStarted","Data":"b1f490634410e937351b7cfd4cf6eec9ada3e3dd10d0cef45fdbe9019ba43894"}
Jul 15 12:22:06.102826 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:06.102794    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-lz79j" event={"ID":"2dce94f6-6164-470e-b10e-11c38e8d9079","Type":"ContainerStarted","Data":"4ba3cc1fe867da45b119b02f36c0c9dc301fe87a80a5b72e10a218a0382bc2cc"}
Jul 15 12:22:06.103062 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:06.103042    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-lz79j"
Jul 15 12:22:06.106946 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:06.106395    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-wgkkl" event={"ID":"caf85504-b314-4a69-a6e2-e4fb79f5a561","Type":"ContainerStarted","Data":"1ade2a19117abfb279c5aace8d9a9e33090f26021b2c531681f2e2d5e45bccc3"}
Jul 15 12:22:06.109068 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:06.109015    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-lz79j"
Jul 15 12:22:06.131812 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:06.131768    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-lz79j" podStartSLOduration=1.593773853 podStartE2EDuration="6.131753298s" totalImagesPullingTime="4.537979445s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:22:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:22:06.130510121 +0000 UTC m=+96.103081279" watchObservedRunningTime="2026-07-15 12:22:06.131753298 +0000 UTC m=+96.104324455"
Jul 15 12:22:06.195991 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:06.195769    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-wgkkl" podStartSLOduration=6.257901875 podStartE2EDuration="35.195747222s" totalImagesPullingTime="28.937845347s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 12:21:31 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:22:06.165895368 +0000 UTC m=+96.138466525" watchObservedRunningTime="2026-07-15 12:22:06.195747222 +0000 UTC m=+96.168318382"
Jul 15 12:22:06.909980 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:06.909945    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-588bdf99f5-jcrtb"]
Jul 15 12:22:06.923973 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:06.923918    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-588bdf99f5-jcrtb"
Jul 15 12:22:06.925950 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:06.925920    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-588bdf99f5-jcrtb"]
Jul 15 12:22:07.014249 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:07.014214    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1b9b11f5-9cc5-4a03-ba2b-c88812c251a5-console-serving-cert\") pod \"console-588bdf99f5-jcrtb\" (UID: \"1b9b11f5-9cc5-4a03-ba2b-c88812c251a5\") " pod="openshift-console/console-588bdf99f5-jcrtb"
Jul 15 12:22:07.014494 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:07.014268    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1b9b11f5-9cc5-4a03-ba2b-c88812c251a5-service-ca\") pod \"console-588bdf99f5-jcrtb\" (UID: \"1b9b11f5-9cc5-4a03-ba2b-c88812c251a5\") " pod="openshift-console/console-588bdf99f5-jcrtb"
Jul 15 12:22:07.014494 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:07.014295    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dphf9\" (UniqueName: \"kubernetes.io/projected/1b9b11f5-9cc5-4a03-ba2b-c88812c251a5-kube-api-access-dphf9\") pod \"console-588bdf99f5-jcrtb\" (UID: \"1b9b11f5-9cc5-4a03-ba2b-c88812c251a5\") " pod="openshift-console/console-588bdf99f5-jcrtb"
Jul 15 12:22:07.014494 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:07.014319    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1b9b11f5-9cc5-4a03-ba2b-c88812c251a5-console-oauth-config\") pod \"console-588bdf99f5-jcrtb\" (UID: \"1b9b11f5-9cc5-4a03-ba2b-c88812c251a5\") " pod="openshift-console/console-588bdf99f5-jcrtb"
Jul 15 12:22:07.014494 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:07.014435    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1b9b11f5-9cc5-4a03-ba2b-c88812c251a5-oauth-serving-cert\") pod \"console-588bdf99f5-jcrtb\" (UID: \"1b9b11f5-9cc5-4a03-ba2b-c88812c251a5\") " pod="openshift-console/console-588bdf99f5-jcrtb"
Jul 15 12:22:07.014699 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:07.014540    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1b9b11f5-9cc5-4a03-ba2b-c88812c251a5-console-config\") pod \"console-588bdf99f5-jcrtb\" (UID: \"1b9b11f5-9cc5-4a03-ba2b-c88812c251a5\") " pod="openshift-console/console-588bdf99f5-jcrtb"
Jul 15 12:22:07.014699 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:07.014589    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b9b11f5-9cc5-4a03-ba2b-c88812c251a5-trusted-ca-bundle\") pod \"console-588bdf99f5-jcrtb\" (UID: \"1b9b11f5-9cc5-4a03-ba2b-c88812c251a5\") " pod="openshift-console/console-588bdf99f5-jcrtb"
Jul 15 12:22:07.115068 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:07.115036    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1b9b11f5-9cc5-4a03-ba2b-c88812c251a5-console-config\") pod \"console-588bdf99f5-jcrtb\" (UID: \"1b9b11f5-9cc5-4a03-ba2b-c88812c251a5\") " pod="openshift-console/console-588bdf99f5-jcrtb"
Jul 15 12:22:07.115560 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:07.115095    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b9b11f5-9cc5-4a03-ba2b-c88812c251a5-trusted-ca-bundle\") pod \"console-588bdf99f5-jcrtb\" (UID: \"1b9b11f5-9cc5-4a03-ba2b-c88812c251a5\") " pod="openshift-console/console-588bdf99f5-jcrtb"
Jul 15 12:22:07.115560 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:07.115137    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1b9b11f5-9cc5-4a03-ba2b-c88812c251a5-console-serving-cert\") pod \"console-588bdf99f5-jcrtb\" (UID: \"1b9b11f5-9cc5-4a03-ba2b-c88812c251a5\") " pod="openshift-console/console-588bdf99f5-jcrtb"
Jul 15 12:22:07.115560 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:07.115164    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1b9b11f5-9cc5-4a03-ba2b-c88812c251a5-service-ca\") pod \"console-588bdf99f5-jcrtb\" (UID: \"1b9b11f5-9cc5-4a03-ba2b-c88812c251a5\") " pod="openshift-console/console-588bdf99f5-jcrtb"
Jul 15 12:22:07.115560 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:07.115190    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dphf9\" (UniqueName: \"kubernetes.io/projected/1b9b11f5-9cc5-4a03-ba2b-c88812c251a5-kube-api-access-dphf9\") pod \"console-588bdf99f5-jcrtb\" (UID: \"1b9b11f5-9cc5-4a03-ba2b-c88812c251a5\") " pod="openshift-console/console-588bdf99f5-jcrtb"
Jul 15 12:22:07.115560 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:07.115219    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1b9b11f5-9cc5-4a03-ba2b-c88812c251a5-console-oauth-config\") pod \"console-588bdf99f5-jcrtb\" (UID: \"1b9b11f5-9cc5-4a03-ba2b-c88812c251a5\") " pod="openshift-console/console-588bdf99f5-jcrtb"
Jul 15 12:22:07.115560 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:07.115277    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1b9b11f5-9cc5-4a03-ba2b-c88812c251a5-oauth-serving-cert\") pod \"console-588bdf99f5-jcrtb\" (UID: \"1b9b11f5-9cc5-4a03-ba2b-c88812c251a5\") " pod="openshift-console/console-588bdf99f5-jcrtb"
Jul 15 12:22:07.116043 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:07.116018    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1b9b11f5-9cc5-4a03-ba2b-c88812c251a5-oauth-serving-cert\") pod \"console-588bdf99f5-jcrtb\" (UID: \"1b9b11f5-9cc5-4a03-ba2b-c88812c251a5\") " pod="openshift-console/console-588bdf99f5-jcrtb"
Jul 15 12:22:07.116305 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:07.116020    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b9b11f5-9cc5-4a03-ba2b-c88812c251a5-trusted-ca-bundle\") pod \"console-588bdf99f5-jcrtb\" (UID: \"1b9b11f5-9cc5-4a03-ba2b-c88812c251a5\") " pod="openshift-console/console-588bdf99f5-jcrtb"
Jul 15 12:22:07.116414 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:07.116020    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1b9b11f5-9cc5-4a03-ba2b-c88812c251a5-console-config\") pod \"console-588bdf99f5-jcrtb\" (UID: \"1b9b11f5-9cc5-4a03-ba2b-c88812c251a5\") " pod="openshift-console/console-588bdf99f5-jcrtb"
Jul 15 12:22:07.116930 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:07.116904    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1b9b11f5-9cc5-4a03-ba2b-c88812c251a5-service-ca\") pod \"console-588bdf99f5-jcrtb\" (UID: \"1b9b11f5-9cc5-4a03-ba2b-c88812c251a5\") " pod="openshift-console/console-588bdf99f5-jcrtb"
Jul 15 12:22:07.119648 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:07.118962    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1b9b11f5-9cc5-4a03-ba2b-c88812c251a5-console-oauth-config\") pod \"console-588bdf99f5-jcrtb\" (UID: \"1b9b11f5-9cc5-4a03-ba2b-c88812c251a5\") " pod="openshift-console/console-588bdf99f5-jcrtb"
Jul 15 12:22:07.119922 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:07.119787    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6","Type":"ContainerStarted","Data":"d7c90462d3a1c9c57941b3af3a8a1500d88d644556ba8565671c59909a109055"}
Jul 15 12:22:07.119922 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:07.119856    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6","Type":"ContainerStarted","Data":"fa12a6b8ff156b7bd6e490d61e0471a90d91199d6183e2e3681c70402c52caa5"}
Jul 15 12:22:07.120345 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:07.120323    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1b9b11f5-9cc5-4a03-ba2b-c88812c251a5-console-serving-cert\") pod \"console-588bdf99f5-jcrtb\" (UID: \"1b9b11f5-9cc5-4a03-ba2b-c88812c251a5\") " pod="openshift-console/console-588bdf99f5-jcrtb"
Jul 15 12:22:07.128036 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:07.127999    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dphf9\" (UniqueName: \"kubernetes.io/projected/1b9b11f5-9cc5-4a03-ba2b-c88812c251a5-kube-api-access-dphf9\") pod \"console-588bdf99f5-jcrtb\" (UID: \"1b9b11f5-9cc5-4a03-ba2b-c88812c251a5\") " pod="openshift-console/console-588bdf99f5-jcrtb"
Jul 15 12:22:07.236536 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:07.236502    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-588bdf99f5-jcrtb"
Jul 15 12:22:07.251697 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:07.251669    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:22:07.351850 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:07.351772    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:22:07.433076 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:07.433036    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-588bdf99f5-jcrtb"]
Jul 15 12:22:07.436998 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:22:07.436965    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b9b11f5_9cc5_4a03_ba2b_c88812c251a5.slice/crio-f469e979aacc2967502ab361e74ea86ab9058ebd3ead50da08bbedb8da6ccce0 WatchSource:0}: Error finding container f469e979aacc2967502ab361e74ea86ab9058ebd3ead50da08bbedb8da6ccce0: Status 404 returned error can't find the container with id f469e979aacc2967502ab361e74ea86ab9058ebd3ead50da08bbedb8da6ccce0
Jul 15 12:22:07.861016 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:07.860914    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:22:07.931134 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:07.931101    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:22:08.125892 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:08.125801    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-588bdf99f5-jcrtb" event={"ID":"1b9b11f5-9cc5-4a03-ba2b-c88812c251a5","Type":"ContainerStarted","Data":"f469e979aacc2967502ab361e74ea86ab9058ebd3ead50da08bbedb8da6ccce0"}
Jul 15 12:22:09.131006 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:09.130913    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-588bdf99f5-jcrtb" event={"ID":"1b9b11f5-9cc5-4a03-ba2b-c88812c251a5","Type":"ContainerStarted","Data":"9c8dd9329e711c8007ba1195f4ad28a5abcd196d679683dfd6b6d1ba1210dfd0"}
Jul 15 12:22:09.134342 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:09.134309    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6","Type":"ContainerStarted","Data":"39744be23c5bf39f6d3b75a36c18859278e4fef888581d49551bf255bb3a98fc"}
Jul 15 12:22:09.167306 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:09.167254    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-588bdf99f5-jcrtb" podStartSLOduration=3.167237197 podStartE2EDuration="3.167237197s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:22:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:22:09.166014574 +0000 UTC m=+99.138585736" watchObservedRunningTime="2026-07-15 12:22:09.167237197 +0000 UTC m=+99.139808356"
Jul 15 12:22:09.198192 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:09.198130    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.204182891 podStartE2EDuration="13.198109701s" totalImagesPullingTime="8.970125448s" totalInitContainerRuntime="23.801362ms" isStatefulPod=false podCreationTimestamp="2026-07-15 12:21:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:22:09.19561905 +0000 UTC m=+99.168190218" watchObservedRunningTime="2026-07-15 12:22:09.198109701 +0000 UTC m=+99.170680861"
Jul 15 12:22:10.145413 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:10.145357    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5aad2a0f-8632-418d-9eee-1fed88395597","Type":"ContainerStarted","Data":"09e0ced1b84c1863219c0d4f97fa89150a6ad5f370f83b278da204da1e1d0cb3"}
Jul 15 12:22:10.145969 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:10.145503    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5aad2a0f-8632-418d-9eee-1fed88395597","Type":"ContainerStarted","Data":"13232e094d2278b5ce1ee107ce143a9194c68a22e3d546a4c7a3ce4a1133efeb"}
Jul 15 12:22:12.157295 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:12.157261    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5aad2a0f-8632-418d-9eee-1fed88395597","Type":"ContainerStarted","Data":"0c475f554771459e00cd32d9c3405927b47f891946b1ade7acff32310d779e7f"}
Jul 15 12:22:12.157749 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:12.157376    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5aad2a0f-8632-418d-9eee-1fed88395597","Type":"ContainerStarted","Data":"bcacab72240d32fd13e860530d977392422722159150de0abd1276b09bc4b78f"}
Jul 15 12:22:12.157749 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:12.157410    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5aad2a0f-8632-418d-9eee-1fed88395597","Type":"ContainerStarted","Data":"4e847f641dcc81b60bf67cb9ce9e7715d54ff29eee2b86cff317945effb1369a"}
Jul 15 12:22:13.164777 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:13.164743    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5aad2a0f-8632-418d-9eee-1fed88395597","Type":"ContainerStarted","Data":"425c8a08583bfb8791983a85ff5092e0bfc01c3be8e3d1287d81e00203403681"}
Jul 15 12:22:13.242664 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:13.242605    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=4.769121866 podStartE2EDuration="11.242587478s" totalImagesPullingTime="6.442028344s" totalInitContainerRuntime="31.437268ms" isStatefulPod=false podCreationTimestamp="2026-07-15 12:22:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:22:13.241460927 +0000 UTC m=+103.214032086" watchObservedRunningTime="2026-07-15 12:22:13.242587478 +0000 UTC m=+103.215158657"
Jul 15 12:22:16.962125 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:16.962092    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:22:17.075168 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:17.075130    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:22:17.237281 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:17.237193    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-588bdf99f5-jcrtb"
Jul 15 12:22:17.237281 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:17.237259    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-588bdf99f5-jcrtb"
Jul 15 12:22:17.242291 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:17.242269    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-588bdf99f5-jcrtb"
Jul 15 12:22:17.656881 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:17.656778    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:22:18.188780 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:18.188752    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-588bdf99f5-jcrtb"
Jul 15 12:22:18.239119 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:18.239089    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65596ddc78-fcm8b"]
Jul 15 12:22:18.363510 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:18.363471    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:22:18.463256 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:18.463229    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:22:18.535078 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:18.535047    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:22:23.133596 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:23.133546    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-7cc65599dd-qjmkj" podUID="e0795e72-5074-47f8-bb5a-143d24109705" containerName="console" containerID="cri-o://756b3477d10bcce319d7c079c1ff5963657f2373fc11a105d8b50bce85a8a074" gracePeriod=15
Jul 15 12:22:23.410225 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:23.410151    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cc65599dd-qjmkj"
Jul 15 12:22:23.458948 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:23.458912    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e0795e72-5074-47f8-bb5a-143d24109705-console-config\") pod \"e0795e72-5074-47f8-bb5a-143d24109705\" (UID: \"e0795e72-5074-47f8-bb5a-143d24109705\") "
Jul 15 12:22:23.458948 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:23.458951    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2r8jv\" (UniqueName: \"kubernetes.io/projected/e0795e72-5074-47f8-bb5a-143d24109705-kube-api-access-2r8jv\") pod \"e0795e72-5074-47f8-bb5a-143d24109705\" (UID: \"e0795e72-5074-47f8-bb5a-143d24109705\") "
Jul 15 12:22:23.459192 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:23.459001    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e0795e72-5074-47f8-bb5a-143d24109705-console-oauth-config\") pod \"e0795e72-5074-47f8-bb5a-143d24109705\" (UID: \"e0795e72-5074-47f8-bb5a-143d24109705\") "
Jul 15 12:22:23.459192 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:23.459026    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e0795e72-5074-47f8-bb5a-143d24109705-console-serving-cert\") pod \"e0795e72-5074-47f8-bb5a-143d24109705\" (UID: \"e0795e72-5074-47f8-bb5a-143d24109705\") "
Jul 15 12:22:23.459192 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:23.459056    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e0795e72-5074-47f8-bb5a-143d24109705-service-ca\") pod \"e0795e72-5074-47f8-bb5a-143d24109705\" (UID: \"e0795e72-5074-47f8-bb5a-143d24109705\") "
Jul 15 12:22:23.459192 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:23.459089    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e0795e72-5074-47f8-bb5a-143d24109705-oauth-serving-cert\") pod \"e0795e72-5074-47f8-bb5a-143d24109705\" (UID: \"e0795e72-5074-47f8-bb5a-143d24109705\") "
Jul 15 12:22:23.459411 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:23.459385    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0795e72-5074-47f8-bb5a-143d24109705-console-config" (OuterVolumeSpecName: "console-config") pod "e0795e72-5074-47f8-bb5a-143d24109705" (UID: "e0795e72-5074-47f8-bb5a-143d24109705"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:22:23.459532 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:23.459507    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0795e72-5074-47f8-bb5a-143d24109705-service-ca" (OuterVolumeSpecName: "service-ca") pod "e0795e72-5074-47f8-bb5a-143d24109705" (UID: "e0795e72-5074-47f8-bb5a-143d24109705"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:22:23.459588 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:23.459517    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e0795e72-5074-47f8-bb5a-143d24109705-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e0795e72-5074-47f8-bb5a-143d24109705" (UID: "e0795e72-5074-47f8-bb5a-143d24109705"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:22:23.461484 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:23.461343    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0795e72-5074-47f8-bb5a-143d24109705-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e0795e72-5074-47f8-bb5a-143d24109705" (UID: "e0795e72-5074-47f8-bb5a-143d24109705"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:22:23.461484 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:23.461424    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e0795e72-5074-47f8-bb5a-143d24109705-kube-api-access-2r8jv" (OuterVolumeSpecName: "kube-api-access-2r8jv") pod "e0795e72-5074-47f8-bb5a-143d24109705" (UID: "e0795e72-5074-47f8-bb5a-143d24109705"). InnerVolumeSpecName "kube-api-access-2r8jv". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:22:23.461484 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:23.461446    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e0795e72-5074-47f8-bb5a-143d24109705-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e0795e72-5074-47f8-bb5a-143d24109705" (UID: "e0795e72-5074-47f8-bb5a-143d24109705"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:22:23.560112 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:23.560074    2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e0795e72-5074-47f8-bb5a-143d24109705-console-oauth-config\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:22:23.560112 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:23.560106    2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e0795e72-5074-47f8-bb5a-143d24109705-console-serving-cert\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:22:23.560112 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:23.560118    2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e0795e72-5074-47f8-bb5a-143d24109705-service-ca\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:22:23.560334 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:23.560126    2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e0795e72-5074-47f8-bb5a-143d24109705-oauth-serving-cert\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:22:23.560334 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:23.560135    2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e0795e72-5074-47f8-bb5a-143d24109705-console-config\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:22:23.560334 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:23.560143    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2r8jv\" (UniqueName: \"kubernetes.io/projected/e0795e72-5074-47f8-bb5a-143d24109705-kube-api-access-2r8jv\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:22:24.207716 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:24.207678    2559 generic.go:356] "Generic (PLEG): container finished" podID="e0795e72-5074-47f8-bb5a-143d24109705" containerID="756b3477d10bcce319d7c079c1ff5963657f2373fc11a105d8b50bce85a8a074" exitCode=0
Jul 15 12:22:24.208157 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:24.207733    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cc65599dd-qjmkj" event={"ID":"e0795e72-5074-47f8-bb5a-143d24109705","Type":"ContainerDied","Data":"756b3477d10bcce319d7c079c1ff5963657f2373fc11a105d8b50bce85a8a074"}
Jul 15 12:22:24.208157 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:24.207749    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7cc65599dd-qjmkj"
Jul 15 12:22:24.208157 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:24.207789    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7cc65599dd-qjmkj" event={"ID":"e0795e72-5074-47f8-bb5a-143d24109705","Type":"ContainerDied","Data":"5e0a5ff1a9a6b272e1c4a330069af640df2ee6d2f1ba4fd32b543a4264905eb7"}
Jul 15 12:22:24.208157 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:24.207811    2559 scope.go:117] "RemoveContainer" containerID="756b3477d10bcce319d7c079c1ff5963657f2373fc11a105d8b50bce85a8a074"
Jul 15 12:22:24.217006 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:24.216982    2559 scope.go:117] "RemoveContainer" containerID="756b3477d10bcce319d7c079c1ff5963657f2373fc11a105d8b50bce85a8a074"
Jul 15 12:22:24.217261 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:22:24.217239    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"756b3477d10bcce319d7c079c1ff5963657f2373fc11a105d8b50bce85a8a074\": container with ID starting with 756b3477d10bcce319d7c079c1ff5963657f2373fc11a105d8b50bce85a8a074 not found: ID does not exist" containerID="756b3477d10bcce319d7c079c1ff5963657f2373fc11a105d8b50bce85a8a074"
Jul 15 12:22:24.217312 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:24.217271    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"756b3477d10bcce319d7c079c1ff5963657f2373fc11a105d8b50bce85a8a074"} err="failed to get container status \"756b3477d10bcce319d7c079c1ff5963657f2373fc11a105d8b50bce85a8a074\": rpc error: code = NotFound desc = could not find container \"756b3477d10bcce319d7c079c1ff5963657f2373fc11a105d8b50bce85a8a074\": container with ID starting with 756b3477d10bcce319d7c079c1ff5963657f2373fc11a105d8b50bce85a8a074 not found: ID does not exist"
Jul 15 12:22:24.230420 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:24.230389    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7cc65599dd-qjmkj"]
Jul 15 12:22:24.232844 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:24.232822    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7cc65599dd-qjmkj"]
Jul 15 12:22:24.582775 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:24.582693    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e0795e72-5074-47f8-bb5a-143d24109705" path="/var/lib/kubelet/pods/e0795e72-5074-47f8-bb5a-143d24109705/volumes"
Jul 15 12:22:24.696476 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:24.696436    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:22:24.813783 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:24.813754    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:22:24.928423 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:24.928344    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:22:25.026330 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:25.026305    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7jz7w"
Jul 15 12:22:42.026096 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:42.026064    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:22:42.093720 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:42.093686    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:22:43.259191 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:43.259151    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-65596ddc78-fcm8b" podUID="4681cea0-9388-45e1-9d99-d1f9c2933c5b" containerName="console" containerID="cri-o://8789aa6ec4dd7bcc91601831c75450f248774635a4934fc5698064865921e772" gracePeriod=15
Jul 15 12:22:44.037582 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:44.037549    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65596ddc78-fcm8b"
Jul 15 12:22:44.142652 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:44.142563    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m26df\" (UniqueName: \"kubernetes.io/projected/4681cea0-9388-45e1-9d99-d1f9c2933c5b-kube-api-access-m26df\") pod \"4681cea0-9388-45e1-9d99-d1f9c2933c5b\" (UID: \"4681cea0-9388-45e1-9d99-d1f9c2933c5b\") "
Jul 15 12:22:44.142652 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:44.142616    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4681cea0-9388-45e1-9d99-d1f9c2933c5b-service-ca\") pod \"4681cea0-9388-45e1-9d99-d1f9c2933c5b\" (UID: \"4681cea0-9388-45e1-9d99-d1f9c2933c5b\") "
Jul 15 12:22:44.142878 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:44.142748    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4681cea0-9388-45e1-9d99-d1f9c2933c5b-console-oauth-config\") pod \"4681cea0-9388-45e1-9d99-d1f9c2933c5b\" (UID: \"4681cea0-9388-45e1-9d99-d1f9c2933c5b\") "
Jul 15 12:22:44.142878 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:44.142786    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4681cea0-9388-45e1-9d99-d1f9c2933c5b-console-serving-cert\") pod \"4681cea0-9388-45e1-9d99-d1f9c2933c5b\" (UID: \"4681cea0-9388-45e1-9d99-d1f9c2933c5b\") "
Jul 15 12:22:44.142878 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:44.142846    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4681cea0-9388-45e1-9d99-d1f9c2933c5b-trusted-ca-bundle\") pod \"4681cea0-9388-45e1-9d99-d1f9c2933c5b\" (UID: \"4681cea0-9388-45e1-9d99-d1f9c2933c5b\") "
Jul 15 12:22:44.142878 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:44.142871    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4681cea0-9388-45e1-9d99-d1f9c2933c5b-oauth-serving-cert\") pod \"4681cea0-9388-45e1-9d99-d1f9c2933c5b\" (UID: \"4681cea0-9388-45e1-9d99-d1f9c2933c5b\") "
Jul 15 12:22:44.143088 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:44.142895    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4681cea0-9388-45e1-9d99-d1f9c2933c5b-console-config\") pod \"4681cea0-9388-45e1-9d99-d1f9c2933c5b\" (UID: \"4681cea0-9388-45e1-9d99-d1f9c2933c5b\") "
Jul 15 12:22:44.143139 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:44.143050    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4681cea0-9388-45e1-9d99-d1f9c2933c5b-service-ca" (OuterVolumeSpecName: "service-ca") pod "4681cea0-9388-45e1-9d99-d1f9c2933c5b" (UID: "4681cea0-9388-45e1-9d99-d1f9c2933c5b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:22:44.143206 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:44.143189    2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/4681cea0-9388-45e1-9d99-d1f9c2933c5b-service-ca\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:22:44.143266 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:44.143230    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4681cea0-9388-45e1-9d99-d1f9c2933c5b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "4681cea0-9388-45e1-9d99-d1f9c2933c5b" (UID: "4681cea0-9388-45e1-9d99-d1f9c2933c5b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:22:44.143397 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:44.143340    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4681cea0-9388-45e1-9d99-d1f9c2933c5b-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "4681cea0-9388-45e1-9d99-d1f9c2933c5b" (UID: "4681cea0-9388-45e1-9d99-d1f9c2933c5b"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:22:44.143476 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:44.143442    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4681cea0-9388-45e1-9d99-d1f9c2933c5b-console-config" (OuterVolumeSpecName: "console-config") pod "4681cea0-9388-45e1-9d99-d1f9c2933c5b" (UID: "4681cea0-9388-45e1-9d99-d1f9c2933c5b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:22:44.144943 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:44.144921    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4681cea0-9388-45e1-9d99-d1f9c2933c5b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "4681cea0-9388-45e1-9d99-d1f9c2933c5b" (UID: "4681cea0-9388-45e1-9d99-d1f9c2933c5b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:22:44.144998 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:44.144949    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4681cea0-9388-45e1-9d99-d1f9c2933c5b-kube-api-access-m26df" (OuterVolumeSpecName: "kube-api-access-m26df") pod "4681cea0-9388-45e1-9d99-d1f9c2933c5b" (UID: "4681cea0-9388-45e1-9d99-d1f9c2933c5b"). InnerVolumeSpecName "kube-api-access-m26df". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:22:44.144998 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:44.144957    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/4681cea0-9388-45e1-9d99-d1f9c2933c5b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "4681cea0-9388-45e1-9d99-d1f9c2933c5b" (UID: "4681cea0-9388-45e1-9d99-d1f9c2933c5b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:22:44.244504 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:44.244469    2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/4681cea0-9388-45e1-9d99-d1f9c2933c5b-trusted-ca-bundle\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:22:44.244504 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:44.244499    2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/4681cea0-9388-45e1-9d99-d1f9c2933c5b-oauth-serving-cert\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:22:44.244504 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:44.244509    2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/4681cea0-9388-45e1-9d99-d1f9c2933c5b-console-config\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:22:44.244725 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:44.244518    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m26df\" (UniqueName: \"kubernetes.io/projected/4681cea0-9388-45e1-9d99-d1f9c2933c5b-kube-api-access-m26df\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:22:44.244725 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:44.244527    2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/4681cea0-9388-45e1-9d99-d1f9c2933c5b-console-oauth-config\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:22:44.244725 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:44.244536    2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/4681cea0-9388-45e1-9d99-d1f9c2933c5b-console-serving-cert\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:22:44.283467 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:44.283432    2559 generic.go:356] "Generic (PLEG): container finished" podID="4681cea0-9388-45e1-9d99-d1f9c2933c5b" containerID="8789aa6ec4dd7bcc91601831c75450f248774635a4934fc5698064865921e772" exitCode=0
Jul 15 12:22:44.283917 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:44.283474    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-65596ddc78-fcm8b"
Jul 15 12:22:44.283917 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:44.283517    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65596ddc78-fcm8b" event={"ID":"4681cea0-9388-45e1-9d99-d1f9c2933c5b","Type":"ContainerDied","Data":"8789aa6ec4dd7bcc91601831c75450f248774635a4934fc5698064865921e772"}
Jul 15 12:22:44.283917 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:44.283576    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-65596ddc78-fcm8b" event={"ID":"4681cea0-9388-45e1-9d99-d1f9c2933c5b","Type":"ContainerDied","Data":"30867e387ab075050c7512e064f2409adbacd1ae0ed91a3827ff160b20f799fe"}
Jul 15 12:22:44.283917 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:44.283607    2559 scope.go:117] "RemoveContainer" containerID="8789aa6ec4dd7bcc91601831c75450f248774635a4934fc5698064865921e772"
Jul 15 12:22:44.291806 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:44.291791    2559 scope.go:117] "RemoveContainer" containerID="8789aa6ec4dd7bcc91601831c75450f248774635a4934fc5698064865921e772"
Jul 15 12:22:44.292038 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:22:44.292018    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8789aa6ec4dd7bcc91601831c75450f248774635a4934fc5698064865921e772\": container with ID starting with 8789aa6ec4dd7bcc91601831c75450f248774635a4934fc5698064865921e772 not found: ID does not exist" containerID="8789aa6ec4dd7bcc91601831c75450f248774635a4934fc5698064865921e772"
Jul 15 12:22:44.292127 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:44.292049    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8789aa6ec4dd7bcc91601831c75450f248774635a4934fc5698064865921e772"} err="failed to get container status \"8789aa6ec4dd7bcc91601831c75450f248774635a4934fc5698064865921e772\": rpc error: code = NotFound desc = could not find container \"8789aa6ec4dd7bcc91601831c75450f248774635a4934fc5698064865921e772\": container with ID starting with 8789aa6ec4dd7bcc91601831c75450f248774635a4934fc5698064865921e772 not found: ID does not exist"
Jul 15 12:22:44.309951 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:44.309918    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-65596ddc78-fcm8b"]
Jul 15 12:22:44.314065 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:44.314045    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-65596ddc78-fcm8b"]
Jul 15 12:22:44.581758 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:22:44.581728    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4681cea0-9388-45e1-9d99-d1f9c2933c5b" path="/var/lib/kubelet/pods/4681cea0-9388-45e1-9d99-d1f9c2933c5b/volumes"
Jul 15 12:23:01.315626 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:01.315594    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:23:02.656459 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:02.656423    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:23:02.675866 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:02.675835    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:23:03.369262 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:03.369234    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:23:12.106460 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:12.106425    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:23:12.208078 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:12.208039    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:23:16.557469 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:16.557431    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 12:23:16.557922 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:16.557701    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6" containerName="alertmanager" containerID="cri-o://b1f490634410e937351b7cfd4cf6eec9ada3e3dd10d0cef45fdbe9019ba43894" gracePeriod=120
Jul 15 12:23:16.557922 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:16.557746    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6" containerName="kube-rbac-proxy-web" containerID="cri-o://c30312f4dc267d67fe8e205c65088b1e32fdfc86150497b6ef66b364db7330fa" gracePeriod=120
Jul 15 12:23:16.557922 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:16.557766    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6" containerName="config-reloader" containerID="cri-o://7a5d3b2ce48ae84331a4dd9bfbc9e972e3b64c707a0fe23c12b74588aa92e503" gracePeriod=120
Jul 15 12:23:16.557922 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:16.557753    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6" containerName="kube-rbac-proxy" containerID="cri-o://d7c90462d3a1c9c57941b3af3a8a1500d88d644556ba8565671c59909a109055" gracePeriod=120
Jul 15 12:23:16.557922 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:16.557794    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6" containerName="prom-label-proxy" containerID="cri-o://39744be23c5bf39f6d3b75a36c18859278e4fef888581d49551bf255bb3a98fc" gracePeriod=120
Jul 15 12:23:16.557922 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:16.557816    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6" containerName="kube-rbac-proxy-metric" containerID="cri-o://fa12a6b8ff156b7bd6e490d61e0471a90d91199d6183e2e3681c70402c52caa5" gracePeriod=120
Jul 15 12:23:17.405454 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:17.405422    2559 generic.go:356] "Generic (PLEG): container finished" podID="24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6" containerID="39744be23c5bf39f6d3b75a36c18859278e4fef888581d49551bf255bb3a98fc" exitCode=0
Jul 15 12:23:17.405454 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:17.405449    2559 generic.go:356] "Generic (PLEG): container finished" podID="24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6" containerID="d7c90462d3a1c9c57941b3af3a8a1500d88d644556ba8565671c59909a109055" exitCode=0
Jul 15 12:23:17.405454 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:17.405457    2559 generic.go:356] "Generic (PLEG): container finished" podID="24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6" containerID="c30312f4dc267d67fe8e205c65088b1e32fdfc86150497b6ef66b364db7330fa" exitCode=0
Jul 15 12:23:17.405454 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:17.405464    2559 generic.go:356] "Generic (PLEG): container finished" podID="24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6" containerID="7a5d3b2ce48ae84331a4dd9bfbc9e972e3b64c707a0fe23c12b74588aa92e503" exitCode=0
Jul 15 12:23:17.405820 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:17.405472    2559 generic.go:356] "Generic (PLEG): container finished" podID="24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6" containerID="b1f490634410e937351b7cfd4cf6eec9ada3e3dd10d0cef45fdbe9019ba43894" exitCode=0
Jul 15 12:23:17.405820 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:17.405502    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6","Type":"ContainerDied","Data":"39744be23c5bf39f6d3b75a36c18859278e4fef888581d49551bf255bb3a98fc"}
Jul 15 12:23:17.405820 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:17.405583    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6","Type":"ContainerDied","Data":"d7c90462d3a1c9c57941b3af3a8a1500d88d644556ba8565671c59909a109055"}
Jul 15 12:23:17.405820 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:17.405624    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6","Type":"ContainerDied","Data":"c30312f4dc267d67fe8e205c65088b1e32fdfc86150497b6ef66b364db7330fa"}
Jul 15 12:23:17.405820 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:17.405660    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6","Type":"ContainerDied","Data":"7a5d3b2ce48ae84331a4dd9bfbc9e972e3b64c707a0fe23c12b74588aa92e503"}
Jul 15 12:23:17.405820 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:17.405697    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6","Type":"ContainerDied","Data":"b1f490634410e937351b7cfd4cf6eec9ada3e3dd10d0cef45fdbe9019ba43894"}
Jul 15 12:23:17.801495 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:17.801471    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:23:17.898808 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:17.898775    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-secret-alertmanager-kube-rbac-proxy-web\") pod \"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6\" (UID: \"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6\") "
Jul 15 12:23:17.898995 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:17.898815    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-web-config\") pod \"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6\" (UID: \"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6\") "
Jul 15 12:23:17.898995 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:17.898842    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-alertmanager-main-db\") pod \"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6\" (UID: \"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6\") "
Jul 15 12:23:17.898995 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:17.898976    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xlbbr\" (UniqueName: \"kubernetes.io/projected/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-kube-api-access-xlbbr\") pod \"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6\" (UID: \"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6\") "
Jul 15 12:23:17.899161 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:17.899017    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-secret-alertmanager-kube-rbac-proxy\") pod \"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6\" (UID: \"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6\") "
Jul 15 12:23:17.899161 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:17.899056    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-config-out\") pod \"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6\" (UID: \"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6\") "
Jul 15 12:23:17.899161 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:17.899101    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-metrics-client-ca\") pod \"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6\" (UID: \"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6\") "
Jul 15 12:23:17.899161 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:17.899128    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-tls-assets\") pod \"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6\" (UID: \"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6\") "
Jul 15 12:23:17.899161 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:17.899136    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6" (UID: "24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:23:17.899430 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:17.899172    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-config-volume\") pod \"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6\" (UID: \"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6\") "
Jul 15 12:23:17.899430 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:17.899208    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-alertmanager-trusted-ca-bundle\") pod \"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6\" (UID: \"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6\") "
Jul 15 12:23:17.899430 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:17.899242    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-cluster-tls-config\") pod \"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6\" (UID: \"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6\") "
Jul 15 12:23:17.899430 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:17.899278    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-secret-alertmanager-main-tls\") pod \"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6\" (UID: \"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6\") "
Jul 15 12:23:17.899430 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:17.899348    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-secret-alertmanager-kube-rbac-proxy-metric\") pod \"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6\" (UID: \"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6\") "
Jul 15 12:23:17.899677 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:17.899613    2559 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-alertmanager-main-db\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:23:17.899677 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:17.899620    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6" (UID: "24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:23:17.900256 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:17.900207    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6" (UID: "24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:23:17.902428 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:17.902397    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6" (UID: "24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:23:17.903631 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:17.903598    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6" (UID: "24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:23:17.903736 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:17.903687    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6" (UID: "24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:23:17.903799 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:17.903735    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-config-volume" (OuterVolumeSpecName: "config-volume") pod "24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6" (UID: "24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:23:17.903799 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:17.903786    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-kube-api-access-xlbbr" (OuterVolumeSpecName: "kube-api-access-xlbbr") pod "24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6" (UID: "24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6"). InnerVolumeSpecName "kube-api-access-xlbbr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:23:17.903910 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:17.903860    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6" (UID: "24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:23:17.903910 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:17.903892    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6" (UID: "24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:23:17.904194 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:17.904166    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-config-out" (OuterVolumeSpecName: "config-out") pod "24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6" (UID: "24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:23:17.907981 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:17.907735    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6" (UID: "24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:23:17.913495 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:17.913468    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-web-config" (OuterVolumeSpecName: "web-config") pod "24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6" (UID: "24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:23:17.999982 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:17.999952    2559 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-config-volume\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:23:18.000131 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:17.999985    2559 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:23:18.000131 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:17.999997    2559 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-cluster-tls-config\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:23:18.000131 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:18.000007    2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-secret-alertmanager-main-tls\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:23:18.000131 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:18.000020    2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:23:18.000131 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:18.000030    2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:23:18.000131 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:18.000039    2559 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-web-config\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:23:18.000131 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:18.000047    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xlbbr\" (UniqueName: \"kubernetes.io/projected/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-kube-api-access-xlbbr\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:23:18.000131 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:18.000055    2559 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:23:18.000131 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:18.000063    2559 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-config-out\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:23:18.000131 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:18.000071    2559 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-metrics-client-ca\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:23:18.000131 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:18.000079    2559 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6-tls-assets\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:23:18.412418 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:18.412319    2559 generic.go:356] "Generic (PLEG): container finished" podID="24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6" containerID="fa12a6b8ff156b7bd6e490d61e0471a90d91199d6183e2e3681c70402c52caa5" exitCode=0
Jul 15 12:23:18.412418 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:18.412395    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6","Type":"ContainerDied","Data":"fa12a6b8ff156b7bd6e490d61e0471a90d91199d6183e2e3681c70402c52caa5"}
Jul 15 12:23:18.412580 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:18.412430    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0"
Jul 15 12:23:18.412580 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:18.412483    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6","Type":"ContainerDied","Data":"229d8d6233642ac4e19c29916b3344cabff32405a08e064a3ea9b0c7bfb24567"}
Jul 15 12:23:18.412580 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:18.412516    2559 scope.go:117] "RemoveContainer" containerID="39744be23c5bf39f6d3b75a36c18859278e4fef888581d49551bf255bb3a98fc"
Jul 15 12:23:18.419813 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:18.419792    2559 scope.go:117] "RemoveContainer" containerID="fa12a6b8ff156b7bd6e490d61e0471a90d91199d6183e2e3681c70402c52caa5"
Jul 15 12:23:18.427196 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:18.427178    2559 scope.go:117] "RemoveContainer" containerID="d7c90462d3a1c9c57941b3af3a8a1500d88d644556ba8565671c59909a109055"
Jul 15 12:23:18.434902 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:18.434883    2559 scope.go:117] "RemoveContainer" containerID="c30312f4dc267d67fe8e205c65088b1e32fdfc86150497b6ef66b364db7330fa"
Jul 15 12:23:18.442504 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:18.442487    2559 scope.go:117] "RemoveContainer" containerID="7a5d3b2ce48ae84331a4dd9bfbc9e972e3b64c707a0fe23c12b74588aa92e503"
Jul 15 12:23:18.450459 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:18.450429    2559 scope.go:117] "RemoveContainer" containerID="b1f490634410e937351b7cfd4cf6eec9ada3e3dd10d0cef45fdbe9019ba43894"
Jul 15 12:23:18.452481 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:18.452460    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 12:23:18.460112 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:18.459816    2559 scope.go:117] "RemoveContainer" containerID="a54cf876c98f4c8e3a434bf40577f6b9e8a9aa4aae086d8f3456402ec413f3dc"
Jul 15 12:23:18.461235 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:18.461218    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"]
Jul 15 12:23:18.467319 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:18.467303    2559 scope.go:117] "RemoveContainer" containerID="39744be23c5bf39f6d3b75a36c18859278e4fef888581d49551bf255bb3a98fc"
Jul 15 12:23:18.467588 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:23:18.467569    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"39744be23c5bf39f6d3b75a36c18859278e4fef888581d49551bf255bb3a98fc\": container with ID starting with 39744be23c5bf39f6d3b75a36c18859278e4fef888581d49551bf255bb3a98fc not found: ID does not exist" containerID="39744be23c5bf39f6d3b75a36c18859278e4fef888581d49551bf255bb3a98fc"
Jul 15 12:23:18.467638 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:18.467599    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"39744be23c5bf39f6d3b75a36c18859278e4fef888581d49551bf255bb3a98fc"} err="failed to get container status \"39744be23c5bf39f6d3b75a36c18859278e4fef888581d49551bf255bb3a98fc\": rpc error: code = NotFound desc = could not find container \"39744be23c5bf39f6d3b75a36c18859278e4fef888581d49551bf255bb3a98fc\": container with ID starting with 39744be23c5bf39f6d3b75a36c18859278e4fef888581d49551bf255bb3a98fc not found: ID does not exist"
Jul 15 12:23:18.467638 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:18.467617    2559 scope.go:117] "RemoveContainer" containerID="fa12a6b8ff156b7bd6e490d61e0471a90d91199d6183e2e3681c70402c52caa5"
Jul 15 12:23:18.467891 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:23:18.467874    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fa12a6b8ff156b7bd6e490d61e0471a90d91199d6183e2e3681c70402c52caa5\": container with ID starting with fa12a6b8ff156b7bd6e490d61e0471a90d91199d6183e2e3681c70402c52caa5 not found: ID does not exist" containerID="fa12a6b8ff156b7bd6e490d61e0471a90d91199d6183e2e3681c70402c52caa5"
Jul 15 12:23:18.467935 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:18.467899    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fa12a6b8ff156b7bd6e490d61e0471a90d91199d6183e2e3681c70402c52caa5"} err="failed to get container status \"fa12a6b8ff156b7bd6e490d61e0471a90d91199d6183e2e3681c70402c52caa5\": rpc error: code = NotFound desc = could not find container \"fa12a6b8ff156b7bd6e490d61e0471a90d91199d6183e2e3681c70402c52caa5\": container with ID starting with fa12a6b8ff156b7bd6e490d61e0471a90d91199d6183e2e3681c70402c52caa5 not found: ID does not exist"
Jul 15 12:23:18.467935 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:18.467915    2559 scope.go:117] "RemoveContainer" containerID="d7c90462d3a1c9c57941b3af3a8a1500d88d644556ba8565671c59909a109055"
Jul 15 12:23:18.468136 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:23:18.468120    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d7c90462d3a1c9c57941b3af3a8a1500d88d644556ba8565671c59909a109055\": container with ID starting with d7c90462d3a1c9c57941b3af3a8a1500d88d644556ba8565671c59909a109055 not found: ID does not exist" containerID="d7c90462d3a1c9c57941b3af3a8a1500d88d644556ba8565671c59909a109055"
Jul 15 12:23:18.468171 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:18.468141    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d7c90462d3a1c9c57941b3af3a8a1500d88d644556ba8565671c59909a109055"} err="failed to get container status \"d7c90462d3a1c9c57941b3af3a8a1500d88d644556ba8565671c59909a109055\": rpc error: code = NotFound desc = could not find container \"d7c90462d3a1c9c57941b3af3a8a1500d88d644556ba8565671c59909a109055\": container with ID starting with d7c90462d3a1c9c57941b3af3a8a1500d88d644556ba8565671c59909a109055 not found: ID does not exist"
Jul 15 12:23:18.468171 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:18.468155    2559 scope.go:117] "RemoveContainer" containerID="c30312f4dc267d67fe8e205c65088b1e32fdfc86150497b6ef66b364db7330fa"
Jul 15 12:23:18.468395 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:23:18.468380    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c30312f4dc267d67fe8e205c65088b1e32fdfc86150497b6ef66b364db7330fa\": container with ID starting with c30312f4dc267d67fe8e205c65088b1e32fdfc86150497b6ef66b364db7330fa not found: ID does not exist" containerID="c30312f4dc267d67fe8e205c65088b1e32fdfc86150497b6ef66b364db7330fa"
Jul 15 12:23:18.468436 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:18.468399    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c30312f4dc267d67fe8e205c65088b1e32fdfc86150497b6ef66b364db7330fa"} err="failed to get container status \"c30312f4dc267d67fe8e205c65088b1e32fdfc86150497b6ef66b364db7330fa\": rpc error: code = NotFound desc = could not find container \"c30312f4dc267d67fe8e205c65088b1e32fdfc86150497b6ef66b364db7330fa\": container with ID starting with c30312f4dc267d67fe8e205c65088b1e32fdfc86150497b6ef66b364db7330fa not found: ID does not exist"
Jul 15 12:23:18.468436 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:18.468411    2559 scope.go:117] "RemoveContainer" containerID="7a5d3b2ce48ae84331a4dd9bfbc9e972e3b64c707a0fe23c12b74588aa92e503"
Jul 15 12:23:18.468623 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:23:18.468604    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7a5d3b2ce48ae84331a4dd9bfbc9e972e3b64c707a0fe23c12b74588aa92e503\": container with ID starting with 7a5d3b2ce48ae84331a4dd9bfbc9e972e3b64c707a0fe23c12b74588aa92e503 not found: ID does not exist" containerID="7a5d3b2ce48ae84331a4dd9bfbc9e972e3b64c707a0fe23c12b74588aa92e503"
Jul 15 12:23:18.468659 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:18.468628    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7a5d3b2ce48ae84331a4dd9bfbc9e972e3b64c707a0fe23c12b74588aa92e503"} err="failed to get container status \"7a5d3b2ce48ae84331a4dd9bfbc9e972e3b64c707a0fe23c12b74588aa92e503\": rpc error: code = NotFound desc = could not find container \"7a5d3b2ce48ae84331a4dd9bfbc9e972e3b64c707a0fe23c12b74588aa92e503\": container with ID starting with 7a5d3b2ce48ae84331a4dd9bfbc9e972e3b64c707a0fe23c12b74588aa92e503 not found: ID does not exist"
Jul 15 12:23:18.468659 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:18.468642    2559 scope.go:117] "RemoveContainer" containerID="b1f490634410e937351b7cfd4cf6eec9ada3e3dd10d0cef45fdbe9019ba43894"
Jul 15 12:23:18.468865 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:23:18.468850    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b1f490634410e937351b7cfd4cf6eec9ada3e3dd10d0cef45fdbe9019ba43894\": container with ID starting with b1f490634410e937351b7cfd4cf6eec9ada3e3dd10d0cef45fdbe9019ba43894 not found: ID does not exist" containerID="b1f490634410e937351b7cfd4cf6eec9ada3e3dd10d0cef45fdbe9019ba43894"
Jul 15 12:23:18.468898 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:18.468869    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b1f490634410e937351b7cfd4cf6eec9ada3e3dd10d0cef45fdbe9019ba43894"} err="failed to get container status \"b1f490634410e937351b7cfd4cf6eec9ada3e3dd10d0cef45fdbe9019ba43894\": rpc error: code = NotFound desc = could not find container \"b1f490634410e937351b7cfd4cf6eec9ada3e3dd10d0cef45fdbe9019ba43894\": container with ID starting with b1f490634410e937351b7cfd4cf6eec9ada3e3dd10d0cef45fdbe9019ba43894 not found: ID does not exist"
Jul 15 12:23:18.468898 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:18.468882    2559 scope.go:117] "RemoveContainer" containerID="a54cf876c98f4c8e3a434bf40577f6b9e8a9aa4aae086d8f3456402ec413f3dc"
Jul 15 12:23:18.469086 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:23:18.469070    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a54cf876c98f4c8e3a434bf40577f6b9e8a9aa4aae086d8f3456402ec413f3dc\": container with ID starting with a54cf876c98f4c8e3a434bf40577f6b9e8a9aa4aae086d8f3456402ec413f3dc not found: ID does not exist" containerID="a54cf876c98f4c8e3a434bf40577f6b9e8a9aa4aae086d8f3456402ec413f3dc"
Jul 15 12:23:18.469130 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:18.469090    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a54cf876c98f4c8e3a434bf40577f6b9e8a9aa4aae086d8f3456402ec413f3dc"} err="failed to get container status \"a54cf876c98f4c8e3a434bf40577f6b9e8a9aa4aae086d8f3456402ec413f3dc\": rpc error: code = NotFound desc = could not find container \"a54cf876c98f4c8e3a434bf40577f6b9e8a9aa4aae086d8f3456402ec413f3dc\": container with ID starting with a54cf876c98f4c8e3a434bf40577f6b9e8a9aa4aae086d8f3456402ec413f3dc not found: ID does not exist"
Jul 15 12:23:18.582358 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:18.582325    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6" path="/var/lib/kubelet/pods/24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6/volumes"
Jul 15 12:23:20.890845 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:20.890796    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:23:21.008478 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.008443    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 12:23:21.008842 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.008811    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5aad2a0f-8632-418d-9eee-1fed88395597" containerName="prometheus" containerID="cri-o://13232e094d2278b5ce1ee107ce143a9194c68a22e3d546a4c7a3ce4a1133efeb" gracePeriod=600
Jul 15 12:23:21.008992 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.008835    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5aad2a0f-8632-418d-9eee-1fed88395597" containerName="kube-rbac-proxy" containerID="cri-o://0c475f554771459e00cd32d9c3405927b47f891946b1ade7acff32310d779e7f" gracePeriod=600
Jul 15 12:23:21.008992 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.008881    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5aad2a0f-8632-418d-9eee-1fed88395597" containerName="config-reloader" containerID="cri-o://09e0ced1b84c1863219c0d4f97fa89150a6ad5f370f83b278da204da1e1d0cb3" gracePeriod=600
Jul 15 12:23:21.008992 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.008891    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5aad2a0f-8632-418d-9eee-1fed88395597" containerName="kube-rbac-proxy-thanos" containerID="cri-o://425c8a08583bfb8791983a85ff5092e0bfc01c3be8e3d1287d81e00203403681" gracePeriod=600
Jul 15 12:23:21.008992 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.008868    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5aad2a0f-8632-418d-9eee-1fed88395597" containerName="thanos-sidecar" containerID="cri-o://4e847f641dcc81b60bf67cb9ce9e7715d54ff29eee2b86cff317945effb1369a" gracePeriod=600
Jul 15 12:23:21.008992 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.008879    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="5aad2a0f-8632-418d-9eee-1fed88395597" containerName="kube-rbac-proxy-web" containerID="cri-o://bcacab72240d32fd13e860530d977392422722159150de0abd1276b09bc4b78f" gracePeriod=600
Jul 15 12:23:21.126654 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.126620    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:23:21.258710 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.258684    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:23:21.296671 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.296069    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:23:21.327095 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.327059    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5aad2a0f-8632-418d-9eee-1fed88395597-thanos-prometheus-http-client-file\") pod \"5aad2a0f-8632-418d-9eee-1fed88395597\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") "
Jul 15 12:23:21.327095 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.327101    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5aad2a0f-8632-418d-9eee-1fed88395597-prometheus-k8s-db\") pod \"5aad2a0f-8632-418d-9eee-1fed88395597\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") "
Jul 15 12:23:21.327328 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.327131    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5aad2a0f-8632-418d-9eee-1fed88395597-configmap-kubelet-serving-ca-bundle\") pod \"5aad2a0f-8632-418d-9eee-1fed88395597\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") "
Jul 15 12:23:21.327328 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.327152    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-66l5x\" (UniqueName: \"kubernetes.io/projected/5aad2a0f-8632-418d-9eee-1fed88395597-kube-api-access-66l5x\") pod \"5aad2a0f-8632-418d-9eee-1fed88395597\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") "
Jul 15 12:23:21.327328 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.327176    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5aad2a0f-8632-418d-9eee-1fed88395597-prometheus-k8s-rulefiles-1\") pod \"5aad2a0f-8632-418d-9eee-1fed88395597\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") "
Jul 15 12:23:21.327328 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.327233    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5aad2a0f-8632-418d-9eee-1fed88395597-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"5aad2a0f-8632-418d-9eee-1fed88395597\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") "
Jul 15 12:23:21.327328 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.327286    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5aad2a0f-8632-418d-9eee-1fed88395597-configmap-serving-certs-ca-bundle\") pod \"5aad2a0f-8632-418d-9eee-1fed88395597\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") "
Jul 15 12:23:21.327328 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.327316    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5aad2a0f-8632-418d-9eee-1fed88395597-secret-grpc-tls\") pod \"5aad2a0f-8632-418d-9eee-1fed88395597\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") "
Jul 15 12:23:21.327665 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.327338    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5aad2a0f-8632-418d-9eee-1fed88395597-tls-assets\") pod \"5aad2a0f-8632-418d-9eee-1fed88395597\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") "
Jul 15 12:23:21.327665 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.327394    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5aad2a0f-8632-418d-9eee-1fed88395597-config-out\") pod \"5aad2a0f-8632-418d-9eee-1fed88395597\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") "
Jul 15 12:23:21.327665 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.327423    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5aad2a0f-8632-418d-9eee-1fed88395597-configmap-metrics-client-ca\") pod \"5aad2a0f-8632-418d-9eee-1fed88395597\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") "
Jul 15 12:23:21.327665 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.327453    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5aad2a0f-8632-418d-9eee-1fed88395597-secret-metrics-client-certs\") pod \"5aad2a0f-8632-418d-9eee-1fed88395597\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") "
Jul 15 12:23:21.327665 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.327484    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5aad2a0f-8632-418d-9eee-1fed88395597-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"5aad2a0f-8632-418d-9eee-1fed88395597\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") "
Jul 15 12:23:21.327665 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.327509    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5aad2a0f-8632-418d-9eee-1fed88395597-secret-prometheus-k8s-tls\") pod \"5aad2a0f-8632-418d-9eee-1fed88395597\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") "
Jul 15 12:23:21.327665 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.327536    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5aad2a0f-8632-418d-9eee-1fed88395597-web-config\") pod \"5aad2a0f-8632-418d-9eee-1fed88395597\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") "
Jul 15 12:23:21.327665 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.327559    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/5aad2a0f-8632-418d-9eee-1fed88395597-config\") pod \"5aad2a0f-8632-418d-9eee-1fed88395597\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") "
Jul 15 12:23:21.327665 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.327588    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5aad2a0f-8632-418d-9eee-1fed88395597-prometheus-trusted-ca-bundle\") pod \"5aad2a0f-8632-418d-9eee-1fed88395597\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") "
Jul 15 12:23:21.327665 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.327619    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5aad2a0f-8632-418d-9eee-1fed88395597-prometheus-k8s-rulefiles-0\") pod \"5aad2a0f-8632-418d-9eee-1fed88395597\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") "
Jul 15 12:23:21.327665 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.327648    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5aad2a0f-8632-418d-9eee-1fed88395597-secret-kube-rbac-proxy\") pod \"5aad2a0f-8632-418d-9eee-1fed88395597\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") "
Jul 15 12:23:21.328168 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.327679    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5aad2a0f-8632-418d-9eee-1fed88395597-prometheus-k8s-rulefiles-2\") pod \"5aad2a0f-8632-418d-9eee-1fed88395597\" (UID: \"5aad2a0f-8632-418d-9eee-1fed88395597\") "
Jul 15 12:23:21.328545 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.327529    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5aad2a0f-8632-418d-9eee-1fed88395597-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "5aad2a0f-8632-418d-9eee-1fed88395597" (UID: "5aad2a0f-8632-418d-9eee-1fed88395597"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:23:21.328545 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.328205    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5aad2a0f-8632-418d-9eee-1fed88395597-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "5aad2a0f-8632-418d-9eee-1fed88395597" (UID: "5aad2a0f-8632-418d-9eee-1fed88395597"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:23:21.329048 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.329009    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5aad2a0f-8632-418d-9eee-1fed88395597-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "5aad2a0f-8632-418d-9eee-1fed88395597" (UID: "5aad2a0f-8632-418d-9eee-1fed88395597"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:23:21.329143 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.329079    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5aad2a0f-8632-418d-9eee-1fed88395597-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "5aad2a0f-8632-418d-9eee-1fed88395597" (UID: "5aad2a0f-8632-418d-9eee-1fed88395597"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:23:21.330536 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.329276    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5aad2a0f-8632-418d-9eee-1fed88395597-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "5aad2a0f-8632-418d-9eee-1fed88395597" (UID: "5aad2a0f-8632-418d-9eee-1fed88395597"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:23:21.330536 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.329524    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5aad2a0f-8632-418d-9eee-1fed88395597-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "5aad2a0f-8632-418d-9eee-1fed88395597" (UID: "5aad2a0f-8632-418d-9eee-1fed88395597"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:23:21.330536 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.329991    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5aad2a0f-8632-418d-9eee-1fed88395597-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "5aad2a0f-8632-418d-9eee-1fed88395597" (UID: "5aad2a0f-8632-418d-9eee-1fed88395597"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:23:21.330536 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.330294    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5aad2a0f-8632-418d-9eee-1fed88395597-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "5aad2a0f-8632-418d-9eee-1fed88395597" (UID: "5aad2a0f-8632-418d-9eee-1fed88395597"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:23:21.332957 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.332931    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5aad2a0f-8632-418d-9eee-1fed88395597-config" (OuterVolumeSpecName: "config") pod "5aad2a0f-8632-418d-9eee-1fed88395597" (UID: "5aad2a0f-8632-418d-9eee-1fed88395597"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:23:21.333070 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.332965    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5aad2a0f-8632-418d-9eee-1fed88395597-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "5aad2a0f-8632-418d-9eee-1fed88395597" (UID: "5aad2a0f-8632-418d-9eee-1fed88395597"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:23:21.333070 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.333064    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5aad2a0f-8632-418d-9eee-1fed88395597-kube-api-access-66l5x" (OuterVolumeSpecName: "kube-api-access-66l5x") pod "5aad2a0f-8632-418d-9eee-1fed88395597" (UID: "5aad2a0f-8632-418d-9eee-1fed88395597"). InnerVolumeSpecName "kube-api-access-66l5x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:23:21.333191 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.333070    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5aad2a0f-8632-418d-9eee-1fed88395597-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "5aad2a0f-8632-418d-9eee-1fed88395597" (UID: "5aad2a0f-8632-418d-9eee-1fed88395597"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:23:21.333323 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.333294    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5aad2a0f-8632-418d-9eee-1fed88395597-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "5aad2a0f-8632-418d-9eee-1fed88395597" (UID: "5aad2a0f-8632-418d-9eee-1fed88395597"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:23:21.333323 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.333311    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5aad2a0f-8632-418d-9eee-1fed88395597-config-out" (OuterVolumeSpecName: "config-out") pod "5aad2a0f-8632-418d-9eee-1fed88395597" (UID: "5aad2a0f-8632-418d-9eee-1fed88395597"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:23:21.333323 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.333295    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5aad2a0f-8632-418d-9eee-1fed88395597-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "5aad2a0f-8632-418d-9eee-1fed88395597" (UID: "5aad2a0f-8632-418d-9eee-1fed88395597"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:23:21.333798 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.333717    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5aad2a0f-8632-418d-9eee-1fed88395597-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "5aad2a0f-8632-418d-9eee-1fed88395597" (UID: "5aad2a0f-8632-418d-9eee-1fed88395597"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:23:21.333886 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.333853    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5aad2a0f-8632-418d-9eee-1fed88395597-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "5aad2a0f-8632-418d-9eee-1fed88395597" (UID: "5aad2a0f-8632-418d-9eee-1fed88395597"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:23:21.333942 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.333899    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5aad2a0f-8632-418d-9eee-1fed88395597-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "5aad2a0f-8632-418d-9eee-1fed88395597" (UID: "5aad2a0f-8632-418d-9eee-1fed88395597"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:23:21.334661 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.334643    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5aad2a0f-8632-418d-9eee-1fed88395597-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "5aad2a0f-8632-418d-9eee-1fed88395597" (UID: "5aad2a0f-8632-418d-9eee-1fed88395597"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:23:21.343977 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.343947    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5aad2a0f-8632-418d-9eee-1fed88395597-web-config" (OuterVolumeSpecName: "web-config") pod "5aad2a0f-8632-418d-9eee-1fed88395597" (UID: "5aad2a0f-8632-418d-9eee-1fed88395597"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:23:21.428213 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.428180    2559 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5aad2a0f-8632-418d-9eee-1fed88395597-configmap-metrics-client-ca\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:23:21.428213 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.428212    2559 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/5aad2a0f-8632-418d-9eee-1fed88395597-secret-metrics-client-certs\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:23:21.428493 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.428228    2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/5aad2a0f-8632-418d-9eee-1fed88395597-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:23:21.428493 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.428240    2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/5aad2a0f-8632-418d-9eee-1fed88395597-secret-prometheus-k8s-tls\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:23:21.428493 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.428249    2559 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/5aad2a0f-8632-418d-9eee-1fed88395597-web-config\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:23:21.428493 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.428258    2559 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/5aad2a0f-8632-418d-9eee-1fed88395597-config\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:23:21.428493 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.428266    2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5aad2a0f-8632-418d-9eee-1fed88395597-prometheus-trusted-ca-bundle\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:23:21.428493 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.428275    2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/5aad2a0f-8632-418d-9eee-1fed88395597-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:23:21.428493 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.428283    2559 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/5aad2a0f-8632-418d-9eee-1fed88395597-secret-kube-rbac-proxy\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:23:21.428493 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.428291    2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/5aad2a0f-8632-418d-9eee-1fed88395597-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:23:21.428493 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.428300    2559 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/5aad2a0f-8632-418d-9eee-1fed88395597-thanos-prometheus-http-client-file\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:23:21.428493 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.428295    2559 generic.go:356] "Generic (PLEG): container finished" podID="5aad2a0f-8632-418d-9eee-1fed88395597" containerID="425c8a08583bfb8791983a85ff5092e0bfc01c3be8e3d1287d81e00203403681" exitCode=0
Jul 15 12:23:21.428493 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.428320    2559 generic.go:356] "Generic (PLEG): container finished" podID="5aad2a0f-8632-418d-9eee-1fed88395597" containerID="0c475f554771459e00cd32d9c3405927b47f891946b1ade7acff32310d779e7f" exitCode=0
Jul 15 12:23:21.428493 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.428330    2559 generic.go:356] "Generic (PLEG): container finished" podID="5aad2a0f-8632-418d-9eee-1fed88395597" containerID="bcacab72240d32fd13e860530d977392422722159150de0abd1276b09bc4b78f" exitCode=0
Jul 15 12:23:21.428493 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.428338    2559 generic.go:356] "Generic (PLEG): container finished" podID="5aad2a0f-8632-418d-9eee-1fed88395597" containerID="4e847f641dcc81b60bf67cb9ce9e7715d54ff29eee2b86cff317945effb1369a" exitCode=0
Jul 15 12:23:21.428493 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.428346    2559 generic.go:356] "Generic (PLEG): container finished" podID="5aad2a0f-8632-418d-9eee-1fed88395597" containerID="09e0ced1b84c1863219c0d4f97fa89150a6ad5f370f83b278da204da1e1d0cb3" exitCode=0
Jul 15 12:23:21.428493 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.428353    2559 generic.go:356] "Generic (PLEG): container finished" podID="5aad2a0f-8632-418d-9eee-1fed88395597" containerID="13232e094d2278b5ce1ee107ce143a9194c68a22e3d546a4c7a3ce4a1133efeb" exitCode=0
Jul 15 12:23:21.428493 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.428323    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5aad2a0f-8632-418d-9eee-1fed88395597","Type":"ContainerDied","Data":"425c8a08583bfb8791983a85ff5092e0bfc01c3be8e3d1287d81e00203403681"}
Jul 15 12:23:21.428493 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.428408    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:23:21.428493 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.428308    2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/5aad2a0f-8632-418d-9eee-1fed88395597-prometheus-k8s-db\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:23:21.428493 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.428467    2559 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5aad2a0f-8632-418d-9eee-1fed88395597-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:23:21.428493 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.428477    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-66l5x\" (UniqueName: \"kubernetes.io/projected/5aad2a0f-8632-418d-9eee-1fed88395597-kube-api-access-66l5x\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:23:21.428493 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.428481    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5aad2a0f-8632-418d-9eee-1fed88395597","Type":"ContainerDied","Data":"0c475f554771459e00cd32d9c3405927b47f891946b1ade7acff32310d779e7f"}
Jul 15 12:23:21.428493 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.428498    2559 scope.go:117] "RemoveContainer" containerID="425c8a08583bfb8791983a85ff5092e0bfc01c3be8e3d1287d81e00203403681"
Jul 15 12:23:21.429329 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.428517    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5aad2a0f-8632-418d-9eee-1fed88395597","Type":"ContainerDied","Data":"bcacab72240d32fd13e860530d977392422722159150de0abd1276b09bc4b78f"}
Jul 15 12:23:21.429329 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.428549    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5aad2a0f-8632-418d-9eee-1fed88395597","Type":"ContainerDied","Data":"4e847f641dcc81b60bf67cb9ce9e7715d54ff29eee2b86cff317945effb1369a"}
Jul 15 12:23:21.429329 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.428575    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5aad2a0f-8632-418d-9eee-1fed88395597","Type":"ContainerDied","Data":"09e0ced1b84c1863219c0d4f97fa89150a6ad5f370f83b278da204da1e1d0cb3"}
Jul 15 12:23:21.429329 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.428486    2559 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/5aad2a0f-8632-418d-9eee-1fed88395597-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:23:21.429329 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.428614    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5aad2a0f-8632-418d-9eee-1fed88395597","Type":"ContainerDied","Data":"13232e094d2278b5ce1ee107ce143a9194c68a22e3d546a4c7a3ce4a1133efeb"}
Jul 15 12:23:21.429329 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.428621    2559 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/5aad2a0f-8632-418d-9eee-1fed88395597-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:23:21.429329 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.428642    2559 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5aad2a0f-8632-418d-9eee-1fed88395597-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:23:21.429329 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.428656    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"5aad2a0f-8632-418d-9eee-1fed88395597","Type":"ContainerDied","Data":"26c796e88ff3a29dddc82b220e13d40c4dbfb2d5fdc480826867d08e26ad515b"}
Jul 15 12:23:21.429329 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.428658    2559 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/5aad2a0f-8632-418d-9eee-1fed88395597-secret-grpc-tls\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:23:21.429329 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.428675    2559 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/5aad2a0f-8632-418d-9eee-1fed88395597-tls-assets\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:23:21.429329 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.428687    2559 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/5aad2a0f-8632-418d-9eee-1fed88395597-config-out\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:23:21.436654 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.436639    2559 scope.go:117] "RemoveContainer" containerID="0c475f554771459e00cd32d9c3405927b47f891946b1ade7acff32310d779e7f"
Jul 15 12:23:21.445685 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.445663    2559 scope.go:117] "RemoveContainer" containerID="bcacab72240d32fd13e860530d977392422722159150de0abd1276b09bc4b78f"
Jul 15 12:23:21.454509 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.454212    2559 scope.go:117] "RemoveContainer" containerID="4e847f641dcc81b60bf67cb9ce9e7715d54ff29eee2b86cff317945effb1369a"
Jul 15 12:23:21.461175 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.461156    2559 scope.go:117] "RemoveContainer" containerID="09e0ced1b84c1863219c0d4f97fa89150a6ad5f370f83b278da204da1e1d0cb3"
Jul 15 12:23:21.468447 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.468425    2559 scope.go:117] "RemoveContainer" containerID="13232e094d2278b5ce1ee107ce143a9194c68a22e3d546a4c7a3ce4a1133efeb"
Jul 15 12:23:21.468523 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.468468    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 12:23:21.475903 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.475882    2559 scope.go:117] "RemoveContainer" containerID="70a0893360ad684e3394cc6f3e482e02737e580d23fabad552a8c77eb6b74543"
Jul 15 12:23:21.481141 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.481117    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 12:23:21.483566 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.483547    2559 scope.go:117] "RemoveContainer" containerID="425c8a08583bfb8791983a85ff5092e0bfc01c3be8e3d1287d81e00203403681"
Jul 15 12:23:21.483876 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:23:21.483856    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"425c8a08583bfb8791983a85ff5092e0bfc01c3be8e3d1287d81e00203403681\": container with ID starting with 425c8a08583bfb8791983a85ff5092e0bfc01c3be8e3d1287d81e00203403681 not found: ID does not exist" containerID="425c8a08583bfb8791983a85ff5092e0bfc01c3be8e3d1287d81e00203403681"
Jul 15 12:23:21.483924 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.483887    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"425c8a08583bfb8791983a85ff5092e0bfc01c3be8e3d1287d81e00203403681"} err="failed to get container status \"425c8a08583bfb8791983a85ff5092e0bfc01c3be8e3d1287d81e00203403681\": rpc error: code = NotFound desc = could not find container \"425c8a08583bfb8791983a85ff5092e0bfc01c3be8e3d1287d81e00203403681\": container with ID starting with 425c8a08583bfb8791983a85ff5092e0bfc01c3be8e3d1287d81e00203403681 not found: ID does not exist"
Jul 15 12:23:21.483924 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.483905    2559 scope.go:117] "RemoveContainer" containerID="0c475f554771459e00cd32d9c3405927b47f891946b1ade7acff32310d779e7f"
Jul 15 12:23:21.484159 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:23:21.484142    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0c475f554771459e00cd32d9c3405927b47f891946b1ade7acff32310d779e7f\": container with ID starting with 0c475f554771459e00cd32d9c3405927b47f891946b1ade7acff32310d779e7f not found: ID does not exist" containerID="0c475f554771459e00cd32d9c3405927b47f891946b1ade7acff32310d779e7f"
Jul 15 12:23:21.484210 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.484163    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c475f554771459e00cd32d9c3405927b47f891946b1ade7acff32310d779e7f"} err="failed to get container status \"0c475f554771459e00cd32d9c3405927b47f891946b1ade7acff32310d779e7f\": rpc error: code = NotFound desc = could not find container \"0c475f554771459e00cd32d9c3405927b47f891946b1ade7acff32310d779e7f\": container with ID starting with 0c475f554771459e00cd32d9c3405927b47f891946b1ade7acff32310d779e7f not found: ID does not exist"
Jul 15 12:23:21.484210 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.484182    2559 scope.go:117] "RemoveContainer" containerID="bcacab72240d32fd13e860530d977392422722159150de0abd1276b09bc4b78f"
Jul 15 12:23:21.484428 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:23:21.484412    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bcacab72240d32fd13e860530d977392422722159150de0abd1276b09bc4b78f\": container with ID starting with bcacab72240d32fd13e860530d977392422722159150de0abd1276b09bc4b78f not found: ID does not exist" containerID="bcacab72240d32fd13e860530d977392422722159150de0abd1276b09bc4b78f"
Jul 15 12:23:21.484478 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.484436    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcacab72240d32fd13e860530d977392422722159150de0abd1276b09bc4b78f"} err="failed to get container status \"bcacab72240d32fd13e860530d977392422722159150de0abd1276b09bc4b78f\": rpc error: code = NotFound desc = could not find container \"bcacab72240d32fd13e860530d977392422722159150de0abd1276b09bc4b78f\": container with ID starting with bcacab72240d32fd13e860530d977392422722159150de0abd1276b09bc4b78f not found: ID does not exist"
Jul 15 12:23:21.484478 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.484450    2559 scope.go:117] "RemoveContainer" containerID="4e847f641dcc81b60bf67cb9ce9e7715d54ff29eee2b86cff317945effb1369a"
Jul 15 12:23:21.484680 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:23:21.484661    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e847f641dcc81b60bf67cb9ce9e7715d54ff29eee2b86cff317945effb1369a\": container with ID starting with 4e847f641dcc81b60bf67cb9ce9e7715d54ff29eee2b86cff317945effb1369a not found: ID does not exist" containerID="4e847f641dcc81b60bf67cb9ce9e7715d54ff29eee2b86cff317945effb1369a"
Jul 15 12:23:21.484725 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.484682    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e847f641dcc81b60bf67cb9ce9e7715d54ff29eee2b86cff317945effb1369a"} err="failed to get container status \"4e847f641dcc81b60bf67cb9ce9e7715d54ff29eee2b86cff317945effb1369a\": rpc error: code = NotFound desc = could not find container \"4e847f641dcc81b60bf67cb9ce9e7715d54ff29eee2b86cff317945effb1369a\": container with ID starting with 4e847f641dcc81b60bf67cb9ce9e7715d54ff29eee2b86cff317945effb1369a not found: ID does not exist"
Jul 15 12:23:21.484725 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.484696    2559 scope.go:117] "RemoveContainer" containerID="09e0ced1b84c1863219c0d4f97fa89150a6ad5f370f83b278da204da1e1d0cb3"
Jul 15 12:23:21.484925 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:23:21.484907    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"09e0ced1b84c1863219c0d4f97fa89150a6ad5f370f83b278da204da1e1d0cb3\": container with ID starting with 09e0ced1b84c1863219c0d4f97fa89150a6ad5f370f83b278da204da1e1d0cb3 not found: ID does not exist" containerID="09e0ced1b84c1863219c0d4f97fa89150a6ad5f370f83b278da204da1e1d0cb3"
Jul 15 12:23:21.484959 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.484929    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09e0ced1b84c1863219c0d4f97fa89150a6ad5f370f83b278da204da1e1d0cb3"} err="failed to get container status \"09e0ced1b84c1863219c0d4f97fa89150a6ad5f370f83b278da204da1e1d0cb3\": rpc error: code = NotFound desc = could not find container \"09e0ced1b84c1863219c0d4f97fa89150a6ad5f370f83b278da204da1e1d0cb3\": container with ID starting with 09e0ced1b84c1863219c0d4f97fa89150a6ad5f370f83b278da204da1e1d0cb3 not found: ID does not exist"
Jul 15 12:23:21.484959 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.484941    2559 scope.go:117] "RemoveContainer" containerID="13232e094d2278b5ce1ee107ce143a9194c68a22e3d546a4c7a3ce4a1133efeb"
Jul 15 12:23:21.485194 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:23:21.485175    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"13232e094d2278b5ce1ee107ce143a9194c68a22e3d546a4c7a3ce4a1133efeb\": container with ID starting with 13232e094d2278b5ce1ee107ce143a9194c68a22e3d546a4c7a3ce4a1133efeb not found: ID does not exist" containerID="13232e094d2278b5ce1ee107ce143a9194c68a22e3d546a4c7a3ce4a1133efeb"
Jul 15 12:23:21.485246 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.485198    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13232e094d2278b5ce1ee107ce143a9194c68a22e3d546a4c7a3ce4a1133efeb"} err="failed to get container status \"13232e094d2278b5ce1ee107ce143a9194c68a22e3d546a4c7a3ce4a1133efeb\": rpc error: code = NotFound desc = could not find container \"13232e094d2278b5ce1ee107ce143a9194c68a22e3d546a4c7a3ce4a1133efeb\": container with ID starting with 13232e094d2278b5ce1ee107ce143a9194c68a22e3d546a4c7a3ce4a1133efeb not found: ID does not exist"
Jul 15 12:23:21.485246 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.485212    2559 scope.go:117] "RemoveContainer" containerID="70a0893360ad684e3394cc6f3e482e02737e580d23fabad552a8c77eb6b74543"
Jul 15 12:23:21.485462 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:23:21.485444    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70a0893360ad684e3394cc6f3e482e02737e580d23fabad552a8c77eb6b74543\": container with ID starting with 70a0893360ad684e3394cc6f3e482e02737e580d23fabad552a8c77eb6b74543 not found: ID does not exist" containerID="70a0893360ad684e3394cc6f3e482e02737e580d23fabad552a8c77eb6b74543"
Jul 15 12:23:21.485507 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.485465    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70a0893360ad684e3394cc6f3e482e02737e580d23fabad552a8c77eb6b74543"} err="failed to get container status \"70a0893360ad684e3394cc6f3e482e02737e580d23fabad552a8c77eb6b74543\": rpc error: code = NotFound desc = could not find container \"70a0893360ad684e3394cc6f3e482e02737e580d23fabad552a8c77eb6b74543\": container with ID starting with 70a0893360ad684e3394cc6f3e482e02737e580d23fabad552a8c77eb6b74543 not found: ID does not exist"
Jul 15 12:23:21.485507 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.485477    2559 scope.go:117] "RemoveContainer" containerID="425c8a08583bfb8791983a85ff5092e0bfc01c3be8e3d1287d81e00203403681"
Jul 15 12:23:21.485708 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.485692    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"425c8a08583bfb8791983a85ff5092e0bfc01c3be8e3d1287d81e00203403681"} err="failed to get container status \"425c8a08583bfb8791983a85ff5092e0bfc01c3be8e3d1287d81e00203403681\": rpc error: code = NotFound desc = could not find container \"425c8a08583bfb8791983a85ff5092e0bfc01c3be8e3d1287d81e00203403681\": container with ID starting with 425c8a08583bfb8791983a85ff5092e0bfc01c3be8e3d1287d81e00203403681 not found: ID does not exist"
Jul 15 12:23:21.485708 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.485708    2559 scope.go:117] "RemoveContainer" containerID="0c475f554771459e00cd32d9c3405927b47f891946b1ade7acff32310d779e7f"
Jul 15 12:23:21.485925 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.485910    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c475f554771459e00cd32d9c3405927b47f891946b1ade7acff32310d779e7f"} err="failed to get container status \"0c475f554771459e00cd32d9c3405927b47f891946b1ade7acff32310d779e7f\": rpc error: code = NotFound desc = could not find container \"0c475f554771459e00cd32d9c3405927b47f891946b1ade7acff32310d779e7f\": container with ID starting with 0c475f554771459e00cd32d9c3405927b47f891946b1ade7acff32310d779e7f not found: ID does not exist"
Jul 15 12:23:21.485960 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.485927    2559 scope.go:117] "RemoveContainer" containerID="bcacab72240d32fd13e860530d977392422722159150de0abd1276b09bc4b78f"
Jul 15 12:23:21.486151 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.486135    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcacab72240d32fd13e860530d977392422722159150de0abd1276b09bc4b78f"} err="failed to get container status \"bcacab72240d32fd13e860530d977392422722159150de0abd1276b09bc4b78f\": rpc error: code = NotFound desc = could not find container \"bcacab72240d32fd13e860530d977392422722159150de0abd1276b09bc4b78f\": container with ID starting with bcacab72240d32fd13e860530d977392422722159150de0abd1276b09bc4b78f not found: ID does not exist"
Jul 15 12:23:21.486187 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.486152    2559 scope.go:117] "RemoveContainer" containerID="4e847f641dcc81b60bf67cb9ce9e7715d54ff29eee2b86cff317945effb1369a"
Jul 15 12:23:21.486335 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.486314    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e847f641dcc81b60bf67cb9ce9e7715d54ff29eee2b86cff317945effb1369a"} err="failed to get container status \"4e847f641dcc81b60bf67cb9ce9e7715d54ff29eee2b86cff317945effb1369a\": rpc error: code = NotFound desc = could not find container \"4e847f641dcc81b60bf67cb9ce9e7715d54ff29eee2b86cff317945effb1369a\": container with ID starting with 4e847f641dcc81b60bf67cb9ce9e7715d54ff29eee2b86cff317945effb1369a not found: ID does not exist"
Jul 15 12:23:21.486401 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.486336    2559 scope.go:117] "RemoveContainer" containerID="09e0ced1b84c1863219c0d4f97fa89150a6ad5f370f83b278da204da1e1d0cb3"
Jul 15 12:23:21.486527 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.486509    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09e0ced1b84c1863219c0d4f97fa89150a6ad5f370f83b278da204da1e1d0cb3"} err="failed to get container status \"09e0ced1b84c1863219c0d4f97fa89150a6ad5f370f83b278da204da1e1d0cb3\": rpc error: code = NotFound desc = could not find container \"09e0ced1b84c1863219c0d4f97fa89150a6ad5f370f83b278da204da1e1d0cb3\": container with ID starting with 09e0ced1b84c1863219c0d4f97fa89150a6ad5f370f83b278da204da1e1d0cb3 not found: ID does not exist"
Jul 15 12:23:21.486564 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.486528    2559 scope.go:117] "RemoveContainer" containerID="13232e094d2278b5ce1ee107ce143a9194c68a22e3d546a4c7a3ce4a1133efeb"
Jul 15 12:23:21.486743 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.486725    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13232e094d2278b5ce1ee107ce143a9194c68a22e3d546a4c7a3ce4a1133efeb"} err="failed to get container status \"13232e094d2278b5ce1ee107ce143a9194c68a22e3d546a4c7a3ce4a1133efeb\": rpc error: code = NotFound desc = could not find container \"13232e094d2278b5ce1ee107ce143a9194c68a22e3d546a4c7a3ce4a1133efeb\": container with ID starting with 13232e094d2278b5ce1ee107ce143a9194c68a22e3d546a4c7a3ce4a1133efeb not found: ID does not exist"
Jul 15 12:23:21.486780 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.486744    2559 scope.go:117] "RemoveContainer" containerID="70a0893360ad684e3394cc6f3e482e02737e580d23fabad552a8c77eb6b74543"
Jul 15 12:23:21.486950 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.486933    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70a0893360ad684e3394cc6f3e482e02737e580d23fabad552a8c77eb6b74543"} err="failed to get container status \"70a0893360ad684e3394cc6f3e482e02737e580d23fabad552a8c77eb6b74543\": rpc error: code = NotFound desc = could not find container \"70a0893360ad684e3394cc6f3e482e02737e580d23fabad552a8c77eb6b74543\": container with ID starting with 70a0893360ad684e3394cc6f3e482e02737e580d23fabad552a8c77eb6b74543 not found: ID does not exist"
Jul 15 12:23:21.486991 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.486951    2559 scope.go:117] "RemoveContainer" containerID="425c8a08583bfb8791983a85ff5092e0bfc01c3be8e3d1287d81e00203403681"
Jul 15 12:23:21.487155 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.487139    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"425c8a08583bfb8791983a85ff5092e0bfc01c3be8e3d1287d81e00203403681"} err="failed to get container status \"425c8a08583bfb8791983a85ff5092e0bfc01c3be8e3d1287d81e00203403681\": rpc error: code = NotFound desc = could not find container \"425c8a08583bfb8791983a85ff5092e0bfc01c3be8e3d1287d81e00203403681\": container with ID starting with 425c8a08583bfb8791983a85ff5092e0bfc01c3be8e3d1287d81e00203403681 not found: ID does not exist"
Jul 15 12:23:21.487191 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.487155    2559 scope.go:117] "RemoveContainer" containerID="0c475f554771459e00cd32d9c3405927b47f891946b1ade7acff32310d779e7f"
Jul 15 12:23:21.487318 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.487304    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c475f554771459e00cd32d9c3405927b47f891946b1ade7acff32310d779e7f"} err="failed to get container status \"0c475f554771459e00cd32d9c3405927b47f891946b1ade7acff32310d779e7f\": rpc error: code = NotFound desc = could not find container \"0c475f554771459e00cd32d9c3405927b47f891946b1ade7acff32310d779e7f\": container with ID starting with 0c475f554771459e00cd32d9c3405927b47f891946b1ade7acff32310d779e7f not found: ID does not exist"
Jul 15 12:23:21.487379 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.487318    2559 scope.go:117] "RemoveContainer" containerID="bcacab72240d32fd13e860530d977392422722159150de0abd1276b09bc4b78f"
Jul 15 12:23:21.487561 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.487545    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcacab72240d32fd13e860530d977392422722159150de0abd1276b09bc4b78f"} err="failed to get container status \"bcacab72240d32fd13e860530d977392422722159150de0abd1276b09bc4b78f\": rpc error: code = NotFound desc = could not find container \"bcacab72240d32fd13e860530d977392422722159150de0abd1276b09bc4b78f\": container with ID starting with bcacab72240d32fd13e860530d977392422722159150de0abd1276b09bc4b78f not found: ID does not exist"
Jul 15 12:23:21.487561 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.487560    2559 scope.go:117] "RemoveContainer" containerID="4e847f641dcc81b60bf67cb9ce9e7715d54ff29eee2b86cff317945effb1369a"
Jul 15 12:23:21.487735 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.487718    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e847f641dcc81b60bf67cb9ce9e7715d54ff29eee2b86cff317945effb1369a"} err="failed to get container status \"4e847f641dcc81b60bf67cb9ce9e7715d54ff29eee2b86cff317945effb1369a\": rpc error: code = NotFound desc = could not find container \"4e847f641dcc81b60bf67cb9ce9e7715d54ff29eee2b86cff317945effb1369a\": container with ID starting with 4e847f641dcc81b60bf67cb9ce9e7715d54ff29eee2b86cff317945effb1369a not found: ID does not exist"
Jul 15 12:23:21.487772 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.487736    2559 scope.go:117] "RemoveContainer" containerID="09e0ced1b84c1863219c0d4f97fa89150a6ad5f370f83b278da204da1e1d0cb3"
Jul 15 12:23:21.487918 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.487901    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09e0ced1b84c1863219c0d4f97fa89150a6ad5f370f83b278da204da1e1d0cb3"} err="failed to get container status \"09e0ced1b84c1863219c0d4f97fa89150a6ad5f370f83b278da204da1e1d0cb3\": rpc error: code = NotFound desc = could not find container \"09e0ced1b84c1863219c0d4f97fa89150a6ad5f370f83b278da204da1e1d0cb3\": container with ID starting with 09e0ced1b84c1863219c0d4f97fa89150a6ad5f370f83b278da204da1e1d0cb3 not found: ID does not exist"
Jul 15 12:23:21.487918 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.487917    2559 scope.go:117] "RemoveContainer" containerID="13232e094d2278b5ce1ee107ce143a9194c68a22e3d546a4c7a3ce4a1133efeb"
Jul 15 12:23:21.488129 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.488112    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13232e094d2278b5ce1ee107ce143a9194c68a22e3d546a4c7a3ce4a1133efeb"} err="failed to get container status \"13232e094d2278b5ce1ee107ce143a9194c68a22e3d546a4c7a3ce4a1133efeb\": rpc error: code = NotFound desc = could not find container \"13232e094d2278b5ce1ee107ce143a9194c68a22e3d546a4c7a3ce4a1133efeb\": container with ID starting with 13232e094d2278b5ce1ee107ce143a9194c68a22e3d546a4c7a3ce4a1133efeb not found: ID does not exist"
Jul 15 12:23:21.488176 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.488129    2559 scope.go:117] "RemoveContainer" containerID="70a0893360ad684e3394cc6f3e482e02737e580d23fabad552a8c77eb6b74543"
Jul 15 12:23:21.488322 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.488302    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70a0893360ad684e3394cc6f3e482e02737e580d23fabad552a8c77eb6b74543"} err="failed to get container status \"70a0893360ad684e3394cc6f3e482e02737e580d23fabad552a8c77eb6b74543\": rpc error: code = NotFound desc = could not find container \"70a0893360ad684e3394cc6f3e482e02737e580d23fabad552a8c77eb6b74543\": container with ID starting with 70a0893360ad684e3394cc6f3e482e02737e580d23fabad552a8c77eb6b74543 not found: ID does not exist"
Jul 15 12:23:21.488374 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.488324    2559 scope.go:117] "RemoveContainer" containerID="425c8a08583bfb8791983a85ff5092e0bfc01c3be8e3d1287d81e00203403681"
Jul 15 12:23:21.488575 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.488552    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"425c8a08583bfb8791983a85ff5092e0bfc01c3be8e3d1287d81e00203403681"} err="failed to get container status \"425c8a08583bfb8791983a85ff5092e0bfc01c3be8e3d1287d81e00203403681\": rpc error: code = NotFound desc = could not find container \"425c8a08583bfb8791983a85ff5092e0bfc01c3be8e3d1287d81e00203403681\": container with ID starting with 425c8a08583bfb8791983a85ff5092e0bfc01c3be8e3d1287d81e00203403681 not found: ID does not exist"
Jul 15 12:23:21.488628 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.488577    2559 scope.go:117] "RemoveContainer" containerID="0c475f554771459e00cd32d9c3405927b47f891946b1ade7acff32310d779e7f"
Jul 15 12:23:21.488811 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.488792    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c475f554771459e00cd32d9c3405927b47f891946b1ade7acff32310d779e7f"} err="failed to get container status \"0c475f554771459e00cd32d9c3405927b47f891946b1ade7acff32310d779e7f\": rpc error: code = NotFound desc = could not find container \"0c475f554771459e00cd32d9c3405927b47f891946b1ade7acff32310d779e7f\": container with ID starting with 0c475f554771459e00cd32d9c3405927b47f891946b1ade7acff32310d779e7f not found: ID does not exist"
Jul 15 12:23:21.488864 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.488813    2559 scope.go:117] "RemoveContainer" containerID="bcacab72240d32fd13e860530d977392422722159150de0abd1276b09bc4b78f"
Jul 15 12:23:21.488997 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.488983    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcacab72240d32fd13e860530d977392422722159150de0abd1276b09bc4b78f"} err="failed to get container status \"bcacab72240d32fd13e860530d977392422722159150de0abd1276b09bc4b78f\": rpc error: code = NotFound desc = could not find container \"bcacab72240d32fd13e860530d977392422722159150de0abd1276b09bc4b78f\": container with ID starting with bcacab72240d32fd13e860530d977392422722159150de0abd1276b09bc4b78f not found: ID does not exist"
Jul 15 12:23:21.489042 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.488998    2559 scope.go:117] "RemoveContainer" containerID="4e847f641dcc81b60bf67cb9ce9e7715d54ff29eee2b86cff317945effb1369a"
Jul 15 12:23:21.489209 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.489193    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e847f641dcc81b60bf67cb9ce9e7715d54ff29eee2b86cff317945effb1369a"} err="failed to get container status \"4e847f641dcc81b60bf67cb9ce9e7715d54ff29eee2b86cff317945effb1369a\": rpc error: code = NotFound desc = could not find container \"4e847f641dcc81b60bf67cb9ce9e7715d54ff29eee2b86cff317945effb1369a\": container with ID starting with 4e847f641dcc81b60bf67cb9ce9e7715d54ff29eee2b86cff317945effb1369a not found: ID does not exist"
Jul 15 12:23:21.489209 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.489209    2559 scope.go:117] "RemoveContainer" containerID="09e0ced1b84c1863219c0d4f97fa89150a6ad5f370f83b278da204da1e1d0cb3"
Jul 15 12:23:21.489436 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.489418    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09e0ced1b84c1863219c0d4f97fa89150a6ad5f370f83b278da204da1e1d0cb3"} err="failed to get container status \"09e0ced1b84c1863219c0d4f97fa89150a6ad5f370f83b278da204da1e1d0cb3\": rpc error: code = NotFound desc = could not find container \"09e0ced1b84c1863219c0d4f97fa89150a6ad5f370f83b278da204da1e1d0cb3\": container with ID starting with 09e0ced1b84c1863219c0d4f97fa89150a6ad5f370f83b278da204da1e1d0cb3 not found: ID does not exist"
Jul 15 12:23:21.489484 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.489446    2559 scope.go:117] "RemoveContainer" containerID="13232e094d2278b5ce1ee107ce143a9194c68a22e3d546a4c7a3ce4a1133efeb"
Jul 15 12:23:21.489649 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.489634    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13232e094d2278b5ce1ee107ce143a9194c68a22e3d546a4c7a3ce4a1133efeb"} err="failed to get container status \"13232e094d2278b5ce1ee107ce143a9194c68a22e3d546a4c7a3ce4a1133efeb\": rpc error: code = NotFound desc = could not find container \"13232e094d2278b5ce1ee107ce143a9194c68a22e3d546a4c7a3ce4a1133efeb\": container with ID starting with 13232e094d2278b5ce1ee107ce143a9194c68a22e3d546a4c7a3ce4a1133efeb not found: ID does not exist"
Jul 15 12:23:21.489690 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.489649    2559 scope.go:117] "RemoveContainer" containerID="70a0893360ad684e3394cc6f3e482e02737e580d23fabad552a8c77eb6b74543"
Jul 15 12:23:21.489831 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.489815    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70a0893360ad684e3394cc6f3e482e02737e580d23fabad552a8c77eb6b74543"} err="failed to get container status \"70a0893360ad684e3394cc6f3e482e02737e580d23fabad552a8c77eb6b74543\": rpc error: code = NotFound desc = could not find container \"70a0893360ad684e3394cc6f3e482e02737e580d23fabad552a8c77eb6b74543\": container with ID starting with 70a0893360ad684e3394cc6f3e482e02737e580d23fabad552a8c77eb6b74543 not found: ID does not exist"
Jul 15 12:23:21.489870 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.489832    2559 scope.go:117] "RemoveContainer" containerID="425c8a08583bfb8791983a85ff5092e0bfc01c3be8e3d1287d81e00203403681"
Jul 15 12:23:21.490008 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.489988    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"425c8a08583bfb8791983a85ff5092e0bfc01c3be8e3d1287d81e00203403681"} err="failed to get container status \"425c8a08583bfb8791983a85ff5092e0bfc01c3be8e3d1287d81e00203403681\": rpc error: code = NotFound desc = could not find container \"425c8a08583bfb8791983a85ff5092e0bfc01c3be8e3d1287d81e00203403681\": container with ID starting with 425c8a08583bfb8791983a85ff5092e0bfc01c3be8e3d1287d81e00203403681 not found: ID does not exist"
Jul 15 12:23:21.490049 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.490009    2559 scope.go:117] "RemoveContainer" containerID="0c475f554771459e00cd32d9c3405927b47f891946b1ade7acff32310d779e7f"
Jul 15 12:23:21.490179 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.490159    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c475f554771459e00cd32d9c3405927b47f891946b1ade7acff32310d779e7f"} err="failed to get container status \"0c475f554771459e00cd32d9c3405927b47f891946b1ade7acff32310d779e7f\": rpc error: code = NotFound desc = could not find container \"0c475f554771459e00cd32d9c3405927b47f891946b1ade7acff32310d779e7f\": container with ID starting with 0c475f554771459e00cd32d9c3405927b47f891946b1ade7acff32310d779e7f not found: ID does not exist"
Jul 15 12:23:21.490219 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.490181    2559 scope.go:117] "RemoveContainer" containerID="bcacab72240d32fd13e860530d977392422722159150de0abd1276b09bc4b78f"
Jul 15 12:23:21.490339 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.490325    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcacab72240d32fd13e860530d977392422722159150de0abd1276b09bc4b78f"} err="failed to get container status \"bcacab72240d32fd13e860530d977392422722159150de0abd1276b09bc4b78f\": rpc error: code = NotFound desc = could not find container \"bcacab72240d32fd13e860530d977392422722159150de0abd1276b09bc4b78f\": container with ID starting with bcacab72240d32fd13e860530d977392422722159150de0abd1276b09bc4b78f not found: ID does not exist"
Jul 15 12:23:21.490399 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.490339    2559 scope.go:117] "RemoveContainer" containerID="4e847f641dcc81b60bf67cb9ce9e7715d54ff29eee2b86cff317945effb1369a"
Jul 15 12:23:21.490518 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.490503    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e847f641dcc81b60bf67cb9ce9e7715d54ff29eee2b86cff317945effb1369a"} err="failed to get container status \"4e847f641dcc81b60bf67cb9ce9e7715d54ff29eee2b86cff317945effb1369a\": rpc error: code = NotFound desc = could not find container \"4e847f641dcc81b60bf67cb9ce9e7715d54ff29eee2b86cff317945effb1369a\": container with ID starting with 4e847f641dcc81b60bf67cb9ce9e7715d54ff29eee2b86cff317945effb1369a not found: ID does not exist"
Jul 15 12:23:21.490518 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.490518    2559 scope.go:117] "RemoveContainer" containerID="09e0ced1b84c1863219c0d4f97fa89150a6ad5f370f83b278da204da1e1d0cb3"
Jul 15 12:23:21.490686 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.490664    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09e0ced1b84c1863219c0d4f97fa89150a6ad5f370f83b278da204da1e1d0cb3"} err="failed to get container status \"09e0ced1b84c1863219c0d4f97fa89150a6ad5f370f83b278da204da1e1d0cb3\": rpc error: code = NotFound desc = could not find container \"09e0ced1b84c1863219c0d4f97fa89150a6ad5f370f83b278da204da1e1d0cb3\": container with ID starting with 09e0ced1b84c1863219c0d4f97fa89150a6ad5f370f83b278da204da1e1d0cb3 not found: ID does not exist"
Jul 15 12:23:21.490726 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.490688    2559 scope.go:117] "RemoveContainer" containerID="13232e094d2278b5ce1ee107ce143a9194c68a22e3d546a4c7a3ce4a1133efeb"
Jul 15 12:23:21.490867 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.490852    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13232e094d2278b5ce1ee107ce143a9194c68a22e3d546a4c7a3ce4a1133efeb"} err="failed to get container status \"13232e094d2278b5ce1ee107ce143a9194c68a22e3d546a4c7a3ce4a1133efeb\": rpc error: code = NotFound desc = could not find container \"13232e094d2278b5ce1ee107ce143a9194c68a22e3d546a4c7a3ce4a1133efeb\": container with ID starting with 13232e094d2278b5ce1ee107ce143a9194c68a22e3d546a4c7a3ce4a1133efeb not found: ID does not exist"
Jul 15 12:23:21.490906 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.490868    2559 scope.go:117] "RemoveContainer" containerID="70a0893360ad684e3394cc6f3e482e02737e580d23fabad552a8c77eb6b74543"
Jul 15 12:23:21.491074 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.491059    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70a0893360ad684e3394cc6f3e482e02737e580d23fabad552a8c77eb6b74543"} err="failed to get container status \"70a0893360ad684e3394cc6f3e482e02737e580d23fabad552a8c77eb6b74543\": rpc error: code = NotFound desc = could not find container \"70a0893360ad684e3394cc6f3e482e02737e580d23fabad552a8c77eb6b74543\": container with ID starting with 70a0893360ad684e3394cc6f3e482e02737e580d23fabad552a8c77eb6b74543 not found: ID does not exist"
Jul 15 12:23:21.491120 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.491074    2559 scope.go:117] "RemoveContainer" containerID="425c8a08583bfb8791983a85ff5092e0bfc01c3be8e3d1287d81e00203403681"
Jul 15 12:23:21.491243 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.491230    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"425c8a08583bfb8791983a85ff5092e0bfc01c3be8e3d1287d81e00203403681"} err="failed to get container status \"425c8a08583bfb8791983a85ff5092e0bfc01c3be8e3d1287d81e00203403681\": rpc error: code = NotFound desc = could not find container \"425c8a08583bfb8791983a85ff5092e0bfc01c3be8e3d1287d81e00203403681\": container with ID starting with 425c8a08583bfb8791983a85ff5092e0bfc01c3be8e3d1287d81e00203403681 not found: ID does not exist"
Jul 15 12:23:21.491280 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.491244    2559 scope.go:117] "RemoveContainer" containerID="0c475f554771459e00cd32d9c3405927b47f891946b1ade7acff32310d779e7f"
Jul 15 12:23:21.491455 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.491438    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0c475f554771459e00cd32d9c3405927b47f891946b1ade7acff32310d779e7f"} err="failed to get container status \"0c475f554771459e00cd32d9c3405927b47f891946b1ade7acff32310d779e7f\": rpc error: code = NotFound desc = could not find container \"0c475f554771459e00cd32d9c3405927b47f891946b1ade7acff32310d779e7f\": container with ID starting with 0c475f554771459e00cd32d9c3405927b47f891946b1ade7acff32310d779e7f not found: ID does not exist"
Jul 15 12:23:21.491504 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.491456    2559 scope.go:117] "RemoveContainer" containerID="bcacab72240d32fd13e860530d977392422722159150de0abd1276b09bc4b78f"
Jul 15 12:23:21.491683 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.491668    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bcacab72240d32fd13e860530d977392422722159150de0abd1276b09bc4b78f"} err="failed to get container status \"bcacab72240d32fd13e860530d977392422722159150de0abd1276b09bc4b78f\": rpc error: code = NotFound desc = could not find container \"bcacab72240d32fd13e860530d977392422722159150de0abd1276b09bc4b78f\": container with ID starting with bcacab72240d32fd13e860530d977392422722159150de0abd1276b09bc4b78f not found: ID does not exist"
Jul 15 12:23:21.491725 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.491684    2559 scope.go:117] "RemoveContainer" containerID="4e847f641dcc81b60bf67cb9ce9e7715d54ff29eee2b86cff317945effb1369a"
Jul 15 12:23:21.491880 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.491863    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e847f641dcc81b60bf67cb9ce9e7715d54ff29eee2b86cff317945effb1369a"} err="failed to get container status \"4e847f641dcc81b60bf67cb9ce9e7715d54ff29eee2b86cff317945effb1369a\": rpc error: code = NotFound desc = could not find container \"4e847f641dcc81b60bf67cb9ce9e7715d54ff29eee2b86cff317945effb1369a\": container with ID starting with 4e847f641dcc81b60bf67cb9ce9e7715d54ff29eee2b86cff317945effb1369a not found: ID does not exist"
Jul 15 12:23:21.491918 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.491881    2559 scope.go:117] "RemoveContainer" containerID="09e0ced1b84c1863219c0d4f97fa89150a6ad5f370f83b278da204da1e1d0cb3"
Jul 15 12:23:21.492072 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.492056    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"09e0ced1b84c1863219c0d4f97fa89150a6ad5f370f83b278da204da1e1d0cb3"} err="failed to get container status \"09e0ced1b84c1863219c0d4f97fa89150a6ad5f370f83b278da204da1e1d0cb3\": rpc error: code = NotFound desc = could not find container \"09e0ced1b84c1863219c0d4f97fa89150a6ad5f370f83b278da204da1e1d0cb3\": container with ID starting with 09e0ced1b84c1863219c0d4f97fa89150a6ad5f370f83b278da204da1e1d0cb3 not found: ID does not exist"
Jul 15 12:23:21.492118 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.492072    2559 scope.go:117] "RemoveContainer" containerID="13232e094d2278b5ce1ee107ce143a9194c68a22e3d546a4c7a3ce4a1133efeb"
Jul 15 12:23:21.492254 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.492236    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"13232e094d2278b5ce1ee107ce143a9194c68a22e3d546a4c7a3ce4a1133efeb"} err="failed to get container status \"13232e094d2278b5ce1ee107ce143a9194c68a22e3d546a4c7a3ce4a1133efeb\": rpc error: code = NotFound desc = could not find container \"13232e094d2278b5ce1ee107ce143a9194c68a22e3d546a4c7a3ce4a1133efeb\": container with ID starting with 13232e094d2278b5ce1ee107ce143a9194c68a22e3d546a4c7a3ce4a1133efeb not found: ID does not exist"
Jul 15 12:23:21.492292 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.492255    2559 scope.go:117] "RemoveContainer" containerID="70a0893360ad684e3394cc6f3e482e02737e580d23fabad552a8c77eb6b74543"
Jul 15 12:23:21.492502 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.492484    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70a0893360ad684e3394cc6f3e482e02737e580d23fabad552a8c77eb6b74543"} err="failed to get container status \"70a0893360ad684e3394cc6f3e482e02737e580d23fabad552a8c77eb6b74543\": rpc error: code = NotFound desc = could not find container \"70a0893360ad684e3394cc6f3e482e02737e580d23fabad552a8c77eb6b74543\": container with ID starting with 70a0893360ad684e3394cc6f3e482e02737e580d23fabad552a8c77eb6b74543 not found: ID does not exist"
Jul 15 12:23:21.544085 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.544054    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 12:23:21.544352 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.544336    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4681cea0-9388-45e1-9d99-d1f9c2933c5b" containerName="console"
Jul 15 12:23:21.544451 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.544355    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4681cea0-9388-45e1-9d99-d1f9c2933c5b" containerName="console"
Jul 15 12:23:21.544451 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.544381    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6" containerName="config-reloader"
Jul 15 12:23:21.544451 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.544389    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6" containerName="config-reloader"
Jul 15 12:23:21.544451 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.544403    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6" containerName="alertmanager"
Jul 15 12:23:21.544451 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.544411    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6" containerName="alertmanager"
Jul 15 12:23:21.544451 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.544424    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5aad2a0f-8632-418d-9eee-1fed88395597" containerName="kube-rbac-proxy-thanos"
Jul 15 12:23:21.544451 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.544433    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5aad2a0f-8632-418d-9eee-1fed88395597" containerName="kube-rbac-proxy-thanos"
Jul 15 12:23:21.544451 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.544446    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6" containerName="kube-rbac-proxy-web"
Jul 15 12:23:21.544451 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.544455    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6" containerName="kube-rbac-proxy-web"
Jul 15 12:23:21.544867 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.544467    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5aad2a0f-8632-418d-9eee-1fed88395597" containerName="config-reloader"
Jul 15 12:23:21.544867 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.544476    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5aad2a0f-8632-418d-9eee-1fed88395597" containerName="config-reloader"
Jul 15 12:23:21.544867 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.544493    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6" containerName="kube-rbac-proxy"
Jul 15 12:23:21.544867 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.544501    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6" containerName="kube-rbac-proxy"
Jul 15 12:23:21.544867 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.544514    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e0795e72-5074-47f8-bb5a-143d24109705" containerName="console"
Jul 15 12:23:21.544867 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.544522    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e0795e72-5074-47f8-bb5a-143d24109705" containerName="console"
Jul 15 12:23:21.544867 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.544534    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6" containerName="init-config-reloader"
Jul 15 12:23:21.544867 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.544544    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6" containerName="init-config-reloader"
Jul 15 12:23:21.544867 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.544554    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6" containerName="prom-label-proxy"
Jul 15 12:23:21.544867 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.544562    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6" containerName="prom-label-proxy"
Jul 15 12:23:21.544867 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.544571    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5aad2a0f-8632-418d-9eee-1fed88395597" containerName="kube-rbac-proxy-web"
Jul 15 12:23:21.544867 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.544578    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5aad2a0f-8632-418d-9eee-1fed88395597" containerName="kube-rbac-proxy-web"
Jul 15 12:23:21.544867 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.544591    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5aad2a0f-8632-418d-9eee-1fed88395597" containerName="init-config-reloader"
Jul 15 12:23:21.544867 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.544599    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5aad2a0f-8632-418d-9eee-1fed88395597" containerName="init-config-reloader"
Jul 15 12:23:21.544867 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.544607    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5aad2a0f-8632-418d-9eee-1fed88395597" containerName="thanos-sidecar"
Jul 15 12:23:21.544867 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.544615    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5aad2a0f-8632-418d-9eee-1fed88395597" containerName="thanos-sidecar"
Jul 15 12:23:21.544867 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.544625    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5aad2a0f-8632-418d-9eee-1fed88395597" containerName="kube-rbac-proxy"
Jul 15 12:23:21.544867 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.544633    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5aad2a0f-8632-418d-9eee-1fed88395597" containerName="kube-rbac-proxy"
Jul 15 12:23:21.544867 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.544644    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6" containerName="kube-rbac-proxy-metric"
Jul 15 12:23:21.544867 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.544653    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6" containerName="kube-rbac-proxy-metric"
Jul 15 12:23:21.544867 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.544661    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5aad2a0f-8632-418d-9eee-1fed88395597" containerName="prometheus"
Jul 15 12:23:21.544867 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.544669    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="5aad2a0f-8632-418d-9eee-1fed88395597" containerName="prometheus"
Jul 15 12:23:21.544867 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.544731    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6" containerName="kube-rbac-proxy-metric"
Jul 15 12:23:21.544867 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.544743    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6" containerName="prom-label-proxy"
Jul 15 12:23:21.544867 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.544753    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6" containerName="kube-rbac-proxy"
Jul 15 12:23:21.544867 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.544762    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5aad2a0f-8632-418d-9eee-1fed88395597" containerName="prometheus"
Jul 15 12:23:21.544867 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.544771    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5aad2a0f-8632-418d-9eee-1fed88395597" containerName="config-reloader"
Jul 15 12:23:21.544867 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.544780    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6" containerName="alertmanager"
Jul 15 12:23:21.544867 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.544789    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5aad2a0f-8632-418d-9eee-1fed88395597" containerName="kube-rbac-proxy-web"
Jul 15 12:23:21.544867 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.544797    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6" containerName="config-reloader"
Jul 15 12:23:21.544867 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.544805    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5aad2a0f-8632-418d-9eee-1fed88395597" containerName="thanos-sidecar"
Jul 15 12:23:21.544867 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.544814    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5aad2a0f-8632-418d-9eee-1fed88395597" containerName="kube-rbac-proxy"
Jul 15 12:23:21.544867 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.544822    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="5aad2a0f-8632-418d-9eee-1fed88395597" containerName="kube-rbac-proxy-thanos"
Jul 15 12:23:21.544867 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.544830    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="24bd57be-9d1f-4e5e-9f42-7ee9ba9158c6" containerName="kube-rbac-proxy-web"
Jul 15 12:23:21.544867 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.544838    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="4681cea0-9388-45e1-9d99-d1f9c2933c5b" containerName="console"
Jul 15 12:23:21.544867 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.544846    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e0795e72-5074-47f8-bb5a-143d24109705" containerName="console"
Jul 15 12:23:21.550512 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.550492    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:23:21.551641 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.551619    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:23:21.554071 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.554048    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\""
Jul 15 12:23:21.554167 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.554094    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\""
Jul 15 12:23:21.556492 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.556475    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\""
Jul 15 12:23:21.556562 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.556532    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-a0vlcb2cqmsk8\""
Jul 15 12:23:21.556635 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.556620    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\""
Jul 15 12:23:21.556921 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.556905    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\""
Jul 15 12:23:21.559641 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.559625    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-fw4n5\""
Jul 15 12:23:21.560255 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.560238    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\""
Jul 15 12:23:21.560486 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.560469    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\""
Jul 15 12:23:21.561731 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.561712    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\""
Jul 15 12:23:21.563306 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.563264    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\""
Jul 15 12:23:21.563306 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.563272    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\""
Jul 15 12:23:21.563956 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.563937    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\""
Jul 15 12:23:21.567719 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.567695    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\""
Jul 15 12:23:21.568488 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.568472    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\""
Jul 15 12:23:21.569831 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.569818    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\""
Jul 15 12:23:21.570547 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.570535    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\""
Jul 15 12:23:21.592669 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.592639    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 12:23:21.630662 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.630631    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d835edf7-920f-45dd-add2-567e986269f5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d835edf7-920f-45dd-add2-567e986269f5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:23:21.630662 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.630663    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d835edf7-920f-45dd-add2-567e986269f5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d835edf7-920f-45dd-add2-567e986269f5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:23:21.630842 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.630687    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d835edf7-920f-45dd-add2-567e986269f5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d835edf7-920f-45dd-add2-567e986269f5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:23:21.630842 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.630778    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d835edf7-920f-45dd-add2-567e986269f5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d835edf7-920f-45dd-add2-567e986269f5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:23:21.630842 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.630814    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d835edf7-920f-45dd-add2-567e986269f5-config\") pod \"prometheus-k8s-0\" (UID: \"d835edf7-920f-45dd-add2-567e986269f5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:23:21.630842 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.630832    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d835edf7-920f-45dd-add2-567e986269f5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d835edf7-920f-45dd-add2-567e986269f5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:23:21.630963 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.630852    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d835edf7-920f-45dd-add2-567e986269f5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d835edf7-920f-45dd-add2-567e986269f5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:23:21.630963 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.630868    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d835edf7-920f-45dd-add2-567e986269f5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d835edf7-920f-45dd-add2-567e986269f5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:23:21.630963 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.630922    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d835edf7-920f-45dd-add2-567e986269f5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d835edf7-920f-45dd-add2-567e986269f5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:23:21.630963 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.630943    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d835edf7-920f-45dd-add2-567e986269f5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d835edf7-920f-45dd-add2-567e986269f5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:23:21.631072 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.630967    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d835edf7-920f-45dd-add2-567e986269f5-web-config\") pod \"prometheus-k8s-0\" (UID: \"d835edf7-920f-45dd-add2-567e986269f5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:23:21.631072 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.630988    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d835edf7-920f-45dd-add2-567e986269f5-config-out\") pod \"prometheus-k8s-0\" (UID: \"d835edf7-920f-45dd-add2-567e986269f5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:23:21.631072 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.631003    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d835edf7-920f-45dd-add2-567e986269f5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d835edf7-920f-45dd-add2-567e986269f5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:23:21.631072 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.631024    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w5n2m\" (UniqueName: \"kubernetes.io/projected/d835edf7-920f-45dd-add2-567e986269f5-kube-api-access-w5n2m\") pod \"prometheus-k8s-0\" (UID: \"d835edf7-920f-45dd-add2-567e986269f5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:23:21.631072 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.631049    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d835edf7-920f-45dd-add2-567e986269f5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d835edf7-920f-45dd-add2-567e986269f5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:23:21.631221 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.631076    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d835edf7-920f-45dd-add2-567e986269f5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d835edf7-920f-45dd-add2-567e986269f5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:23:21.631221 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.631095    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d835edf7-920f-45dd-add2-567e986269f5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d835edf7-920f-45dd-add2-567e986269f5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:23:21.631221 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.631115    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d835edf7-920f-45dd-add2-567e986269f5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d835edf7-920f-45dd-add2-567e986269f5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:23:21.631221 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.631143    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d835edf7-920f-45dd-add2-567e986269f5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d835edf7-920f-45dd-add2-567e986269f5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:23:21.631221 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.631162    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d835edf7-920f-45dd-add2-567e986269f5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d835edf7-920f-45dd-add2-567e986269f5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:23:21.661351 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.661321    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:23:21.731890 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.731857    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d835edf7-920f-45dd-add2-567e986269f5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d835edf7-920f-45dd-add2-567e986269f5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:23:21.732042 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.731894    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d835edf7-920f-45dd-add2-567e986269f5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d835edf7-920f-45dd-add2-567e986269f5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:23:21.732042 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.731911    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d835edf7-920f-45dd-add2-567e986269f5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d835edf7-920f-45dd-add2-567e986269f5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:23:21.732042 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.731938    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d835edf7-920f-45dd-add2-567e986269f5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d835edf7-920f-45dd-add2-567e986269f5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:23:21.732042 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.731984    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/d835edf7-920f-45dd-add2-567e986269f5-config\") pod \"prometheus-k8s-0\" (UID: \"d835edf7-920f-45dd-add2-567e986269f5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:23:21.732042 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.732036    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d835edf7-920f-45dd-add2-567e986269f5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d835edf7-920f-45dd-add2-567e986269f5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:23:21.732284 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.732065    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d835edf7-920f-45dd-add2-567e986269f5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d835edf7-920f-45dd-add2-567e986269f5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:23:21.732284 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.732091    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d835edf7-920f-45dd-add2-567e986269f5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d835edf7-920f-45dd-add2-567e986269f5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:23:21.732435 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.732382    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d835edf7-920f-45dd-add2-567e986269f5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d835edf7-920f-45dd-add2-567e986269f5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:23:21.732435 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.732417    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d835edf7-920f-45dd-add2-567e986269f5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d835edf7-920f-45dd-add2-567e986269f5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:23:21.732538 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.732471    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d835edf7-920f-45dd-add2-567e986269f5-web-config\") pod \"prometheus-k8s-0\" (UID: \"d835edf7-920f-45dd-add2-567e986269f5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:23:21.732538 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.732498    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d835edf7-920f-45dd-add2-567e986269f5-config-out\") pod \"prometheus-k8s-0\" (UID: \"d835edf7-920f-45dd-add2-567e986269f5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:23:21.732538 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.732523    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d835edf7-920f-45dd-add2-567e986269f5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d835edf7-920f-45dd-add2-567e986269f5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:23:21.732674 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.732546    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w5n2m\" (UniqueName: \"kubernetes.io/projected/d835edf7-920f-45dd-add2-567e986269f5-kube-api-access-w5n2m\") pod \"prometheus-k8s-0\" (UID: \"d835edf7-920f-45dd-add2-567e986269f5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:23:21.732674 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.732570    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d835edf7-920f-45dd-add2-567e986269f5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d835edf7-920f-45dd-add2-567e986269f5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:23:21.732674 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.732612    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d835edf7-920f-45dd-add2-567e986269f5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d835edf7-920f-45dd-add2-567e986269f5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:23:21.732674 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.732638    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d835edf7-920f-45dd-add2-567e986269f5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d835edf7-920f-45dd-add2-567e986269f5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:23:21.732674 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.732664    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d835edf7-920f-45dd-add2-567e986269f5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d835edf7-920f-45dd-add2-567e986269f5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:23:21.732911 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.732711    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d835edf7-920f-45dd-add2-567e986269f5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d835edf7-920f-45dd-add2-567e986269f5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:23:21.732911 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.732742    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d835edf7-920f-45dd-add2-567e986269f5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d835edf7-920f-45dd-add2-567e986269f5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:23:21.732911 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.732821    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/d835edf7-920f-45dd-add2-567e986269f5-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"d835edf7-920f-45dd-add2-567e986269f5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:23:21.734769 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.733873    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d835edf7-920f-45dd-add2-567e986269f5-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d835edf7-920f-45dd-add2-567e986269f5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:23:21.734769 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.734055    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/d835edf7-920f-45dd-add2-567e986269f5-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"d835edf7-920f-45dd-add2-567e986269f5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:23:21.734769 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.734408    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d835edf7-920f-45dd-add2-567e986269f5-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d835edf7-920f-45dd-add2-567e986269f5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:23:21.734769 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.734588    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/d835edf7-920f-45dd-add2-567e986269f5-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"d835edf7-920f-45dd-add2-567e986269f5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:23:21.735742 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.734966    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d835edf7-920f-45dd-add2-567e986269f5-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"d835edf7-920f-45dd-add2-567e986269f5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:23:21.735742 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.735091    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/d835edf7-920f-45dd-add2-567e986269f5-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"d835edf7-920f-45dd-add2-567e986269f5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:23:21.735742 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.735508    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/d835edf7-920f-45dd-add2-567e986269f5-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"d835edf7-920f-45dd-add2-567e986269f5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:23:21.735742 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.735528    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/d835edf7-920f-45dd-add2-567e986269f5-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"d835edf7-920f-45dd-add2-567e986269f5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:23:21.736943 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.736912    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/d835edf7-920f-45dd-add2-567e986269f5-config-out\") pod \"prometheus-k8s-0\" (UID: \"d835edf7-920f-45dd-add2-567e986269f5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:23:21.737074 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.737051    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/d835edf7-920f-45dd-add2-567e986269f5-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"d835edf7-920f-45dd-add2-567e986269f5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:23:21.737153 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.737077    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/d835edf7-920f-45dd-add2-567e986269f5-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"d835edf7-920f-45dd-add2-567e986269f5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:23:21.737325 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.737306    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/d835edf7-920f-45dd-add2-567e986269f5-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"d835edf7-920f-45dd-add2-567e986269f5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:23:21.737417 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.737312    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/d835edf7-920f-45dd-add2-567e986269f5-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"d835edf7-920f-45dd-add2-567e986269f5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:23:21.737470 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.737455    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/d835edf7-920f-45dd-add2-567e986269f5-web-config\") pod \"prometheus-k8s-0\" (UID: \"d835edf7-920f-45dd-add2-567e986269f5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:23:21.737507 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.737462    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/d835edf7-920f-45dd-add2-567e986269f5-config\") pod \"prometheus-k8s-0\" (UID: \"d835edf7-920f-45dd-add2-567e986269f5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:23:21.737507 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.737470    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/d835edf7-920f-45dd-add2-567e986269f5-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"d835edf7-920f-45dd-add2-567e986269f5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:23:21.737715 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.737699    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/d835edf7-920f-45dd-add2-567e986269f5-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"d835edf7-920f-45dd-add2-567e986269f5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:23:21.738654 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.738637    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/d835edf7-920f-45dd-add2-567e986269f5-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"d835edf7-920f-45dd-add2-567e986269f5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:23:21.743233 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.743212    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w5n2m\" (UniqueName: \"kubernetes.io/projected/d835edf7-920f-45dd-add2-567e986269f5-kube-api-access-w5n2m\") pod \"prometheus-k8s-0\" (UID: \"d835edf7-920f-45dd-add2-567e986269f5\") " pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:23:21.860585 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:21.860535    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:23:22.020303 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:22.020197    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"]
Jul 15 12:23:22.023433 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:23:22.023411    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd835edf7_920f_45dd_add2_567e986269f5.slice/crio-9c00e2c54a8e7e385739d4a864fab8d32bc6323a4bc684ce139a8267738c5016 WatchSource:0}: Error finding container 9c00e2c54a8e7e385739d4a864fab8d32bc6323a4bc684ce139a8267738c5016: Status 404 returned error can't find the container with id 9c00e2c54a8e7e385739d4a864fab8d32bc6323a4bc684ce139a8267738c5016
Jul 15 12:23:22.437752 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:22.437661    2559 generic.go:356] "Generic (PLEG): container finished" podID="d835edf7-920f-45dd-add2-567e986269f5" containerID="b20d153669bab1a3f8034c9db38125dfe0b98f0749e7bbb0dec079f1c4aaa0f6" exitCode=0
Jul 15 12:23:22.437924 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:22.437746    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d835edf7-920f-45dd-add2-567e986269f5","Type":"ContainerDied","Data":"b20d153669bab1a3f8034c9db38125dfe0b98f0749e7bbb0dec079f1c4aaa0f6"}
Jul 15 12:23:22.437924 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:22.437850    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d835edf7-920f-45dd-add2-567e986269f5","Type":"ContainerStarted","Data":"9c00e2c54a8e7e385739d4a864fab8d32bc6323a4bc684ce139a8267738c5016"}
Jul 15 12:23:22.584478 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:22.584355    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5aad2a0f-8632-418d-9eee-1fed88395597" path="/var/lib/kubelet/pods/5aad2a0f-8632-418d-9eee-1fed88395597/volumes"
Jul 15 12:23:23.446244 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:23.446207    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d835edf7-920f-45dd-add2-567e986269f5","Type":"ContainerStarted","Data":"49d7050a49a9f4b44862347fb55fd91e57745651f0e926cb8ccefbb7455591b2"}
Jul 15 12:23:23.446694 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:23.446285    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d835edf7-920f-45dd-add2-567e986269f5","Type":"ContainerStarted","Data":"e3bda056194ca1bbb8fc22e84763eb943e323c0ca485b31bdf07d4638414dbb9"}
Jul 15 12:23:23.446694 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:23.446323    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d835edf7-920f-45dd-add2-567e986269f5","Type":"ContainerStarted","Data":"c4eadf819614d98a0f0c92713d140fc09e9d84023970e86e79f24aac2c409ea2"}
Jul 15 12:23:23.446694 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:23.446382    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d835edf7-920f-45dd-add2-567e986269f5","Type":"ContainerStarted","Data":"569f5f19d56577a760e01ee3221c8a1b89c3b4b3c0cdd365898243dca11d18f4"}
Jul 15 12:23:23.446694 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:23.446426    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d835edf7-920f-45dd-add2-567e986269f5","Type":"ContainerStarted","Data":"9cf889a12379d34bd9ec05f1fd1ea3710b004aca9d13daa615f5c87c14731026"}
Jul 15 12:23:23.446694 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:23.446462    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"d835edf7-920f-45dd-add2-567e986269f5","Type":"ContainerStarted","Data":"77d10a2c6b3000e0da43267292ad3212fcf0a76daa1886da76c8810f4ae7e050"}
Jul 15 12:23:23.492859 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:23.492807    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.477465211 podStartE2EDuration="2.492788957s" totalImagesPullingTime="0s" totalInitContainerRuntime="15.323746ms" isStatefulPod=false podCreationTimestamp="2026-07-15 12:23:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:23:23.491608447 +0000 UTC m=+173.464179617" watchObservedRunningTime="2026-07-15 12:23:23.492788957 +0000 UTC m=+173.465360115"
Jul 15 12:23:24.178489 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:24.178456    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:23:24.266257 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:24.266224    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:23:26.861650 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:26.861600    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:23:31.393269 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:31.393228    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-588bdf99f5-jcrtb"]
Jul 15 12:23:31.650249 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:31.650169    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:23:31.788537 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:31.788501    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:23:32.087211 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:32.087184    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:23:32.219139 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:32.219080    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:23:56.412863 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:56.412820    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-588bdf99f5-jcrtb" podUID="1b9b11f5-9cc5-4a03-ba2b-c88812c251a5" containerName="console" containerID="cri-o://9c8dd9329e711c8007ba1195f4ad28a5abcd196d679683dfd6b6d1ba1210dfd0" gracePeriod=15
Jul 15 12:23:56.564615 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:56.564581    2559 generic.go:356] "Generic (PLEG): container finished" podID="1b9b11f5-9cc5-4a03-ba2b-c88812c251a5" containerID="9c8dd9329e711c8007ba1195f4ad28a5abcd196d679683dfd6b6d1ba1210dfd0" exitCode=0
Jul 15 12:23:56.564770 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:56.564628    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-588bdf99f5-jcrtb" event={"ID":"1b9b11f5-9cc5-4a03-ba2b-c88812c251a5","Type":"ContainerDied","Data":"9c8dd9329e711c8007ba1195f4ad28a5abcd196d679683dfd6b6d1ba1210dfd0"}
Jul 15 12:23:56.663766 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:56.663706    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-588bdf99f5-jcrtb"
Jul 15 12:23:56.813968 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:56.813916    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b9b11f5-9cc5-4a03-ba2b-c88812c251a5-trusted-ca-bundle\") pod \"1b9b11f5-9cc5-4a03-ba2b-c88812c251a5\" (UID: \"1b9b11f5-9cc5-4a03-ba2b-c88812c251a5\") "
Jul 15 12:23:56.813968 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:56.813966    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1b9b11f5-9cc5-4a03-ba2b-c88812c251a5-console-config\") pod \"1b9b11f5-9cc5-4a03-ba2b-c88812c251a5\" (UID: \"1b9b11f5-9cc5-4a03-ba2b-c88812c251a5\") "
Jul 15 12:23:56.814234 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:56.813994    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1b9b11f5-9cc5-4a03-ba2b-c88812c251a5-oauth-serving-cert\") pod \"1b9b11f5-9cc5-4a03-ba2b-c88812c251a5\" (UID: \"1b9b11f5-9cc5-4a03-ba2b-c88812c251a5\") "
Jul 15 12:23:56.814234 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:56.814016    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1b9b11f5-9cc5-4a03-ba2b-c88812c251a5-console-oauth-config\") pod \"1b9b11f5-9cc5-4a03-ba2b-c88812c251a5\" (UID: \"1b9b11f5-9cc5-4a03-ba2b-c88812c251a5\") "
Jul 15 12:23:56.814234 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:56.814205    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1b9b11f5-9cc5-4a03-ba2b-c88812c251a5-console-serving-cert\") pod \"1b9b11f5-9cc5-4a03-ba2b-c88812c251a5\" (UID: \"1b9b11f5-9cc5-4a03-ba2b-c88812c251a5\") "
Jul 15 12:23:56.814382 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:56.814254    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dphf9\" (UniqueName: \"kubernetes.io/projected/1b9b11f5-9cc5-4a03-ba2b-c88812c251a5-kube-api-access-dphf9\") pod \"1b9b11f5-9cc5-4a03-ba2b-c88812c251a5\" (UID: \"1b9b11f5-9cc5-4a03-ba2b-c88812c251a5\") "
Jul 15 12:23:56.814382 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:56.814295    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1b9b11f5-9cc5-4a03-ba2b-c88812c251a5-service-ca\") pod \"1b9b11f5-9cc5-4a03-ba2b-c88812c251a5\" (UID: \"1b9b11f5-9cc5-4a03-ba2b-c88812c251a5\") "
Jul 15 12:23:56.814503 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:56.814404    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b9b11f5-9cc5-4a03-ba2b-c88812c251a5-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1b9b11f5-9cc5-4a03-ba2b-c88812c251a5" (UID: "1b9b11f5-9cc5-4a03-ba2b-c88812c251a5"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:23:56.814503 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:56.814426    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b9b11f5-9cc5-4a03-ba2b-c88812c251a5-console-config" (OuterVolumeSpecName: "console-config") pod "1b9b11f5-9cc5-4a03-ba2b-c88812c251a5" (UID: "1b9b11f5-9cc5-4a03-ba2b-c88812c251a5"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:23:56.814607 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:56.814507    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b9b11f5-9cc5-4a03-ba2b-c88812c251a5-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1b9b11f5-9cc5-4a03-ba2b-c88812c251a5" (UID: "1b9b11f5-9cc5-4a03-ba2b-c88812c251a5"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:23:56.814607 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:56.814581    2559 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1b9b11f5-9cc5-4a03-ba2b-c88812c251a5-trusted-ca-bundle\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:23:56.814607 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:56.814598    2559 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1b9b11f5-9cc5-4a03-ba2b-c88812c251a5-console-config\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:23:56.814767 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:56.814611    2559 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1b9b11f5-9cc5-4a03-ba2b-c88812c251a5-oauth-serving-cert\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:23:56.814767 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:56.814736    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1b9b11f5-9cc5-4a03-ba2b-c88812c251a5-service-ca" (OuterVolumeSpecName: "service-ca") pod "1b9b11f5-9cc5-4a03-ba2b-c88812c251a5" (UID: "1b9b11f5-9cc5-4a03-ba2b-c88812c251a5"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:23:56.816289 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:56.816261    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b9b11f5-9cc5-4a03-ba2b-c88812c251a5-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1b9b11f5-9cc5-4a03-ba2b-c88812c251a5" (UID: "1b9b11f5-9cc5-4a03-ba2b-c88812c251a5"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:23:56.816289 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:56.816266    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1b9b11f5-9cc5-4a03-ba2b-c88812c251a5-kube-api-access-dphf9" (OuterVolumeSpecName: "kube-api-access-dphf9") pod "1b9b11f5-9cc5-4a03-ba2b-c88812c251a5" (UID: "1b9b11f5-9cc5-4a03-ba2b-c88812c251a5"). InnerVolumeSpecName "kube-api-access-dphf9". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:23:56.816460 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:56.816348    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1b9b11f5-9cc5-4a03-ba2b-c88812c251a5-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1b9b11f5-9cc5-4a03-ba2b-c88812c251a5" (UID: "1b9b11f5-9cc5-4a03-ba2b-c88812c251a5"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:23:56.915298 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:56.915208    2559 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1b9b11f5-9cc5-4a03-ba2b-c88812c251a5-console-oauth-config\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:23:56.915298 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:56.915240    2559 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1b9b11f5-9cc5-4a03-ba2b-c88812c251a5-console-serving-cert\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:23:56.915298 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:56.915252    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dphf9\" (UniqueName: \"kubernetes.io/projected/1b9b11f5-9cc5-4a03-ba2b-c88812c251a5-kube-api-access-dphf9\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:23:56.915298 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:56.915269    2559 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1b9b11f5-9cc5-4a03-ba2b-c88812c251a5-service-ca\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:23:57.569519 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:57.569488    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-588bdf99f5-jcrtb" event={"ID":"1b9b11f5-9cc5-4a03-ba2b-c88812c251a5","Type":"ContainerDied","Data":"f469e979aacc2967502ab361e74ea86ab9058ebd3ead50da08bbedb8da6ccce0"}
Jul 15 12:23:57.570001 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:57.569545    2559 scope.go:117] "RemoveContainer" containerID="9c8dd9329e711c8007ba1195f4ad28a5abcd196d679683dfd6b6d1ba1210dfd0"
Jul 15 12:23:57.570001 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:57.569503    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-588bdf99f5-jcrtb"
Jul 15 12:23:57.593567 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:57.593541    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-588bdf99f5-jcrtb"]
Jul 15 12:23:57.598769 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:57.598749    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-588bdf99f5-jcrtb"]
Jul 15 12:23:58.582094 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:23:58.582057    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1b9b11f5-9cc5-4a03-ba2b-c88812c251a5" path="/var/lib/kubelet/pods/1b9b11f5-9cc5-4a03-ba2b-c88812c251a5/volumes"
Jul 15 12:24:21.861214 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:24:21.861170    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:24:21.876190 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:24:21.876165    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:24:22.044523 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:24:22.044447    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:22.669215 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:24:22.669185    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0"
Jul 15 12:24:26.982182 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:24:26.982144    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:27.160511 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:24:27.160474    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:54.262052 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:24:54.261976    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:56.272615 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:24:56.272584    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:57.864737 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:24:57.864702    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:57.964061 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:24:57.964031    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:59.086152 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:24:59.086114    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:24:59.282891 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:24:59.282860    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:00.163571 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:00.163538    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:00.307026 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:00.306993    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:02.506133 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:02.502263    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:02.764328 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:02.764246    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:04.865805 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:04.865777    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:04.967023 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:04.966988    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:06.781876 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:06.781844    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-9vjk2"]
Jul 15 12:25:06.782246 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:06.782109    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1b9b11f5-9cc5-4a03-ba2b-c88812c251a5" containerName="console"
Jul 15 12:25:06.782246 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:06.782119    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1b9b11f5-9cc5-4a03-ba2b-c88812c251a5" containerName="console"
Jul 15 12:25:06.782246 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:06.782169    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1b9b11f5-9cc5-4a03-ba2b-c88812c251a5" containerName="console"
Jul 15 12:25:06.785032 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:06.785014    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9vjk2"
Jul 15 12:25:06.790338 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:06.790321    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 15 12:25:06.790338 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:06.790327    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 15 12:25:06.791321 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:06.791303    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-28vtz\""
Jul 15 12:25:06.797779 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:06.797756    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-9vjk2"]
Jul 15 12:25:06.936120 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:06.936083    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5zqcc\" (UniqueName: \"kubernetes.io/projected/bcf53195-49a2-4d33-b9b7-5502088c1343-kube-api-access-5zqcc\") pod \"cert-manager-cainjector-559cdd8c87-9vjk2\" (UID: \"bcf53195-49a2-4d33-b9b7-5502088c1343\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9vjk2"
Jul 15 12:25:06.936279 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:06.936157    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bcf53195-49a2-4d33-b9b7-5502088c1343-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-9vjk2\" (UID: \"bcf53195-49a2-4d33-b9b7-5502088c1343\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9vjk2"
Jul 15 12:25:07.036932 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:07.036864    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5zqcc\" (UniqueName: \"kubernetes.io/projected/bcf53195-49a2-4d33-b9b7-5502088c1343-kube-api-access-5zqcc\") pod \"cert-manager-cainjector-559cdd8c87-9vjk2\" (UID: \"bcf53195-49a2-4d33-b9b7-5502088c1343\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9vjk2"
Jul 15 12:25:07.036932 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:07.036930    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bcf53195-49a2-4d33-b9b7-5502088c1343-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-9vjk2\" (UID: \"bcf53195-49a2-4d33-b9b7-5502088c1343\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9vjk2"
Jul 15 12:25:07.046555 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:07.046515    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/bcf53195-49a2-4d33-b9b7-5502088c1343-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-9vjk2\" (UID: \"bcf53195-49a2-4d33-b9b7-5502088c1343\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9vjk2"
Jul 15 12:25:07.046866 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:07.046848    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5zqcc\" (UniqueName: \"kubernetes.io/projected/bcf53195-49a2-4d33-b9b7-5502088c1343-kube-api-access-5zqcc\") pod \"cert-manager-cainjector-559cdd8c87-9vjk2\" (UID: \"bcf53195-49a2-4d33-b9b7-5502088c1343\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-9vjk2"
Jul 15 12:25:07.107801 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:07.107756    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9vjk2"
Jul 15 12:25:07.253621 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:07.253588    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-9vjk2"]
Jul 15 12:25:07.256909 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:25:07.256882    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbcf53195_49a2_4d33_b9b7_5502088c1343.slice/crio-8adad9bc3a9b10d35f5da2a02951369195105d4251d7e323269b2d87da71601f WatchSource:0}: Error finding container 8adad9bc3a9b10d35f5da2a02951369195105d4251d7e323269b2d87da71601f: Status 404 returned error can't find the container with id 8adad9bc3a9b10d35f5da2a02951369195105d4251d7e323269b2d87da71601f
Jul 15 12:25:07.808844 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:07.808804    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9vjk2" event={"ID":"bcf53195-49a2-4d33-b9b7-5502088c1343","Type":"ContainerStarted","Data":"8adad9bc3a9b10d35f5da2a02951369195105d4251d7e323269b2d87da71601f"}
Jul 15 12:25:09.839610 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:09.839576    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:10.068995 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:10.068960    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:10.823633 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:10.823589    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9vjk2" event={"ID":"bcf53195-49a2-4d33-b9b7-5502088c1343","Type":"ContainerStarted","Data":"fb9efa485bbaff6f919e6e90493d42ca11e1ff40ed8a9180e8b0efb50980c76a"}
Jul 15 12:25:11.005561 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:11.005521    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:11.086113 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:11.086002    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:11.699938 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:11.699880    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-9vjk2" podStartSLOduration=2.74041075 podStartE2EDuration="5.699860529s" totalImagesPullingTime="2.959449779s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:25:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:25:10.849642263 +0000 UTC m=+280.822213444" watchObservedRunningTime="2026-07-15 12:25:11.699860529 +0000 UTC m=+281.672431686"
Jul 15 12:25:11.700752 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:11.700735    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-cdkfw"]
Jul 15 12:25:11.703815 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:11.703800    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-cdkfw"
Jul 15 12:25:11.706407 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:11.706387    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-rk9xp\""
Jul 15 12:25:11.716056 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:11.716035    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-cdkfw"]
Jul 15 12:25:11.879637 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:11.879611    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a9bd29cc-6bfa-4b2e-afe7-f9db8cdb291b-bound-sa-token\") pod \"cert-manager-55b4d954d5-cdkfw\" (UID: \"a9bd29cc-6bfa-4b2e-afe7-f9db8cdb291b\") " pod="cert-manager/cert-manager-55b4d954d5-cdkfw"
Jul 15 12:25:11.879806 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:11.879663    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8g7q\" (UniqueName: \"kubernetes.io/projected/a9bd29cc-6bfa-4b2e-afe7-f9db8cdb291b-kube-api-access-q8g7q\") pod \"cert-manager-55b4d954d5-cdkfw\" (UID: \"a9bd29cc-6bfa-4b2e-afe7-f9db8cdb291b\") " pod="cert-manager/cert-manager-55b4d954d5-cdkfw"
Jul 15 12:25:11.980710 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:11.980674    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8g7q\" (UniqueName: \"kubernetes.io/projected/a9bd29cc-6bfa-4b2e-afe7-f9db8cdb291b-kube-api-access-q8g7q\") pod \"cert-manager-55b4d954d5-cdkfw\" (UID: \"a9bd29cc-6bfa-4b2e-afe7-f9db8cdb291b\") " pod="cert-manager/cert-manager-55b4d954d5-cdkfw"
Jul 15 12:25:11.980876 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:11.980743    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a9bd29cc-6bfa-4b2e-afe7-f9db8cdb291b-bound-sa-token\") pod \"cert-manager-55b4d954d5-cdkfw\" (UID: \"a9bd29cc-6bfa-4b2e-afe7-f9db8cdb291b\") " pod="cert-manager/cert-manager-55b4d954d5-cdkfw"
Jul 15 12:25:11.988816 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:11.988784    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/a9bd29cc-6bfa-4b2e-afe7-f9db8cdb291b-bound-sa-token\") pod \"cert-manager-55b4d954d5-cdkfw\" (UID: \"a9bd29cc-6bfa-4b2e-afe7-f9db8cdb291b\") " pod="cert-manager/cert-manager-55b4d954d5-cdkfw"
Jul 15 12:25:11.988816 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:11.988797    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8g7q\" (UniqueName: \"kubernetes.io/projected/a9bd29cc-6bfa-4b2e-afe7-f9db8cdb291b-kube-api-access-q8g7q\") pod \"cert-manager-55b4d954d5-cdkfw\" (UID: \"a9bd29cc-6bfa-4b2e-afe7-f9db8cdb291b\") " pod="cert-manager/cert-manager-55b4d954d5-cdkfw"
Jul 15 12:25:12.012259 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:12.012235    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-cdkfw"
Jul 15 12:25:12.135811 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:12.135785    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-cdkfw"]
Jul 15 12:25:12.138313 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:25:12.138279    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda9bd29cc_6bfa_4b2e_afe7_f9db8cdb291b.slice/crio-3c455c684c9035fd8dd8f2d0240a1ba017879770033a38c5743a3d6103e4dbf4 WatchSource:0}: Error finding container 3c455c684c9035fd8dd8f2d0240a1ba017879770033a38c5743a3d6103e4dbf4: Status 404 returned error can't find the container with id 3c455c684c9035fd8dd8f2d0240a1ba017879770033a38c5743a3d6103e4dbf4
Jul 15 12:25:12.832052 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:12.832011    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-cdkfw" event={"ID":"a9bd29cc-6bfa-4b2e-afe7-f9db8cdb291b","Type":"ContainerStarted","Data":"5fb18eb0ba4ab2b7db6c76ed3ee93614e6d888e9dac8eff713f3217662d7218b"}
Jul 15 12:25:12.832233 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:12.832062    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-cdkfw" event={"ID":"a9bd29cc-6bfa-4b2e-afe7-f9db8cdb291b","Type":"ContainerStarted","Data":"3c455c684c9035fd8dd8f2d0240a1ba017879770033a38c5743a3d6103e4dbf4"}
Jul 15 12:25:12.852562 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:12.852511    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-cdkfw" podStartSLOduration=1.8524938899999999 podStartE2EDuration="1.85249389s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:25:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:25:12.85159995 +0000 UTC m=+282.824171108" watchObservedRunningTime="2026-07-15 12:25:12.85249389 +0000 UTC m=+282.825065047"
Jul 15 12:25:13.477740 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:13.477677    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:13.577208 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:13.577179    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:19.467975 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:19.467941    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:19.679550 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:19.679518    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:21.130413 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:21.130372    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:26.209329 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:26.209285    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:30.408082 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:30.408051    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vp8z_009c50dc-2f9e-455b-95f2-a03e7ed3defd/ovn-acl-logging/0.log"
Jul 15 12:25:30.411969 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:30.411946    2559 kubelet.go:1648] "Image garbage collection succeeded"
Jul 15 12:25:30.412122 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:30.412004    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vp8z_009c50dc-2f9e-455b-95f2-a03e7ed3defd/ovn-acl-logging/0.log"
Jul 15 12:25:35.900813 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:35.900777    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:36.028318 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:36.028285    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:36.733136 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:36.733095    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:37.247271 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:37.247237    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:37.357203 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:37.357173    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:37.476025 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:37.475995    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f56ddd455-x5ptk"]
Jul 15 12:25:37.478149 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:37.478133    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5f56ddd455-x5ptk"
Jul 15 12:25:37.482333 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:37.482313    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-657ml\""
Jul 15 12:25:37.482456 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:37.482430    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 15 12:25:37.482567 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:37.482548    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 15 12:25:37.482675 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:37.482660    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 15 12:25:37.482925 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:37.482912    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 15 12:25:37.531422 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:37.531339    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f56ddd455-x5ptk"]
Jul 15 12:25:37.570094 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:37.570064    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/24648ba5-de32-4acd-bc6a-328322102365-tmp\") pod \"opendatahub-operator-controller-manager-5f56ddd455-x5ptk\" (UID: \"24648ba5-de32-4acd-bc6a-328322102365\") " pod="opendatahub/opendatahub-operator-controller-manager-5f56ddd455-x5ptk"
Jul 15 12:25:37.570236 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:37.570096    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/24648ba5-de32-4acd-bc6a-328322102365-manifests\") pod \"opendatahub-operator-controller-manager-5f56ddd455-x5ptk\" (UID: \"24648ba5-de32-4acd-bc6a-328322102365\") " pod="opendatahub/opendatahub-operator-controller-manager-5f56ddd455-x5ptk"
Jul 15 12:25:37.570236 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:37.570124    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/24648ba5-de32-4acd-bc6a-328322102365-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f56ddd455-x5ptk\" (UID: \"24648ba5-de32-4acd-bc6a-328322102365\") " pod="opendatahub/opendatahub-operator-controller-manager-5f56ddd455-x5ptk"
Jul 15 12:25:37.570236 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:37.570184    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/24648ba5-de32-4acd-bc6a-328322102365-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f56ddd455-x5ptk\" (UID: \"24648ba5-de32-4acd-bc6a-328322102365\") " pod="opendatahub/opendatahub-operator-controller-manager-5f56ddd455-x5ptk"
Jul 15 12:25:37.570236 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:37.570227    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jw5n9\" (UniqueName: \"kubernetes.io/projected/24648ba5-de32-4acd-bc6a-328322102365-kube-api-access-jw5n9\") pod \"opendatahub-operator-controller-manager-5f56ddd455-x5ptk\" (UID: \"24648ba5-de32-4acd-bc6a-328322102365\") " pod="opendatahub/opendatahub-operator-controller-manager-5f56ddd455-x5ptk"
Jul 15 12:25:37.670664 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:37.670634    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/24648ba5-de32-4acd-bc6a-328322102365-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f56ddd455-x5ptk\" (UID: \"24648ba5-de32-4acd-bc6a-328322102365\") " pod="opendatahub/opendatahub-operator-controller-manager-5f56ddd455-x5ptk"
Jul 15 12:25:37.670828 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:37.670677    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jw5n9\" (UniqueName: \"kubernetes.io/projected/24648ba5-de32-4acd-bc6a-328322102365-kube-api-access-jw5n9\") pod \"opendatahub-operator-controller-manager-5f56ddd455-x5ptk\" (UID: \"24648ba5-de32-4acd-bc6a-328322102365\") " pod="opendatahub/opendatahub-operator-controller-manager-5f56ddd455-x5ptk"
Jul 15 12:25:37.670828 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:37.670714    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/24648ba5-de32-4acd-bc6a-328322102365-tmp\") pod \"opendatahub-operator-controller-manager-5f56ddd455-x5ptk\" (UID: \"24648ba5-de32-4acd-bc6a-328322102365\") " pod="opendatahub/opendatahub-operator-controller-manager-5f56ddd455-x5ptk"
Jul 15 12:25:37.670828 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:37.670733    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/24648ba5-de32-4acd-bc6a-328322102365-manifests\") pod \"opendatahub-operator-controller-manager-5f56ddd455-x5ptk\" (UID: \"24648ba5-de32-4acd-bc6a-328322102365\") " pod="opendatahub/opendatahub-operator-controller-manager-5f56ddd455-x5ptk"
Jul 15 12:25:37.670828 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:37.670757    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/24648ba5-de32-4acd-bc6a-328322102365-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f56ddd455-x5ptk\" (UID: \"24648ba5-de32-4acd-bc6a-328322102365\") " pod="opendatahub/opendatahub-operator-controller-manager-5f56ddd455-x5ptk"
Jul 15 12:25:37.671153 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:37.671128    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/24648ba5-de32-4acd-bc6a-328322102365-manifests\") pod \"opendatahub-operator-controller-manager-5f56ddd455-x5ptk\" (UID: \"24648ba5-de32-4acd-bc6a-328322102365\") " pod="opendatahub/opendatahub-operator-controller-manager-5f56ddd455-x5ptk"
Jul 15 12:25:37.672816 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:37.672797    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/24648ba5-de32-4acd-bc6a-328322102365-tmp\") pod \"opendatahub-operator-controller-manager-5f56ddd455-x5ptk\" (UID: \"24648ba5-de32-4acd-bc6a-328322102365\") " pod="opendatahub/opendatahub-operator-controller-manager-5f56ddd455-x5ptk"
Jul 15 12:25:37.672961 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:37.672944    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/24648ba5-de32-4acd-bc6a-328322102365-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f56ddd455-x5ptk\" (UID: \"24648ba5-de32-4acd-bc6a-328322102365\") " pod="opendatahub/opendatahub-operator-controller-manager-5f56ddd455-x5ptk"
Jul 15 12:25:37.673119 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:37.673100    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/24648ba5-de32-4acd-bc6a-328322102365-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f56ddd455-x5ptk\" (UID: \"24648ba5-de32-4acd-bc6a-328322102365\") " pod="opendatahub/opendatahub-operator-controller-manager-5f56ddd455-x5ptk"
Jul 15 12:25:37.682817 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:37.682792    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jw5n9\" (UniqueName: \"kubernetes.io/projected/24648ba5-de32-4acd-bc6a-328322102365-kube-api-access-jw5n9\") pod \"opendatahub-operator-controller-manager-5f56ddd455-x5ptk\" (UID: \"24648ba5-de32-4acd-bc6a-328322102365\") " pod="opendatahub/opendatahub-operator-controller-manager-5f56ddd455-x5ptk"
Jul 15 12:25:37.787554 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:37.787463    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5f56ddd455-x5ptk"
Jul 15 12:25:37.834391 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:37.834340    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:37.937855 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:37.937823    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f56ddd455-x5ptk"]
Jul 15 12:25:37.941853 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:25:37.941827    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24648ba5_de32_4acd_bc6a_328322102365.slice/crio-5fb2d0deceb0d0f59e740f8f2f660f66407244fe24c958aa69112312b4cbb582 WatchSource:0}: Error finding container 5fb2d0deceb0d0f59e740f8f2f660f66407244fe24c958aa69112312b4cbb582: Status 404 returned error can't find the container with id 5fb2d0deceb0d0f59e740f8f2f660f66407244fe24c958aa69112312b4cbb582
Jul 15 12:25:37.943491 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:37.943474    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 12:25:38.007692 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:38.007663    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:38.108019 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:38.107939    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:38.211681 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:38.211640    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:38.309606 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:38.309576    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:38.934232 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:38.934189    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f56ddd455-x5ptk" event={"ID":"24648ba5-de32-4acd-bc6a-328322102365","Type":"ContainerStarted","Data":"5fb2d0deceb0d0f59e740f8f2f660f66407244fe24c958aa69112312b4cbb582"}
Jul 15 12:25:41.522731 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:41.522691    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:41.677288 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:41.677254    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:41.947883 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:41.947798    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f56ddd455-x5ptk" event={"ID":"24648ba5-de32-4acd-bc6a-328322102365","Type":"ContainerStarted","Data":"85e798b74895b3a427cb8646f07df01fb38bfb05168b68aac7fc31c2de137da8"}
Jul 15 12:25:42.953335 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:42.953301    2559 generic.go:356] "Generic (PLEG): container finished" podID="24648ba5-de32-4acd-bc6a-328322102365" containerID="85e798b74895b3a427cb8646f07df01fb38bfb05168b68aac7fc31c2de137da8" exitCode=0
Jul 15 12:25:42.953715 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:42.953345    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f56ddd455-x5ptk" event={"ID":"24648ba5-de32-4acd-bc6a-328322102365","Type":"ContainerDied","Data":"85e798b74895b3a427cb8646f07df01fb38bfb05168b68aac7fc31c2de137da8"}
Jul 15 12:25:43.959259 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:43.959226    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f56ddd455-x5ptk" event={"ID":"24648ba5-de32-4acd-bc6a-328322102365","Type":"ContainerStarted","Data":"cdbccaa24fdb083931d9233e09dd4f8de451fff79ac6d832d7f195cc253e8fea"}
Jul 15 12:25:43.959669 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:43.959357    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5f56ddd455-x5ptk"
Jul 15 12:25:43.987100 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:43.987056    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5f56ddd455-x5ptk" podStartSLOduration=2.339591448 podStartE2EDuration="6.98704056s" totalImagesPullingTime="3.58655255s" totalInitContainerRuntime="1.060896562s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:25:37 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:25:43.985736242 +0000 UTC m=+313.958307409" watchObservedRunningTime="2026-07-15 12:25:43.98704056 +0000 UTC m=+313.959611718"
Jul 15 12:25:54.965207 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:54.965176    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5f56ddd455-x5ptk"
Jul 15 12:25:57.037762 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:57.037728    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:57.285578 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:57.285547    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:57.762678 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:57.762642    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:57.855605 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:57.855575    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-6c484c84b4-5rh5h"]
Jul 15 12:25:57.861239 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:57.861215    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6c484c84b4-5rh5h"
Jul 15 12:25:57.866791 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:57.866764    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\""
Jul 15 12:25:57.866945 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:57.866767    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\""
Jul 15 12:25:57.867046 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:57.867031    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 15 12:25:57.867123 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:57.867102    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-jz64k\""
Jul 15 12:25:57.867180 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:57.867119    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 15 12:25:57.879083 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:57.879056    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6c484c84b4-5rh5h"]
Jul 15 12:25:57.936000 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:57.935967    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/22eac3d8-e8df-443c-99d0-15237dc20453-tls-certs\") pod \"kube-auth-proxy-6c484c84b4-5rh5h\" (UID: \"22eac3d8-e8df-443c-99d0-15237dc20453\") " pod="openshift-ingress/kube-auth-proxy-6c484c84b4-5rh5h"
Jul 15 12:25:57.936168 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:57.936012    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/22eac3d8-e8df-443c-99d0-15237dc20453-tmp\") pod \"kube-auth-proxy-6c484c84b4-5rh5h\" (UID: \"22eac3d8-e8df-443c-99d0-15237dc20453\") " pod="openshift-ingress/kube-auth-proxy-6c484c84b4-5rh5h"
Jul 15 12:25:57.936168 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:57.936078    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4hfbl\" (UniqueName: \"kubernetes.io/projected/22eac3d8-e8df-443c-99d0-15237dc20453-kube-api-access-4hfbl\") pod \"kube-auth-proxy-6c484c84b4-5rh5h\" (UID: \"22eac3d8-e8df-443c-99d0-15237dc20453\") " pod="openshift-ingress/kube-auth-proxy-6c484c84b4-5rh5h"
Jul 15 12:25:58.036835 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:58.036741    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4hfbl\" (UniqueName: \"kubernetes.io/projected/22eac3d8-e8df-443c-99d0-15237dc20453-kube-api-access-4hfbl\") pod \"kube-auth-proxy-6c484c84b4-5rh5h\" (UID: \"22eac3d8-e8df-443c-99d0-15237dc20453\") " pod="openshift-ingress/kube-auth-proxy-6c484c84b4-5rh5h"
Jul 15 12:25:58.036835 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:58.036806    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/22eac3d8-e8df-443c-99d0-15237dc20453-tls-certs\") pod \"kube-auth-proxy-6c484c84b4-5rh5h\" (UID: \"22eac3d8-e8df-443c-99d0-15237dc20453\") " pod="openshift-ingress/kube-auth-proxy-6c484c84b4-5rh5h"
Jul 15 12:25:58.037053 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:58.036855    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/22eac3d8-e8df-443c-99d0-15237dc20453-tmp\") pod \"kube-auth-proxy-6c484c84b4-5rh5h\" (UID: \"22eac3d8-e8df-443c-99d0-15237dc20453\") " pod="openshift-ingress/kube-auth-proxy-6c484c84b4-5rh5h"
Jul 15 12:25:58.039125 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:58.039099    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/22eac3d8-e8df-443c-99d0-15237dc20453-tmp\") pod \"kube-auth-proxy-6c484c84b4-5rh5h\" (UID: \"22eac3d8-e8df-443c-99d0-15237dc20453\") " pod="openshift-ingress/kube-auth-proxy-6c484c84b4-5rh5h"
Jul 15 12:25:58.039450 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:58.039235    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/22eac3d8-e8df-443c-99d0-15237dc20453-tls-certs\") pod \"kube-auth-proxy-6c484c84b4-5rh5h\" (UID: \"22eac3d8-e8df-443c-99d0-15237dc20453\") " pod="openshift-ingress/kube-auth-proxy-6c484c84b4-5rh5h"
Jul 15 12:25:58.055632 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:58.055602    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:58.058183 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:58.058155    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4hfbl\" (UniqueName: \"kubernetes.io/projected/22eac3d8-e8df-443c-99d0-15237dc20453-kube-api-access-4hfbl\") pod \"kube-auth-proxy-6c484c84b4-5rh5h\" (UID: \"22eac3d8-e8df-443c-99d0-15237dc20453\") " pod="openshift-ingress/kube-auth-proxy-6c484c84b4-5rh5h"
Jul 15 12:25:58.175027 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:58.174986    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-6c484c84b4-5rh5h"
Jul 15 12:25:58.218626 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:58.218595    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:58.354072 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:25:58.354041    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22eac3d8_e8df_443c_99d0_15237dc20453.slice/crio-b309eb5f6453b7a9b6b6f42c086ec3ed2754281b5dbd3542951d70b97093dfdc WatchSource:0}: Error finding container b309eb5f6453b7a9b6b6f42c086ec3ed2754281b5dbd3542951d70b97093dfdc: Status 404 returned error can't find the container with id b309eb5f6453b7a9b6b6f42c086ec3ed2754281b5dbd3542951d70b97093dfdc
Jul 15 12:25:58.365884 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:58.365859    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-6c484c84b4-5rh5h"]
Jul 15 12:25:58.573100 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:58.573058    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:58.850128 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:58.850096    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:25:59.013141 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:59.013108    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6c484c84b4-5rh5h" event={"ID":"22eac3d8-e8df-443c-99d0-15237dc20453","Type":"ContainerStarted","Data":"b309eb5f6453b7a9b6b6f42c086ec3ed2754281b5dbd3542951d70b97093dfdc"}
Jul 15 12:25:59.758463 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:25:59.758425    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:26:00.645095 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:26:00.645050    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:26:00.866791 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:26:00.866753    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:26:02.038234 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:26:02.038197    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-6c484c84b4-5rh5h" event={"ID":"22eac3d8-e8df-443c-99d0-15237dc20453","Type":"ContainerStarted","Data":"2cfd06ec1fcfb5b37b1a16bc4b8a85dd7ca49e5fd7164ae1ae34b35e69f508b8"}
Jul 15 12:26:02.059451 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:26:02.059397    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-6c484c84b4-5rh5h" podStartSLOduration=2.146791928 podStartE2EDuration="5.059359784s" totalImagesPullingTime="2.912567856s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:25:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:26:02.058488622 +0000 UTC m=+332.031059780" watchObservedRunningTime="2026-07-15 12:26:02.059359784 +0000 UTC m=+332.031930941"
Jul 15 12:26:02.705940 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:26:02.705906    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:26:06.472781 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:26:06.472746    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:26:06.613852 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:26:06.613820    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:26:06.715055 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:26:06.715022    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-595c7f4b4c-dc6tc"]
Jul 15 12:26:06.718280 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:26:06.718260    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-595c7f4b4c-dc6tc"
Jul 15 12:26:06.722628 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:26:06.722601    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\""
Jul 15 12:26:06.722750 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:26:06.722603    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\""
Jul 15 12:26:06.722750 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:26:06.722601    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-k2zm9\""
Jul 15 12:26:06.722750 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:26:06.722602    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 15 12:26:06.722750 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:26:06.722668    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 15 12:26:06.722967 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:26:06.722754    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\""
Jul 15 12:26:06.745698 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:26:06.745669    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-595c7f4b4c-dc6tc"]
Jul 15 12:26:06.816317 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:26:06.816282    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d033e7a0-e799-4c2a-841a-f44eb31eac6e-cert\") pod \"lws-controller-manager-595c7f4b4c-dc6tc\" (UID: \"d033e7a0-e799-4c2a-841a-f44eb31eac6e\") " pod="openshift-lws-operator/lws-controller-manager-595c7f4b4c-dc6tc"
Jul 15 12:26:06.816524 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:26:06.816340    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fr7rs\" (UniqueName: \"kubernetes.io/projected/d033e7a0-e799-4c2a-841a-f44eb31eac6e-kube-api-access-fr7rs\") pod \"lws-controller-manager-595c7f4b4c-dc6tc\" (UID: \"d033e7a0-e799-4c2a-841a-f44eb31eac6e\") " pod="openshift-lws-operator/lws-controller-manager-595c7f4b4c-dc6tc"
Jul 15 12:26:06.816524 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:26:06.816445    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d033e7a0-e799-4c2a-841a-f44eb31eac6e-manager-config\") pod \"lws-controller-manager-595c7f4b4c-dc6tc\" (UID: \"d033e7a0-e799-4c2a-841a-f44eb31eac6e\") " pod="openshift-lws-operator/lws-controller-manager-595c7f4b4c-dc6tc"
Jul 15 12:26:06.816524 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:26:06.816484    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d033e7a0-e799-4c2a-841a-f44eb31eac6e-metrics-cert\") pod \"lws-controller-manager-595c7f4b4c-dc6tc\" (UID: \"d033e7a0-e799-4c2a-841a-f44eb31eac6e\") " pod="openshift-lws-operator/lws-controller-manager-595c7f4b4c-dc6tc"
Jul 15 12:26:06.917843 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:26:06.917792    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d033e7a0-e799-4c2a-841a-f44eb31eac6e-metrics-cert\") pod \"lws-controller-manager-595c7f4b4c-dc6tc\" (UID: \"d033e7a0-e799-4c2a-841a-f44eb31eac6e\") " pod="openshift-lws-operator/lws-controller-manager-595c7f4b4c-dc6tc"
Jul 15 12:26:06.918029 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:26:06.917874    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d033e7a0-e799-4c2a-841a-f44eb31eac6e-cert\") pod \"lws-controller-manager-595c7f4b4c-dc6tc\" (UID: \"d033e7a0-e799-4c2a-841a-f44eb31eac6e\") " pod="openshift-lws-operator/lws-controller-manager-595c7f4b4c-dc6tc"
Jul 15 12:26:06.918029 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:26:06.917915    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fr7rs\" (UniqueName: \"kubernetes.io/projected/d033e7a0-e799-4c2a-841a-f44eb31eac6e-kube-api-access-fr7rs\") pod \"lws-controller-manager-595c7f4b4c-dc6tc\" (UID: \"d033e7a0-e799-4c2a-841a-f44eb31eac6e\") " pod="openshift-lws-operator/lws-controller-manager-595c7f4b4c-dc6tc"
Jul 15 12:26:06.918029 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:26:06.917942    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d033e7a0-e799-4c2a-841a-f44eb31eac6e-manager-config\") pod \"lws-controller-manager-595c7f4b4c-dc6tc\" (UID: \"d033e7a0-e799-4c2a-841a-f44eb31eac6e\") " pod="openshift-lws-operator/lws-controller-manager-595c7f4b4c-dc6tc"
Jul 15 12:26:06.918648 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:26:06.918617    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/d033e7a0-e799-4c2a-841a-f44eb31eac6e-manager-config\") pod \"lws-controller-manager-595c7f4b4c-dc6tc\" (UID: \"d033e7a0-e799-4c2a-841a-f44eb31eac6e\") " pod="openshift-lws-operator/lws-controller-manager-595c7f4b4c-dc6tc"
Jul 15 12:26:06.920381 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:26:06.920345    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/d033e7a0-e799-4c2a-841a-f44eb31eac6e-metrics-cert\") pod \"lws-controller-manager-595c7f4b4c-dc6tc\" (UID: \"d033e7a0-e799-4c2a-841a-f44eb31eac6e\") " pod="openshift-lws-operator/lws-controller-manager-595c7f4b4c-dc6tc"
Jul 15 12:26:06.920480 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:26:06.920385    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/d033e7a0-e799-4c2a-841a-f44eb31eac6e-cert\") pod \"lws-controller-manager-595c7f4b4c-dc6tc\" (UID: \"d033e7a0-e799-4c2a-841a-f44eb31eac6e\") " pod="openshift-lws-operator/lws-controller-manager-595c7f4b4c-dc6tc"
Jul 15 12:26:06.957007 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:26:06.956970    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fr7rs\" (UniqueName: \"kubernetes.io/projected/d033e7a0-e799-4c2a-841a-f44eb31eac6e-kube-api-access-fr7rs\") pod \"lws-controller-manager-595c7f4b4c-dc6tc\" (UID: \"d033e7a0-e799-4c2a-841a-f44eb31eac6e\") " pod="openshift-lws-operator/lws-controller-manager-595c7f4b4c-dc6tc"
Jul 15 12:26:07.027259 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:26:07.027168    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-595c7f4b4c-dc6tc"
Jul 15 12:26:07.199022 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:26:07.198995    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd033e7a0_e799_4c2a_841a_f44eb31eac6e.slice/crio-fb1c885e236136542c3611f726155a935574b50b5246bb2cad07e32f0adfbe8f WatchSource:0}: Error finding container fb1c885e236136542c3611f726155a935574b50b5246bb2cad07e32f0adfbe8f: Status 404 returned error can't find the container with id fb1c885e236136542c3611f726155a935574b50b5246bb2cad07e32f0adfbe8f
Jul 15 12:26:07.199140 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:26:07.199023    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-595c7f4b4c-dc6tc"]
Jul 15 12:26:08.064448 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:26:08.064398    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-595c7f4b4c-dc6tc" event={"ID":"d033e7a0-e799-4c2a-841a-f44eb31eac6e","Type":"ContainerStarted","Data":"fb1c885e236136542c3611f726155a935574b50b5246bb2cad07e32f0adfbe8f"}
Jul 15 12:26:08.489871 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:26:08.489837    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:26:08.824460 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:26:08.824351    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:26:09.165408 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:26:09.165298    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:26:10.074066 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:26:10.074032    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-595c7f4b4c-dc6tc" event={"ID":"d033e7a0-e799-4c2a-841a-f44eb31eac6e","Type":"ContainerStarted","Data":"a1bd298c500d8c85efd503e4dc93a256dda79d10364ce0e6bf09b588b11a4dfc"}
Jul 15 12:26:10.074279 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:26:10.074106    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-595c7f4b4c-dc6tc"
Jul 15 12:26:10.109919 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:26:10.109862    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-595c7f4b4c-dc6tc" podStartSLOduration=1.765003583 podStartE2EDuration="4.109845832s" totalImagesPullingTime="2.344842249s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:26:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:26:10.109415014 +0000 UTC m=+340.081986176" watchObservedRunningTime="2026-07-15 12:26:10.109845832 +0000 UTC m=+340.082416990"
Jul 15 12:26:10.695400 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:26:10.695345    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:26:10.886786 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:26:10.886755    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:26:10.991999 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:26:10.991961    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:26:11.176187 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:26:11.176152    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:26:12.214743 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:26:12.214709    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:26:12.445662 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:26:12.445628    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:26:18.470629 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:26:18.470595    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:26:21.079324 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:26:21.079286    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-595c7f4b4c-dc6tc"
Jul 15 12:26:22.333497 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:26:22.333412    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:26:22.442699 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:26:22.442661    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:26:24.376117 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:26:24.376082    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:26:24.477933 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:26:24.477902    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:26:35.978252 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:26:35.978218    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:26:36.116225 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:26:36.116193    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:26:58.758323 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:26:58.758289    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:26:59.074833 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:26:59.074752    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:26:59.809986 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:26:59.809951    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:27:00.422933 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:00.422902    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:27:24.909158 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:24.909123    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:27:28.238338 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:28.238302    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:27:31.375274 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:31.375239    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-69945c44d-xf8x8"]
Jul 15 12:27:31.378409 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:31.378390    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69945c44d-xf8x8"
Jul 15 12:27:31.385887 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:31.385866    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 15 12:27:31.386025 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:31.385893    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 15 12:27:31.386985 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:31.386969    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 15 12:27:31.387104 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:31.387089    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 15 12:27:31.387157 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:31.387145    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-w4w5h\""
Jul 15 12:27:31.387195 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:31.387180    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 15 12:27:31.401786 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:31.401761    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69945c44d-xf8x8"]
Jul 15 12:27:31.402260 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:31.402240    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 15 12:27:31.472124 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:31.472092    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:27:31.491080 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:31.491044    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f4b0861d-323c-4d1a-8bbe-b3de874b595d-console-config\") pod \"console-69945c44d-xf8x8\" (UID: \"f4b0861d-323c-4d1a-8bbe-b3de874b595d\") " pod="openshift-console/console-69945c44d-xf8x8"
Jul 15 12:27:31.491245 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:31.491101    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwcgq\" (UniqueName: \"kubernetes.io/projected/f4b0861d-323c-4d1a-8bbe-b3de874b595d-kube-api-access-pwcgq\") pod \"console-69945c44d-xf8x8\" (UID: \"f4b0861d-323c-4d1a-8bbe-b3de874b595d\") " pod="openshift-console/console-69945c44d-xf8x8"
Jul 15 12:27:31.491245 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:31.491148    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f4b0861d-323c-4d1a-8bbe-b3de874b595d-console-oauth-config\") pod \"console-69945c44d-xf8x8\" (UID: \"f4b0861d-323c-4d1a-8bbe-b3de874b595d\") " pod="openshift-console/console-69945c44d-xf8x8"
Jul 15 12:27:31.491245 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:31.491171    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f4b0861d-323c-4d1a-8bbe-b3de874b595d-console-serving-cert\") pod \"console-69945c44d-xf8x8\" (UID: \"f4b0861d-323c-4d1a-8bbe-b3de874b595d\") " pod="openshift-console/console-69945c44d-xf8x8"
Jul 15 12:27:31.491430 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:31.491263    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f4b0861d-323c-4d1a-8bbe-b3de874b595d-service-ca\") pod \"console-69945c44d-xf8x8\" (UID: \"f4b0861d-323c-4d1a-8bbe-b3de874b595d\") " pod="openshift-console/console-69945c44d-xf8x8"
Jul 15 12:27:31.491430 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:31.491302    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f4b0861d-323c-4d1a-8bbe-b3de874b595d-oauth-serving-cert\") pod \"console-69945c44d-xf8x8\" (UID: \"f4b0861d-323c-4d1a-8bbe-b3de874b595d\") " pod="openshift-console/console-69945c44d-xf8x8"
Jul 15 12:27:31.491430 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:31.491333    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4b0861d-323c-4d1a-8bbe-b3de874b595d-trusted-ca-bundle\") pod \"console-69945c44d-xf8x8\" (UID: \"f4b0861d-323c-4d1a-8bbe-b3de874b595d\") " pod="openshift-console/console-69945c44d-xf8x8"
Jul 15 12:27:31.560654 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:31.560620    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:27:31.592494 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:31.592462    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f4b0861d-323c-4d1a-8bbe-b3de874b595d-service-ca\") pod \"console-69945c44d-xf8x8\" (UID: \"f4b0861d-323c-4d1a-8bbe-b3de874b595d\") " pod="openshift-console/console-69945c44d-xf8x8"
Jul 15 12:27:31.592624 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:31.592501    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f4b0861d-323c-4d1a-8bbe-b3de874b595d-oauth-serving-cert\") pod \"console-69945c44d-xf8x8\" (UID: \"f4b0861d-323c-4d1a-8bbe-b3de874b595d\") " pod="openshift-console/console-69945c44d-xf8x8"
Jul 15 12:27:31.592624 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:31.592523    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4b0861d-323c-4d1a-8bbe-b3de874b595d-trusted-ca-bundle\") pod \"console-69945c44d-xf8x8\" (UID: \"f4b0861d-323c-4d1a-8bbe-b3de874b595d\") " pod="openshift-console/console-69945c44d-xf8x8"
Jul 15 12:27:31.592624 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:31.592553    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f4b0861d-323c-4d1a-8bbe-b3de874b595d-console-config\") pod \"console-69945c44d-xf8x8\" (UID: \"f4b0861d-323c-4d1a-8bbe-b3de874b595d\") " pod="openshift-console/console-69945c44d-xf8x8"
Jul 15 12:27:31.592624 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:31.592583    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwcgq\" (UniqueName: \"kubernetes.io/projected/f4b0861d-323c-4d1a-8bbe-b3de874b595d-kube-api-access-pwcgq\") pod \"console-69945c44d-xf8x8\" (UID: \"f4b0861d-323c-4d1a-8bbe-b3de874b595d\") " pod="openshift-console/console-69945c44d-xf8x8"
Jul 15 12:27:31.592624 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:31.592602    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f4b0861d-323c-4d1a-8bbe-b3de874b595d-console-oauth-config\") pod \"console-69945c44d-xf8x8\" (UID: \"f4b0861d-323c-4d1a-8bbe-b3de874b595d\") " pod="openshift-console/console-69945c44d-xf8x8"
Jul 15 12:27:31.592624 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:31.592619    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f4b0861d-323c-4d1a-8bbe-b3de874b595d-console-serving-cert\") pod \"console-69945c44d-xf8x8\" (UID: \"f4b0861d-323c-4d1a-8bbe-b3de874b595d\") " pod="openshift-console/console-69945c44d-xf8x8"
Jul 15 12:27:31.593328 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:31.593282    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/f4b0861d-323c-4d1a-8bbe-b3de874b595d-service-ca\") pod \"console-69945c44d-xf8x8\" (UID: \"f4b0861d-323c-4d1a-8bbe-b3de874b595d\") " pod="openshift-console/console-69945c44d-xf8x8"
Jul 15 12:27:31.593462 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:31.593417    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/f4b0861d-323c-4d1a-8bbe-b3de874b595d-oauth-serving-cert\") pod \"console-69945c44d-xf8x8\" (UID: \"f4b0861d-323c-4d1a-8bbe-b3de874b595d\") " pod="openshift-console/console-69945c44d-xf8x8"
Jul 15 12:27:31.593462 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:31.593432    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/f4b0861d-323c-4d1a-8bbe-b3de874b595d-console-config\") pod \"console-69945c44d-xf8x8\" (UID: \"f4b0861d-323c-4d1a-8bbe-b3de874b595d\") " pod="openshift-console/console-69945c44d-xf8x8"
Jul 15 12:27:31.593662 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:31.593645    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/f4b0861d-323c-4d1a-8bbe-b3de874b595d-trusted-ca-bundle\") pod \"console-69945c44d-xf8x8\" (UID: \"f4b0861d-323c-4d1a-8bbe-b3de874b595d\") " pod="openshift-console/console-69945c44d-xf8x8"
Jul 15 12:27:31.595069 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:31.595048    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/f4b0861d-323c-4d1a-8bbe-b3de874b595d-console-serving-cert\") pod \"console-69945c44d-xf8x8\" (UID: \"f4b0861d-323c-4d1a-8bbe-b3de874b595d\") " pod="openshift-console/console-69945c44d-xf8x8"
Jul 15 12:27:31.595158 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:31.595104    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/f4b0861d-323c-4d1a-8bbe-b3de874b595d-console-oauth-config\") pod \"console-69945c44d-xf8x8\" (UID: \"f4b0861d-323c-4d1a-8bbe-b3de874b595d\") " pod="openshift-console/console-69945c44d-xf8x8"
Jul 15 12:27:31.604973 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:31.604941    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwcgq\" (UniqueName: \"kubernetes.io/projected/f4b0861d-323c-4d1a-8bbe-b3de874b595d-kube-api-access-pwcgq\") pod \"console-69945c44d-xf8x8\" (UID: \"f4b0861d-323c-4d1a-8bbe-b3de874b595d\") " pod="openshift-console/console-69945c44d-xf8x8"
Jul 15 12:27:31.687426 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:31.687310    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69945c44d-xf8x8"
Jul 15 12:27:31.823578 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:31.823552    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69945c44d-xf8x8"]
Jul 15 12:27:31.826053 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:27:31.826026    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf4b0861d_323c_4d1a_8bbe_b3de874b595d.slice/crio-458fd1f89691068a695b2dbba6b671d500f38b6841d92890aab9bae59d8907cd WatchSource:0}: Error finding container 458fd1f89691068a695b2dbba6b671d500f38b6841d92890aab9bae59d8907cd: Status 404 returned error can't find the container with id 458fd1f89691068a695b2dbba6b671d500f38b6841d92890aab9bae59d8907cd
Jul 15 12:27:32.371336 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:32.371293    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69945c44d-xf8x8" event={"ID":"f4b0861d-323c-4d1a-8bbe-b3de874b595d","Type":"ContainerStarted","Data":"8a54b117bfc27f7969e8c10f83075bef4008806d33144a49daec50ffd129a4d0"}
Jul 15 12:27:32.371538 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:32.371358    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69945c44d-xf8x8" event={"ID":"f4b0861d-323c-4d1a-8bbe-b3de874b595d","Type":"ContainerStarted","Data":"458fd1f89691068a695b2dbba6b671d500f38b6841d92890aab9bae59d8907cd"}
Jul 15 12:27:32.400467 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:32.400379    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-69945c44d-xf8x8" podStartSLOduration=1.400345475 podStartE2EDuration="1.400345475s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:27:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:27:32.398243455 +0000 UTC m=+422.370814631" watchObservedRunningTime="2026-07-15 12:27:32.400345475 +0000 UTC m=+422.372916633"
Jul 15 12:27:32.495277 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:32.495241    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:27:35.059052 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:35.059020    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:27:36.706745 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:36.706710    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:27:38.103640 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:38.103609    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:27:39.629876 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:39.629845    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:27:39.916006 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:39.915919    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:27:40.260979 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:40.260945    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:27:41.687483 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:41.687440    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-69945c44d-xf8x8"
Jul 15 12:27:41.687861 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:41.687500    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-69945c44d-xf8x8"
Jul 15 12:27:41.692544 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:41.692521    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-69945c44d-xf8x8"
Jul 15 12:27:42.417675 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:42.417650    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-69945c44d-xf8x8"
Jul 15 12:27:42.777736 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:42.777699    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:27:42.962403 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:42.962356    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:27:43.154638 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:43.154555    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:27:43.480540 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:43.480507    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-mgc8t"]
Jul 15 12:27:43.483733 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:43.483717    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mgc8t"
Jul 15 12:27:43.486440 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:43.486347    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zfbzw\" (UniqueName: \"kubernetes.io/projected/2e4fa205-1279-4e67-bcf8-feb81a023b5b-kube-api-access-zfbzw\") pod \"authorino-operator-75cc8d5cb7-mgc8t\" (UID: \"2e4fa205-1279-4e67-bcf8-feb81a023b5b\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-mgc8t"
Jul 15 12:27:43.489116 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:43.489090    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 15 12:27:43.489241 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:43.489153    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-94fd6\""
Jul 15 12:27:43.490276 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:43.490257    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 15 12:27:43.506454 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:43.506425    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-mgc8t"]
Jul 15 12:27:43.587553 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:43.587516    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zfbzw\" (UniqueName: \"kubernetes.io/projected/2e4fa205-1279-4e67-bcf8-feb81a023b5b-kube-api-access-zfbzw\") pod \"authorino-operator-75cc8d5cb7-mgc8t\" (UID: \"2e4fa205-1279-4e67-bcf8-feb81a023b5b\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-mgc8t"
Jul 15 12:27:43.600893 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:43.600863    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zfbzw\" (UniqueName: \"kubernetes.io/projected/2e4fa205-1279-4e67-bcf8-feb81a023b5b-kube-api-access-zfbzw\") pod \"authorino-operator-75cc8d5cb7-mgc8t\" (UID: \"2e4fa205-1279-4e67-bcf8-feb81a023b5b\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-mgc8t"
Jul 15 12:27:43.794300 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:43.794211    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mgc8t"
Jul 15 12:27:43.932647 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:43.932616    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-mgc8t"]
Jul 15 12:27:43.936089 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:27:43.936060    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e4fa205_1279_4e67_bcf8_feb81a023b5b.slice/crio-3b2f4b2cf2f2343889a7da7a9f45e1f6c6c9717a8ffa1d570e083f1f6428e3b4 WatchSource:0}: Error finding container 3b2f4b2cf2f2343889a7da7a9f45e1f6c6c9717a8ffa1d570e083f1f6428e3b4: Status 404 returned error can't find the container with id 3b2f4b2cf2f2343889a7da7a9f45e1f6c6c9717a8ffa1d570e083f1f6428e3b4
Jul 15 12:27:44.427611 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:44.427573    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mgc8t" event={"ID":"2e4fa205-1279-4e67-bcf8-feb81a023b5b","Type":"ContainerStarted","Data":"3b2f4b2cf2f2343889a7da7a9f45e1f6c6c9717a8ffa1d570e083f1f6428e3b4"}
Jul 15 12:27:44.688408 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:44.688303    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:27:44.803318 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:44.803283    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:27:46.675318 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:46.675286    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:27:46.778524 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:46.778489    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:27:47.441786 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:47.441754    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mgc8t" event={"ID":"2e4fa205-1279-4e67-bcf8-feb81a023b5b","Type":"ContainerStarted","Data":"0c3eeb33372bc204758132941c3cbfcda40ea14e875f7e43348a2be9a43ff306"}
Jul 15 12:27:47.441947 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:47.441905    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mgc8t"
Jul 15 12:27:47.461806 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:47.461760    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mgc8t" podStartSLOduration=1.041416557 podStartE2EDuration="4.461742243s" totalImagesPullingTime="3.420325686s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:27:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:27:47.460483434 +0000 UTC m=+437.433054589" watchObservedRunningTime="2026-07-15 12:27:47.461742243 +0000 UTC m=+437.434313401"
Jul 15 12:27:48.592338 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:48.592290    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:27:48.981498 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:48.981466    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:27:51.838574 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:51.838534    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:27:51.920637 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:51.920603    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:27:58.448295 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:27:58.448261    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-mgc8t"
Jul 15 12:28:01.480171 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:28:01.480134    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:28:01.636687 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:28:01.636655    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:28:03.277918 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:28:03.277883    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:28:03.547188 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:28:03.547095    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:28:05.586513 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:28:05.586480    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:28:05.690969 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:28:05.690941    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:28:10.232316 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:28:10.232282    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:28:11.885467 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:28:11.885432    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:28:18.684907 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:28:18.684867    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:28:18.834666 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:28:18.834638    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:28:30.813760 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:28:30.813723    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:28:30.908200 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:28:30.908165    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:28:46.339587 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:28:46.339557    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:28:46.576868 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:28:46.576837    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:28:51.044105 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:28:51.044069    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:28:51.158017 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:28:51.157980    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:28:51.231550 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:28:51.231488    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:28:51.379461 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:28:51.379376    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:28:51.381547 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:28:51.381527    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-nbghp"
Jul 15 12:28:51.384557 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:28:51.384531    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 15 12:28:51.384673 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:28:51.384573    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-9hp94\""
Jul 15 12:28:51.391122 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:28:51.391095    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:28:51.411201 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:28:51.411171    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:28:51.457576 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:28:51.457541    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/15f9d695-6430-4f27-b41c-f3b93a14207f-config-file\") pod \"limitador-limitador-54d6d988d5-nbghp\" (UID: \"15f9d695-6430-4f27-b41c-f3b93a14207f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nbghp"
Jul 15 12:28:51.457757 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:28:51.457648    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5fw8r\" (UniqueName: \"kubernetes.io/projected/15f9d695-6430-4f27-b41c-f3b93a14207f-kube-api-access-5fw8r\") pod \"limitador-limitador-54d6d988d5-nbghp\" (UID: \"15f9d695-6430-4f27-b41c-f3b93a14207f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nbghp"
Jul 15 12:28:51.558418 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:28:51.558385    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/15f9d695-6430-4f27-b41c-f3b93a14207f-config-file\") pod \"limitador-limitador-54d6d988d5-nbghp\" (UID: \"15f9d695-6430-4f27-b41c-f3b93a14207f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nbghp"
Jul 15 12:28:51.558613 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:28:51.558458    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5fw8r\" (UniqueName: \"kubernetes.io/projected/15f9d695-6430-4f27-b41c-f3b93a14207f-kube-api-access-5fw8r\") pod \"limitador-limitador-54d6d988d5-nbghp\" (UID: \"15f9d695-6430-4f27-b41c-f3b93a14207f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nbghp"
Jul 15 12:28:51.559117 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:28:51.559088    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/15f9d695-6430-4f27-b41c-f3b93a14207f-config-file\") pod \"limitador-limitador-54d6d988d5-nbghp\" (UID: \"15f9d695-6430-4f27-b41c-f3b93a14207f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nbghp"
Jul 15 12:28:51.567268 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:28:51.567238    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5fw8r\" (UniqueName: \"kubernetes.io/projected/15f9d695-6430-4f27-b41c-f3b93a14207f-kube-api-access-5fw8r\") pod \"limitador-limitador-54d6d988d5-nbghp\" (UID: \"15f9d695-6430-4f27-b41c-f3b93a14207f\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-nbghp"
Jul 15 12:28:51.691373 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:28:51.691265    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-nbghp"
Jul 15 12:28:51.828441 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:28:51.828410    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:28:51.829333 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:28:51.829306    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod15f9d695_6430_4f27_b41c_f3b93a14207f.slice/crio-89c5788442caab78cf1d1d83e5560cc0e331aaa86a0eccacda0acb2bad3849e3 WatchSource:0}: Error finding container 89c5788442caab78cf1d1d83e5560cc0e331aaa86a0eccacda0acb2bad3849e3: Status 404 returned error can't find the container with id 89c5788442caab78cf1d1d83e5560cc0e331aaa86a0eccacda0acb2bad3849e3
Jul 15 12:28:51.929452 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:28:51.929401    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:28:52.006178 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:28:52.006149    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:28:52.060995 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:28:52.060961    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-w7xdd"]
Jul 15 12:28:52.063640 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:28:52.063616    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-w7xdd"
Jul 15 12:28:52.066397 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:28:52.066377    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-ffgw8\""
Jul 15 12:28:52.076013 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:28:52.075986    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-w7xdd"]
Jul 15 12:28:52.163962 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:28:52.163926    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tdmb5\" (UniqueName: \"kubernetes.io/projected/2066c8ee-6666-4fec-9bef-95fad07b9e81-kube-api-access-tdmb5\") pod \"authorino-75d556bd77-w7xdd\" (UID: \"2066c8ee-6666-4fec-9bef-95fad07b9e81\") " pod="kuadrant-system/authorino-75d556bd77-w7xdd"
Jul 15 12:28:52.264845 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:28:52.264767    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tdmb5\" (UniqueName: \"kubernetes.io/projected/2066c8ee-6666-4fec-9bef-95fad07b9e81-kube-api-access-tdmb5\") pod \"authorino-75d556bd77-w7xdd\" (UID: \"2066c8ee-6666-4fec-9bef-95fad07b9e81\") " pod="kuadrant-system/authorino-75d556bd77-w7xdd"
Jul 15 12:28:52.274379 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:28:52.274330    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tdmb5\" (UniqueName: \"kubernetes.io/projected/2066c8ee-6666-4fec-9bef-95fad07b9e81-kube-api-access-tdmb5\") pod \"authorino-75d556bd77-w7xdd\" (UID: \"2066c8ee-6666-4fec-9bef-95fad07b9e81\") " pod="kuadrant-system/authorino-75d556bd77-w7xdd"
Jul 15 12:28:52.373884 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:28:52.373828    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-w7xdd"
Jul 15 12:28:52.554623 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:28:52.554491    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-w7xdd"]
Jul 15 12:28:52.559934 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:28:52.559885    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2066c8ee_6666_4fec_9bef_95fad07b9e81.slice/crio-6b20bb864d7d36548cdc2344ee512100a30866f3aa164724155fae9c0bafae28 WatchSource:0}: Error finding container 6b20bb864d7d36548cdc2344ee512100a30866f3aa164724155fae9c0bafae28: Status 404 returned error can't find the container with id 6b20bb864d7d36548cdc2344ee512100a30866f3aa164724155fae9c0bafae28
Jul 15 12:28:52.704599 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:28:52.704563    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-w7xdd" event={"ID":"2066c8ee-6666-4fec-9bef-95fad07b9e81","Type":"ContainerStarted","Data":"6b20bb864d7d36548cdc2344ee512100a30866f3aa164724155fae9c0bafae28"}
Jul 15 12:28:52.705641 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:28:52.705615    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-nbghp" event={"ID":"15f9d695-6430-4f27-b41c-f3b93a14207f","Type":"ContainerStarted","Data":"89c5788442caab78cf1d1d83e5560cc0e331aaa86a0eccacda0acb2bad3849e3"}
Jul 15 12:28:55.588228 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:28:55.588188    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:28:55.784242 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:28:55.784209    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:28:56.726533 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:28:56.726501    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-w7xdd" event={"ID":"2066c8ee-6666-4fec-9bef-95fad07b9e81","Type":"ContainerStarted","Data":"f20db6858682825ad89595ee0fa673a28b98ac7e233ed835dd520ffbacd83f11"}
Jul 15 12:28:56.727986 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:28:56.727955    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-nbghp" event={"ID":"15f9d695-6430-4f27-b41c-f3b93a14207f","Type":"ContainerStarted","Data":"0582164432f73b9a3ca64c8d3b665b52285efd14aebfb75ec6b7a08672455ca2"}
Jul 15 12:28:56.728114 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:28:56.728028    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-nbghp"
Jul 15 12:28:56.750785 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:28:56.750729    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-w7xdd" podStartSLOduration=1.093896364 podStartE2EDuration="4.750713548s" totalImagesPullingTime="3.656817184s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:28:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:28:56.749544641 +0000 UTC m=+506.722115800" watchObservedRunningTime="2026-07-15 12:28:56.750713548 +0000 UTC m=+506.723284684"
Jul 15 12:28:56.779388 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:28:56.779306    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-nbghp" podStartSLOduration=1.4489229319999999 podStartE2EDuration="5.779288237s" totalImagesPullingTime="4.330365305s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:28:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:28:56.777966328 +0000 UTC m=+506.750537512" watchObservedRunningTime="2026-07-15 12:28:56.779288237 +0000 UTC m=+506.751859395"
Jul 15 12:29:07.732678 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:29:07.732648    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-nbghp"
Jul 15 12:29:12.465649 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:29:12.465616    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:29:12.626348 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:29:12.626315    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:29:13.110852 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:29:13.110814    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:29:27.485754 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:29:27.485656    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:29:28.258825 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:29:28.258784    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-586987bf69-mbpcs"]
Jul 15 12:29:28.262186 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:29:28.262161    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-586987bf69-mbpcs"
Jul 15 12:29:28.274117 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:29:28.274097    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\""
Jul 15 12:29:28.284888 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:29:28.284860    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-586987bf69-mbpcs"]
Jul 15 12:29:28.378921 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:29:28.378887    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qj2v4\" (UniqueName: \"kubernetes.io/projected/1d914b7e-58f9-42af-bc3d-8f6d7e14220e-kube-api-access-qj2v4\") pod \"authorino-586987bf69-mbpcs\" (UID: \"1d914b7e-58f9-42af-bc3d-8f6d7e14220e\") " pod="kuadrant-system/authorino-586987bf69-mbpcs"
Jul 15 12:29:28.379105 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:29:28.378941    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1d914b7e-58f9-42af-bc3d-8f6d7e14220e-tls-cert\") pod \"authorino-586987bf69-mbpcs\" (UID: \"1d914b7e-58f9-42af-bc3d-8f6d7e14220e\") " pod="kuadrant-system/authorino-586987bf69-mbpcs"
Jul 15 12:29:28.480062 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:29:28.479994    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qj2v4\" (UniqueName: \"kubernetes.io/projected/1d914b7e-58f9-42af-bc3d-8f6d7e14220e-kube-api-access-qj2v4\") pod \"authorino-586987bf69-mbpcs\" (UID: \"1d914b7e-58f9-42af-bc3d-8f6d7e14220e\") " pod="kuadrant-system/authorino-586987bf69-mbpcs"
Jul 15 12:29:28.480240 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:29:28.480077    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1d914b7e-58f9-42af-bc3d-8f6d7e14220e-tls-cert\") pod \"authorino-586987bf69-mbpcs\" (UID: \"1d914b7e-58f9-42af-bc3d-8f6d7e14220e\") " pod="kuadrant-system/authorino-586987bf69-mbpcs"
Jul 15 12:29:28.482505 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:29:28.482481    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1d914b7e-58f9-42af-bc3d-8f6d7e14220e-tls-cert\") pod \"authorino-586987bf69-mbpcs\" (UID: \"1d914b7e-58f9-42af-bc3d-8f6d7e14220e\") " pod="kuadrant-system/authorino-586987bf69-mbpcs"
Jul 15 12:29:28.489255 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:29:28.489231    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qj2v4\" (UniqueName: \"kubernetes.io/projected/1d914b7e-58f9-42af-bc3d-8f6d7e14220e-kube-api-access-qj2v4\") pod \"authorino-586987bf69-mbpcs\" (UID: \"1d914b7e-58f9-42af-bc3d-8f6d7e14220e\") " pod="kuadrant-system/authorino-586987bf69-mbpcs"
Jul 15 12:29:28.571266 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:29:28.571181    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-586987bf69-mbpcs"
Jul 15 12:29:28.703894 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:29:28.703861    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-586987bf69-mbpcs"]
Jul 15 12:29:28.707927 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:29:28.707901    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod1d914b7e_58f9_42af_bc3d_8f6d7e14220e.slice/crio-37fe2f7c23d0baf6b07670bb383cff4e50efe9a71bdc32014f85d86bcb4ba294 WatchSource:0}: Error finding container 37fe2f7c23d0baf6b07670bb383cff4e50efe9a71bdc32014f85d86bcb4ba294: Status 404 returned error can't find the container with id 37fe2f7c23d0baf6b07670bb383cff4e50efe9a71bdc32014f85d86bcb4ba294
Jul 15 12:29:28.860941 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:29:28.860856    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-586987bf69-mbpcs" event={"ID":"1d914b7e-58f9-42af-bc3d-8f6d7e14220e","Type":"ContainerStarted","Data":"37fe2f7c23d0baf6b07670bb383cff4e50efe9a71bdc32014f85d86bcb4ba294"}
Jul 15 12:29:29.866562 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:29:29.866526    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-586987bf69-mbpcs" event={"ID":"1d914b7e-58f9-42af-bc3d-8f6d7e14220e","Type":"ContainerStarted","Data":"4616c583a81b8e1d18d7bfe9305d641f844a8dde012678ee287d9850a92e3d9c"}
Jul 15 12:29:29.917175 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:29:29.917121    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-586987bf69-mbpcs" podStartSLOduration=1.279330396 podStartE2EDuration="1.917101981s" totalImagesPullingTime="637.771585ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:29:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:29:29.881270746 +0000 UTC m=+539.853841905" watchObservedRunningTime="2026-07-15 12:29:29.917101981 +0000 UTC m=+539.889673142"
Jul 15 12:29:29.917501 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:29:29.917485    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-w7xdd"]
Jul 15 12:29:29.917693 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:29:29.917673    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-w7xdd" podUID="2066c8ee-6666-4fec-9bef-95fad07b9e81" containerName="authorino" containerID="cri-o://f20db6858682825ad89595ee0fa673a28b98ac7e233ed835dd520ffbacd83f11" gracePeriod=30
Jul 15 12:29:30.159219 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:29:30.159192    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-w7xdd"
Jul 15 12:29:30.195424 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:29:30.195393    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tdmb5\" (UniqueName: \"kubernetes.io/projected/2066c8ee-6666-4fec-9bef-95fad07b9e81-kube-api-access-tdmb5\") pod \"2066c8ee-6666-4fec-9bef-95fad07b9e81\" (UID: \"2066c8ee-6666-4fec-9bef-95fad07b9e81\") "
Jul 15 12:29:30.197614 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:29:30.197591    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2066c8ee-6666-4fec-9bef-95fad07b9e81-kube-api-access-tdmb5" (OuterVolumeSpecName: "kube-api-access-tdmb5") pod "2066c8ee-6666-4fec-9bef-95fad07b9e81" (UID: "2066c8ee-6666-4fec-9bef-95fad07b9e81"). InnerVolumeSpecName "kube-api-access-tdmb5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:29:30.296180 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:29:30.296146    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tdmb5\" (UniqueName: \"kubernetes.io/projected/2066c8ee-6666-4fec-9bef-95fad07b9e81-kube-api-access-tdmb5\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:29:30.414584 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:29:30.414510    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:29:30.872013 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:29:30.871979    2559 generic.go:356] "Generic (PLEG): container finished" podID="2066c8ee-6666-4fec-9bef-95fad07b9e81" containerID="f20db6858682825ad89595ee0fa673a28b98ac7e233ed835dd520ffbacd83f11" exitCode=0
Jul 15 12:29:30.872496 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:29:30.872306    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-w7xdd" event={"ID":"2066c8ee-6666-4fec-9bef-95fad07b9e81","Type":"ContainerDied","Data":"f20db6858682825ad89595ee0fa673a28b98ac7e233ed835dd520ffbacd83f11"}
Jul 15 12:29:30.872496 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:29:30.872374    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-w7xdd"
Jul 15 12:29:30.872496 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:29:30.872402    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-w7xdd" event={"ID":"2066c8ee-6666-4fec-9bef-95fad07b9e81","Type":"ContainerDied","Data":"6b20bb864d7d36548cdc2344ee512100a30866f3aa164724155fae9c0bafae28"}
Jul 15 12:29:30.872661 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:29:30.872612    2559 scope.go:117] "RemoveContainer" containerID="f20db6858682825ad89595ee0fa673a28b98ac7e233ed835dd520ffbacd83f11"
Jul 15 12:29:30.885297 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:29:30.885280    2559 scope.go:117] "RemoveContainer" containerID="f20db6858682825ad89595ee0fa673a28b98ac7e233ed835dd520ffbacd83f11"
Jul 15 12:29:30.885596 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:29:30.885572    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f20db6858682825ad89595ee0fa673a28b98ac7e233ed835dd520ffbacd83f11\": container with ID starting with f20db6858682825ad89595ee0fa673a28b98ac7e233ed835dd520ffbacd83f11 not found: ID does not exist" containerID="f20db6858682825ad89595ee0fa673a28b98ac7e233ed835dd520ffbacd83f11"
Jul 15 12:29:30.885682 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:29:30.885605    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f20db6858682825ad89595ee0fa673a28b98ac7e233ed835dd520ffbacd83f11"} err="failed to get container status \"f20db6858682825ad89595ee0fa673a28b98ac7e233ed835dd520ffbacd83f11\": rpc error: code = NotFound desc = could not find container \"f20db6858682825ad89595ee0fa673a28b98ac7e233ed835dd520ffbacd83f11\": container with ID starting with f20db6858682825ad89595ee0fa673a28b98ac7e233ed835dd520ffbacd83f11 not found: ID does not exist"
Jul 15 12:29:30.892818 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:29:30.892797    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-w7xdd"]
Jul 15 12:29:30.896701 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:29:30.896682    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-w7xdd"]
Jul 15 12:29:32.585635 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:29:32.585603    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2066c8ee-6666-4fec-9bef-95fad07b9e81" path="/var/lib/kubelet/pods/2066c8ee-6666-4fec-9bef-95fad07b9e81/volumes"
Jul 15 12:29:34.971657 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:29:34.971625    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:29:35.092663 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:29:35.092628    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:29:35.204881 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:29:35.204844    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:29:35.301872 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:29:35.301789    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:29:38.457637 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:29:38.457600    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:29:38.583564 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:29:38.583534    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:30:01.051344 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:30:01.051308    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:30:10.427484 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:30:10.427447    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:30:10.531891 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:30:10.531845    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:30:10.921139 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:30:10.921102    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:30:11.445537 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:30:11.445505    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:30:12.005945 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:30:12.005914    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:30:12.123272 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:30:12.123235    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:30:12.207970 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:30:12.207935    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:30:21.580538 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:30:21.580502    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:30:21.736756 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:30:21.736726    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:30:26.127270 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:30:26.127234    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:30:26.625876 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:30:26.625830    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:30:30.434377 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:30:30.434329    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vp8z_009c50dc-2f9e-455b-95f2-a03e7ed3defd/ovn-acl-logging/0.log"
Jul 15 12:30:30.435451 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:30:30.435429    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vp8z_009c50dc-2f9e-455b-95f2-a03e7ed3defd/ovn-acl-logging/0.log"
Jul 15 12:30:36.838119 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:30:36.838081    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:30:37.684468 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:30:37.684434    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:30:41.929481 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:30:41.929447    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:30:42.642604 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:30:42.642569    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:30:46.752667 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:30:46.752631    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:30:48.656232 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:30:48.656199    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:31:17.584671 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:31:17.584635    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:31:19.641988 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:31:19.641945    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:31:21.574102 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:31:21.574065    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:31:25.197284 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:31:25.197249    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-44mnc"]
Jul 15 12:31:25.197676 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:31:25.197585    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2066c8ee-6666-4fec-9bef-95fad07b9e81" containerName="authorino"
Jul 15 12:31:25.197676 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:31:25.197597    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2066c8ee-6666-4fec-9bef-95fad07b9e81" containerName="authorino"
Jul 15 12:31:25.197676 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:31:25.197662    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2066c8ee-6666-4fec-9bef-95fad07b9e81" containerName="authorino"
Jul 15 12:31:25.199599 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:31:25.199582    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-44mnc"
Jul 15 12:31:25.206135 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:31:25.206105    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"premium-simulated-simulated-premium-kserve-self-signed-certs\""
Jul 15 12:31:25.206305 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:31:25.206164    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-f96dj\""
Jul 15 12:31:25.206305 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:31:25.206189    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 15 12:31:25.206305 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:31:25.206253    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 15 12:31:25.216122 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:31:25.216097    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-44mnc"]
Jul 15 12:31:25.251139 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:31:25.251111    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bwrc\" (UniqueName: \"kubernetes.io/projected/94bf6677-5a99-4a4a-8cf0-d64b7af3253d-kube-api-access-7bwrc\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-44mnc\" (UID: \"94bf6677-5a99-4a4a-8cf0-d64b7af3253d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-44mnc"
Jul 15 12:31:25.251290 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:31:25.251154    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/94bf6677-5a99-4a4a-8cf0-d64b7af3253d-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-44mnc\" (UID: \"94bf6677-5a99-4a4a-8cf0-d64b7af3253d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-44mnc"
Jul 15 12:31:25.251290 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:31:25.251202    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94bf6677-5a99-4a4a-8cf0-d64b7af3253d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-44mnc\" (UID: \"94bf6677-5a99-4a4a-8cf0-d64b7af3253d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-44mnc"
Jul 15 12:31:25.251290 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:31:25.251242    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/94bf6677-5a99-4a4a-8cf0-d64b7af3253d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-44mnc\" (UID: \"94bf6677-5a99-4a4a-8cf0-d64b7af3253d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-44mnc"
Jul 15 12:31:25.251290 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:31:25.251265    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94bf6677-5a99-4a4a-8cf0-d64b7af3253d-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-44mnc\" (UID: \"94bf6677-5a99-4a4a-8cf0-d64b7af3253d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-44mnc"
Jul 15 12:31:25.251290 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:31:25.251281    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/94bf6677-5a99-4a4a-8cf0-d64b7af3253d-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-44mnc\" (UID: \"94bf6677-5a99-4a4a-8cf0-d64b7af3253d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-44mnc"
Jul 15 12:31:25.288111 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:31:25.288079    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:31:25.352271 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:31:25.352240    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94bf6677-5a99-4a4a-8cf0-d64b7af3253d-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-44mnc\" (UID: \"94bf6677-5a99-4a4a-8cf0-d64b7af3253d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-44mnc"
Jul 15 12:31:25.352271 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:31:25.352275    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/94bf6677-5a99-4a4a-8cf0-d64b7af3253d-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-44mnc\" (UID: \"94bf6677-5a99-4a4a-8cf0-d64b7af3253d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-44mnc"
Jul 15 12:31:25.352553 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:31:25.352296    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bwrc\" (UniqueName: \"kubernetes.io/projected/94bf6677-5a99-4a4a-8cf0-d64b7af3253d-kube-api-access-7bwrc\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-44mnc\" (UID: \"94bf6677-5a99-4a4a-8cf0-d64b7af3253d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-44mnc"
Jul 15 12:31:25.352553 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:31:25.352322    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/94bf6677-5a99-4a4a-8cf0-d64b7af3253d-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-44mnc\" (UID: \"94bf6677-5a99-4a4a-8cf0-d64b7af3253d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-44mnc"
Jul 15 12:31:25.352553 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:31:25.352383    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94bf6677-5a99-4a4a-8cf0-d64b7af3253d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-44mnc\" (UID: \"94bf6677-5a99-4a4a-8cf0-d64b7af3253d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-44mnc"
Jul 15 12:31:25.352553 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:31:25.352409    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/94bf6677-5a99-4a4a-8cf0-d64b7af3253d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-44mnc\" (UID: \"94bf6677-5a99-4a4a-8cf0-d64b7af3253d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-44mnc"
Jul 15 12:31:25.352819 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:31:25.352796    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/94bf6677-5a99-4a4a-8cf0-d64b7af3253d-model-cache\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-44mnc\" (UID: \"94bf6677-5a99-4a4a-8cf0-d64b7af3253d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-44mnc"
Jul 15 12:31:25.352961 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:31:25.352843    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/94bf6677-5a99-4a4a-8cf0-d64b7af3253d-home\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-44mnc\" (UID: \"94bf6677-5a99-4a4a-8cf0-d64b7af3253d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-44mnc"
Jul 15 12:31:25.352961 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:31:25.352879    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/94bf6677-5a99-4a4a-8cf0-d64b7af3253d-tmp-dir\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-44mnc\" (UID: \"94bf6677-5a99-4a4a-8cf0-d64b7af3253d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-44mnc"
Jul 15 12:31:25.354658 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:31:25.354641    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/94bf6677-5a99-4a4a-8cf0-d64b7af3253d-dshm\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-44mnc\" (UID: \"94bf6677-5a99-4a4a-8cf0-d64b7af3253d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-44mnc"
Jul 15 12:31:25.354807 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:31:25.354791    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/94bf6677-5a99-4a4a-8cf0-d64b7af3253d-tls-certs\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-44mnc\" (UID: \"94bf6677-5a99-4a4a-8cf0-d64b7af3253d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-44mnc"
Jul 15 12:31:25.360333 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:31:25.360309    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bwrc\" (UniqueName: \"kubernetes.io/projected/94bf6677-5a99-4a4a-8cf0-d64b7af3253d-kube-api-access-7bwrc\") pod \"premium-simulated-simulated-premium-kserve-5fc6fb456f-44mnc\" (UID: \"94bf6677-5a99-4a4a-8cf0-d64b7af3253d\") " pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-44mnc"
Jul 15 12:31:25.513694 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:31:25.513653    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-44mnc"
Jul 15 12:31:25.647659 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:31:25.647628    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-44mnc"]
Jul 15 12:31:25.651141 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:31:25.651109    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod94bf6677_5a99_4a4a_8cf0_d64b7af3253d.slice/crio-55484bfde753176eef7f4665c458a36a44389948e7fdfa3fbe64da1953bb9af8 WatchSource:0}: Error finding container 55484bfde753176eef7f4665c458a36a44389948e7fdfa3fbe64da1953bb9af8: Status 404 returned error can't find the container with id 55484bfde753176eef7f4665c458a36a44389948e7fdfa3fbe64da1953bb9af8
Jul 15 12:31:25.652449 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:31:25.652430    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 12:31:26.346032 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:31:26.345993    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-44mnc" event={"ID":"94bf6677-5a99-4a4a-8cf0-d64b7af3253d","Type":"ContainerStarted","Data":"55484bfde753176eef7f4665c458a36a44389948e7fdfa3fbe64da1953bb9af8"}
Jul 15 12:31:27.351172 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:31:27.351139    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-44mnc" event={"ID":"94bf6677-5a99-4a4a-8cf0-d64b7af3253d","Type":"ContainerStarted","Data":"24492c926a6a1c934dd2d3eebc4d4659377960579131acc2c893ba8993e8bf96"}
Jul 15 12:31:27.371775 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:31:27.371728    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-44mnc" podStartSLOduration=1.386369263 podStartE2EDuration="2.371712769s" totalImagesPullingTime="985.343506ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:31:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:31:27.37022999 +0000 UTC m=+657.342801149" watchObservedRunningTime="2026-07-15 12:31:27.371712769 +0000 UTC m=+657.344283927"
Jul 15 12:31:28.629261 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:31:28.629227    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:31:35.514662 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:31:35.514604    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-44mnc"
Jul 15 12:31:35.514662 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:31:35.514673    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-44mnc"
Jul 15 12:31:35.527323 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:31:35.527300    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-44mnc"
Jul 15 12:31:36.404098 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:31:36.404070    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/premium-simulated-simulated-premium-kserve-5fc6fb456f-44mnc"
Jul 15 12:32:31.601543 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:32:31.601495    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5c6cd74488-hqw2x"]
Jul 15 12:32:31.604716 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:32:31.604695    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c6cd74488-hqw2x"
Jul 15 12:32:31.621833 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:32:31.621803    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5c6cd74488-hqw2x"]
Jul 15 12:32:31.710063 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:32:31.710028    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/37f90423-8f45-45cb-8bd6-b07c02618515-tls-cert\") pod \"authorino-5c6cd74488-hqw2x\" (UID: \"37f90423-8f45-45cb-8bd6-b07c02618515\") " pod="kuadrant-system/authorino-5c6cd74488-hqw2x"
Jul 15 12:32:31.710063 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:32:31.710064    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vd55\" (UniqueName: \"kubernetes.io/projected/37f90423-8f45-45cb-8bd6-b07c02618515-kube-api-access-2vd55\") pod \"authorino-5c6cd74488-hqw2x\" (UID: \"37f90423-8f45-45cb-8bd6-b07c02618515\") " pod="kuadrant-system/authorino-5c6cd74488-hqw2x"
Jul 15 12:32:31.811331 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:32:31.811281    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/37f90423-8f45-45cb-8bd6-b07c02618515-tls-cert\") pod \"authorino-5c6cd74488-hqw2x\" (UID: \"37f90423-8f45-45cb-8bd6-b07c02618515\") " pod="kuadrant-system/authorino-5c6cd74488-hqw2x"
Jul 15 12:32:31.811331 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:32:31.811333    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vd55\" (UniqueName: \"kubernetes.io/projected/37f90423-8f45-45cb-8bd6-b07c02618515-kube-api-access-2vd55\") pod \"authorino-5c6cd74488-hqw2x\" (UID: \"37f90423-8f45-45cb-8bd6-b07c02618515\") " pod="kuadrant-system/authorino-5c6cd74488-hqw2x"
Jul 15 12:32:31.813805 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:32:31.813774    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/37f90423-8f45-45cb-8bd6-b07c02618515-tls-cert\") pod \"authorino-5c6cd74488-hqw2x\" (UID: \"37f90423-8f45-45cb-8bd6-b07c02618515\") " pod="kuadrant-system/authorino-5c6cd74488-hqw2x"
Jul 15 12:32:31.825223 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:32:31.825192    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vd55\" (UniqueName: \"kubernetes.io/projected/37f90423-8f45-45cb-8bd6-b07c02618515-kube-api-access-2vd55\") pod \"authorino-5c6cd74488-hqw2x\" (UID: \"37f90423-8f45-45cb-8bd6-b07c02618515\") " pod="kuadrant-system/authorino-5c6cd74488-hqw2x"
Jul 15 12:32:31.914399 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:32:31.914294    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c6cd74488-hqw2x"
Jul 15 12:32:32.059652 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:32:32.059617    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:32:32.069317 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:32:32.069283    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5c6cd74488-hqw2x"]
Jul 15 12:32:32.167601 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:32:32.167507    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:32:32.641429 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:32:32.641378    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c6cd74488-hqw2x" event={"ID":"37f90423-8f45-45cb-8bd6-b07c02618515","Type":"ContainerStarted","Data":"7f7d9a1949991ccc0d003d3e085089308d122b2fd8b629585d765c4fdec636b6"}
Jul 15 12:32:32.641429 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:32:32.641443    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c6cd74488-hqw2x" event={"ID":"37f90423-8f45-45cb-8bd6-b07c02618515","Type":"ContainerStarted","Data":"4d765e34f2791012152c75d3dc3548d9debd4b6330a12c2b0955b26d87226c1a"}
Jul 15 12:32:32.674247 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:32:32.674190    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5c6cd74488-hqw2x" podStartSLOduration=1.213750234 podStartE2EDuration="1.674173377s" totalImagesPullingTime="460.423143ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:32:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:32:32.673807962 +0000 UTC m=+722.646379119" watchObservedRunningTime="2026-07-15 12:32:32.674173377 +0000 UTC m=+722.646744513"
Jul 15 12:32:32.717913 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:32:32.717870    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-586987bf69-mbpcs"]
Jul 15 12:32:32.718661 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:32:32.718624    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-586987bf69-mbpcs" podUID="1d914b7e-58f9-42af-bc3d-8f6d7e14220e" containerName="authorino" containerID="cri-o://4616c583a81b8e1d18d7bfe9305d641f844a8dde012678ee287d9850a92e3d9c" gracePeriod=30
Jul 15 12:32:32.974162 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:32:32.974137    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-586987bf69-mbpcs"
Jul 15 12:32:33.020565 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:32:33.020529    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qj2v4\" (UniqueName: \"kubernetes.io/projected/1d914b7e-58f9-42af-bc3d-8f6d7e14220e-kube-api-access-qj2v4\") pod \"1d914b7e-58f9-42af-bc3d-8f6d7e14220e\" (UID: \"1d914b7e-58f9-42af-bc3d-8f6d7e14220e\") "
Jul 15 12:32:33.020742 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:32:33.020623    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1d914b7e-58f9-42af-bc3d-8f6d7e14220e-tls-cert\") pod \"1d914b7e-58f9-42af-bc3d-8f6d7e14220e\" (UID: \"1d914b7e-58f9-42af-bc3d-8f6d7e14220e\") "
Jul 15 12:32:33.022751 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:32:33.022719    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1d914b7e-58f9-42af-bc3d-8f6d7e14220e-kube-api-access-qj2v4" (OuterVolumeSpecName: "kube-api-access-qj2v4") pod "1d914b7e-58f9-42af-bc3d-8f6d7e14220e" (UID: "1d914b7e-58f9-42af-bc3d-8f6d7e14220e"). InnerVolumeSpecName "kube-api-access-qj2v4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:32:33.030239 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:32:33.030196    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1d914b7e-58f9-42af-bc3d-8f6d7e14220e-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "1d914b7e-58f9-42af-bc3d-8f6d7e14220e" (UID: "1d914b7e-58f9-42af-bc3d-8f6d7e14220e"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:32:33.121994 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:32:33.121909    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qj2v4\" (UniqueName: \"kubernetes.io/projected/1d914b7e-58f9-42af-bc3d-8f6d7e14220e-kube-api-access-qj2v4\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:32:33.121994 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:32:33.121943    2559 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/1d914b7e-58f9-42af-bc3d-8f6d7e14220e-tls-cert\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:32:33.188501 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:32:33.188461    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:32:33.329382 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:32:33.329341    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:32:33.646403 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:32:33.646348    2559 generic.go:356] "Generic (PLEG): container finished" podID="1d914b7e-58f9-42af-bc3d-8f6d7e14220e" containerID="4616c583a81b8e1d18d7bfe9305d641f844a8dde012678ee287d9850a92e3d9c" exitCode=0
Jul 15 12:32:33.646403 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:32:33.646406    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-586987bf69-mbpcs"
Jul 15 12:32:33.646883 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:32:33.646439    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-586987bf69-mbpcs" event={"ID":"1d914b7e-58f9-42af-bc3d-8f6d7e14220e","Type":"ContainerDied","Data":"4616c583a81b8e1d18d7bfe9305d641f844a8dde012678ee287d9850a92e3d9c"}
Jul 15 12:32:33.646883 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:32:33.646481    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-586987bf69-mbpcs" event={"ID":"1d914b7e-58f9-42af-bc3d-8f6d7e14220e","Type":"ContainerDied","Data":"37fe2f7c23d0baf6b07670bb383cff4e50efe9a71bdc32014f85d86bcb4ba294"}
Jul 15 12:32:33.646883 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:32:33.646503    2559 scope.go:117] "RemoveContainer" containerID="4616c583a81b8e1d18d7bfe9305d641f844a8dde012678ee287d9850a92e3d9c"
Jul 15 12:32:33.655836 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:32:33.655812    2559 scope.go:117] "RemoveContainer" containerID="4616c583a81b8e1d18d7bfe9305d641f844a8dde012678ee287d9850a92e3d9c"
Jul 15 12:32:33.656127 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:32:33.656104    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4616c583a81b8e1d18d7bfe9305d641f844a8dde012678ee287d9850a92e3d9c\": container with ID starting with 4616c583a81b8e1d18d7bfe9305d641f844a8dde012678ee287d9850a92e3d9c not found: ID does not exist" containerID="4616c583a81b8e1d18d7bfe9305d641f844a8dde012678ee287d9850a92e3d9c"
Jul 15 12:32:33.656197 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:32:33.656135    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4616c583a81b8e1d18d7bfe9305d641f844a8dde012678ee287d9850a92e3d9c"} err="failed to get container status \"4616c583a81b8e1d18d7bfe9305d641f844a8dde012678ee287d9850a92e3d9c\": rpc error: code = NotFound desc = could not find container \"4616c583a81b8e1d18d7bfe9305d641f844a8dde012678ee287d9850a92e3d9c\": container with ID starting with 4616c583a81b8e1d18d7bfe9305d641f844a8dde012678ee287d9850a92e3d9c not found: ID does not exist"
Jul 15 12:32:33.684845 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:32:33.684815    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-586987bf69-mbpcs"]
Jul 15 12:32:33.709505 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:32:33.709478    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-586987bf69-mbpcs"]
Jul 15 12:32:34.584933 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:32:34.584897    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1d914b7e-58f9-42af-bc3d-8f6d7e14220e" path="/var/lib/kubelet/pods/1d914b7e-58f9-42af-bc3d-8f6d7e14220e/volumes"
Jul 15 12:32:52.114562 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:32:52.114532    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:32:55.331185 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:32:55.331153    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:33:26.496803 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:33:26.496762    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:33:36.030581 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:33:36.030542    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:33:45.722336 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:33:45.722298    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:33:56.032253 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:33:56.032173    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:34:06.447566 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:34:06.447524    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:34:08.712084 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:34:08.712050    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:34:10.187748 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:34:10.187706    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:34:29.728638 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:34:29.728601    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:34:38.985857 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:34:38.985820    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:34:49.814746 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:34:49.814710    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:35:00.047093 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:35:00.047052    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:35:00.154648 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:35:00.154609    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:35:00.296960 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:35:00.296921    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:35:06.680768 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:35:06.680732    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:35:11.893653 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:35:11.893617    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:35:13.094140 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:35:13.094109    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:35:13.192398 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:35:13.192347    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:35:30.458982 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:35:30.458950    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vp8z_009c50dc-2f9e-455b-95f2-a03e7ed3defd/ovn-acl-logging/0.log"
Jul 15 12:35:30.459504 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:35:30.459484    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vp8z_009c50dc-2f9e-455b-95f2-a03e7ed3defd/ovn-acl-logging/0.log"
Jul 15 12:35:30.520344 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:35:30.520308    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:35:40.144348 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:35:40.144317    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:35:40.245969 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:35:40.245936    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:35:41.024925 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:35:41.024878    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:35:53.732927 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:35:53.732877    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:36:01.055413 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:36:01.055376    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:36:11.739308 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:36:11.738281    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:36:22.726346 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:36:22.726298    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:36:33.515611 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:36:33.515576    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:36:42.924140 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:36:42.924106    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:37:06.527116 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:37:06.527079    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:37:17.122385 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:37:17.122340    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:37:40.927733 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:37:40.927694    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:37:51.733554 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:37:51.733516    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:38:08.425280 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:38:08.425243    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:38:16.518274 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:38:16.518237    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:38:27.811696 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:38:27.811614    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:38:37.911818 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:38:37.911783    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:38:48.525483 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:38:48.525451    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:40:13.549338 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:40:13.549307    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:40:30.481935 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:40:30.481908    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vp8z_009c50dc-2f9e-455b-95f2-a03e7ed3defd/ovn-acl-logging/0.log"
Jul 15 12:40:30.484847 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:40:30.484828    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vp8z_009c50dc-2f9e-455b-95f2-a03e7ed3defd/ovn-acl-logging/0.log"
Jul 15 12:40:37.318348 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:40:37.318306    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:40:48.329677 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:40:48.329638    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:40:57.315650 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:40:57.315613    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:41:11.627607 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:41:11.627568    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:41:21.020935 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:41:21.020900    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:41:29.958448 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:41:29.958415    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:41:40.125722 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:41:40.125689    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:41:50.156241 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:41:50.156205    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:42:02.345568 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:42:02.345534    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:42:11.011679 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:42:11.011644    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:42:23.387508 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:42:23.387461    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:42:36.709422 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:42:36.709355    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:42:43.409441 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:42:43.409402    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:42:52.534638 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:42:52.534557    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:43:02.953545 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:43:02.953510    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:43:13.338469 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:43:13.338431    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:43:22.744570 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:43:22.744535    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:43:36.053216 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:43:36.053180    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:43:47.862751 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:43:47.862717    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:43:56.737883 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:43:56.737847    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:44:07.718508 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:44:07.718475    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:44:08.632915 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:44:08.632876    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:44:08.723190 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:44:08.723157    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:44:09.725206 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:44:09.725172    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:44:16.621676 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:44:16.621641    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:44:26.429918 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:44:26.429833    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:44:41.024781 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:44:41.024743    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:44:50.224468 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:44:50.224431    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:44:59.661065 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:44:59.661025    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:45:12.222602 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:45:12.222566    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:45:23.054253 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:45:23.054217    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:45:30.505593 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:45:30.505566    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vp8z_009c50dc-2f9e-455b-95f2-a03e7ed3defd/ovn-acl-logging/0.log"
Jul 15 12:45:30.509563 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:45:30.509541    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vp8z_009c50dc-2f9e-455b-95f2-a03e7ed3defd/ovn-acl-logging/0.log"
Jul 15 12:45:31.912926 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:45:31.912892    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:45:43.923942 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:45:43.923905    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:45:55.656783 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:45:55.656694    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:46:06.822344 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:46:06.822308    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:46:14.072191 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:46:14.072154    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:46:15.399523 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:46:15.399490    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:46:17.937381 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:46:17.937331    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:46:18.038241 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:46:18.038210    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:46:18.192488 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:46:18.192418    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:46:18.278923 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:46:18.278888    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:46:19.385792 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:46:19.385759    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:46:19.484613 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:46:19.484582    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:46:19.582753 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:46:19.582703    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:46:19.893618 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:46:19.893592    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:46:20.178511 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:46:20.178417    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:46:20.278927 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:46:20.278896    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:46:22.123035 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:46:22.123004    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:46:22.293464 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:46:22.293423    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:46:35.199070 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:46:35.199030    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:46:39.565088 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:46:39.565055    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:46:40.225668 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:46:40.225629    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:46:46.597014 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:46:46.596975    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:46:46.697585 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:46:46.697551    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:46:49.783076 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:46:49.783046    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:46:51.564823 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:46:51.564768    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:46:51.667699 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:46:51.667660    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:46:51.747300 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:46:51.747265    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:46:51.917518 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:46:51.917442    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:46:52.437588 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:46:52.437553    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:46:52.535658 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:46:52.535628    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:46:53.723017 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:46:53.722984    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:46:56.177430 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:46:56.177398    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-907cfafc-8mrcv"]
Jul 15 12:46:56.177794 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:46:56.177695    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1d914b7e-58f9-42af-bc3d-8f6d7e14220e" containerName="authorino"
Jul 15 12:46:56.177794 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:46:56.177704    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="1d914b7e-58f9-42af-bc3d-8f6d7e14220e" containerName="authorino"
Jul 15 12:46:56.177794 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:46:56.177761    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="1d914b7e-58f9-42af-bc3d-8f6d7e14220e" containerName="authorino"
Jul 15 12:46:56.180712 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:46:56.180696    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-907cfafc-8mrcv"
Jul 15 12:46:56.184671 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:46:56.184648    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-267b6\""
Jul 15 12:46:56.184793 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:46:56.184723    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 12:46:56.191841 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:46:56.191818    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-907cfafc-8mrcv"]
Jul 15 12:46:56.271520 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:46:56.271481    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/54dcf7ed-334d-40d7-801f-0e5d9a8a2a73-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-907cfafc-8mrcv\" (UID: \"54dcf7ed-334d-40d7-801f-0e5d9a8a2a73\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-907cfafc-8mrcv"
Jul 15 12:46:56.372719 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:46:56.372673    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/54dcf7ed-334d-40d7-801f-0e5d9a8a2a73-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-907cfafc-8mrcv\" (UID: \"54dcf7ed-334d-40d7-801f-0e5d9a8a2a73\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-907cfafc-8mrcv"
Jul 15 12:46:56.373291 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:46:56.373271    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/54dcf7ed-334d-40d7-801f-0e5d9a8a2a73-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-migrate-907cfafc-8mrcv\" (UID: \"54dcf7ed-334d-40d7-801f-0e5d9a8a2a73\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-907cfafc-8mrcv"
Jul 15 12:46:56.491498 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:46:56.491462    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-907cfafc-8mrcv"
Jul 15 12:46:56.566607 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:46:56.566571    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:46:56.624338 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:46:56.624316    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-907cfafc-8mrcv"]
Jul 15 12:46:56.626333 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:46:56.626308    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod54dcf7ed_334d_40d7_801f_0e5d9a8a2a73.slice/crio-0f6151f72670961d64fd108870b7f767e3fa46ef9b10bc9cfddbbfbbab84d0b5 WatchSource:0}: Error finding container 0f6151f72670961d64fd108870b7f767e3fa46ef9b10bc9cfddbbfbbab84d0b5: Status 404 returned error can't find the container with id 0f6151f72670961d64fd108870b7f767e3fa46ef9b10bc9cfddbbfbbab84d0b5
Jul 15 12:46:56.628199 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:46:56.628182    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 12:46:56.664148 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:46:56.664114    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:46:57.300056 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:46:57.300018    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-907cfafc-8mrcv" event={"ID":"54dcf7ed-334d-40d7-801f-0e5d9a8a2a73","Type":"ContainerStarted","Data":"0f6151f72670961d64fd108870b7f767e3fa46ef9b10bc9cfddbbfbbab84d0b5"}
Jul 15 12:46:59.310559 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:46:59.310525    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-907cfafc-8mrcv" event={"ID":"54dcf7ed-334d-40d7-801f-0e5d9a8a2a73","Type":"ContainerStarted","Data":"fdb437cf96db932c34d95e098b8efbbbea338fe2e26f38526e990416641b7fb9"}
Jul 15 12:46:59.329040 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:46:59.328984    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-907cfafc-8mrcv" podStartSLOduration=1.216452616 podStartE2EDuration="3.32896966s" totalImagesPullingTime="2.112517044s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:46:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:46:59.327102506 +0000 UTC m=+1589.299673664" watchObservedRunningTime="2026-07-15 12:46:59.32896966 +0000 UTC m=+1589.301540817"
Jul 15 12:46:59.834654 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:46:59.834617    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:47:00.316521 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:47:00.316481    2559 generic.go:356] "Generic (PLEG): container finished" podID="54dcf7ed-334d-40d7-801f-0e5d9a8a2a73" containerID="fdb437cf96db932c34d95e098b8efbbbea338fe2e26f38526e990416641b7fb9" exitCode=0
Jul 15 12:47:00.316521 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:47:00.316526    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-907cfafc-8mrcv" event={"ID":"54dcf7ed-334d-40d7-801f-0e5d9a8a2a73","Type":"ContainerDied","Data":"fdb437cf96db932c34d95e098b8efbbbea338fe2e26f38526e990416641b7fb9"}
Jul 15 12:47:01.451426 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:47:01.451402    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-907cfafc-8mrcv"
Jul 15 12:47:01.620082 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:47:01.619982    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/54dcf7ed-334d-40d7-801f-0e5d9a8a2a73-maas-api-service-ca\") pod \"54dcf7ed-334d-40d7-801f-0e5d9a8a2a73\" (UID: \"54dcf7ed-334d-40d7-801f-0e5d9a8a2a73\") "
Jul 15 12:47:01.620406 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:47:01.620356    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/54dcf7ed-334d-40d7-801f-0e5d9a8a2a73-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "54dcf7ed-334d-40d7-801f-0e5d9a8a2a73" (UID: "54dcf7ed-334d-40d7-801f-0e5d9a8a2a73"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:47:01.721528 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:47:01.721492    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/54dcf7ed-334d-40d7-801f-0e5d9a8a2a73-maas-api-service-ca\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:47:02.325593 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:47:02.325554    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-907cfafc-8mrcv" event={"ID":"54dcf7ed-334d-40d7-801f-0e5d9a8a2a73","Type":"ContainerDied","Data":"0f6151f72670961d64fd108870b7f767e3fa46ef9b10bc9cfddbbfbbab84d0b5"}
Jul 15 12:47:02.325764 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:47:02.325612    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="0f6151f72670961d64fd108870b7f767e3fa46ef9b10bc9cfddbbfbbab84d0b5"
Jul 15 12:47:02.325764 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:47:02.325568    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-migrate-907cfafc-8mrcv"
Jul 15 12:47:06.803527 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:47:06.803490    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:47:09.615378 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:47:09.615341    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:47:11.282439 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:47:11.282404    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:47:17.869322 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:47:17.869285    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:47:17.947067 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:47:17.947040    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:47:21.523016 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:47:21.522987    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:47:21.893784 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:47:21.893755    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:47:23.150259 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:47:23.150230    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:47:23.291281 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:47:23.291244    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:47:23.479723 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:47:23.479695    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:47:23.735651 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:47:23.735573    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:47:24.144980 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:47:24.144899    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:47:24.250048 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:47:24.250014    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:47:25.741093 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:47:25.741063    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:47:28.232838 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:47:28.232802    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-691083d1-57zgq"]
Jul 15 12:47:28.233213 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:47:28.233137    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="54dcf7ed-334d-40d7-801f-0e5d9a8a2a73" containerName="revoke-keys"
Jul 15 12:47:28.233213 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:47:28.233149    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="54dcf7ed-334d-40d7-801f-0e5d9a8a2a73" containerName="revoke-keys"
Jul 15 12:47:28.233213 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:47:28.233197    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="54dcf7ed-334d-40d7-801f-0e5d9a8a2a73" containerName="revoke-keys"
Jul 15 12:47:28.239822 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:47:28.239797    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-691083d1-57zgq"
Jul 15 12:47:28.243264 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:47:28.243244    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-267b6\""
Jul 15 12:47:28.243869 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:47:28.243848    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 12:47:28.245047 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:47:28.244941    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-691083d1-57zgq"]
Jul 15 12:47:28.294327 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:47:28.294291    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:47:28.340090 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:47:28.340051    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1444c41-e1f4-48a8-bbf2-096dcfa4ce02-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-691083d1-57zgq\" (UID: \"f1444c41-e1f4-48a8-bbf2-096dcfa4ce02\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-691083d1-57zgq"
Jul 15 12:47:28.394795 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:47:28.394763    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:47:28.440955 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:47:28.440926    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1444c41-e1f4-48a8-bbf2-096dcfa4ce02-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-691083d1-57zgq\" (UID: \"f1444c41-e1f4-48a8-bbf2-096dcfa4ce02\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-691083d1-57zgq"
Jul 15 12:47:28.441568 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:47:28.441550    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1444c41-e1f4-48a8-bbf2-096dcfa4ce02-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-691083d1-57zgq\" (UID: \"f1444c41-e1f4-48a8-bbf2-096dcfa4ce02\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-691083d1-57zgq"
Jul 15 12:47:28.551599 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:47:28.551514    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-691083d1-57zgq"
Jul 15 12:47:28.680504 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:47:28.680480    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-691083d1-57zgq"]
Jul 15 12:47:28.682778 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:47:28.682744    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf1444c41_e1f4_48a8_bbf2_096dcfa4ce02.slice/crio-f7d0fbd92d642db5bbbbc5b7b6348cda2575c4b0a1e6aab9cf29e9a627a56699 WatchSource:0}: Error finding container f7d0fbd92d642db5bbbbc5b7b6348cda2575c4b0a1e6aab9cf29e9a627a56699: Status 404 returned error can't find the container with id f7d0fbd92d642db5bbbbc5b7b6348cda2575c4b0a1e6aab9cf29e9a627a56699
Jul 15 12:47:29.441639 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:47:29.441606    2559 generic.go:356] "Generic (PLEG): container finished" podID="f1444c41-e1f4-48a8-bbf2-096dcfa4ce02" containerID="de7518341b4f737c0c968fc6fb1dd907f5749fa71aeb06a5e8b18189c41fd49f" exitCode=7
Jul 15 12:47:29.442022 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:47:29.441643    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-691083d1-57zgq" event={"ID":"f1444c41-e1f4-48a8-bbf2-096dcfa4ce02","Type":"ContainerDied","Data":"de7518341b4f737c0c968fc6fb1dd907f5749fa71aeb06a5e8b18189c41fd49f"}
Jul 15 12:47:29.442022 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:47:29.441696    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-691083d1-57zgq" event={"ID":"f1444c41-e1f4-48a8-bbf2-096dcfa4ce02","Type":"ContainerStarted","Data":"f7d0fbd92d642db5bbbbc5b7b6348cda2575c4b0a1e6aab9cf29e9a627a56699"}
Jul 15 12:47:29.442022 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:47:29.441864    2559 scope.go:117] "RemoveContainer" containerID="de7518341b4f737c0c968fc6fb1dd907f5749fa71aeb06a5e8b18189c41fd49f"
Jul 15 12:47:30.448906 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:47:30.448822    2559 generic.go:356] "Generic (PLEG): container finished" podID="f1444c41-e1f4-48a8-bbf2-096dcfa4ce02" containerID="6f7de328ddde85240a9adfb26fc824045a1ed1493fe6def3902a8b97f7885853" exitCode=7
Jul 15 12:47:30.448906 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:47:30.448863    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-691083d1-57zgq" event={"ID":"f1444c41-e1f4-48a8-bbf2-096dcfa4ce02","Type":"ContainerDied","Data":"6f7de328ddde85240a9adfb26fc824045a1ed1493fe6def3902a8b97f7885853"}
Jul 15 12:47:30.449356 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:47:30.448930    2559 scope.go:117] "RemoveContainer" containerID="de7518341b4f737c0c968fc6fb1dd907f5749fa71aeb06a5e8b18189c41fd49f"
Jul 15 12:47:30.449356 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:47:30.449075    2559 scope.go:117] "RemoveContainer" containerID="6f7de328ddde85240a9adfb26fc824045a1ed1493fe6def3902a8b97f7885853"
Jul 15 12:47:30.449356 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:47:30.449320    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-691083d1-57zgq_odh-ai-gateway-infra(f1444c41-e1f4-48a8-bbf2-096dcfa4ce02)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-691083d1-57zgq" podUID="f1444c41-e1f4-48a8-bbf2-096dcfa4ce02"
Jul 15 12:47:31.454619 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:47:31.454593    2559 scope.go:117] "RemoveContainer" containerID="6f7de328ddde85240a9adfb26fc824045a1ed1493fe6def3902a8b97f7885853"
Jul 15 12:47:31.454994 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:47:31.454789    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-ait-691083d1-57zgq_odh-ai-gateway-infra(f1444c41-e1f4-48a8-bbf2-096dcfa4ce02)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-691083d1-57zgq" podUID="f1444c41-e1f4-48a8-bbf2-096dcfa4ce02"
Jul 15 12:47:31.597631 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:47:31.597597    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:47:43.577993 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:47:43.577947    2559 scope.go:117] "RemoveContainer" containerID="6f7de328ddde85240a9adfb26fc824045a1ed1493fe6def3902a8b97f7885853"
Jul 15 12:47:44.510660 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:47:44.510626    2559 generic.go:356] "Generic (PLEG): container finished" podID="f1444c41-e1f4-48a8-bbf2-096dcfa4ce02" containerID="618091038be86e579c462cbfee9d2fd7429c0f58ac0a84d978865b7dfe2a8384" exitCode=0
Jul 15 12:47:44.510660 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:47:44.510671    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-691083d1-57zgq" event={"ID":"f1444c41-e1f4-48a8-bbf2-096dcfa4ce02","Type":"ContainerDied","Data":"618091038be86e579c462cbfee9d2fd7429c0f58ac0a84d978865b7dfe2a8384"}
Jul 15 12:47:44.510880 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:47:44.510718    2559 scope.go:117] "RemoveContainer" containerID="6f7de328ddde85240a9adfb26fc824045a1ed1493fe6def3902a8b97f7885853"
Jul 15 12:47:45.549779 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:47:45.549748    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-691083d1-57zgq"]
Jul 15 12:47:45.642216 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:47:45.642193    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-691083d1-57zgq"
Jul 15 12:47:45.799942 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:47:45.799847    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1444c41-e1f4-48a8-bbf2-096dcfa4ce02-maas-api-service-ca\") pod \"f1444c41-e1f4-48a8-bbf2-096dcfa4ce02\" (UID: \"f1444c41-e1f4-48a8-bbf2-096dcfa4ce02\") "
Jul 15 12:47:45.800194 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:47:45.800171    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f1444c41-e1f4-48a8-bbf2-096dcfa4ce02-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "f1444c41-e1f4-48a8-bbf2-096dcfa4ce02" (UID: "f1444c41-e1f4-48a8-bbf2-096dcfa4ce02"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:47:45.901083 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:47:45.901053    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/f1444c41-e1f4-48a8-bbf2-096dcfa4ce02-maas-api-service-ca\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:47:46.522098 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:47:46.522066    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-691083d1-57zgq"
Jul 15 12:47:46.522289 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:47:46.522100    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-691083d1-57zgq" event={"ID":"f1444c41-e1f4-48a8-bbf2-096dcfa4ce02","Type":"ContainerDied","Data":"f7d0fbd92d642db5bbbbc5b7b6348cda2575c4b0a1e6aab9cf29e9a627a56699"}
Jul 15 12:47:46.522289 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:47:46.522150    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f7d0fbd92d642db5bbbbc5b7b6348cda2575c4b0a1e6aab9cf29e9a627a56699"
Jul 15 12:47:46.565228 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:47:46.565194    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-691083d1-57zgq"]
Jul 15 12:47:46.570481 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:47:46.570457    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-691083d1-57zgq"]
Jul 15 12:47:46.583239 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:47:46.583204    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f1444c41-e1f4-48a8-bbf2-096dcfa4ce02" path="/var/lib/kubelet/pods/f1444c41-e1f4-48a8-bbf2-096dcfa4ce02/volumes"
Jul 15 12:48:18.280419 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:48:18.280382    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-691083d1-qc7n5"]
Jul 15 12:48:18.280915 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:48:18.280681    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1444c41-e1f4-48a8-bbf2-096dcfa4ce02" containerName="revoke-keys"
Jul 15 12:48:18.280915 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:48:18.280693    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1444c41-e1f4-48a8-bbf2-096dcfa4ce02" containerName="revoke-keys"
Jul 15 12:48:18.280915 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:48:18.280706    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1444c41-e1f4-48a8-bbf2-096dcfa4ce02" containerName="revoke-keys"
Jul 15 12:48:18.280915 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:48:18.280712    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1444c41-e1f4-48a8-bbf2-096dcfa4ce02" containerName="revoke-keys"
Jul 15 12:48:18.280915 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:48:18.280718    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f1444c41-e1f4-48a8-bbf2-096dcfa4ce02" containerName="revoke-keys"
Jul 15 12:48:18.280915 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:48:18.280724    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f1444c41-e1f4-48a8-bbf2-096dcfa4ce02" containerName="revoke-keys"
Jul 15 12:48:18.280915 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:48:18.280773    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1444c41-e1f4-48a8-bbf2-096dcfa4ce02" containerName="revoke-keys"
Jul 15 12:48:18.280915 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:48:18.280782    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1444c41-e1f4-48a8-bbf2-096dcfa4ce02" containerName="revoke-keys"
Jul 15 12:48:18.280915 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:48:18.280788    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f1444c41-e1f4-48a8-bbf2-096dcfa4ce02" containerName="revoke-keys"
Jul 15 12:48:18.284014 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:48:18.283996    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-691083d1-qc7n5"
Jul 15 12:48:18.286502 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:48:18.286475    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 12:48:18.286620 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:48:18.286482    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-267b6\""
Jul 15 12:48:18.290938 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:48:18.290909    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-691083d1-qc7n5"]
Jul 15 12:48:18.374924 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:48:18.374886    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f398458-9027-4770-82ce-81163f584cd2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-691083d1-qc7n5\" (UID: \"2f398458-9027-4770-82ce-81163f584cd2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-691083d1-qc7n5"
Jul 15 12:48:18.475722 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:48:18.475682    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f398458-9027-4770-82ce-81163f584cd2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-691083d1-qc7n5\" (UID: \"2f398458-9027-4770-82ce-81163f584cd2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-691083d1-qc7n5"
Jul 15 12:48:18.476308 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:48:18.476289    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f398458-9027-4770-82ce-81163f584cd2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-ait-691083d1-qc7n5\" (UID: \"2f398458-9027-4770-82ce-81163f584cd2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-691083d1-qc7n5"
Jul 15 12:48:18.595418 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:48:18.595313    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-691083d1-qc7n5"
Jul 15 12:48:18.726422 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:48:18.726395    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-691083d1-qc7n5"]
Jul 15 12:48:18.728684 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:48:18.728658    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2f398458_9027_4770_82ce_81163f584cd2.slice/crio-e6a7ae6167d3f047b5797c422f72969a80a30f4bd7100c264c228422e12c850e WatchSource:0}: Error finding container e6a7ae6167d3f047b5797c422f72969a80a30f4bd7100c264c228422e12c850e: Status 404 returned error can't find the container with id e6a7ae6167d3f047b5797c422f72969a80a30f4bd7100c264c228422e12c850e
Jul 15 12:48:19.669521 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:48:19.669427    2559 generic.go:356] "Generic (PLEG): container finished" podID="2f398458-9027-4770-82ce-81163f584cd2" containerID="5e64ac27cd18a306251d1a6cda7c6787853efa9d620b1ac07074987024df50fc" exitCode=0
Jul 15 12:48:19.669521 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:48:19.669503    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-691083d1-qc7n5" event={"ID":"2f398458-9027-4770-82ce-81163f584cd2","Type":"ContainerDied","Data":"5e64ac27cd18a306251d1a6cda7c6787853efa9d620b1ac07074987024df50fc"}
Jul 15 12:48:19.669917 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:48:19.669581    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-691083d1-qc7n5" event={"ID":"2f398458-9027-4770-82ce-81163f584cd2","Type":"ContainerStarted","Data":"e6a7ae6167d3f047b5797c422f72969a80a30f4bd7100c264c228422e12c850e"}
Jul 15 12:48:20.800349 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:48:20.800325    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-691083d1-qc7n5"
Jul 15 12:48:20.896744 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:48:20.896720    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f398458-9027-4770-82ce-81163f584cd2-maas-api-service-ca\") pod \"2f398458-9027-4770-82ce-81163f584cd2\" (UID: \"2f398458-9027-4770-82ce-81163f584cd2\") "
Jul 15 12:48:20.897081 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:48:20.897059    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2f398458-9027-4770-82ce-81163f584cd2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "2f398458-9027-4770-82ce-81163f584cd2" (UID: "2f398458-9027-4770-82ce-81163f584cd2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:48:20.998156 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:48:20.998122    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/2f398458-9027-4770-82ce-81163f584cd2-maas-api-service-ca\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:48:21.679650 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:48:21.679613    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-691083d1-qc7n5" event={"ID":"2f398458-9027-4770-82ce-81163f584cd2","Type":"ContainerDied","Data":"e6a7ae6167d3f047b5797c422f72969a80a30f4bd7100c264c228422e12c850e"}
Jul 15 12:48:21.679650 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:48:21.679646    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-ait-691083d1-qc7n5"
Jul 15 12:48:21.679900 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:48:21.679662    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e6a7ae6167d3f047b5797c422f72969a80a30f4bd7100c264c228422e12c850e"
Jul 15 12:48:28.974064 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:48:28.974029    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:48:32.034096 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:48:32.034060    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:48:33.436181 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:48:33.436148    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:48:40.119585 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:48:40.119546    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:48:40.220508 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:48:40.220472    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:48:44.564091 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:48:44.564056    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:48:44.882561 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:48:44.882532    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:48:46.021509 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:48:46.021482    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:48:46.131539 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:48:46.131506    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:48:46.268779 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:48:46.268730    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:48:46.385838 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:48:46.385753    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:48:46.766373 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:48:46.766340    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:48:46.943028 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:48:46.942997    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:48:48.539344 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:48:48.539313    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:48:50.469253 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:48:50.469224    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a074e0bb-kntzv"]
Jul 15 12:48:50.469690 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:48:50.469541    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2f398458-9027-4770-82ce-81163f584cd2" containerName="revoke-keys"
Jul 15 12:48:50.469690 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:48:50.469553    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="2f398458-9027-4770-82ce-81163f584cd2" containerName="revoke-keys"
Jul 15 12:48:50.469690 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:48:50.469614    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="2f398458-9027-4770-82ce-81163f584cd2" containerName="revoke-keys"
Jul 15 12:48:50.472765 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:48:50.472750    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a074e0bb-kntzv"
Jul 15 12:48:50.475166 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:48:50.475148    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-267b6\""
Jul 15 12:48:50.475288 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:48:50.475203    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 12:48:50.480344 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:48:50.480321    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a074e0bb-kntzv"]
Jul 15 12:48:50.530639 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:48:50.530602    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba291196-c868-47dd-b44d-6dac4b19066a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-a074e0bb-kntzv\" (UID: \"ba291196-c868-47dd-b44d-6dac4b19066a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a074e0bb-kntzv"
Jul 15 12:48:50.631429 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:48:50.631398    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba291196-c868-47dd-b44d-6dac4b19066a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-a074e0bb-kntzv\" (UID: \"ba291196-c868-47dd-b44d-6dac4b19066a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a074e0bb-kntzv"
Jul 15 12:48:50.631992 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:48:50.631972    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba291196-c868-47dd-b44d-6dac4b19066a-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-a074e0bb-kntzv\" (UID: \"ba291196-c868-47dd-b44d-6dac4b19066a\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a074e0bb-kntzv"
Jul 15 12:48:50.784550 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:48:50.784468    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a074e0bb-kntzv"
Jul 15 12:48:50.985258 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:48:50.985223    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a074e0bb-kntzv"]
Jul 15 12:48:50.990122 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:48:50.990089    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podba291196_c868_47dd_b44d_6dac4b19066a.slice/crio-ab3f7257a7c642e9a4e014d77e46b7a0216bd28c99b212dfcae3a330a65f769d WatchSource:0}: Error finding container ab3f7257a7c642e9a4e014d77e46b7a0216bd28c99b212dfcae3a330a65f769d: Status 404 returned error can't find the container with id ab3f7257a7c642e9a4e014d77e46b7a0216bd28c99b212dfcae3a330a65f769d
Jul 15 12:48:51.016729 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:48:51.016697    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:48:51.180579 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:48:51.180550    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:48:51.811383 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:48:51.811338    2559 generic.go:356] "Generic (PLEG): container finished" podID="ba291196-c868-47dd-b44d-6dac4b19066a" containerID="81573165b8a530cdda59a5eb36a3f3dbdbb93c1fcf3421102ae03e53075d8dfd" exitCode=7
Jul 15 12:48:51.811850 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:48:51.811430    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a074e0bb-kntzv" event={"ID":"ba291196-c868-47dd-b44d-6dac4b19066a","Type":"ContainerDied","Data":"81573165b8a530cdda59a5eb36a3f3dbdbb93c1fcf3421102ae03e53075d8dfd"}
Jul 15 12:48:51.811850 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:48:51.811488    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a074e0bb-kntzv" event={"ID":"ba291196-c868-47dd-b44d-6dac4b19066a","Type":"ContainerStarted","Data":"ab3f7257a7c642e9a4e014d77e46b7a0216bd28c99b212dfcae3a330a65f769d"}
Jul 15 12:48:51.811850 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:48:51.811664    2559 scope.go:117] "RemoveContainer" containerID="81573165b8a530cdda59a5eb36a3f3dbdbb93c1fcf3421102ae03e53075d8dfd"
Jul 15 12:48:52.817881 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:48:52.817847    2559 generic.go:356] "Generic (PLEG): container finished" podID="ba291196-c868-47dd-b44d-6dac4b19066a" containerID="60e5e082e159dc1c5c0334cbf85c728cccfa65fd00526c1e93f0a94da7312b08" exitCode=7
Jul 15 12:48:52.818264 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:48:52.817928    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a074e0bb-kntzv" event={"ID":"ba291196-c868-47dd-b44d-6dac4b19066a","Type":"ContainerDied","Data":"60e5e082e159dc1c5c0334cbf85c728cccfa65fd00526c1e93f0a94da7312b08"}
Jul 15 12:48:52.818264 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:48:52.817987    2559 scope.go:117] "RemoveContainer" containerID="81573165b8a530cdda59a5eb36a3f3dbdbb93c1fcf3421102ae03e53075d8dfd"
Jul 15 12:48:52.818264 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:48:52.818107    2559 scope.go:117] "RemoveContainer" containerID="60e5e082e159dc1c5c0334cbf85c728cccfa65fd00526c1e93f0a94da7312b08"
Jul 15 12:48:52.818435 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:48:52.818311    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-a074e0bb-kntzv_odh-ai-gateway-infra(ba291196-c868-47dd-b44d-6dac4b19066a)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a074e0bb-kntzv" podUID="ba291196-c868-47dd-b44d-6dac4b19066a"
Jul 15 12:48:53.824080 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:48:53.824057    2559 scope.go:117] "RemoveContainer" containerID="60e5e082e159dc1c5c0334cbf85c728cccfa65fd00526c1e93f0a94da7312b08"
Jul 15 12:48:53.824462 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:48:53.824260    2559 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"revoke-keys\" with CrashLoopBackOff: \"back-off 10s restarting failed container=revoke-keys pod=maas-api-revoke-keys-e2e-derive-a074e0bb-kntzv_odh-ai-gateway-infra(ba291196-c868-47dd-b44d-6dac4b19066a)\"" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a074e0bb-kntzv" podUID="ba291196-c868-47dd-b44d-6dac4b19066a"
Jul 15 12:48:54.400332 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:48:54.400288    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:49:08.578622 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:49:08.578582    2559 scope.go:117] "RemoveContainer" containerID="60e5e082e159dc1c5c0334cbf85c728cccfa65fd00526c1e93f0a94da7312b08"
Jul 15 12:49:09.894601 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:49:09.894568    2559 generic.go:356] "Generic (PLEG): container finished" podID="ba291196-c868-47dd-b44d-6dac4b19066a" containerID="4e2307c35e28098ec294017dc5eba2ec803d94cb98209f839e3be18105e59ff8" exitCode=0
Jul 15 12:49:09.894991 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:49:09.894641    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a074e0bb-kntzv" event={"ID":"ba291196-c868-47dd-b44d-6dac4b19066a","Type":"ContainerDied","Data":"4e2307c35e28098ec294017dc5eba2ec803d94cb98209f839e3be18105e59ff8"}
Jul 15 12:49:09.894991 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:49:09.894701    2559 scope.go:117] "RemoveContainer" containerID="60e5e082e159dc1c5c0334cbf85c728cccfa65fd00526c1e93f0a94da7312b08"
Jul 15 12:49:10.939319 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:49:10.939283    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a074e0bb-kntzv"]
Jul 15 12:49:11.031811 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:49:11.031789    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a074e0bb-kntzv"
Jul 15 12:49:11.086840 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:49:11.086809    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba291196-c868-47dd-b44d-6dac4b19066a-maas-api-service-ca\") pod \"ba291196-c868-47dd-b44d-6dac4b19066a\" (UID: \"ba291196-c868-47dd-b44d-6dac4b19066a\") "
Jul 15 12:49:11.087154 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:49:11.087132    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ba291196-c868-47dd-b44d-6dac4b19066a-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "ba291196-c868-47dd-b44d-6dac4b19066a" (UID: "ba291196-c868-47dd-b44d-6dac4b19066a"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:49:11.188469 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:49:11.188385    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/ba291196-c868-47dd-b44d-6dac4b19066a-maas-api-service-ca\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:49:11.905852 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:49:11.905824    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a074e0bb-kntzv"
Jul 15 12:49:11.905852 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:49:11.905838    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a074e0bb-kntzv" event={"ID":"ba291196-c868-47dd-b44d-6dac4b19066a","Type":"ContainerDied","Data":"ab3f7257a7c642e9a4e014d77e46b7a0216bd28c99b212dfcae3a330a65f769d"}
Jul 15 12:49:11.906066 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:49:11.905888    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ab3f7257a7c642e9a4e014d77e46b7a0216bd28c99b212dfcae3a330a65f769d"
Jul 15 12:49:11.975198 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:49:11.975169    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a074e0bb-kntzv"]
Jul 15 12:49:11.985561 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:49:11.985533    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a074e0bb-kntzv"]
Jul 15 12:49:12.585159 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:49:12.585124    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ba291196-c868-47dd-b44d-6dac4b19066a" path="/var/lib/kubelet/pods/ba291196-c868-47dd-b44d-6dac4b19066a/volumes"
Jul 15 12:49:37.631169 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:49:37.631135    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:49:37.791440 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:49:37.791406    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:49:46.739958 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:49:46.739921    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:49:50.548313 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:49:50.548283    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a074e0bb-5lh5n"]
Jul 15 12:49:50.548728 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:49:50.548582    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba291196-c868-47dd-b44d-6dac4b19066a" containerName="revoke-keys"
Jul 15 12:49:50.548728 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:49:50.548593    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba291196-c868-47dd-b44d-6dac4b19066a" containerName="revoke-keys"
Jul 15 12:49:50.548728 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:49:50.548611    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba291196-c868-47dd-b44d-6dac4b19066a" containerName="revoke-keys"
Jul 15 12:49:50.548728 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:49:50.548617    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba291196-c868-47dd-b44d-6dac4b19066a" containerName="revoke-keys"
Jul 15 12:49:50.548728 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:49:50.548669    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba291196-c868-47dd-b44d-6dac4b19066a" containerName="revoke-keys"
Jul 15 12:49:50.548728 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:49:50.548679    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba291196-c868-47dd-b44d-6dac4b19066a" containerName="revoke-keys"
Jul 15 12:49:50.551787 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:49:50.551771    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a074e0bb-5lh5n"
Jul 15 12:49:50.554553 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:49:50.554534    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-267b6\""
Jul 15 12:49:50.555320 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:49:50.555300    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 12:49:50.560840 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:49:50.560818    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a074e0bb-5lh5n"]
Jul 15 12:49:50.623726 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:49:50.623696    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/00ebf612-43d4-48e9-bee7-516f8764f094-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-a074e0bb-5lh5n\" (UID: \"00ebf612-43d4-48e9-bee7-516f8764f094\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a074e0bb-5lh5n"
Jul 15 12:49:50.724928 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:49:50.724898    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/00ebf612-43d4-48e9-bee7-516f8764f094-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-a074e0bb-5lh5n\" (UID: \"00ebf612-43d4-48e9-bee7-516f8764f094\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a074e0bb-5lh5n"
Jul 15 12:49:50.725536 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:49:50.725518    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/00ebf612-43d4-48e9-bee7-516f8764f094-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-derive-a074e0bb-5lh5n\" (UID: \"00ebf612-43d4-48e9-bee7-516f8764f094\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a074e0bb-5lh5n"
Jul 15 12:49:50.862928 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:49:50.862848    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a074e0bb-5lh5n"
Jul 15 12:49:51.017296 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:49:51.017273    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a074e0bb-5lh5n"]
Jul 15 12:49:51.019713 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:49:51.019686    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00ebf612_43d4_48e9_bee7_516f8764f094.slice/crio-aa7b1f09291712a239abe6d6f9ec2259c4271e7db42edfb94935e1200688232f WatchSource:0}: Error finding container aa7b1f09291712a239abe6d6f9ec2259c4271e7db42edfb94935e1200688232f: Status 404 returned error can't find the container with id aa7b1f09291712a239abe6d6f9ec2259c4271e7db42edfb94935e1200688232f
Jul 15 12:49:51.077004 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:49:51.076970    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a074e0bb-5lh5n" event={"ID":"00ebf612-43d4-48e9-bee7-516f8764f094","Type":"ContainerStarted","Data":"aa7b1f09291712a239abe6d6f9ec2259c4271e7db42edfb94935e1200688232f"}
Jul 15 12:49:51.483570 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:49:51.483542    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:49:51.580625 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:49:51.580597    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:49:52.082126 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:49:52.082089    2559 generic.go:356] "Generic (PLEG): container finished" podID="00ebf612-43d4-48e9-bee7-516f8764f094" containerID="7469f8029362beccf6ed7d6801576e4529d785102891ab214d724d3d63915a1f" exitCode=0
Jul 15 12:49:52.082126 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:49:52.082126    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a074e0bb-5lh5n" event={"ID":"00ebf612-43d4-48e9-bee7-516f8764f094","Type":"ContainerDied","Data":"7469f8029362beccf6ed7d6801576e4529d785102891ab214d724d3d63915a1f"}
Jul 15 12:49:53.208152 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:49:53.208129    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a074e0bb-5lh5n"
Jul 15 12:49:53.248101 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:49:53.248080    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/00ebf612-43d4-48e9-bee7-516f8764f094-maas-api-service-ca\") pod \"00ebf612-43d4-48e9-bee7-516f8764f094\" (UID: \"00ebf612-43d4-48e9-bee7-516f8764f094\") "
Jul 15 12:49:53.248499 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:49:53.248475    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/00ebf612-43d4-48e9-bee7-516f8764f094-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "00ebf612-43d4-48e9-bee7-516f8764f094" (UID: "00ebf612-43d4-48e9-bee7-516f8764f094"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:49:53.349236 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:49:53.349164    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/00ebf612-43d4-48e9-bee7-516f8764f094-maas-api-service-ca\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:49:54.097031 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:49:54.096986    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a074e0bb-5lh5n" event={"ID":"00ebf612-43d4-48e9-bee7-516f8764f094","Type":"ContainerDied","Data":"aa7b1f09291712a239abe6d6f9ec2259c4271e7db42edfb94935e1200688232f"}
Jul 15 12:49:54.097200 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:49:54.097038    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-derive-a074e0bb-5lh5n"
Jul 15 12:49:54.097200 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:49:54.097066    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="aa7b1f09291712a239abe6d6f9ec2259c4271e7db42edfb94935e1200688232f"
Jul 15 12:50:01.325778 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:50:01.325722    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:50:04.341053 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:50:04.341017    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:50:05.700981 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:50:05.700942    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:50:12.793582 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:50:12.793553    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:50:13.008593 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:50:13.008556    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:50:17.137914 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:50:17.137873    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:50:17.410523 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:50:17.410433    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:50:18.778932 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:50:18.778899    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:50:19.818575 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:50:19.818544    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:50:22.503953 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:50:22.503906    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:50:26.404769 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:50:26.404734    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:50:26.564946 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:50:26.564910    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:50:26.729892 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:50:26.729860    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:50:26.900264 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:50:26.900236    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:50:27.372928 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:50:27.372894    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:50:30.530883 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:50:30.530850    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vp8z_009c50dc-2f9e-455b-95f2-a03e7ed3defd/ovn-acl-logging/0.log"
Jul 15 12:50:30.535584 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:50:30.535562    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vp8z_009c50dc-2f9e-455b-95f2-a03e7ed3defd/ovn-acl-logging/0.log"
Jul 15 12:50:33.564077 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:50:33.564007    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:50:33.674661 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:50:33.674633    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:50:44.189224 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:50:44.189191    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:50:53.344384 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:50:53.344325    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:50:59.755916 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:50:59.755880    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:50:59.882628 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:50:59.882584    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:51:00.031235 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:51:00.031151    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:51:15.948480 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:51:15.948446    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:51:22.891095 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:51:22.891053    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:51:23.085219 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:51:23.085183    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:51:23.205167 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:51:23.205085    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:51:33.693613 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:51:33.693582    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:51:34.503172 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:51:34.503138    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:51:40.572700 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:51:40.572668    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:51:40.644082 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:51:40.644047    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:51:40.733934 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:51:40.733900    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:51:40.922968 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:51:40.922881    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:51:41.684453 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:51:41.684416    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:51:41.784495 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:51:41.784460    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:51:43.035358 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:51:43.035324    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:51:43.483093 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:51:43.483061    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:51:49.387158 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:51:49.387124    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:51:49.485273 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:51:49.485237    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:51:50.079421 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:51:50.079390    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:51:50.632329 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:51:50.632296    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:51:57.059434 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:51:57.059398    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:51:57.157045 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:51:57.156996    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:51:57.251595 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:51:57.251566    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:51:57.583593 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:51:57.583561    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:51:57.908601 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:51:57.908520    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:51:58.325513 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:51:58.325483    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:52:00.619581 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:52:00.619546    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:52:00.728685 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:52:00.728644    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:52:00.825597 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:52:00.825546    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:52:02.228802 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:52:02.228766    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:52:02.379668 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:52:02.379632    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:52:05.157418 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:52:05.157385    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:52:05.828846 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:52:05.828811    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:52:05.929100 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:52:05.929064    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:52:06.247232 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:52:06.247199    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:52:06.300071 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:52:06.300040    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:52:12.418652 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:52:12.418616    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:52:12.626383 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:52:12.626335    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:52:12.763208 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:52:12.763175    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8a28be15-cpgfl"]
Jul 15 12:52:12.763518 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:52:12.763505    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ba291196-c868-47dd-b44d-6dac4b19066a" containerName="revoke-keys"
Jul 15 12:52:12.763571 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:52:12.763521    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="ba291196-c868-47dd-b44d-6dac4b19066a" containerName="revoke-keys"
Jul 15 12:52:12.763571 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:52:12.763530    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="00ebf612-43d4-48e9-bee7-516f8764f094" containerName="revoke-keys"
Jul 15 12:52:12.763571 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:52:12.763536    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="00ebf612-43d4-48e9-bee7-516f8764f094" containerName="revoke-keys"
Jul 15 12:52:12.763667 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:52:12.763589    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="ba291196-c868-47dd-b44d-6dac4b19066a" containerName="revoke-keys"
Jul 15 12:52:12.763667 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:52:12.763596    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="00ebf612-43d4-48e9-bee7-516f8764f094" containerName="revoke-keys"
Jul 15 12:52:12.766462 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:52:12.766446    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8a28be15-cpgfl"
Jul 15 12:52:12.769022 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:52:12.768994    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 12:52:12.769227 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:52:12.769210    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-267b6\""
Jul 15 12:52:12.775232 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:52:12.775211    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8a28be15-cpgfl"]
Jul 15 12:52:12.922289 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:52:12.922252    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/40663aa0-27d9-4f4e-9e46-2ace56bada46-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-8a28be15-cpgfl\" (UID: \"40663aa0-27d9-4f4e-9e46-2ace56bada46\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8a28be15-cpgfl"
Jul 15 12:52:13.023311 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:52:13.023217    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/40663aa0-27d9-4f4e-9e46-2ace56bada46-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-8a28be15-cpgfl\" (UID: \"40663aa0-27d9-4f4e-9e46-2ace56bada46\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8a28be15-cpgfl"
Jul 15 12:52:13.023892 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:52:13.023869    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/40663aa0-27d9-4f4e-9e46-2ace56bada46-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-8a28be15-cpgfl\" (UID: \"40663aa0-27d9-4f4e-9e46-2ace56bada46\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8a28be15-cpgfl"
Jul 15 12:52:13.077339 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:52:13.077306    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8a28be15-cpgfl"
Jul 15 12:52:13.210499 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:52:13.210468    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8a28be15-cpgfl"]
Jul 15 12:52:13.213825 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:52:13.213797    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40663aa0_27d9_4f4e_9e46_2ace56bada46.slice/crio-26917c40c7109467c2c7ef39bc26b5ae2d3e4758d24d317e62986890efda625b WatchSource:0}: Error finding container 26917c40c7109467c2c7ef39bc26b5ae2d3e4758d24d317e62986890efda625b: Status 404 returned error can't find the container with id 26917c40c7109467c2c7ef39bc26b5ae2d3e4758d24d317e62986890efda625b
Jul 15 12:52:13.713756 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:52:13.713718    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8a28be15-cpgfl" event={"ID":"40663aa0-27d9-4f4e-9e46-2ace56bada46","Type":"ContainerStarted","Data":"adbdc67218694788e3c03eef99308b51c5c47a5fbe1c41944378c4811341bd0d"}
Jul 15 12:52:13.714132 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:52:13.713779    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8a28be15-cpgfl" event={"ID":"40663aa0-27d9-4f4e-9e46-2ace56bada46","Type":"ContainerStarted","Data":"26917c40c7109467c2c7ef39bc26b5ae2d3e4758d24d317e62986890efda625b"}
Jul 15 12:52:13.739326 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:52:13.739274    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8a28be15-cpgfl" podStartSLOduration=1.7392576260000001 podStartE2EDuration="1.739257626s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:52:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:52:13.738068563 +0000 UTC m=+1903.710639721" watchObservedRunningTime="2026-07-15 12:52:13.739257626 +0000 UTC m=+1903.711828801"
Jul 15 12:52:14.719292 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:52:14.719257    2559 generic.go:356] "Generic (PLEG): container finished" podID="40663aa0-27d9-4f4e-9e46-2ace56bada46" containerID="adbdc67218694788e3c03eef99308b51c5c47a5fbe1c41944378c4811341bd0d" exitCode=0
Jul 15 12:52:14.719685 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:52:14.719305    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8a28be15-cpgfl" event={"ID":"40663aa0-27d9-4f4e-9e46-2ace56bada46","Type":"ContainerDied","Data":"adbdc67218694788e3c03eef99308b51c5c47a5fbe1c41944378c4811341bd0d"}
Jul 15 12:52:15.853926 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:52:15.853901    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8a28be15-cpgfl"
Jul 15 12:52:15.950972 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:52:15.950932    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/40663aa0-27d9-4f4e-9e46-2ace56bada46-maas-api-service-ca\") pod \"40663aa0-27d9-4f4e-9e46-2ace56bada46\" (UID: \"40663aa0-27d9-4f4e-9e46-2ace56bada46\") "
Jul 15 12:52:15.951353 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:52:15.951324    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/40663aa0-27d9-4f4e-9e46-2ace56bada46-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "40663aa0-27d9-4f4e-9e46-2ace56bada46" (UID: "40663aa0-27d9-4f4e-9e46-2ace56bada46"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:52:16.051985 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:52:16.051896    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/40663aa0-27d9-4f4e-9e46-2ace56bada46-maas-api-service-ca\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:52:16.730099 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:52:16.730064    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8a28be15-cpgfl" event={"ID":"40663aa0-27d9-4f4e-9e46-2ace56bada46","Type":"ContainerDied","Data":"26917c40c7109467c2c7ef39bc26b5ae2d3e4758d24d317e62986890efda625b"}
Jul 15 12:52:16.730099 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:52:16.730102    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-8a28be15-cpgfl"
Jul 15 12:52:16.730302 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:52:16.730122    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="26917c40c7109467c2c7ef39bc26b5ae2d3e4758d24d317e62986890efda625b"
Jul 15 12:52:23.274479 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:52:23.274443    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:52:26.016405 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:52:26.016350    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:52:27.851543 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:52:27.851506    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:52:34.026094 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:52:34.026063    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:52:34.100006 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:52:34.099974    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:52:38.559014 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:52:38.558983    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:52:38.786928 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:52:38.786889    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:52:38.912644 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:52:38.912564    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:52:39.006853 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:52:39.006821    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:52:39.142326 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:52:39.142297    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:52:45.346876 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:52:45.346843    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:52:45.456720 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:52:45.456688    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:52:45.593526 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:52:45.593497    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:52:45.881561 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:52:45.881529    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:52:52.289722 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:52:52.289687    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:52:52.365133 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:52:52.365103    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:52:58.913281 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:52:58.913247    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:53:00.489094 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:00.489060    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:53:00.558120 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:00.558067    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:53:01.809624 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:01.809589    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:53:01.905066 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:01.905021    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:53:02.002126 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:02.002091    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:53:02.117603 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:02.117508    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:53:02.628597 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:02.628566    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:53:02.728589 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:02.728539    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:53:06.160967 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:06.160938    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:53:06.292874 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:06.292840    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:53:07.984846 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:07.984812    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-mt-1f25dafc/e2e-lifecycle-model-1f25dafc-kserve-694855486c-s22gf"]
Jul 15 12:53:07.985230 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:07.985118    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="40663aa0-27d9-4f4e-9e46-2ace56bada46" containerName="revoke-keys"
Jul 15 12:53:07.985230 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:07.985130    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="40663aa0-27d9-4f4e-9e46-2ace56bada46" containerName="revoke-keys"
Jul 15 12:53:07.985230 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:07.985213    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="40663aa0-27d9-4f4e-9e46-2ace56bada46" containerName="revoke-keys"
Jul 15 12:53:07.988022 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:07.988001    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-1f25dafc/e2e-lifecycle-model-1f25dafc-kserve-694855486c-s22gf"
Jul 15 12:53:07.991240 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:07.991217    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-1f25dafc\"/\"kube-root-ca.crt\""
Jul 15 12:53:07.991410 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:07.991272    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-1f25dafc\"/\"e2e-lifecycle-model-1f25dafc-kserve-self-signed-certs\""
Jul 15 12:53:07.991410 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:07.991217    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-mt-1f25dafc\"/\"default-dockercfg-zc4v6\""
Jul 15 12:53:07.991410 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:07.991288    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-mt-1f25dafc\"/\"openshift-service-ca.crt\""
Jul 15 12:53:07.998820 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:07.998795    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-1f25dafc/e2e-lifecycle-model-1f25dafc-kserve-694855486c-s22gf"]
Jul 15 12:53:08.018419 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:08.018389    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:53:08.089236 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:08.089205    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0a71e4c-d41b-4648-a7d3-428431e94892-home\") pod \"e2e-lifecycle-model-1f25dafc-kserve-694855486c-s22gf\" (UID: \"d0a71e4c-d41b-4648-a7d3-428431e94892\") " pod="ai-tenant-e2e-mt-1f25dafc/e2e-lifecycle-model-1f25dafc-kserve-694855486c-s22gf"
Jul 15 12:53:08.089236 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:08.089239    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0a71e4c-d41b-4648-a7d3-428431e94892-tls-certs\") pod \"e2e-lifecycle-model-1f25dafc-kserve-694855486c-s22gf\" (UID: \"d0a71e4c-d41b-4648-a7d3-428431e94892\") " pod="ai-tenant-e2e-mt-1f25dafc/e2e-lifecycle-model-1f25dafc-kserve-694855486c-s22gf"
Jul 15 12:53:08.089470 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:08.089259    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0a71e4c-d41b-4648-a7d3-428431e94892-model-cache\") pod \"e2e-lifecycle-model-1f25dafc-kserve-694855486c-s22gf\" (UID: \"d0a71e4c-d41b-4648-a7d3-428431e94892\") " pod="ai-tenant-e2e-mt-1f25dafc/e2e-lifecycle-model-1f25dafc-kserve-694855486c-s22gf"
Jul 15 12:53:08.089470 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:08.089280    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wz9ct\" (UniqueName: \"kubernetes.io/projected/d0a71e4c-d41b-4648-a7d3-428431e94892-kube-api-access-wz9ct\") pod \"e2e-lifecycle-model-1f25dafc-kserve-694855486c-s22gf\" (UID: \"d0a71e4c-d41b-4648-a7d3-428431e94892\") " pod="ai-tenant-e2e-mt-1f25dafc/e2e-lifecycle-model-1f25dafc-kserve-694855486c-s22gf"
Jul 15 12:53:08.089470 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:08.089344    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0a71e4c-d41b-4648-a7d3-428431e94892-tmp-dir\") pod \"e2e-lifecycle-model-1f25dafc-kserve-694855486c-s22gf\" (UID: \"d0a71e4c-d41b-4648-a7d3-428431e94892\") " pod="ai-tenant-e2e-mt-1f25dafc/e2e-lifecycle-model-1f25dafc-kserve-694855486c-s22gf"
Jul 15 12:53:08.089470 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:08.089415    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0a71e4c-d41b-4648-a7d3-428431e94892-dshm\") pod \"e2e-lifecycle-model-1f25dafc-kserve-694855486c-s22gf\" (UID: \"d0a71e4c-d41b-4648-a7d3-428431e94892\") " pod="ai-tenant-e2e-mt-1f25dafc/e2e-lifecycle-model-1f25dafc-kserve-694855486c-s22gf"
Jul 15 12:53:08.190032 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:08.189998    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wz9ct\" (UniqueName: \"kubernetes.io/projected/d0a71e4c-d41b-4648-a7d3-428431e94892-kube-api-access-wz9ct\") pod \"e2e-lifecycle-model-1f25dafc-kserve-694855486c-s22gf\" (UID: \"d0a71e4c-d41b-4648-a7d3-428431e94892\") " pod="ai-tenant-e2e-mt-1f25dafc/e2e-lifecycle-model-1f25dafc-kserve-694855486c-s22gf"
Jul 15 12:53:08.190233 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:08.190060    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0a71e4c-d41b-4648-a7d3-428431e94892-tmp-dir\") pod \"e2e-lifecycle-model-1f25dafc-kserve-694855486c-s22gf\" (UID: \"d0a71e4c-d41b-4648-a7d3-428431e94892\") " pod="ai-tenant-e2e-mt-1f25dafc/e2e-lifecycle-model-1f25dafc-kserve-694855486c-s22gf"
Jul 15 12:53:08.190233 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:08.190095    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0a71e4c-d41b-4648-a7d3-428431e94892-dshm\") pod \"e2e-lifecycle-model-1f25dafc-kserve-694855486c-s22gf\" (UID: \"d0a71e4c-d41b-4648-a7d3-428431e94892\") " pod="ai-tenant-e2e-mt-1f25dafc/e2e-lifecycle-model-1f25dafc-kserve-694855486c-s22gf"
Jul 15 12:53:08.190233 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:08.190127    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0a71e4c-d41b-4648-a7d3-428431e94892-home\") pod \"e2e-lifecycle-model-1f25dafc-kserve-694855486c-s22gf\" (UID: \"d0a71e4c-d41b-4648-a7d3-428431e94892\") " pod="ai-tenant-e2e-mt-1f25dafc/e2e-lifecycle-model-1f25dafc-kserve-694855486c-s22gf"
Jul 15 12:53:08.190233 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:08.190145    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0a71e4c-d41b-4648-a7d3-428431e94892-tls-certs\") pod \"e2e-lifecycle-model-1f25dafc-kserve-694855486c-s22gf\" (UID: \"d0a71e4c-d41b-4648-a7d3-428431e94892\") " pod="ai-tenant-e2e-mt-1f25dafc/e2e-lifecycle-model-1f25dafc-kserve-694855486c-s22gf"
Jul 15 12:53:08.190233 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:08.190164    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0a71e4c-d41b-4648-a7d3-428431e94892-model-cache\") pod \"e2e-lifecycle-model-1f25dafc-kserve-694855486c-s22gf\" (UID: \"d0a71e4c-d41b-4648-a7d3-428431e94892\") " pod="ai-tenant-e2e-mt-1f25dafc/e2e-lifecycle-model-1f25dafc-kserve-694855486c-s22gf"
Jul 15 12:53:08.190662 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:08.190628    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0a71e4c-d41b-4648-a7d3-428431e94892-model-cache\") pod \"e2e-lifecycle-model-1f25dafc-kserve-694855486c-s22gf\" (UID: \"d0a71e4c-d41b-4648-a7d3-428431e94892\") " pod="ai-tenant-e2e-mt-1f25dafc/e2e-lifecycle-model-1f25dafc-kserve-694855486c-s22gf"
Jul 15 12:53:08.190662 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:08.190651    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0a71e4c-d41b-4648-a7d3-428431e94892-home\") pod \"e2e-lifecycle-model-1f25dafc-kserve-694855486c-s22gf\" (UID: \"d0a71e4c-d41b-4648-a7d3-428431e94892\") " pod="ai-tenant-e2e-mt-1f25dafc/e2e-lifecycle-model-1f25dafc-kserve-694855486c-s22gf"
Jul 15 12:53:08.190841 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:08.190712    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0a71e4c-d41b-4648-a7d3-428431e94892-tmp-dir\") pod \"e2e-lifecycle-model-1f25dafc-kserve-694855486c-s22gf\" (UID: \"d0a71e4c-d41b-4648-a7d3-428431e94892\") " pod="ai-tenant-e2e-mt-1f25dafc/e2e-lifecycle-model-1f25dafc-kserve-694855486c-s22gf"
Jul 15 12:53:08.192394 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:08.192356    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0a71e4c-d41b-4648-a7d3-428431e94892-dshm\") pod \"e2e-lifecycle-model-1f25dafc-kserve-694855486c-s22gf\" (UID: \"d0a71e4c-d41b-4648-a7d3-428431e94892\") " pod="ai-tenant-e2e-mt-1f25dafc/e2e-lifecycle-model-1f25dafc-kserve-694855486c-s22gf"
Jul 15 12:53:08.192788 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:08.192757    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0a71e4c-d41b-4648-a7d3-428431e94892-tls-certs\") pod \"e2e-lifecycle-model-1f25dafc-kserve-694855486c-s22gf\" (UID: \"d0a71e4c-d41b-4648-a7d3-428431e94892\") " pod="ai-tenant-e2e-mt-1f25dafc/e2e-lifecycle-model-1f25dafc-kserve-694855486c-s22gf"
Jul 15 12:53:08.198497 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:08.198471    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wz9ct\" (UniqueName: \"kubernetes.io/projected/d0a71e4c-d41b-4648-a7d3-428431e94892-kube-api-access-wz9ct\") pod \"e2e-lifecycle-model-1f25dafc-kserve-694855486c-s22gf\" (UID: \"d0a71e4c-d41b-4648-a7d3-428431e94892\") " pod="ai-tenant-e2e-mt-1f25dafc/e2e-lifecycle-model-1f25dafc-kserve-694855486c-s22gf"
Jul 15 12:53:08.297773 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:08.297691    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-1f25dafc/e2e-lifecycle-model-1f25dafc-kserve-694855486c-s22gf"
Jul 15 12:53:08.426217 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:08.426191    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-mt-1f25dafc/e2e-lifecycle-model-1f25dafc-kserve-694855486c-s22gf"]
Jul 15 12:53:08.428836 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:53:08.428807    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd0a71e4c_d41b_4648_a7d3_428431e94892.slice/crio-4a9a857acf54b9ff0c3863efbdf03fc9761ba97137cc4f4aa18554ce4d5a84d5 WatchSource:0}: Error finding container 4a9a857acf54b9ff0c3863efbdf03fc9761ba97137cc4f4aa18554ce4d5a84d5: Status 404 returned error can't find the container with id 4a9a857acf54b9ff0c3863efbdf03fc9761ba97137cc4f4aa18554ce4d5a84d5
Jul 15 12:53:08.966691 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:08.966644    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-1f25dafc/e2e-lifecycle-model-1f25dafc-kserve-694855486c-s22gf" event={"ID":"d0a71e4c-d41b-4648-a7d3-428431e94892","Type":"ContainerStarted","Data":"68633a4001a89539bb4ae6d7a978f3ebb4cb4c673e51069ae530a941247d531a"}
Jul 15 12:53:08.966691 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:08.966688    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-1f25dafc/e2e-lifecycle-model-1f25dafc-kserve-694855486c-s22gf" event={"ID":"d0a71e4c-d41b-4648-a7d3-428431e94892","Type":"ContainerStarted","Data":"4a9a857acf54b9ff0c3863efbdf03fc9761ba97137cc4f4aa18554ce4d5a84d5"}
Jul 15 12:53:08.993330 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:08.993283    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-mt-1f25dafc/e2e-lifecycle-model-1f25dafc-kserve-694855486c-s22gf" podStartSLOduration=1.9932701210000001 podStartE2EDuration="1.993270121s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:53:07 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:53:08.992505606 +0000 UTC m=+1958.965076776" watchObservedRunningTime="2026-07-15 12:53:08.993270121 +0000 UTC m=+1958.965841278"
Jul 15 12:53:09.420907 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:09.420828    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:53:17.923475 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:17.923440    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:53:18.298207 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:18.298168    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-mt-1f25dafc/e2e-lifecycle-model-1f25dafc-kserve-694855486c-s22gf"
Jul 15 12:53:18.298404 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:18.298228    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-mt-1f25dafc/e2e-lifecycle-model-1f25dafc-kserve-694855486c-s22gf"
Jul 15 12:53:18.310689 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:18.310666    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-mt-1f25dafc/e2e-lifecycle-model-1f25dafc-kserve-694855486c-s22gf"
Jul 15 12:53:19.023905 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:19.023877    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-mt-1f25dafc/e2e-lifecycle-model-1f25dafc-kserve-694855486c-s22gf"
Jul 15 12:53:28.139714 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:28.139636    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:53:34.381358 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:34.381325    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1f25dafc-vczm6"]
Jul 15 12:53:34.384473 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:34.384456    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1f25dafc-vczm6"
Jul 15 12:53:34.387146 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:34.387112    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 12:53:34.387146 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:34.387139    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-267b6\""
Jul 15 12:53:34.393140 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:34.393117    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1f25dafc-vczm6"]
Jul 15 12:53:34.407979 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:34.407951    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b8d0004-31a4-4f43-83ea-66f20d862c6d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-1f25dafc-vczm6\" (UID: \"7b8d0004-31a4-4f43-83ea-66f20d862c6d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1f25dafc-vczm6"
Jul 15 12:53:34.508654 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:34.508618    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b8d0004-31a4-4f43-83ea-66f20d862c6d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-1f25dafc-vczm6\" (UID: \"7b8d0004-31a4-4f43-83ea-66f20d862c6d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1f25dafc-vczm6"
Jul 15 12:53:34.509216 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:34.509198    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b8d0004-31a4-4f43-83ea-66f20d862c6d-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-mt-1f25dafc-vczm6\" (UID: \"7b8d0004-31a4-4f43-83ea-66f20d862c6d\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1f25dafc-vczm6"
Jul 15 12:53:34.695355 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:34.695269    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1f25dafc-vczm6"
Jul 15 12:53:34.831877 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:34.831852    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1f25dafc-vczm6"]
Jul 15 12:53:34.833516 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:53:34.833489    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b8d0004_31a4_4f43_83ea_66f20d862c6d.slice/crio-a2073e81b9f96e033fd6cfbb93edbb8f93cc200686d2e5cebf4c1be00d1f030f WatchSource:0}: Error finding container a2073e81b9f96e033fd6cfbb93edbb8f93cc200686d2e5cebf4c1be00d1f030f: Status 404 returned error can't find the container with id a2073e81b9f96e033fd6cfbb93edbb8f93cc200686d2e5cebf4c1be00d1f030f
Jul 15 12:53:35.082519 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:35.082486    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1f25dafc-vczm6" event={"ID":"7b8d0004-31a4-4f43-83ea-66f20d862c6d","Type":"ContainerStarted","Data":"23db2121c30509e698b05ed9a3f1d341ff33fc6940e758f95013c78aab74020b"}
Jul 15 12:53:35.082687 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:35.082538    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1f25dafc-vczm6" event={"ID":"7b8d0004-31a4-4f43-83ea-66f20d862c6d","Type":"ContainerStarted","Data":"a2073e81b9f96e033fd6cfbb93edbb8f93cc200686d2e5cebf4c1be00d1f030f"}
Jul 15 12:53:35.105186 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:35.105135    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1f25dafc-vczm6" podStartSLOduration=1.105119121 podStartE2EDuration="1.105119121s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:53:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:53:35.104162424 +0000 UTC m=+1985.076733584" watchObservedRunningTime="2026-07-15 12:53:35.105119121 +0000 UTC m=+1985.077690328"
Jul 15 12:53:36.089306 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:36.089267    2559 generic.go:356] "Generic (PLEG): container finished" podID="7b8d0004-31a4-4f43-83ea-66f20d862c6d" containerID="23db2121c30509e698b05ed9a3f1d341ff33fc6940e758f95013c78aab74020b" exitCode=0
Jul 15 12:53:36.089684 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:36.089314    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1f25dafc-vczm6" event={"ID":"7b8d0004-31a4-4f43-83ea-66f20d862c6d","Type":"ContainerDied","Data":"23db2121c30509e698b05ed9a3f1d341ff33fc6940e758f95013c78aab74020b"}
Jul 15 12:53:37.226459 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:37.226433    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1f25dafc-vczm6"
Jul 15 12:53:37.333574 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:37.333544    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b8d0004-31a4-4f43-83ea-66f20d862c6d-maas-api-service-ca\") pod \"7b8d0004-31a4-4f43-83ea-66f20d862c6d\" (UID: \"7b8d0004-31a4-4f43-83ea-66f20d862c6d\") "
Jul 15 12:53:37.333903 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:37.333879    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b8d0004-31a4-4f43-83ea-66f20d862c6d-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7b8d0004-31a4-4f43-83ea-66f20d862c6d" (UID: "7b8d0004-31a4-4f43-83ea-66f20d862c6d"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:53:37.434515 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:37.434401    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b8d0004-31a4-4f43-83ea-66f20d862c6d-maas-api-service-ca\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:53:38.100145 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:38.100118    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1f25dafc-vczm6"
Jul 15 12:53:38.100145 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:38.100125    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-mt-1f25dafc-vczm6" event={"ID":"7b8d0004-31a4-4f43-83ea-66f20d862c6d","Type":"ContainerDied","Data":"a2073e81b9f96e033fd6cfbb93edbb8f93cc200686d2e5cebf4c1be00d1f030f"}
Jul 15 12:53:38.100348 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:38.100177    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a2073e81b9f96e033fd6cfbb93edbb8f93cc200686d2e5cebf4c1be00d1f030f"
Jul 15 12:53:44.918669 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:44.918637    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:53:48.336725 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:48.336695    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:53:49.502840 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:49.502804    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:53:54.462290 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:54.462255    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-1f25dafc/e2e-lifecycle-model-1f25dafc-kserve-694855486c-s22gf"]
Jul 15 12:53:54.562824 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:53:54.562787    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:54:09.482047 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:54:09.481989    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-mt-1f25dafc/e2e-lifecycle-model-1f25dafc-kserve-694855486c-s22gf" podUID="d0a71e4c-d41b-4648-a7d3-428431e94892" containerName="main" containerID="cri-o://68633a4001a89539bb4ae6d7a978f3ebb4cb4c673e51069ae530a941247d531a" gracePeriod=45
Jul 15 12:54:09.729724 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:54:09.729701    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-1f25dafc/e2e-lifecycle-model-1f25dafc-kserve-694855486c-s22gf"
Jul 15 12:54:09.902411 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:54:09.902312    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0a71e4c-d41b-4648-a7d3-428431e94892-tls-certs\") pod \"d0a71e4c-d41b-4648-a7d3-428431e94892\" (UID: \"d0a71e4c-d41b-4648-a7d3-428431e94892\") "
Jul 15 12:54:09.902411 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:54:09.902404    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0a71e4c-d41b-4648-a7d3-428431e94892-home\") pod \"d0a71e4c-d41b-4648-a7d3-428431e94892\" (UID: \"d0a71e4c-d41b-4648-a7d3-428431e94892\") "
Jul 15 12:54:09.902649 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:54:09.902429    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0a71e4c-d41b-4648-a7d3-428431e94892-dshm\") pod \"d0a71e4c-d41b-4648-a7d3-428431e94892\" (UID: \"d0a71e4c-d41b-4648-a7d3-428431e94892\") "
Jul 15 12:54:09.902649 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:54:09.902446    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0a71e4c-d41b-4648-a7d3-428431e94892-tmp-dir\") pod \"d0a71e4c-d41b-4648-a7d3-428431e94892\" (UID: \"d0a71e4c-d41b-4648-a7d3-428431e94892\") "
Jul 15 12:54:09.902649 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:54:09.902463    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wz9ct\" (UniqueName: \"kubernetes.io/projected/d0a71e4c-d41b-4648-a7d3-428431e94892-kube-api-access-wz9ct\") pod \"d0a71e4c-d41b-4648-a7d3-428431e94892\" (UID: \"d0a71e4c-d41b-4648-a7d3-428431e94892\") "
Jul 15 12:54:09.902649 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:54:09.902505    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0a71e4c-d41b-4648-a7d3-428431e94892-model-cache\") pod \"d0a71e4c-d41b-4648-a7d3-428431e94892\" (UID: \"d0a71e4c-d41b-4648-a7d3-428431e94892\") "
Jul 15 12:54:09.902837 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:54:09.902739    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0a71e4c-d41b-4648-a7d3-428431e94892-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d0a71e4c-d41b-4648-a7d3-428431e94892" (UID: "d0a71e4c-d41b-4648-a7d3-428431e94892"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:54:09.902837 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:54:09.902761    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0a71e4c-d41b-4648-a7d3-428431e94892-home" (OuterVolumeSpecName: "home") pod "d0a71e4c-d41b-4648-a7d3-428431e94892" (UID: "d0a71e4c-d41b-4648-a7d3-428431e94892"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:54:09.902924 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:54:09.902907    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0a71e4c-d41b-4648-a7d3-428431e94892-model-cache" (OuterVolumeSpecName: "model-cache") pod "d0a71e4c-d41b-4648-a7d3-428431e94892" (UID: "d0a71e4c-d41b-4648-a7d3-428431e94892"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:54:09.904735 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:54:09.904702    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d0a71e4c-d41b-4648-a7d3-428431e94892-kube-api-access-wz9ct" (OuterVolumeSpecName: "kube-api-access-wz9ct") pod "d0a71e4c-d41b-4648-a7d3-428431e94892" (UID: "d0a71e4c-d41b-4648-a7d3-428431e94892"). InnerVolumeSpecName "kube-api-access-wz9ct". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:54:09.904875 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:54:09.904858    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d0a71e4c-d41b-4648-a7d3-428431e94892-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d0a71e4c-d41b-4648-a7d3-428431e94892" (UID: "d0a71e4c-d41b-4648-a7d3-428431e94892"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:54:09.904942 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:54:09.904882    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d0a71e4c-d41b-4648-a7d3-428431e94892-dshm" (OuterVolumeSpecName: "dshm") pod "d0a71e4c-d41b-4648-a7d3-428431e94892" (UID: "d0a71e4c-d41b-4648-a7d3-428431e94892"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:54:10.003518 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:54:10.003469    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d0a71e4c-d41b-4648-a7d3-428431e94892-model-cache\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:54:10.003518 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:54:10.003516    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d0a71e4c-d41b-4648-a7d3-428431e94892-tls-certs\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:54:10.003518 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:54:10.003524    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d0a71e4c-d41b-4648-a7d3-428431e94892-home\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:54:10.003744 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:54:10.003532    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d0a71e4c-d41b-4648-a7d3-428431e94892-dshm\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:54:10.003744 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:54:10.003539    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d0a71e4c-d41b-4648-a7d3-428431e94892-tmp-dir\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:54:10.003744 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:54:10.003547    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wz9ct\" (UniqueName: \"kubernetes.io/projected/d0a71e4c-d41b-4648-a7d3-428431e94892-kube-api-access-wz9ct\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:54:10.255489 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:54:10.255449    2559 generic.go:356] "Generic (PLEG): container finished" podID="d0a71e4c-d41b-4648-a7d3-428431e94892" containerID="68633a4001a89539bb4ae6d7a978f3ebb4cb4c673e51069ae530a941247d531a" exitCode=0
Jul 15 12:54:10.255662 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:54:10.255498    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-mt-1f25dafc/e2e-lifecycle-model-1f25dafc-kserve-694855486c-s22gf"
Jul 15 12:54:10.255662 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:54:10.255507    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-1f25dafc/e2e-lifecycle-model-1f25dafc-kserve-694855486c-s22gf" event={"ID":"d0a71e4c-d41b-4648-a7d3-428431e94892","Type":"ContainerDied","Data":"68633a4001a89539bb4ae6d7a978f3ebb4cb4c673e51069ae530a941247d531a"}
Jul 15 12:54:10.255662 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:54:10.255548    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-mt-1f25dafc/e2e-lifecycle-model-1f25dafc-kserve-694855486c-s22gf" event={"ID":"d0a71e4c-d41b-4648-a7d3-428431e94892","Type":"ContainerDied","Data":"4a9a857acf54b9ff0c3863efbdf03fc9761ba97137cc4f4aa18554ce4d5a84d5"}
Jul 15 12:54:10.255662 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:54:10.255572    2559 scope.go:117] "RemoveContainer" containerID="68633a4001a89539bb4ae6d7a978f3ebb4cb4c673e51069ae530a941247d531a"
Jul 15 12:54:10.264351 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:54:10.264334    2559 scope.go:117] "RemoveContainer" containerID="68633a4001a89539bb4ae6d7a978f3ebb4cb4c673e51069ae530a941247d531a"
Jul 15 12:54:10.264622 ip-10-0-140-67 kubenswrapper[2559]: E0715 12:54:10.264600    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"68633a4001a89539bb4ae6d7a978f3ebb4cb4c673e51069ae530a941247d531a\": container with ID starting with 68633a4001a89539bb4ae6d7a978f3ebb4cb4c673e51069ae530a941247d531a not found: ID does not exist" containerID="68633a4001a89539bb4ae6d7a978f3ebb4cb4c673e51069ae530a941247d531a"
Jul 15 12:54:10.264691 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:54:10.264628    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"68633a4001a89539bb4ae6d7a978f3ebb4cb4c673e51069ae530a941247d531a"} err="failed to get container status \"68633a4001a89539bb4ae6d7a978f3ebb4cb4c673e51069ae530a941247d531a\": rpc error: code = NotFound desc = could not find container \"68633a4001a89539bb4ae6d7a978f3ebb4cb4c673e51069ae530a941247d531a\": container with ID starting with 68633a4001a89539bb4ae6d7a978f3ebb4cb4c673e51069ae530a941247d531a not found: ID does not exist"
Jul 15 12:54:10.278174 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:54:10.278152    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-mt-1f25dafc/e2e-lifecycle-model-1f25dafc-kserve-694855486c-s22gf"]
Jul 15 12:54:10.283374 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:54:10.283341    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-mt-1f25dafc/e2e-lifecycle-model-1f25dafc-kserve-694855486c-s22gf"]
Jul 15 12:54:10.584520 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:54:10.584442    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d0a71e4c-d41b-4648-a7d3-428431e94892" path="/var/lib/kubelet/pods/d0a71e4c-d41b-4648-a7d3-428431e94892/volumes"
Jul 15 12:54:30.611434 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:54:30.611404    2559 scope.go:117] "RemoveContainer" containerID="618091038be86e579c462cbfee9d2fd7429c0f58ac0a84d978865b7dfe2a8384"
Jul 15 12:54:30.995103 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:54:30.995065    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:54:32.330822 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:54:32.330785    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:54:38.848299 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:54:38.848258    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:54:38.954950 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:54:38.954914    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:54:39.880506 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:54:39.880470    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:54:39.980867 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:54:39.980810    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:54:51.918795 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:54:51.918755    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:54:52.160047 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:54:52.159958    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:54:53.255150 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:54:53.255094    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:54:53.417582 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:54:53.417542    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:54:53.562886 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:54:53.562791    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:54:54.358765 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:54:54.358730    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:54:54.452954 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:54:54.452911    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:54:55.687522 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:54:55.687484    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:54:56.066265 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:54:56.066233    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:55:02.460541 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:55:02.460494    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:55:02.633027 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:55:02.632999    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:55:03.229763 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:55:03.229730    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:55:07.525277 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:55:07.525248    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:55:09.351813 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:55:09.351766    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:55:09.454492 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:55:09.454458    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:55:09.546336 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:55:09.546291    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:55:20.109169 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:55:20.109096    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:55:20.452826 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:55:20.452704    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:55:29.683322 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:55:29.683281    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:55:30.557438 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:55:30.557409    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vp8z_009c50dc-2f9e-455b-95f2-a03e7ed3defd/ovn-acl-logging/0.log"
Jul 15 12:55:30.561299 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:55:30.561279    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vp8z_009c50dc-2f9e-455b-95f2-a03e7ed3defd/ovn-acl-logging/0.log"
Jul 15 12:55:30.632290 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:55:30.632261    2559 scope.go:117] "RemoveContainer" containerID="4e2307c35e28098ec294017dc5eba2ec803d94cb98209f839e3be18105e59ff8"
Jul 15 12:55:41.527595 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:55:41.527551    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:55:47.809199 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:55:47.809167    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:55:47.915381 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:55:47.915309    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:55:48.165259 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:55:48.165153    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:55:48.503139 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:55:48.503096    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:55:48.791991 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:55:48.791886    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:55:51.884135 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:55:51.884088    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:55:51.987945 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:55:51.987903    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:55:52.175166 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:55:52.175069    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:55:52.378963 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:55:52.378929    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:55:52.822400 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:55:52.822350    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:55:52.972538 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:55:52.972497    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:55:56.523251 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:55:56.523214    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:55:56.849809 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:55:56.849717    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:55:57.246346 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:55:57.246294    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:55:57.418940 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:55:57.418901    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:55:59.622888 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:55:59.622845    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:56:00.700022 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:00.699985    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:56:00.873729 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:00.873699    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:56:01.119385 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:01.119337    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:56:01.255604 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:01.255571    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:56:01.756272 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:01.756239    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:56:01.909885 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:01.909857    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:56:03.390976 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:03.390937    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:56:05.128550 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:05.128520    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:56:11.832307 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:11.832276    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-a-4060a9/test-model-4060a9-kserve-8567457bdf-j674p"]
Jul 15 12:56:11.832742 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:11.832592    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d0a71e4c-d41b-4648-a7d3-428431e94892" containerName="main"
Jul 15 12:56:11.832742 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:11.832604    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d0a71e4c-d41b-4648-a7d3-428431e94892" containerName="main"
Jul 15 12:56:11.832742 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:11.832623    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b8d0004-31a4-4f43-83ea-66f20d862c6d" containerName="revoke-keys"
Jul 15 12:56:11.832742 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:11.832630    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b8d0004-31a4-4f43-83ea-66f20d862c6d" containerName="revoke-keys"
Jul 15 12:56:11.832742 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:11.832686    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b8d0004-31a4-4f43-83ea-66f20d862c6d" containerName="revoke-keys"
Jul 15 12:56:11.832742 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:11.832695    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d0a71e4c-d41b-4648-a7d3-428431e94892" containerName="main"
Jul 15 12:56:11.835571 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:11.835554    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-4060a9/test-model-4060a9-kserve-8567457bdf-j674p"
Jul 15 12:56:11.839519 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:11.839493    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-4060a9\"/\"default-dockercfg-h49cx\""
Jul 15 12:56:11.839668 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:11.839497    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-4060a9\"/\"openshift-service-ca.crt\""
Jul 15 12:56:11.839668 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:11.839496    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-a-4060a9\"/\"test-model-4060a9-kserve-self-signed-certs\""
Jul 15 12:56:11.839668 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:11.839497    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-a-4060a9\"/\"kube-root-ca.crt\""
Jul 15 12:56:11.847618 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:11.847594    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d7c6f765-9ad5-449f-b1d4-43bf2759b808-dshm\") pod \"test-model-4060a9-kserve-8567457bdf-j674p\" (UID: \"d7c6f765-9ad5-449f-b1d4-43bf2759b808\") " pod="ai-tenant-e2e-inf-a-4060a9/test-model-4060a9-kserve-8567457bdf-j674p"
Jul 15 12:56:11.847750 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:11.847626    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-td7jk\" (UniqueName: \"kubernetes.io/projected/d7c6f765-9ad5-449f-b1d4-43bf2759b808-kube-api-access-td7jk\") pod \"test-model-4060a9-kserve-8567457bdf-j674p\" (UID: \"d7c6f765-9ad5-449f-b1d4-43bf2759b808\") " pod="ai-tenant-e2e-inf-a-4060a9/test-model-4060a9-kserve-8567457bdf-j674p"
Jul 15 12:56:11.847750 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:11.847698    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d7c6f765-9ad5-449f-b1d4-43bf2759b808-home\") pod \"test-model-4060a9-kserve-8567457bdf-j674p\" (UID: \"d7c6f765-9ad5-449f-b1d4-43bf2759b808\") " pod="ai-tenant-e2e-inf-a-4060a9/test-model-4060a9-kserve-8567457bdf-j674p"
Jul 15 12:56:11.847853 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:11.847764    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7c6f765-9ad5-449f-b1d4-43bf2759b808-tls-certs\") pod \"test-model-4060a9-kserve-8567457bdf-j674p\" (UID: \"d7c6f765-9ad5-449f-b1d4-43bf2759b808\") " pod="ai-tenant-e2e-inf-a-4060a9/test-model-4060a9-kserve-8567457bdf-j674p"
Jul 15 12:56:11.847853 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:11.847789    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d7c6f765-9ad5-449f-b1d4-43bf2759b808-model-cache\") pod \"test-model-4060a9-kserve-8567457bdf-j674p\" (UID: \"d7c6f765-9ad5-449f-b1d4-43bf2759b808\") " pod="ai-tenant-e2e-inf-a-4060a9/test-model-4060a9-kserve-8567457bdf-j674p"
Jul 15 12:56:11.847853 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:11.847803    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d7c6f765-9ad5-449f-b1d4-43bf2759b808-tmp-dir\") pod \"test-model-4060a9-kserve-8567457bdf-j674p\" (UID: \"d7c6f765-9ad5-449f-b1d4-43bf2759b808\") " pod="ai-tenant-e2e-inf-a-4060a9/test-model-4060a9-kserve-8567457bdf-j674p"
Jul 15 12:56:11.855995 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:11.855970    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-4060a9/test-model-4060a9-kserve-8567457bdf-j674p"]
Jul 15 12:56:11.948208 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:11.948152    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7c6f765-9ad5-449f-b1d4-43bf2759b808-tls-certs\") pod \"test-model-4060a9-kserve-8567457bdf-j674p\" (UID: \"d7c6f765-9ad5-449f-b1d4-43bf2759b808\") " pod="ai-tenant-e2e-inf-a-4060a9/test-model-4060a9-kserve-8567457bdf-j674p"
Jul 15 12:56:11.948208 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:11.948204    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d7c6f765-9ad5-449f-b1d4-43bf2759b808-model-cache\") pod \"test-model-4060a9-kserve-8567457bdf-j674p\" (UID: \"d7c6f765-9ad5-449f-b1d4-43bf2759b808\") " pod="ai-tenant-e2e-inf-a-4060a9/test-model-4060a9-kserve-8567457bdf-j674p"
Jul 15 12:56:11.948500 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:11.948231    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d7c6f765-9ad5-449f-b1d4-43bf2759b808-tmp-dir\") pod \"test-model-4060a9-kserve-8567457bdf-j674p\" (UID: \"d7c6f765-9ad5-449f-b1d4-43bf2759b808\") " pod="ai-tenant-e2e-inf-a-4060a9/test-model-4060a9-kserve-8567457bdf-j674p"
Jul 15 12:56:11.948500 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:11.948300    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d7c6f765-9ad5-449f-b1d4-43bf2759b808-dshm\") pod \"test-model-4060a9-kserve-8567457bdf-j674p\" (UID: \"d7c6f765-9ad5-449f-b1d4-43bf2759b808\") " pod="ai-tenant-e2e-inf-a-4060a9/test-model-4060a9-kserve-8567457bdf-j674p"
Jul 15 12:56:11.948500 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:11.948323    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-td7jk\" (UniqueName: \"kubernetes.io/projected/d7c6f765-9ad5-449f-b1d4-43bf2759b808-kube-api-access-td7jk\") pod \"test-model-4060a9-kserve-8567457bdf-j674p\" (UID: \"d7c6f765-9ad5-449f-b1d4-43bf2759b808\") " pod="ai-tenant-e2e-inf-a-4060a9/test-model-4060a9-kserve-8567457bdf-j674p"
Jul 15 12:56:11.948500 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:11.948402    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d7c6f765-9ad5-449f-b1d4-43bf2759b808-home\") pod \"test-model-4060a9-kserve-8567457bdf-j674p\" (UID: \"d7c6f765-9ad5-449f-b1d4-43bf2759b808\") " pod="ai-tenant-e2e-inf-a-4060a9/test-model-4060a9-kserve-8567457bdf-j674p"
Jul 15 12:56:11.948709 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:11.948644    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d7c6f765-9ad5-449f-b1d4-43bf2759b808-model-cache\") pod \"test-model-4060a9-kserve-8567457bdf-j674p\" (UID: \"d7c6f765-9ad5-449f-b1d4-43bf2759b808\") " pod="ai-tenant-e2e-inf-a-4060a9/test-model-4060a9-kserve-8567457bdf-j674p"
Jul 15 12:56:11.948709 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:11.948679    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d7c6f765-9ad5-449f-b1d4-43bf2759b808-tmp-dir\") pod \"test-model-4060a9-kserve-8567457bdf-j674p\" (UID: \"d7c6f765-9ad5-449f-b1d4-43bf2759b808\") " pod="ai-tenant-e2e-inf-a-4060a9/test-model-4060a9-kserve-8567457bdf-j674p"
Jul 15 12:56:11.948821 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:11.948729    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d7c6f765-9ad5-449f-b1d4-43bf2759b808-home\") pod \"test-model-4060a9-kserve-8567457bdf-j674p\" (UID: \"d7c6f765-9ad5-449f-b1d4-43bf2759b808\") " pod="ai-tenant-e2e-inf-a-4060a9/test-model-4060a9-kserve-8567457bdf-j674p"
Jul 15 12:56:11.950614 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:11.950584    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d7c6f765-9ad5-449f-b1d4-43bf2759b808-dshm\") pod \"test-model-4060a9-kserve-8567457bdf-j674p\" (UID: \"d7c6f765-9ad5-449f-b1d4-43bf2759b808\") " pod="ai-tenant-e2e-inf-a-4060a9/test-model-4060a9-kserve-8567457bdf-j674p"
Jul 15 12:56:11.950858 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:11.950839    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7c6f765-9ad5-449f-b1d4-43bf2759b808-tls-certs\") pod \"test-model-4060a9-kserve-8567457bdf-j674p\" (UID: \"d7c6f765-9ad5-449f-b1d4-43bf2759b808\") " pod="ai-tenant-e2e-inf-a-4060a9/test-model-4060a9-kserve-8567457bdf-j674p"
Jul 15 12:56:11.957768 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:11.957748    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-td7jk\" (UniqueName: \"kubernetes.io/projected/d7c6f765-9ad5-449f-b1d4-43bf2759b808-kube-api-access-td7jk\") pod \"test-model-4060a9-kserve-8567457bdf-j674p\" (UID: \"d7c6f765-9ad5-449f-b1d4-43bf2759b808\") " pod="ai-tenant-e2e-inf-a-4060a9/test-model-4060a9-kserve-8567457bdf-j674p"
Jul 15 12:56:12.144584 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:12.144500    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-4060a9/test-model-4060a9-kserve-8567457bdf-j674p"
Jul 15 12:56:12.286048 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:12.286018    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-a-4060a9/test-model-4060a9-kserve-8567457bdf-j674p"]
Jul 15 12:56:12.289936 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:56:12.289906    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd7c6f765_9ad5_449f_b1d4_43bf2759b808.slice/crio-2f001b9d1c22dedd8507df7a1aa7184c7a122c80959f3a3c19db69794292ca48 WatchSource:0}: Error finding container 2f001b9d1c22dedd8507df7a1aa7184c7a122c80959f3a3c19db69794292ca48: Status 404 returned error can't find the container with id 2f001b9d1c22dedd8507df7a1aa7184c7a122c80959f3a3c19db69794292ca48
Jul 15 12:56:12.799358 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:12.799315    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-4060a9/test-model-4060a9-kserve-8567457bdf-j674p" event={"ID":"d7c6f765-9ad5-449f-b1d4-43bf2759b808","Type":"ContainerStarted","Data":"4bab223531dd15b2d5757747cfb32f652a98e2e97cf4b66f0e29f9fa93b0775c"}
Jul 15 12:56:12.799358 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:12.799354    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-4060a9/test-model-4060a9-kserve-8567457bdf-j674p" event={"ID":"d7c6f765-9ad5-449f-b1d4-43bf2759b808","Type":"ContainerStarted","Data":"2f001b9d1c22dedd8507df7a1aa7184c7a122c80959f3a3c19db69794292ca48"}
Jul 15 12:56:12.822109 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:12.822035    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-a-4060a9/test-model-4060a9-kserve-8567457bdf-j674p" podStartSLOduration=1.8220194250000001 podStartE2EDuration="1.822019425s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:56:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:56:12.820565788 +0000 UTC m=+2142.793136959" watchObservedRunningTime="2026-07-15 12:56:12.822019425 +0000 UTC m=+2142.794590582"
Jul 15 12:56:13.433012 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:13.432972    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:56:13.520536 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:13.520506    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:56:15.454859 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:15.454826    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:56:15.557397 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:15.557332    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:56:22.145717 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:22.145610    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-a-4060a9/test-model-4060a9-kserve-8567457bdf-j674p"
Jul 15 12:56:22.145717 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:22.145686    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-a-4060a9/test-model-4060a9-kserve-8567457bdf-j674p"
Jul 15 12:56:22.158156 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:22.158128    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-a-4060a9/test-model-4060a9-kserve-8567457bdf-j674p"
Jul 15 12:56:22.856861 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:22.856831    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-a-4060a9/test-model-4060a9-kserve-8567457bdf-j674p"
Jul 15 12:56:23.118699 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:23.118611    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:56:28.528807 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:28.528770    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:56:28.679745 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:28.679713    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:56:35.492266 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:35.492232    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-inf-b-ee3fe5/test-model-ee3fe5-kserve-6658b776b7-7nc7s"]
Jul 15 12:56:35.495695 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:35.495677    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-ee3fe5/test-model-ee3fe5-kserve-6658b776b7-7nc7s"
Jul 15 12:56:35.499131 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:35.499102    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-ee3fe5\"/\"default-dockercfg-gcdb5\""
Jul 15 12:56:35.499131 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:35.499130    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-ee3fe5\"/\"kube-root-ca.crt\""
Jul 15 12:56:35.499317 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:35.499106    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-inf-b-ee3fe5\"/\"openshift-service-ca.crt\""
Jul 15 12:56:35.499774 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:35.499760    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-inf-b-ee3fe5\"/\"test-model-ee3fe5-kserve-self-signed-certs\""
Jul 15 12:56:35.508512 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:35.508491    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-ee3fe5/test-model-ee3fe5-kserve-6658b776b7-7nc7s"]
Jul 15 12:56:35.529463 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:35.529433    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:56:35.553880 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:35.553846    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wwlv4\" (UniqueName: \"kubernetes.io/projected/136bc100-b893-4212-a663-7a837778f738-kube-api-access-wwlv4\") pod \"test-model-ee3fe5-kserve-6658b776b7-7nc7s\" (UID: \"136bc100-b893-4212-a663-7a837778f738\") " pod="ai-tenant-e2e-inf-b-ee3fe5/test-model-ee3fe5-kserve-6658b776b7-7nc7s"
Jul 15 12:56:35.554044 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:35.553884    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/136bc100-b893-4212-a663-7a837778f738-tmp-dir\") pod \"test-model-ee3fe5-kserve-6658b776b7-7nc7s\" (UID: \"136bc100-b893-4212-a663-7a837778f738\") " pod="ai-tenant-e2e-inf-b-ee3fe5/test-model-ee3fe5-kserve-6658b776b7-7nc7s"
Jul 15 12:56:35.554044 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:35.553926    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/136bc100-b893-4212-a663-7a837778f738-model-cache\") pod \"test-model-ee3fe5-kserve-6658b776b7-7nc7s\" (UID: \"136bc100-b893-4212-a663-7a837778f738\") " pod="ai-tenant-e2e-inf-b-ee3fe5/test-model-ee3fe5-kserve-6658b776b7-7nc7s"
Jul 15 12:56:35.554044 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:35.554002    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/136bc100-b893-4212-a663-7a837778f738-dshm\") pod \"test-model-ee3fe5-kserve-6658b776b7-7nc7s\" (UID: \"136bc100-b893-4212-a663-7a837778f738\") " pod="ai-tenant-e2e-inf-b-ee3fe5/test-model-ee3fe5-kserve-6658b776b7-7nc7s"
Jul 15 12:56:35.554044 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:35.554034    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/136bc100-b893-4212-a663-7a837778f738-home\") pod \"test-model-ee3fe5-kserve-6658b776b7-7nc7s\" (UID: \"136bc100-b893-4212-a663-7a837778f738\") " pod="ai-tenant-e2e-inf-b-ee3fe5/test-model-ee3fe5-kserve-6658b776b7-7nc7s"
Jul 15 12:56:35.554192 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:35.554067    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/136bc100-b893-4212-a663-7a837778f738-tls-certs\") pod \"test-model-ee3fe5-kserve-6658b776b7-7nc7s\" (UID: \"136bc100-b893-4212-a663-7a837778f738\") " pod="ai-tenant-e2e-inf-b-ee3fe5/test-model-ee3fe5-kserve-6658b776b7-7nc7s"
Jul 15 12:56:35.655525 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:35.655475    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/136bc100-b893-4212-a663-7a837778f738-model-cache\") pod \"test-model-ee3fe5-kserve-6658b776b7-7nc7s\" (UID: \"136bc100-b893-4212-a663-7a837778f738\") " pod="ai-tenant-e2e-inf-b-ee3fe5/test-model-ee3fe5-kserve-6658b776b7-7nc7s"
Jul 15 12:56:35.655733 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:35.655546    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/136bc100-b893-4212-a663-7a837778f738-dshm\") pod \"test-model-ee3fe5-kserve-6658b776b7-7nc7s\" (UID: \"136bc100-b893-4212-a663-7a837778f738\") " pod="ai-tenant-e2e-inf-b-ee3fe5/test-model-ee3fe5-kserve-6658b776b7-7nc7s"
Jul 15 12:56:35.655733 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:35.655570    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/136bc100-b893-4212-a663-7a837778f738-home\") pod \"test-model-ee3fe5-kserve-6658b776b7-7nc7s\" (UID: \"136bc100-b893-4212-a663-7a837778f738\") " pod="ai-tenant-e2e-inf-b-ee3fe5/test-model-ee3fe5-kserve-6658b776b7-7nc7s"
Jul 15 12:56:35.655733 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:35.655604    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/136bc100-b893-4212-a663-7a837778f738-tls-certs\") pod \"test-model-ee3fe5-kserve-6658b776b7-7nc7s\" (UID: \"136bc100-b893-4212-a663-7a837778f738\") " pod="ai-tenant-e2e-inf-b-ee3fe5/test-model-ee3fe5-kserve-6658b776b7-7nc7s"
Jul 15 12:56:35.655733 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:35.655625    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wwlv4\" (UniqueName: \"kubernetes.io/projected/136bc100-b893-4212-a663-7a837778f738-kube-api-access-wwlv4\") pod \"test-model-ee3fe5-kserve-6658b776b7-7nc7s\" (UID: \"136bc100-b893-4212-a663-7a837778f738\") " pod="ai-tenant-e2e-inf-b-ee3fe5/test-model-ee3fe5-kserve-6658b776b7-7nc7s"
Jul 15 12:56:35.655733 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:35.655650    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/136bc100-b893-4212-a663-7a837778f738-tmp-dir\") pod \"test-model-ee3fe5-kserve-6658b776b7-7nc7s\" (UID: \"136bc100-b893-4212-a663-7a837778f738\") " pod="ai-tenant-e2e-inf-b-ee3fe5/test-model-ee3fe5-kserve-6658b776b7-7nc7s"
Jul 15 12:56:35.656035 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:35.655950    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/136bc100-b893-4212-a663-7a837778f738-model-cache\") pod \"test-model-ee3fe5-kserve-6658b776b7-7nc7s\" (UID: \"136bc100-b893-4212-a663-7a837778f738\") " pod="ai-tenant-e2e-inf-b-ee3fe5/test-model-ee3fe5-kserve-6658b776b7-7nc7s"
Jul 15 12:56:35.656035 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:35.655984    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/136bc100-b893-4212-a663-7a837778f738-home\") pod \"test-model-ee3fe5-kserve-6658b776b7-7nc7s\" (UID: \"136bc100-b893-4212-a663-7a837778f738\") " pod="ai-tenant-e2e-inf-b-ee3fe5/test-model-ee3fe5-kserve-6658b776b7-7nc7s"
Jul 15 12:56:35.656104 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:35.656084    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/136bc100-b893-4212-a663-7a837778f738-tmp-dir\") pod \"test-model-ee3fe5-kserve-6658b776b7-7nc7s\" (UID: \"136bc100-b893-4212-a663-7a837778f738\") " pod="ai-tenant-e2e-inf-b-ee3fe5/test-model-ee3fe5-kserve-6658b776b7-7nc7s"
Jul 15 12:56:35.657840 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:35.657819    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/136bc100-b893-4212-a663-7a837778f738-dshm\") pod \"test-model-ee3fe5-kserve-6658b776b7-7nc7s\" (UID: \"136bc100-b893-4212-a663-7a837778f738\") " pod="ai-tenant-e2e-inf-b-ee3fe5/test-model-ee3fe5-kserve-6658b776b7-7nc7s"
Jul 15 12:56:35.658137 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:35.658120    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/136bc100-b893-4212-a663-7a837778f738-tls-certs\") pod \"test-model-ee3fe5-kserve-6658b776b7-7nc7s\" (UID: \"136bc100-b893-4212-a663-7a837778f738\") " pod="ai-tenant-e2e-inf-b-ee3fe5/test-model-ee3fe5-kserve-6658b776b7-7nc7s"
Jul 15 12:56:35.665328 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:35.665305    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wwlv4\" (UniqueName: \"kubernetes.io/projected/136bc100-b893-4212-a663-7a837778f738-kube-api-access-wwlv4\") pod \"test-model-ee3fe5-kserve-6658b776b7-7nc7s\" (UID: \"136bc100-b893-4212-a663-7a837778f738\") " pod="ai-tenant-e2e-inf-b-ee3fe5/test-model-ee3fe5-kserve-6658b776b7-7nc7s"
Jul 15 12:56:35.804696 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:35.804599    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-ee3fe5/test-model-ee3fe5-kserve-6658b776b7-7nc7s"
Jul 15 12:56:35.941242 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:35.941211    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-inf-b-ee3fe5/test-model-ee3fe5-kserve-6658b776b7-7nc7s"]
Jul 15 12:56:35.944332 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:56:35.944306    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod136bc100_b893_4212_a663_7a837778f738.slice/crio-1d68190eab29efab3fa66c6719eb0fc248f238de18074ac0b428adaeccb2dfe3 WatchSource:0}: Error finding container 1d68190eab29efab3fa66c6719eb0fc248f238de18074ac0b428adaeccb2dfe3: Status 404 returned error can't find the container with id 1d68190eab29efab3fa66c6719eb0fc248f238de18074ac0b428adaeccb2dfe3
Jul 15 12:56:36.911810 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:36.911772    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-ee3fe5/test-model-ee3fe5-kserve-6658b776b7-7nc7s" event={"ID":"136bc100-b893-4212-a663-7a837778f738","Type":"ContainerStarted","Data":"a5a241708d92034c8a905e037dee1046202ddcccfd6d7d5eb43bfd6061ba4ff5"}
Jul 15 12:56:36.911810 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:36.911820    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-ee3fe5/test-model-ee3fe5-kserve-6658b776b7-7nc7s" event={"ID":"136bc100-b893-4212-a663-7a837778f738","Type":"ContainerStarted","Data":"1d68190eab29efab3fa66c6719eb0fc248f238de18074ac0b428adaeccb2dfe3"}
Jul 15 12:56:36.932077 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:36.932029    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-inf-b-ee3fe5/test-model-ee3fe5-kserve-6658b776b7-7nc7s" podStartSLOduration=1.932013289 podStartE2EDuration="1.932013289s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:56:35 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:56:36.931595193 +0000 UTC m=+2166.904166372" watchObservedRunningTime="2026-07-15 12:56:36.932013289 +0000 UTC m=+2166.904584446"
Jul 15 12:56:38.925255 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:38.925221    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:56:45.805539 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:45.805499    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-inf-b-ee3fe5/test-model-ee3fe5-kserve-6658b776b7-7nc7s"
Jul 15 12:56:45.805946 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:45.805553    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-inf-b-ee3fe5/test-model-ee3fe5-kserve-6658b776b7-7nc7s"
Jul 15 12:56:45.817756 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:45.817729    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-inf-b-ee3fe5/test-model-ee3fe5-kserve-6658b776b7-7nc7s"
Jul 15 12:56:45.962331 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:45.962299    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-inf-b-ee3fe5/test-model-ee3fe5-kserve-6658b776b7-7nc7s"
Jul 15 12:56:56.436326 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:56:56.436289    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:57:13.999322 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:13.999292    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-4060a9/test-model-4060a9-kserve-8567457bdf-j674p"]
Jul 15 12:57:14.030103 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:14.030058    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:57:14.913304 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:14.913269    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-ee3fe5/test-model-ee3fe5-kserve-6658b776b7-7nc7s"]
Jul 15 12:57:15.245606 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:15.245575    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:57:15.805987 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:15.805951    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:57:15.929096 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:15.929052    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:57:19.061535 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:19.061505    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:57:25.988754 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:25.988718    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:57:29.019067 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:29.019023    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-a-4060a9/test-model-4060a9-kserve-8567457bdf-j674p" podUID="d7c6f765-9ad5-449f-b1d4-43bf2759b808" containerName="main" containerID="cri-o://4bab223531dd15b2d5757747cfb32f652a98e2e97cf4b66f0e29f9fa93b0775c" gracePeriod=45
Jul 15 12:57:29.146145 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:29.146116    2559 generic.go:356] "Generic (PLEG): container finished" podID="d7c6f765-9ad5-449f-b1d4-43bf2759b808" containerID="4bab223531dd15b2d5757747cfb32f652a98e2e97cf4b66f0e29f9fa93b0775c" exitCode=0
Jul 15 12:57:29.146255 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:29.146191    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-4060a9/test-model-4060a9-kserve-8567457bdf-j674p" event={"ID":"d7c6f765-9ad5-449f-b1d4-43bf2759b808","Type":"ContainerDied","Data":"4bab223531dd15b2d5757747cfb32f652a98e2e97cf4b66f0e29f9fa93b0775c"}
Jul 15 12:57:29.257929 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:29.257903    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-4060a9/test-model-4060a9-kserve-8567457bdf-j674p"
Jul 15 12:57:29.321242 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:29.321161    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-td7jk\" (UniqueName: \"kubernetes.io/projected/d7c6f765-9ad5-449f-b1d4-43bf2759b808-kube-api-access-td7jk\") pod \"d7c6f765-9ad5-449f-b1d4-43bf2759b808\" (UID: \"d7c6f765-9ad5-449f-b1d4-43bf2759b808\") "
Jul 15 12:57:29.321428 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:29.321247    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d7c6f765-9ad5-449f-b1d4-43bf2759b808-dshm\") pod \"d7c6f765-9ad5-449f-b1d4-43bf2759b808\" (UID: \"d7c6f765-9ad5-449f-b1d4-43bf2759b808\") "
Jul 15 12:57:29.321428 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:29.321263    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d7c6f765-9ad5-449f-b1d4-43bf2759b808-tmp-dir\") pod \"d7c6f765-9ad5-449f-b1d4-43bf2759b808\" (UID: \"d7c6f765-9ad5-449f-b1d4-43bf2759b808\") "
Jul 15 12:57:29.321428 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:29.321292    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d7c6f765-9ad5-449f-b1d4-43bf2759b808-home\") pod \"d7c6f765-9ad5-449f-b1d4-43bf2759b808\" (UID: \"d7c6f765-9ad5-449f-b1d4-43bf2759b808\") "
Jul 15 12:57:29.321428 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:29.321318    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d7c6f765-9ad5-449f-b1d4-43bf2759b808-model-cache\") pod \"d7c6f765-9ad5-449f-b1d4-43bf2759b808\" (UID: \"d7c6f765-9ad5-449f-b1d4-43bf2759b808\") "
Jul 15 12:57:29.321428 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:29.321350    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7c6f765-9ad5-449f-b1d4-43bf2759b808-tls-certs\") pod \"d7c6f765-9ad5-449f-b1d4-43bf2759b808\" (UID: \"d7c6f765-9ad5-449f-b1d4-43bf2759b808\") "
Jul 15 12:57:29.321697 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:29.321556    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7c6f765-9ad5-449f-b1d4-43bf2759b808-model-cache" (OuterVolumeSpecName: "model-cache") pod "d7c6f765-9ad5-449f-b1d4-43bf2759b808" (UID: "d7c6f765-9ad5-449f-b1d4-43bf2759b808"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:57:29.321697 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:29.321600    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7c6f765-9ad5-449f-b1d4-43bf2759b808-home" (OuterVolumeSpecName: "home") pod "d7c6f765-9ad5-449f-b1d4-43bf2759b808" (UID: "d7c6f765-9ad5-449f-b1d4-43bf2759b808"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:57:29.321697 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:29.321613    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7c6f765-9ad5-449f-b1d4-43bf2759b808-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d7c6f765-9ad5-449f-b1d4-43bf2759b808" (UID: "d7c6f765-9ad5-449f-b1d4-43bf2759b808"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:57:29.321697 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:29.321675    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d7c6f765-9ad5-449f-b1d4-43bf2759b808-model-cache\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:57:29.323480 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:29.323455    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d7c6f765-9ad5-449f-b1d4-43bf2759b808-dshm" (OuterVolumeSpecName: "dshm") pod "d7c6f765-9ad5-449f-b1d4-43bf2759b808" (UID: "d7c6f765-9ad5-449f-b1d4-43bf2759b808"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:57:29.323480 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:29.323466    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7c6f765-9ad5-449f-b1d4-43bf2759b808-kube-api-access-td7jk" (OuterVolumeSpecName: "kube-api-access-td7jk") pod "d7c6f765-9ad5-449f-b1d4-43bf2759b808" (UID: "d7c6f765-9ad5-449f-b1d4-43bf2759b808"). InnerVolumeSpecName "kube-api-access-td7jk". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:57:29.323634 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:29.323514    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7c6f765-9ad5-449f-b1d4-43bf2759b808-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d7c6f765-9ad5-449f-b1d4-43bf2759b808" (UID: "d7c6f765-9ad5-449f-b1d4-43bf2759b808"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:57:29.422432 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:29.422398    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d7c6f765-9ad5-449f-b1d4-43bf2759b808-dshm\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:57:29.422589 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:29.422443    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d7c6f765-9ad5-449f-b1d4-43bf2759b808-tmp-dir\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:57:29.422589 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:29.422452    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d7c6f765-9ad5-449f-b1d4-43bf2759b808-home\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:57:29.422589 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:29.422460    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d7c6f765-9ad5-449f-b1d4-43bf2759b808-tls-certs\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:57:29.422589 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:29.422469    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-td7jk\" (UniqueName: \"kubernetes.io/projected/d7c6f765-9ad5-449f-b1d4-43bf2759b808-kube-api-access-td7jk\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:57:29.934015 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:29.933970    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-inf-b-ee3fe5/test-model-ee3fe5-kserve-6658b776b7-7nc7s" podUID="136bc100-b893-4212-a663-7a837778f738" containerName="main" containerID="cri-o://a5a241708d92034c8a905e037dee1046202ddcccfd6d7d5eb43bfd6061ba4ff5" gracePeriod=45
Jul 15 12:57:30.158865 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:30.158819    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-a-4060a9/test-model-4060a9-kserve-8567457bdf-j674p"
Jul 15 12:57:30.159310 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:30.158817    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-a-4060a9/test-model-4060a9-kserve-8567457bdf-j674p" event={"ID":"d7c6f765-9ad5-449f-b1d4-43bf2759b808","Type":"ContainerDied","Data":"2f001b9d1c22dedd8507df7a1aa7184c7a122c80959f3a3c19db69794292ca48"}
Jul 15 12:57:30.159310 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:30.158976    2559 scope.go:117] "RemoveContainer" containerID="4bab223531dd15b2d5757747cfb32f652a98e2e97cf4b66f0e29f9fa93b0775c"
Jul 15 12:57:30.160893 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:30.160850    2559 generic.go:356] "Generic (PLEG): container finished" podID="136bc100-b893-4212-a663-7a837778f738" containerID="a5a241708d92034c8a905e037dee1046202ddcccfd6d7d5eb43bfd6061ba4ff5" exitCode=0
Jul 15 12:57:30.161023 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:30.160937    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-ee3fe5/test-model-ee3fe5-kserve-6658b776b7-7nc7s" event={"ID":"136bc100-b893-4212-a663-7a837778f738","Type":"ContainerDied","Data":"a5a241708d92034c8a905e037dee1046202ddcccfd6d7d5eb43bfd6061ba4ff5"}
Jul 15 12:57:30.189580 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:30.189545    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-a-4060a9/test-model-4060a9-kserve-8567457bdf-j674p"]
Jul 15 12:57:30.195511 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:30.195486    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-a-4060a9/test-model-4060a9-kserve-8567457bdf-j674p"]
Jul 15 12:57:30.205130 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:30.205111    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-ee3fe5/test-model-ee3fe5-kserve-6658b776b7-7nc7s"
Jul 15 12:57:30.331168 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:30.331133    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/136bc100-b893-4212-a663-7a837778f738-tls-certs\") pod \"136bc100-b893-4212-a663-7a837778f738\" (UID: \"136bc100-b893-4212-a663-7a837778f738\") "
Jul 15 12:57:30.331168 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:30.331180    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/136bc100-b893-4212-a663-7a837778f738-model-cache\") pod \"136bc100-b893-4212-a663-7a837778f738\" (UID: \"136bc100-b893-4212-a663-7a837778f738\") "
Jul 15 12:57:30.331463 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:30.331214    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wwlv4\" (UniqueName: \"kubernetes.io/projected/136bc100-b893-4212-a663-7a837778f738-kube-api-access-wwlv4\") pod \"136bc100-b893-4212-a663-7a837778f738\" (UID: \"136bc100-b893-4212-a663-7a837778f738\") "
Jul 15 12:57:30.331463 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:30.331334    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/136bc100-b893-4212-a663-7a837778f738-dshm\") pod \"136bc100-b893-4212-a663-7a837778f738\" (UID: \"136bc100-b893-4212-a663-7a837778f738\") "
Jul 15 12:57:30.331463 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:30.331411    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/136bc100-b893-4212-a663-7a837778f738-home\") pod \"136bc100-b893-4212-a663-7a837778f738\" (UID: \"136bc100-b893-4212-a663-7a837778f738\") "
Jul 15 12:57:30.331623 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:30.331474    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/136bc100-b893-4212-a663-7a837778f738-tmp-dir\") pod \"136bc100-b893-4212-a663-7a837778f738\" (UID: \"136bc100-b893-4212-a663-7a837778f738\") "
Jul 15 12:57:30.331623 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:30.331525    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/136bc100-b893-4212-a663-7a837778f738-model-cache" (OuterVolumeSpecName: "model-cache") pod "136bc100-b893-4212-a663-7a837778f738" (UID: "136bc100-b893-4212-a663-7a837778f738"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:57:30.331736 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:30.331642    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/136bc100-b893-4212-a663-7a837778f738-home" (OuterVolumeSpecName: "home") pod "136bc100-b893-4212-a663-7a837778f738" (UID: "136bc100-b893-4212-a663-7a837778f738"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:57:30.331814 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:30.331786    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/136bc100-b893-4212-a663-7a837778f738-model-cache\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:57:30.331814 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:30.331790    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/136bc100-b893-4212-a663-7a837778f738-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "136bc100-b893-4212-a663-7a837778f738" (UID: "136bc100-b893-4212-a663-7a837778f738"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:57:30.332001 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:30.331815    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/136bc100-b893-4212-a663-7a837778f738-home\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:57:30.333643 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:30.333609    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/136bc100-b893-4212-a663-7a837778f738-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "136bc100-b893-4212-a663-7a837778f738" (UID: "136bc100-b893-4212-a663-7a837778f738"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 12:57:30.333800 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:30.333780    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/136bc100-b893-4212-a663-7a837778f738-dshm" (OuterVolumeSpecName: "dshm") pod "136bc100-b893-4212-a663-7a837778f738" (UID: "136bc100-b893-4212-a663-7a837778f738"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 12:57:30.333890 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:30.333798    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/136bc100-b893-4212-a663-7a837778f738-kube-api-access-wwlv4" (OuterVolumeSpecName: "kube-api-access-wwlv4") pod "136bc100-b893-4212-a663-7a837778f738" (UID: "136bc100-b893-4212-a663-7a837778f738"). InnerVolumeSpecName "kube-api-access-wwlv4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 12:57:30.433078 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:30.433050    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/136bc100-b893-4212-a663-7a837778f738-dshm\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:57:30.433078 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:30.433070    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/136bc100-b893-4212-a663-7a837778f738-tmp-dir\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:57:30.433078 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:30.433079    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/136bc100-b893-4212-a663-7a837778f738-tls-certs\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:57:30.433078 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:30.433087    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wwlv4\" (UniqueName: \"kubernetes.io/projected/136bc100-b893-4212-a663-7a837778f738-kube-api-access-wwlv4\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:57:30.583663 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:30.583631    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7c6f765-9ad5-449f-b1d4-43bf2759b808" path="/var/lib/kubelet/pods/d7c6f765-9ad5-449f-b1d4-43bf2759b808/volumes"
Jul 15 12:57:31.166280 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:31.166245    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-inf-b-ee3fe5/test-model-ee3fe5-kserve-6658b776b7-7nc7s" event={"ID":"136bc100-b893-4212-a663-7a837778f738","Type":"ContainerDied","Data":"1d68190eab29efab3fa66c6719eb0fc248f238de18074ac0b428adaeccb2dfe3"}
Jul 15 12:57:31.166280 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:31.166277    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-inf-b-ee3fe5/test-model-ee3fe5-kserve-6658b776b7-7nc7s"
Jul 15 12:57:31.166776 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:31.166305    2559 scope.go:117] "RemoveContainer" containerID="a5a241708d92034c8a905e037dee1046202ddcccfd6d7d5eb43bfd6061ba4ff5"
Jul 15 12:57:31.195453 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:31.195424    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-inf-b-ee3fe5/test-model-ee3fe5-kserve-6658b776b7-7nc7s"]
Jul 15 12:57:31.202506 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:31.202486    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-inf-b-ee3fe5/test-model-ee3fe5-kserve-6658b776b7-7nc7s"]
Jul 15 12:57:31.588067 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:31.588022    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:57:32.585853 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:32.585819    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="136bc100-b893-4212-a663-7a837778f738" path="/var/lib/kubelet/pods/136bc100-b893-4212-a663-7a837778f738/volumes"
Jul 15 12:57:36.497932 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:36.497898    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:57:39.176571 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:39.176531    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:57:39.274920 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:39.274884    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:57:40.985717 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:40.985689    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:57:41.202884 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:41.202846    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:57:41.387583 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:41.387494    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ee3fe5-ccq9p"]
Jul 15 12:57:41.387892 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:41.387873    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="136bc100-b893-4212-a663-7a837778f738" containerName="main"
Jul 15 12:57:41.387971 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:41.387895    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="136bc100-b893-4212-a663-7a837778f738" containerName="main"
Jul 15 12:57:41.387971 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:41.387912    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7c6f765-9ad5-449f-b1d4-43bf2759b808" containerName="main"
Jul 15 12:57:41.387971 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:41.387920    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7c6f765-9ad5-449f-b1d4-43bf2759b808" containerName="main"
Jul 15 12:57:41.388126 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:41.388000    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7c6f765-9ad5-449f-b1d4-43bf2759b808" containerName="main"
Jul 15 12:57:41.388126 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:41.388018    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="136bc100-b893-4212-a663-7a837778f738" containerName="main"
Jul 15 12:57:41.390948 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:41.390928    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ee3fe5-ccq9p"
Jul 15 12:57:41.394459 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:41.394436    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-267b6\""
Jul 15 12:57:41.409611 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:41.409594    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 12:57:41.413844 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:41.413822    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ee3fe5-ccq9p"]
Jul 15 12:57:41.530967 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:41.530903    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/859ab969-f1cc-4d45-bf16-5984d2617ece-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-ee3fe5-ccq9p\" (UID: \"859ab969-f1cc-4d45-bf16-5984d2617ece\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ee3fe5-ccq9p"
Jul 15 12:57:41.631965 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:41.631927    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/859ab969-f1cc-4d45-bf16-5984d2617ece-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-ee3fe5-ccq9p\" (UID: \"859ab969-f1cc-4d45-bf16-5984d2617ece\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ee3fe5-ccq9p"
Jul 15 12:57:41.632589 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:41.632568    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/859ab969-f1cc-4d45-bf16-5984d2617ece-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-inf-b-ee3fe5-ccq9p\" (UID: \"859ab969-f1cc-4d45-bf16-5984d2617ece\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ee3fe5-ccq9p"
Jul 15 12:57:41.701078 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:41.700996    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ee3fe5-ccq9p"
Jul 15 12:57:42.039123 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:42.039095    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ee3fe5-ccq9p"]
Jul 15 12:57:42.041800 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:57:42.041770    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod859ab969_f1cc_4d45_bf16_5984d2617ece.slice/crio-64de145560eb56f113905df76beb4a13ca7e314b326e23d461aa4b3e6073d249 WatchSource:0}: Error finding container 64de145560eb56f113905df76beb4a13ca7e314b326e23d461aa4b3e6073d249: Status 404 returned error can't find the container with id 64de145560eb56f113905df76beb4a13ca7e314b326e23d461aa4b3e6073d249
Jul 15 12:57:42.197658 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:42.197625    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:57:42.218033 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:42.218004    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ee3fe5-ccq9p" event={"ID":"859ab969-f1cc-4d45-bf16-5984d2617ece","Type":"ContainerStarted","Data":"64de145560eb56f113905df76beb4a13ca7e314b326e23d461aa4b3e6073d249"}
Jul 15 12:57:42.297563 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:42.297534    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:57:43.223454 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:43.223421    2559 generic.go:356] "Generic (PLEG): container finished" podID="859ab969-f1cc-4d45-bf16-5984d2617ece" containerID="55dd3cb74ce2cc71d3e89f597cde3e1280b023ddcc577ea1fbd2a9c054af1941" exitCode=0
Jul 15 12:57:43.223806 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:43.223501    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ee3fe5-ccq9p" event={"ID":"859ab969-f1cc-4d45-bf16-5984d2617ece","Type":"ContainerDied","Data":"55dd3cb74ce2cc71d3e89f597cde3e1280b023ddcc577ea1fbd2a9c054af1941"}
Jul 15 12:57:44.355836 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:44.355813    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ee3fe5-ccq9p"
Jul 15 12:57:44.458895 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:44.458863    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/859ab969-f1cc-4d45-bf16-5984d2617ece-maas-api-service-ca\") pod \"859ab969-f1cc-4d45-bf16-5984d2617ece\" (UID: \"859ab969-f1cc-4d45-bf16-5984d2617ece\") "
Jul 15 12:57:44.459253 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:44.459228    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/859ab969-f1cc-4d45-bf16-5984d2617ece-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "859ab969-f1cc-4d45-bf16-5984d2617ece" (UID: "859ab969-f1cc-4d45-bf16-5984d2617ece"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:57:44.559794 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:44.559712    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/859ab969-f1cc-4d45-bf16-5984d2617ece-maas-api-service-ca\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:57:45.233681 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:45.233645    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ee3fe5-ccq9p" event={"ID":"859ab969-f1cc-4d45-bf16-5984d2617ece","Type":"ContainerDied","Data":"64de145560eb56f113905df76beb4a13ca7e314b326e23d461aa4b3e6073d249"}
Jul 15 12:57:45.233681 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:45.233685    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-inf-b-ee3fe5-ccq9p"
Jul 15 12:57:45.233894 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:45.233698    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="64de145560eb56f113905df76beb4a13ca7e314b326e23d461aa4b3e6073d249"
Jul 15 12:57:52.088406 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:52.088312    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:57:55.447628 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:55.447595    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:57:56.485377 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:56.485340    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:57:58.064075 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:58.064037    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:57:58.145251 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:57:58.145217    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:58:03.319637 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:03.319599    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:58:03.445652 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:03.445612    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:58:07.380025 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:07.379989    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:58:07.508230 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:07.508201    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:58:07.857232 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:07.857196    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:58:08.226919 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:08.226892    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:58:08.382164 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:08.382134    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:58:12.049930 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:12.049898    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:58:12.196936 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:12.196886    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:58:12.338630 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:12.338549    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:58:12.518168 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:12.518136    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:58:13.873074 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:13.873039    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:58:14.104542 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:14.104506    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:58:16.476696 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:16.476661    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:58:16.959764 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:16.959731    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:58:17.051664 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:17.051625    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:58:17.672754 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:17.672720    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:58:17.903544 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:17.903514    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:58:20.389351 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:20.389316    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:58:20.540641 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:20.540609    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:58:20.638652 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:20.638622    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:58:20.777784 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:20.777755    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:58:21.344585 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:21.344553    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:58:21.570200 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:21.570165    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:58:24.983060 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:24.983022    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:58:31.978944 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:31.978912    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:58:33.266171 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:33.266126    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d0ed97-7w5kb"]
Jul 15 12:58:33.266572 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:33.266449    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="859ab969-f1cc-4d45-bf16-5984d2617ece" containerName="revoke-keys"
Jul 15 12:58:33.266572 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:33.266461    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="859ab969-f1cc-4d45-bf16-5984d2617ece" containerName="revoke-keys"
Jul 15 12:58:33.266572 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:33.266521    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="859ab969-f1cc-4d45-bf16-5984d2617ece" containerName="revoke-keys"
Jul 15 12:58:33.270432 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:33.270414    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d0ed97-7w5kb"
Jul 15 12:58:33.279216 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:33.279196    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-267b6\""
Jul 15 12:58:33.294430 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:33.294406    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 12:58:33.309524 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:33.309498    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d0ed97-7w5kb"]
Jul 15 12:58:33.363010 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:33.362986    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/950c8c6b-3099-4ab8-bbc0-de97467712ab-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-d0ed97-7w5kb\" (UID: \"950c8c6b-3099-4ab8-bbc0-de97467712ab\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d0ed97-7w5kb"
Jul 15 12:58:33.463340 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:33.463312    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/950c8c6b-3099-4ab8-bbc0-de97467712ab-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-d0ed97-7w5kb\" (UID: \"950c8c6b-3099-4ab8-bbc0-de97467712ab\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d0ed97-7w5kb"
Jul 15 12:58:33.463921 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:33.463894    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/950c8c6b-3099-4ab8-bbc0-de97467712ab-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-a-d0ed97-7w5kb\" (UID: \"950c8c6b-3099-4ab8-bbc0-de97467712ab\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d0ed97-7w5kb"
Jul 15 12:58:33.579421 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:33.579330    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d0ed97-7w5kb"
Jul 15 12:58:33.720826 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:33.720795    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d0ed97-7w5kb"]
Jul 15 12:58:33.723841 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:58:33.723813    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod950c8c6b_3099_4ab8_bbc0_de97467712ab.slice/crio-05224d5dbd30abc143cd7d42b46ed2f8f62fac82f81167d07ca553cb9407113a WatchSource:0}: Error finding container 05224d5dbd30abc143cd7d42b46ed2f8f62fac82f81167d07ca553cb9407113a: Status 404 returned error can't find the container with id 05224d5dbd30abc143cd7d42b46ed2f8f62fac82f81167d07ca553cb9407113a
Jul 15 12:58:34.183865 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:34.183778    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:58:34.285155 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:34.285120    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:58:34.460409 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:34.460380    2559 generic.go:356] "Generic (PLEG): container finished" podID="950c8c6b-3099-4ab8-bbc0-de97467712ab" containerID="ea89b2313739b6511b195c649ff96ca656d17cc04f97142b43f74f569ca2798e" exitCode=0
Jul 15 12:58:34.460643 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:34.460475    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d0ed97-7w5kb" event={"ID":"950c8c6b-3099-4ab8-bbc0-de97467712ab","Type":"ContainerDied","Data":"ea89b2313739b6511b195c649ff96ca656d17cc04f97142b43f74f569ca2798e"}
Jul 15 12:58:34.460643 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:34.460557    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d0ed97-7w5kb" event={"ID":"950c8c6b-3099-4ab8-bbc0-de97467712ab","Type":"ContainerStarted","Data":"05224d5dbd30abc143cd7d42b46ed2f8f62fac82f81167d07ca553cb9407113a"}
Jul 15 12:58:35.589890 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:35.589867    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d0ed97-7w5kb"
Jul 15 12:58:35.684047 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:35.684019    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/950c8c6b-3099-4ab8-bbc0-de97467712ab-maas-api-service-ca\") pod \"950c8c6b-3099-4ab8-bbc0-de97467712ab\" (UID: \"950c8c6b-3099-4ab8-bbc0-de97467712ab\") "
Jul 15 12:58:35.684384 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:35.684344    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/950c8c6b-3099-4ab8-bbc0-de97467712ab-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "950c8c6b-3099-4ab8-bbc0-de97467712ab" (UID: "950c8c6b-3099-4ab8-bbc0-de97467712ab"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:58:35.784695 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:35.784629    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/950c8c6b-3099-4ab8-bbc0-de97467712ab-maas-api-service-ca\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:58:36.470177 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:36.470148    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d0ed97-7w5kb"
Jul 15 12:58:36.470177 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:36.470157    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-a-d0ed97-7w5kb" event={"ID":"950c8c6b-3099-4ab8-bbc0-de97467712ab","Type":"ContainerDied","Data":"05224d5dbd30abc143cd7d42b46ed2f8f62fac82f81167d07ca553cb9407113a"}
Jul 15 12:58:36.470411 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:36.470214    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="05224d5dbd30abc143cd7d42b46ed2f8f62fac82f81167d07ca553cb9407113a"
Jul 15 12:58:42.574969 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:42.574941    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:58:42.706731 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:42.706699    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:58:43.096929 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:43.096900    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:58:43.759977 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:43.759945    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:58:46.958813 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:46.958782    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:58:48.373559 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:48.373526    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:58:55.816637 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:55.816603    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:58:56.220454 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:56.220425    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:58:59.097774 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:59.097736    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:58:59.332528 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:59.332500    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:58:59.456218 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:59.456138    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-aed9ee-wnjhj"]
Jul 15 12:58:59.456518 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:59.456503    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="950c8c6b-3099-4ab8-bbc0-de97467712ab" containerName="revoke-keys"
Jul 15 12:58:59.456573 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:59.456521    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="950c8c6b-3099-4ab8-bbc0-de97467712ab" containerName="revoke-keys"
Jul 15 12:58:59.456608 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:59.456583    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="950c8c6b-3099-4ab8-bbc0-de97467712ab" containerName="revoke-keys"
Jul 15 12:58:59.459542 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:59.459526    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-aed9ee-wnjhj"
Jul 15 12:58:59.464761 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:59.464731    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 12:58:59.464890 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:59.464780    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-267b6\""
Jul 15 12:58:59.469752 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:59.469730    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-aed9ee-wnjhj"]
Jul 15 12:58:59.479758 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:59.479734    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/645532a9-c72f-41a0-b357-8a9f0abd130e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-aed9ee-wnjhj\" (UID: \"645532a9-c72f-41a0-b357-8a9f0abd130e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-aed9ee-wnjhj"
Jul 15 12:58:59.581163 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:59.581121    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/645532a9-c72f-41a0-b357-8a9f0abd130e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-aed9ee-wnjhj\" (UID: \"645532a9-c72f-41a0-b357-8a9f0abd130e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-aed9ee-wnjhj"
Jul 15 12:58:59.581772 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:59.581752    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/645532a9-c72f-41a0-b357-8a9f0abd130e-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-api-b-aed9ee-wnjhj\" (UID: \"645532a9-c72f-41a0-b357-8a9f0abd130e\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-aed9ee-wnjhj"
Jul 15 12:58:59.769797 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:59.769766    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-aed9ee-wnjhj"
Jul 15 12:58:59.902500 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:58:59.902470    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-aed9ee-wnjhj"]
Jul 15 12:58:59.904672 ip-10-0-140-67 kubenswrapper[2559]: W0715 12:58:59.904646    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod645532a9_c72f_41a0_b357_8a9f0abd130e.slice/crio-b9924d541d3fca6b32f333578f244266c41d5b52fd400b05ab9d794520dcd66e WatchSource:0}: Error finding container b9924d541d3fca6b32f333578f244266c41d5b52fd400b05ab9d794520dcd66e: Status 404 returned error can't find the container with id b9924d541d3fca6b32f333578f244266c41d5b52fd400b05ab9d794520dcd66e
Jul 15 12:59:00.582934 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:59:00.582897    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-aed9ee-wnjhj" event={"ID":"645532a9-c72f-41a0-b357-8a9f0abd130e","Type":"ContainerStarted","Data":"bf6cd879c919b4ea5bfe6a226e8322dacb86b0b04e0fea15a26b5ccfeb53a15b"}
Jul 15 12:59:00.583281 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:59:00.582954    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-aed9ee-wnjhj" event={"ID":"645532a9-c72f-41a0-b357-8a9f0abd130e","Type":"ContainerStarted","Data":"b9924d541d3fca6b32f333578f244266c41d5b52fd400b05ab9d794520dcd66e"}
Jul 15 12:59:00.610607 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:59:00.610565    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-aed9ee-wnjhj" podStartSLOduration=1.610550602 podStartE2EDuration="1.610550602s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 12:58:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 12:59:00.608490023 +0000 UTC m=+2310.581061180" watchObservedRunningTime="2026-07-15 12:59:00.610550602 +0000 UTC m=+2310.583121760"
Jul 15 12:59:01.584904 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:59:01.584873    2559 generic.go:356] "Generic (PLEG): container finished" podID="645532a9-c72f-41a0-b357-8a9f0abd130e" containerID="bf6cd879c919b4ea5bfe6a226e8322dacb86b0b04e0fea15a26b5ccfeb53a15b" exitCode=0
Jul 15 12:59:01.585303 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:59:01.584979    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-aed9ee-wnjhj" event={"ID":"645532a9-c72f-41a0-b357-8a9f0abd130e","Type":"ContainerDied","Data":"bf6cd879c919b4ea5bfe6a226e8322dacb86b0b04e0fea15a26b5ccfeb53a15b"}
Jul 15 12:59:02.715183 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:59:02.715159    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-aed9ee-wnjhj"
Jul 15 12:59:02.805191 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:59:02.805156    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/645532a9-c72f-41a0-b357-8a9f0abd130e-maas-api-service-ca\") pod \"645532a9-c72f-41a0-b357-8a9f0abd130e\" (UID: \"645532a9-c72f-41a0-b357-8a9f0abd130e\") "
Jul 15 12:59:02.805521 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:59:02.805500    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/645532a9-c72f-41a0-b357-8a9f0abd130e-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "645532a9-c72f-41a0-b357-8a9f0abd130e" (UID: "645532a9-c72f-41a0-b357-8a9f0abd130e"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 12:59:02.906115 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:59:02.906039    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/645532a9-c72f-41a0-b357-8a9f0abd130e-maas-api-service-ca\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 12:59:03.594765 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:59:03.594740    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-aed9ee-wnjhj"
Jul 15 12:59:03.594765 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:59:03.594750    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-api-b-aed9ee-wnjhj" event={"ID":"645532a9-c72f-41a0-b357-8a9f0abd130e","Type":"ContainerDied","Data":"b9924d541d3fca6b32f333578f244266c41d5b52fd400b05ab9d794520dcd66e"}
Jul 15 12:59:03.594977 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:59:03.594798    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b9924d541d3fca6b32f333578f244266c41d5b52fd400b05ab9d794520dcd66e"
Jul 15 12:59:09.978019 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:59:09.977983    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:59:13.424585 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:59:13.424548    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:59:14.543160 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:59:14.543123    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:59:20.963481 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:59:20.963444    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:59:21.142338 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:59:21.142282    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:59:25.399909 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:59:25.399830    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:59:25.645722 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:59:25.645686    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:59:26.049645 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:59:26.049610    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:59:26.477350 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:59:26.477318    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:59:26.596548 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:59:26.596516    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:59:29.460901 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:59:29.460862    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:59:29.593535 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:59:29.593502    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:59:29.689261 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:59:29.689226    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:59:29.866087 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:59:29.866016    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:59:30.273779 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:59:30.273725    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:59:30.373384 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:59:30.373334    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:59:33.734259 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:59:33.734224    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:59:33.850751 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:59:33.850719    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:59:34.228702 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:59:34.228674    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:59:34.653541 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:59:34.653449    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:59:35.273430 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:59:35.273395    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:59:37.841524 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:59:37.841491    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:59:37.983485 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:59:37.983453    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:59:38.206675 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:59:38.206584    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:59:38.594336 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:59:38.594301    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:59:38.752881 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:59:38.752848    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:59:38.876802 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:59:38.876700    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:59:40.283289 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:59:40.283259    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:59:40.379397 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:59:40.379351    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:59:41.309980 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:59:41.309948    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:59:41.403267 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:59:41.403230    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:59:42.375561 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:59:42.375531    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:59:47.541786 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:59:47.541748    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 12:59:52.361224 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:59:52.361192    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 12:59:52.461293 ip-10-0-140-67 kubenswrapper[2559]: I0715 12:59:52.461263    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 13:00:00.015170 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:00.015137    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 13:00:00.117122 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:00.117087    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 13:00:00.151449 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:00.151416    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735340-486h9"]
Jul 15 13:00:00.151763 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:00.151750    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="645532a9-c72f-41a0-b357-8a9f0abd130e" containerName="revoke-keys"
Jul 15 13:00:00.151808 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:00.151765    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="645532a9-c72f-41a0-b357-8a9f0abd130e" containerName="revoke-keys"
Jul 15 13:00:00.151843 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:00.151825    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="645532a9-c72f-41a0-b357-8a9f0abd130e" containerName="revoke-keys"
Jul 15 13:00:00.154798 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:00.154780    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735340-486h9"
Jul 15 13:00:00.159989 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:00.159964    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-267b6\""
Jul 15 13:00:00.160125 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:00.160089    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-3af497-29735340-p2h2b"]
Jul 15 13:00:00.163636 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:00.163615    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-70ed7b-29735340-bngts"]
Jul 15 13:00:00.163748 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:00.163714    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-3af497-29735340-p2h2b"
Jul 15 13:00:00.164723 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:00.164705    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735340-486h9"
Jul 15 13:00:00.166689 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:00.166672    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-70ed7b-29735340-bngts"
Jul 15 13:00:00.172036 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:00.172013    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735340-486h9"]
Jul 15 13:00:00.175392 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:00.175341    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-3af497-29735340-p2h2b"
Jul 15 13:00:00.176856 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:00.176832    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-3af497-29735340-p2h2b"]
Jul 15 13:00:00.198092 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:00.198006    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-70ed7b-29735340-bngts"]
Jul 15 13:00:00.211693 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:00.211672    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-70ed7b-29735340-bngts"
Jul 15 13:00:00.330304 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:00.330070    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735340-486h9"]
Jul 15 13:00:00.332810 ip-10-0-140-67 kubenswrapper[2559]: W0715 13:00:00.332779    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d6807e1_1542_40ed_8f15_d8df411544e2.slice/crio-4b3c40876f4be29421ae6bfc36e94aac3b4ee7148b18644f231cb9b5633cb5ea WatchSource:0}: Error finding container 4b3c40876f4be29421ae6bfc36e94aac3b4ee7148b18644f231cb9b5633cb5ea: Status 404 returned error can't find the container with id 4b3c40876f4be29421ae6bfc36e94aac3b4ee7148b18644f231cb9b5633cb5ea
Jul 15 13:00:00.382182 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:00.382149    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-70ed7b-29735340-bngts"]
Jul 15 13:00:00.385211 ip-10-0-140-67 kubenswrapper[2559]: W0715 13:00:00.385185    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode165a78e_8df1_44ec_996b_9027f2d230f1.slice/crio-3f0a8322178f6d9b4c3e5138e95b5e06f8f08bb69f35b8ef6bf5a2cca5b13ccf WatchSource:0}: Error finding container 3f0a8322178f6d9b4c3e5138e95b5e06f8f08bb69f35b8ef6bf5a2cca5b13ccf: Status 404 returned error can't find the container with id 3f0a8322178f6d9b4c3e5138e95b5e06f8f08bb69f35b8ef6bf5a2cca5b13ccf
Jul 15 13:00:00.564332 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:00.564245    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-3af497-29735340-p2h2b"]
Jul 15 13:00:00.574208 ip-10-0-140-67 kubenswrapper[2559]: W0715 13:00:00.574178    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7429077_809c_4717_b3f9_24f3d944434b.slice/crio-4d14994f2086efba751b2459471f242fa9fcd2a9505d03ee93574c780c62b49a WatchSource:0}: Error finding container 4d14994f2086efba751b2459471f242fa9fcd2a9505d03ee93574c780c62b49a: Status 404 returned error can't find the container with id 4d14994f2086efba751b2459471f242fa9fcd2a9505d03ee93574c780c62b49a
Jul 15 13:00:00.852604 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:00.852505    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-3af497-29735340-p2h2b" event={"ID":"d7429077-809c-4717-b3f9-24f3d944434b","Type":"ContainerStarted","Data":"4d14994f2086efba751b2459471f242fa9fcd2a9505d03ee93574c780c62b49a"}
Jul 15 13:00:00.853820 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:00.853792    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-70ed7b-29735340-bngts" event={"ID":"e165a78e-8df1-44ec-996b-9027f2d230f1","Type":"ContainerStarted","Data":"3d4f2fa33ddd2a99f6f52835993c3082afde631771e36394bcb705ce3e7fd42c"}
Jul 15 13:00:00.853905 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:00.853850    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-70ed7b-29735340-bngts" event={"ID":"e165a78e-8df1-44ec-996b-9027f2d230f1","Type":"ContainerStarted","Data":"3f0a8322178f6d9b4c3e5138e95b5e06f8f08bb69f35b8ef6bf5a2cca5b13ccf"}
Jul 15 13:00:00.855162 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:00.855138    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735340-486h9" event={"ID":"6d6807e1-1542-40ed-8f15-d8df411544e2","Type":"ContainerStarted","Data":"83c0f3910b7db035f0f435e3d54ac9a7f98c42c4fb254e3db5ceacfd8c5bb511"}
Jul 15 13:00:00.855250 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:00.855185    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735340-486h9" event={"ID":"6d6807e1-1542-40ed-8f15-d8df411544e2","Type":"ContainerStarted","Data":"4b3c40876f4be29421ae6bfc36e94aac3b4ee7148b18644f231cb9b5633cb5ea"}
Jul 15 13:00:00.874145 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:00.874099    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-70ed7b-29735340-bngts" podStartSLOduration=0.874082549 podStartE2EDuration="874.082549ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:00:00.871284302 +0000 UTC m=+2370.843855473" watchObservedRunningTime="2026-07-15 13:00:00.874082549 +0000 UTC m=+2370.846653685"
Jul 15 13:00:00.893411 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:00.893350    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735340-486h9" podStartSLOduration=0.893334363 podStartE2EDuration="893.334363ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:00:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:00:00.891790446 +0000 UTC m=+2370.864361617" watchObservedRunningTime="2026-07-15 13:00:00.893334363 +0000 UTC m=+2370.865905522"
Jul 15 13:00:01.732144 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:01.732107    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-3af497/auth-test-model-3af497-kserve-7689d987-69qgz"]
Jul 15 13:00:01.735410 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:01.735393    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3af497/auth-test-model-3af497-kserve-7689d987-69qgz"
Jul 15 13:00:01.739180 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:01.739157    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-3af497\"/\"kube-root-ca.crt\""
Jul 15 13:00:01.739312 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:01.739260    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-3af497\"/\"auth-test-model-3af497-kserve-self-signed-certs\""
Jul 15 13:00:01.740062 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:01.740041    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-3af497\"/\"openshift-service-ca.crt\""
Jul 15 13:00:01.743628 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:01.743608    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-3af497\"/\"default-dockercfg-5rt8n\""
Jul 15 13:00:01.755675 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:01.755649    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-3af497/auth-test-model-3af497-kserve-7689d987-69qgz"]
Jul 15 13:00:01.797073 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:01.797039    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28bf2015-50ef-41f9-8d40-2157bd40a259-model-cache\") pod \"auth-test-model-3af497-kserve-7689d987-69qgz\" (UID: \"28bf2015-50ef-41f9-8d40-2157bd40a259\") " pod="ai-tenant-e2e-shared-a-3af497/auth-test-model-3af497-kserve-7689d987-69qgz"
Jul 15 13:00:01.797269 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:01.797090    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28bf2015-50ef-41f9-8d40-2157bd40a259-tmp-dir\") pod \"auth-test-model-3af497-kserve-7689d987-69qgz\" (UID: \"28bf2015-50ef-41f9-8d40-2157bd40a259\") " pod="ai-tenant-e2e-shared-a-3af497/auth-test-model-3af497-kserve-7689d987-69qgz"
Jul 15 13:00:01.797269 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:01.797117    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28bf2015-50ef-41f9-8d40-2157bd40a259-home\") pod \"auth-test-model-3af497-kserve-7689d987-69qgz\" (UID: \"28bf2015-50ef-41f9-8d40-2157bd40a259\") " pod="ai-tenant-e2e-shared-a-3af497/auth-test-model-3af497-kserve-7689d987-69qgz"
Jul 15 13:00:01.797269 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:01.797197    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28bf2015-50ef-41f9-8d40-2157bd40a259-dshm\") pod \"auth-test-model-3af497-kserve-7689d987-69qgz\" (UID: \"28bf2015-50ef-41f9-8d40-2157bd40a259\") " pod="ai-tenant-e2e-shared-a-3af497/auth-test-model-3af497-kserve-7689d987-69qgz"
Jul 15 13:00:01.797468 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:01.797289    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28bf2015-50ef-41f9-8d40-2157bd40a259-tls-certs\") pod \"auth-test-model-3af497-kserve-7689d987-69qgz\" (UID: \"28bf2015-50ef-41f9-8d40-2157bd40a259\") " pod="ai-tenant-e2e-shared-a-3af497/auth-test-model-3af497-kserve-7689d987-69qgz"
Jul 15 13:00:01.797468 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:01.797319    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tx6pw\" (UniqueName: \"kubernetes.io/projected/28bf2015-50ef-41f9-8d40-2157bd40a259-kube-api-access-tx6pw\") pod \"auth-test-model-3af497-kserve-7689d987-69qgz\" (UID: \"28bf2015-50ef-41f9-8d40-2157bd40a259\") " pod="ai-tenant-e2e-shared-a-3af497/auth-test-model-3af497-kserve-7689d987-69qgz"
Jul 15 13:00:01.861190 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:01.861092    2559 generic.go:356] "Generic (PLEG): container finished" podID="e165a78e-8df1-44ec-996b-9027f2d230f1" containerID="3d4f2fa33ddd2a99f6f52835993c3082afde631771e36394bcb705ce3e7fd42c" exitCode=0
Jul 15 13:00:01.861376 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:01.861193    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-70ed7b-29735340-bngts" event={"ID":"e165a78e-8df1-44ec-996b-9027f2d230f1","Type":"ContainerDied","Data":"3d4f2fa33ddd2a99f6f52835993c3082afde631771e36394bcb705ce3e7fd42c"}
Jul 15 13:00:01.862588 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:01.862562    2559 generic.go:356] "Generic (PLEG): container finished" podID="6d6807e1-1542-40ed-8f15-d8df411544e2" containerID="83c0f3910b7db035f0f435e3d54ac9a7f98c42c4fb254e3db5ceacfd8c5bb511" exitCode=0
Jul 15 13:00:01.862700 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:01.862680    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735340-486h9" event={"ID":"6d6807e1-1542-40ed-8f15-d8df411544e2","Type":"ContainerDied","Data":"83c0f3910b7db035f0f435e3d54ac9a7f98c42c4fb254e3db5ceacfd8c5bb511"}
Jul 15 13:00:01.864219 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:01.864197    2559 generic.go:356] "Generic (PLEG): container finished" podID="d7429077-809c-4717-b3f9-24f3d944434b" containerID="43011c516dc6a3a0e1321f6211d7949e4a42ec2fd2fbb5e4976fd8f5f79fd0fa" exitCode=0
Jul 15 13:00:01.864305 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:01.864233    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-3af497-29735340-p2h2b" event={"ID":"d7429077-809c-4717-b3f9-24f3d944434b","Type":"ContainerDied","Data":"43011c516dc6a3a0e1321f6211d7949e4a42ec2fd2fbb5e4976fd8f5f79fd0fa"}
Jul 15 13:00:01.898704 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:01.898671    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28bf2015-50ef-41f9-8d40-2157bd40a259-home\") pod \"auth-test-model-3af497-kserve-7689d987-69qgz\" (UID: \"28bf2015-50ef-41f9-8d40-2157bd40a259\") " pod="ai-tenant-e2e-shared-a-3af497/auth-test-model-3af497-kserve-7689d987-69qgz"
Jul 15 13:00:01.898869 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:01.898715    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28bf2015-50ef-41f9-8d40-2157bd40a259-dshm\") pod \"auth-test-model-3af497-kserve-7689d987-69qgz\" (UID: \"28bf2015-50ef-41f9-8d40-2157bd40a259\") " pod="ai-tenant-e2e-shared-a-3af497/auth-test-model-3af497-kserve-7689d987-69qgz"
Jul 15 13:00:01.898869 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:01.898752    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28bf2015-50ef-41f9-8d40-2157bd40a259-tls-certs\") pod \"auth-test-model-3af497-kserve-7689d987-69qgz\" (UID: \"28bf2015-50ef-41f9-8d40-2157bd40a259\") " pod="ai-tenant-e2e-shared-a-3af497/auth-test-model-3af497-kserve-7689d987-69qgz"
Jul 15 13:00:01.898869 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:01.898768    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tx6pw\" (UniqueName: \"kubernetes.io/projected/28bf2015-50ef-41f9-8d40-2157bd40a259-kube-api-access-tx6pw\") pod \"auth-test-model-3af497-kserve-7689d987-69qgz\" (UID: \"28bf2015-50ef-41f9-8d40-2157bd40a259\") " pod="ai-tenant-e2e-shared-a-3af497/auth-test-model-3af497-kserve-7689d987-69qgz"
Jul 15 13:00:01.898998 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:01.898886    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28bf2015-50ef-41f9-8d40-2157bd40a259-model-cache\") pod \"auth-test-model-3af497-kserve-7689d987-69qgz\" (UID: \"28bf2015-50ef-41f9-8d40-2157bd40a259\") " pod="ai-tenant-e2e-shared-a-3af497/auth-test-model-3af497-kserve-7689d987-69qgz"
Jul 15 13:00:01.898998 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:01.898940    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28bf2015-50ef-41f9-8d40-2157bd40a259-tmp-dir\") pod \"auth-test-model-3af497-kserve-7689d987-69qgz\" (UID: \"28bf2015-50ef-41f9-8d40-2157bd40a259\") " pod="ai-tenant-e2e-shared-a-3af497/auth-test-model-3af497-kserve-7689d987-69qgz"
Jul 15 13:00:01.899104 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:01.899091    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28bf2015-50ef-41f9-8d40-2157bd40a259-home\") pod \"auth-test-model-3af497-kserve-7689d987-69qgz\" (UID: \"28bf2015-50ef-41f9-8d40-2157bd40a259\") " pod="ai-tenant-e2e-shared-a-3af497/auth-test-model-3af497-kserve-7689d987-69qgz"
Jul 15 13:00:01.899261 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:01.899241    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28bf2015-50ef-41f9-8d40-2157bd40a259-tmp-dir\") pod \"auth-test-model-3af497-kserve-7689d987-69qgz\" (UID: \"28bf2015-50ef-41f9-8d40-2157bd40a259\") " pod="ai-tenant-e2e-shared-a-3af497/auth-test-model-3af497-kserve-7689d987-69qgz"
Jul 15 13:00:01.899338 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:01.899298    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28bf2015-50ef-41f9-8d40-2157bd40a259-model-cache\") pod \"auth-test-model-3af497-kserve-7689d987-69qgz\" (UID: \"28bf2015-50ef-41f9-8d40-2157bd40a259\") " pod="ai-tenant-e2e-shared-a-3af497/auth-test-model-3af497-kserve-7689d987-69qgz"
Jul 15 13:00:01.901050 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:01.901032    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28bf2015-50ef-41f9-8d40-2157bd40a259-dshm\") pod \"auth-test-model-3af497-kserve-7689d987-69qgz\" (UID: \"28bf2015-50ef-41f9-8d40-2157bd40a259\") " pod="ai-tenant-e2e-shared-a-3af497/auth-test-model-3af497-kserve-7689d987-69qgz"
Jul 15 13:00:01.901208 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:01.901193    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28bf2015-50ef-41f9-8d40-2157bd40a259-tls-certs\") pod \"auth-test-model-3af497-kserve-7689d987-69qgz\" (UID: \"28bf2015-50ef-41f9-8d40-2157bd40a259\") " pod="ai-tenant-e2e-shared-a-3af497/auth-test-model-3af497-kserve-7689d987-69qgz"
Jul 15 13:00:01.915059 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:01.915028    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tx6pw\" (UniqueName: \"kubernetes.io/projected/28bf2015-50ef-41f9-8d40-2157bd40a259-kube-api-access-tx6pw\") pod \"auth-test-model-3af497-kserve-7689d987-69qgz\" (UID: \"28bf2015-50ef-41f9-8d40-2157bd40a259\") " pod="ai-tenant-e2e-shared-a-3af497/auth-test-model-3af497-kserve-7689d987-69qgz"
Jul 15 13:00:02.013233 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:02.013196    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 13:00:02.044613 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:02.044573    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3af497/auth-test-model-3af497-kserve-7689d987-69qgz"
Jul 15 13:00:02.185323 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:02.185296    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-3af497/auth-test-model-3af497-kserve-7689d987-69qgz"]
Jul 15 13:00:02.188398 ip-10-0-140-67 kubenswrapper[2559]: W0715 13:00:02.188345    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod28bf2015_50ef_41f9_8d40_2157bd40a259.slice/crio-5bd2ee800fd2e34fe990b378f18fdb197f92a77a6355e3e87ac2376c85a8afa8 WatchSource:0}: Error finding container 5bd2ee800fd2e34fe990b378f18fdb197f92a77a6355e3e87ac2376c85a8afa8: Status 404 returned error can't find the container with id 5bd2ee800fd2e34fe990b378f18fdb197f92a77a6355e3e87ac2376c85a8afa8
Jul 15 13:00:02.871199 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:02.871158    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3af497/auth-test-model-3af497-kserve-7689d987-69qgz" event={"ID":"28bf2015-50ef-41f9-8d40-2157bd40a259","Type":"ContainerStarted","Data":"cab7baaa83fe7764ee36d31f680548e383197a2fd377571e21d1fe87c3da5532"}
Jul 15 13:00:02.871710 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:02.871208    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3af497/auth-test-model-3af497-kserve-7689d987-69qgz" event={"ID":"28bf2015-50ef-41f9-8d40-2157bd40a259","Type":"ContainerStarted","Data":"5bd2ee800fd2e34fe990b378f18fdb197f92a77a6355e3e87ac2376c85a8afa8"}
Jul 15 13:00:02.897775 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:02.897667    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-3af497/auth-test-model-3af497-kserve-7689d987-69qgz" podStartSLOduration=1.897642874 podStartE2EDuration="1.897642874s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:00:01 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:00:02.894600878 +0000 UTC m=+2372.867172037" watchObservedRunningTime="2026-07-15 13:00:02.897642874 +0000 UTC m=+2372.870214033"
Jul 15 13:00:03.037883 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:03.037855    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-3af497-29735340-p2h2b"
Jul 15 13:00:03.040800 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:03.040776    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735340-486h9"
Jul 15 13:00:03.056887 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:03.056866    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-70ed7b-29735340-bngts"
Jul 15 13:00:03.877085 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:03.877051    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-3af497-29735340-p2h2b"
Jul 15 13:00:03.877546 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:03.877054    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-3af497-29735340-p2h2b" event={"ID":"d7429077-809c-4717-b3f9-24f3d944434b","Type":"ContainerDied","Data":"4d14994f2086efba751b2459471f242fa9fcd2a9505d03ee93574c780c62b49a"}
Jul 15 13:00:03.877546 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:03.877196    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4d14994f2086efba751b2459471f242fa9fcd2a9505d03ee93574c780c62b49a"
Jul 15 13:00:03.878303 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:03.878284    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-70ed7b-29735340-bngts"
Jul 15 13:00:03.878303 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:03.878293    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-70ed7b-29735340-bngts" event={"ID":"e165a78e-8df1-44ec-996b-9027f2d230f1","Type":"ContainerDied","Data":"3f0a8322178f6d9b4c3e5138e95b5e06f8f08bb69f35b8ef6bf5a2cca5b13ccf"}
Jul 15 13:00:03.878420 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:03.878332    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3f0a8322178f6d9b4c3e5138e95b5e06f8f08bb69f35b8ef6bf5a2cca5b13ccf"
Jul 15 13:00:03.879620 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:03.879594    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735340-486h9"
Jul 15 13:00:03.879719 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:03.879643    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735340-486h9" event={"ID":"6d6807e1-1542-40ed-8f15-d8df411544e2","Type":"ContainerDied","Data":"4b3c40876f4be29421ae6bfc36e94aac3b4ee7148b18644f231cb9b5633cb5ea"}
Jul 15 13:00:03.879719 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:03.879680    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4b3c40876f4be29421ae6bfc36e94aac3b4ee7148b18644f231cb9b5633cb5ea"
Jul 15 13:00:05.442284 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:05.442249    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 13:00:12.045306 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:12.045263    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-3af497/auth-test-model-3af497-kserve-7689d987-69qgz"
Jul 15 13:00:12.045306 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:12.045312    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-3af497/auth-test-model-3af497-kserve-7689d987-69qgz"
Jul 15 13:00:12.057727 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:12.057697    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-3af497/auth-test-model-3af497-kserve-7689d987-69qgz"
Jul 15 13:00:12.934601 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:12.934573    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-3af497/auth-test-model-3af497-kserve-7689d987-69qgz"
Jul 15 13:00:18.980689 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:18.980654    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 13:00:30.586437 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:30.586411    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vp8z_009c50dc-2f9e-455b-95f2-a03e7ed3defd/ovn-acl-logging/0.log"
Jul 15 13:00:30.590490 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:30.590470    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vp8z_009c50dc-2f9e-455b-95f2-a03e7ed3defd/ovn-acl-logging/0.log"
Jul 15 13:00:59.894550 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:59.894513    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-70ed7b/auth-test-model-70ed7b-kserve-858d9f6fbc-b27xj"]
Jul 15 13:00:59.895040 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:59.894821    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d6807e1-1542-40ed-8f15-d8df411544e2" containerName="cleanup"
Jul 15 13:00:59.895040 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:59.894833    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d6807e1-1542-40ed-8f15-d8df411544e2" containerName="cleanup"
Jul 15 13:00:59.895040 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:59.894841    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e165a78e-8df1-44ec-996b-9027f2d230f1" containerName="cleanup"
Jul 15 13:00:59.895040 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:59.894847    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e165a78e-8df1-44ec-996b-9027f2d230f1" containerName="cleanup"
Jul 15 13:00:59.895040 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:59.894863    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7429077-809c-4717-b3f9-24f3d944434b" containerName="cleanup"
Jul 15 13:00:59.895040 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:59.894869    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7429077-809c-4717-b3f9-24f3d944434b" containerName="cleanup"
Jul 15 13:00:59.895040 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:59.894917    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7429077-809c-4717-b3f9-24f3d944434b" containerName="cleanup"
Jul 15 13:00:59.895040 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:59.894924    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e165a78e-8df1-44ec-996b-9027f2d230f1" containerName="cleanup"
Jul 15 13:00:59.895040 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:59.894931    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d6807e1-1542-40ed-8f15-d8df411544e2" containerName="cleanup"
Jul 15 13:00:59.898063 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:59.898045    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-70ed7b/auth-test-model-70ed7b-kserve-858d9f6fbc-b27xj"
Jul 15 13:00:59.901850 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:59.901823    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-70ed7b\"/\"default-dockercfg-sk5wg\""
Jul 15 13:00:59.901850 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:59.901842    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-70ed7b\"/\"auth-test-model-70ed7b-kserve-self-signed-certs\""
Jul 15 13:00:59.902027 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:59.901885    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-70ed7b\"/\"kube-root-ca.crt\""
Jul 15 13:00:59.902027 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:59.901832    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-70ed7b\"/\"openshift-service-ca.crt\""
Jul 15 13:00:59.916839 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:59.916813    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-70ed7b/auth-test-model-70ed7b-kserve-858d9f6fbc-b27xj"]
Jul 15 13:00:59.926439 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:00:59.926412    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 13:01:00.007869 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:01:00.007826    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d065e326-4743-4f66-8fd3-33ac9f3ecd00-tls-certs\") pod \"auth-test-model-70ed7b-kserve-858d9f6fbc-b27xj\" (UID: \"d065e326-4743-4f66-8fd3-33ac9f3ecd00\") " pod="ai-tenant-e2e-shared-b-70ed7b/auth-test-model-70ed7b-kserve-858d9f6fbc-b27xj"
Jul 15 13:01:00.008047 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:01:00.007898    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8dr9r\" (UniqueName: \"kubernetes.io/projected/d065e326-4743-4f66-8fd3-33ac9f3ecd00-kube-api-access-8dr9r\") pod \"auth-test-model-70ed7b-kserve-858d9f6fbc-b27xj\" (UID: \"d065e326-4743-4f66-8fd3-33ac9f3ecd00\") " pod="ai-tenant-e2e-shared-b-70ed7b/auth-test-model-70ed7b-kserve-858d9f6fbc-b27xj"
Jul 15 13:01:00.008047 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:01:00.007922    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d065e326-4743-4f66-8fd3-33ac9f3ecd00-model-cache\") pod \"auth-test-model-70ed7b-kserve-858d9f6fbc-b27xj\" (UID: \"d065e326-4743-4f66-8fd3-33ac9f3ecd00\") " pod="ai-tenant-e2e-shared-b-70ed7b/auth-test-model-70ed7b-kserve-858d9f6fbc-b27xj"
Jul 15 13:01:00.008047 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:01:00.007960    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d065e326-4743-4f66-8fd3-33ac9f3ecd00-tmp-dir\") pod \"auth-test-model-70ed7b-kserve-858d9f6fbc-b27xj\" (UID: \"d065e326-4743-4f66-8fd3-33ac9f3ecd00\") " pod="ai-tenant-e2e-shared-b-70ed7b/auth-test-model-70ed7b-kserve-858d9f6fbc-b27xj"
Jul 15 13:01:00.008047 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:01:00.008036    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d065e326-4743-4f66-8fd3-33ac9f3ecd00-home\") pod \"auth-test-model-70ed7b-kserve-858d9f6fbc-b27xj\" (UID: \"d065e326-4743-4f66-8fd3-33ac9f3ecd00\") " pod="ai-tenant-e2e-shared-b-70ed7b/auth-test-model-70ed7b-kserve-858d9f6fbc-b27xj"
Jul 15 13:01:00.008189 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:01:00.008063    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d065e326-4743-4f66-8fd3-33ac9f3ecd00-dshm\") pod \"auth-test-model-70ed7b-kserve-858d9f6fbc-b27xj\" (UID: \"d065e326-4743-4f66-8fd3-33ac9f3ecd00\") " pod="ai-tenant-e2e-shared-b-70ed7b/auth-test-model-70ed7b-kserve-858d9f6fbc-b27xj"
Jul 15 13:01:00.109463 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:01:00.109424    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8dr9r\" (UniqueName: \"kubernetes.io/projected/d065e326-4743-4f66-8fd3-33ac9f3ecd00-kube-api-access-8dr9r\") pod \"auth-test-model-70ed7b-kserve-858d9f6fbc-b27xj\" (UID: \"d065e326-4743-4f66-8fd3-33ac9f3ecd00\") " pod="ai-tenant-e2e-shared-b-70ed7b/auth-test-model-70ed7b-kserve-858d9f6fbc-b27xj"
Jul 15 13:01:00.109463 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:01:00.109471    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d065e326-4743-4f66-8fd3-33ac9f3ecd00-model-cache\") pod \"auth-test-model-70ed7b-kserve-858d9f6fbc-b27xj\" (UID: \"d065e326-4743-4f66-8fd3-33ac9f3ecd00\") " pod="ai-tenant-e2e-shared-b-70ed7b/auth-test-model-70ed7b-kserve-858d9f6fbc-b27xj"
Jul 15 13:01:00.109731 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:01:00.109509    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d065e326-4743-4f66-8fd3-33ac9f3ecd00-tmp-dir\") pod \"auth-test-model-70ed7b-kserve-858d9f6fbc-b27xj\" (UID: \"d065e326-4743-4f66-8fd3-33ac9f3ecd00\") " pod="ai-tenant-e2e-shared-b-70ed7b/auth-test-model-70ed7b-kserve-858d9f6fbc-b27xj"
Jul 15 13:01:00.109731 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:01:00.109527    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d065e326-4743-4f66-8fd3-33ac9f3ecd00-home\") pod \"auth-test-model-70ed7b-kserve-858d9f6fbc-b27xj\" (UID: \"d065e326-4743-4f66-8fd3-33ac9f3ecd00\") " pod="ai-tenant-e2e-shared-b-70ed7b/auth-test-model-70ed7b-kserve-858d9f6fbc-b27xj"
Jul 15 13:01:00.109731 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:01:00.109541    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d065e326-4743-4f66-8fd3-33ac9f3ecd00-dshm\") pod \"auth-test-model-70ed7b-kserve-858d9f6fbc-b27xj\" (UID: \"d065e326-4743-4f66-8fd3-33ac9f3ecd00\") " pod="ai-tenant-e2e-shared-b-70ed7b/auth-test-model-70ed7b-kserve-858d9f6fbc-b27xj"
Jul 15 13:01:00.109731 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:01:00.109558    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d065e326-4743-4f66-8fd3-33ac9f3ecd00-tls-certs\") pod \"auth-test-model-70ed7b-kserve-858d9f6fbc-b27xj\" (UID: \"d065e326-4743-4f66-8fd3-33ac9f3ecd00\") " pod="ai-tenant-e2e-shared-b-70ed7b/auth-test-model-70ed7b-kserve-858d9f6fbc-b27xj"
Jul 15 13:01:00.109980 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:01:00.109944    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d065e326-4743-4f66-8fd3-33ac9f3ecd00-tmp-dir\") pod \"auth-test-model-70ed7b-kserve-858d9f6fbc-b27xj\" (UID: \"d065e326-4743-4f66-8fd3-33ac9f3ecd00\") " pod="ai-tenant-e2e-shared-b-70ed7b/auth-test-model-70ed7b-kserve-858d9f6fbc-b27xj"
Jul 15 13:01:00.110133 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:01:00.109999    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d065e326-4743-4f66-8fd3-33ac9f3ecd00-home\") pod \"auth-test-model-70ed7b-kserve-858d9f6fbc-b27xj\" (UID: \"d065e326-4743-4f66-8fd3-33ac9f3ecd00\") " pod="ai-tenant-e2e-shared-b-70ed7b/auth-test-model-70ed7b-kserve-858d9f6fbc-b27xj"
Jul 15 13:01:00.110133 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:01:00.110055    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d065e326-4743-4f66-8fd3-33ac9f3ecd00-model-cache\") pod \"auth-test-model-70ed7b-kserve-858d9f6fbc-b27xj\" (UID: \"d065e326-4743-4f66-8fd3-33ac9f3ecd00\") " pod="ai-tenant-e2e-shared-b-70ed7b/auth-test-model-70ed7b-kserve-858d9f6fbc-b27xj"
Jul 15 13:01:00.111983 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:01:00.111963    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d065e326-4743-4f66-8fd3-33ac9f3ecd00-dshm\") pod \"auth-test-model-70ed7b-kserve-858d9f6fbc-b27xj\" (UID: \"d065e326-4743-4f66-8fd3-33ac9f3ecd00\") " pod="ai-tenant-e2e-shared-b-70ed7b/auth-test-model-70ed7b-kserve-858d9f6fbc-b27xj"
Jul 15 13:01:00.112069 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:01:00.112040    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d065e326-4743-4f66-8fd3-33ac9f3ecd00-tls-certs\") pod \"auth-test-model-70ed7b-kserve-858d9f6fbc-b27xj\" (UID: \"d065e326-4743-4f66-8fd3-33ac9f3ecd00\") " pod="ai-tenant-e2e-shared-b-70ed7b/auth-test-model-70ed7b-kserve-858d9f6fbc-b27xj"
Jul 15 13:01:00.118114 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:01:00.118093    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8dr9r\" (UniqueName: \"kubernetes.io/projected/d065e326-4743-4f66-8fd3-33ac9f3ecd00-kube-api-access-8dr9r\") pod \"auth-test-model-70ed7b-kserve-858d9f6fbc-b27xj\" (UID: \"d065e326-4743-4f66-8fd3-33ac9f3ecd00\") " pod="ai-tenant-e2e-shared-b-70ed7b/auth-test-model-70ed7b-kserve-858d9f6fbc-b27xj"
Jul 15 13:01:00.206946 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:01:00.206850    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-70ed7b/auth-test-model-70ed7b-kserve-858d9f6fbc-b27xj"
Jul 15 13:01:00.343181 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:01:00.343153    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-70ed7b/auth-test-model-70ed7b-kserve-858d9f6fbc-b27xj"]
Jul 15 13:01:00.344907 ip-10-0-140-67 kubenswrapper[2559]: W0715 13:01:00.344877    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podd065e326_4743_4f66_8fd3_33ac9f3ecd00.slice/crio-0445f1d761d77961314fd063464874bcf7e4a5731b591cd61b38267a9c42974c WatchSource:0}: Error finding container 0445f1d761d77961314fd063464874bcf7e4a5731b591cd61b38267a9c42974c: Status 404 returned error can't find the container with id 0445f1d761d77961314fd063464874bcf7e4a5731b591cd61b38267a9c42974c
Jul 15 13:01:01.155152 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:01:01.155115    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-70ed7b/auth-test-model-70ed7b-kserve-858d9f6fbc-b27xj" event={"ID":"d065e326-4743-4f66-8fd3-33ac9f3ecd00","Type":"ContainerStarted","Data":"e9adcfe3edee33ebd03f6297311bbaebb40bb60fc59bce3d6a3dfad3f9ffacfa"}
Jul 15 13:01:01.155152 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:01:01.155157    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-70ed7b/auth-test-model-70ed7b-kserve-858d9f6fbc-b27xj" event={"ID":"d065e326-4743-4f66-8fd3-33ac9f3ecd00","Type":"ContainerStarted","Data":"0445f1d761d77961314fd063464874bcf7e4a5731b591cd61b38267a9c42974c"}
Jul 15 13:01:01.178238 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:01:01.178186    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-70ed7b/auth-test-model-70ed7b-kserve-858d9f6fbc-b27xj" podStartSLOduration=2.17817252 podStartE2EDuration="2.17817252s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:00:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:01:01.176089938 +0000 UTC m=+2431.148661096" watchObservedRunningTime="2026-07-15 13:01:01.17817252 +0000 UTC m=+2431.150743677"
Jul 15 13:01:03.726690 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:01:03.726653    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 13:01:10.207744 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:01:10.207704    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-70ed7b/auth-test-model-70ed7b-kserve-858d9f6fbc-b27xj"
Jul 15 13:01:10.208153 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:01:10.207764    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-70ed7b/auth-test-model-70ed7b-kserve-858d9f6fbc-b27xj"
Jul 15 13:01:10.220158 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:01:10.220128    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-70ed7b/auth-test-model-70ed7b-kserve-858d9f6fbc-b27xj"
Jul 15 13:01:11.219467 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:01:11.219438    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-70ed7b/auth-test-model-70ed7b-kserve-858d9f6fbc-b27xj"
Jul 15 13:01:18.823294 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:01:18.823257    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 13:01:23.691264 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:01:23.691228    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 13:01:31.404643 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:01:31.404611    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 13:01:34.335632 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:01:34.335591    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 13:01:47.393282 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:01:47.393248    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 13:01:51.041243 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:01:51.041203    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 13:02:07.323866 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:02:07.323824    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 13:02:25.736760 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:02:25.736681    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 13:02:43.733063 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:02:43.728859    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 13:02:58.767029 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:02:58.766988    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-3af497/auth-test-model-3af497-kserve-7689d987-69qgz"]
Jul 15 13:02:58.823542 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:02:58.823504    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 13:02:59.596638 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:02:59.596605    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-70ed7b/auth-test-model-70ed7b-kserve-858d9f6fbc-b27xj"]
Jul 15 13:02:59.606124 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:02:59.606096    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 13:03:01.426953 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:01.426918    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 13:03:13.786756 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:13.786718    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-3af497/auth-test-model-3af497-kserve-7689d987-69qgz" podUID="28bf2015-50ef-41f9-8d40-2157bd40a259" containerName="main" containerID="cri-o://cab7baaa83fe7764ee36d31f680548e383197a2fd377571e21d1fe87c3da5532" gracePeriod=45
Jul 15 13:03:14.031395 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:14.031345    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3af497/auth-test-model-3af497-kserve-7689d987-69qgz"
Jul 15 13:03:14.033375 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:14.033345    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tx6pw\" (UniqueName: \"kubernetes.io/projected/28bf2015-50ef-41f9-8d40-2157bd40a259-kube-api-access-tx6pw\") pod \"28bf2015-50ef-41f9-8d40-2157bd40a259\" (UID: \"28bf2015-50ef-41f9-8d40-2157bd40a259\") "
Jul 15 13:03:14.033483 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:14.033421    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28bf2015-50ef-41f9-8d40-2157bd40a259-dshm\") pod \"28bf2015-50ef-41f9-8d40-2157bd40a259\" (UID: \"28bf2015-50ef-41f9-8d40-2157bd40a259\") "
Jul 15 13:03:14.033483 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:14.033448    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28bf2015-50ef-41f9-8d40-2157bd40a259-tls-certs\") pod \"28bf2015-50ef-41f9-8d40-2157bd40a259\" (UID: \"28bf2015-50ef-41f9-8d40-2157bd40a259\") "
Jul 15 13:03:14.033483 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:14.033477    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28bf2015-50ef-41f9-8d40-2157bd40a259-home\") pod \"28bf2015-50ef-41f9-8d40-2157bd40a259\" (UID: \"28bf2015-50ef-41f9-8d40-2157bd40a259\") "
Jul 15 13:03:14.033645 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:14.033525    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28bf2015-50ef-41f9-8d40-2157bd40a259-model-cache\") pod \"28bf2015-50ef-41f9-8d40-2157bd40a259\" (UID: \"28bf2015-50ef-41f9-8d40-2157bd40a259\") "
Jul 15 13:03:14.033645 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:14.033562    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28bf2015-50ef-41f9-8d40-2157bd40a259-tmp-dir\") pod \"28bf2015-50ef-41f9-8d40-2157bd40a259\" (UID: \"28bf2015-50ef-41f9-8d40-2157bd40a259\") "
Jul 15 13:03:14.033799 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:14.033768    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28bf2015-50ef-41f9-8d40-2157bd40a259-home" (OuterVolumeSpecName: "home") pod "28bf2015-50ef-41f9-8d40-2157bd40a259" (UID: "28bf2015-50ef-41f9-8d40-2157bd40a259"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:03:14.033927 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:14.033808    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28bf2015-50ef-41f9-8d40-2157bd40a259-model-cache" (OuterVolumeSpecName: "model-cache") pod "28bf2015-50ef-41f9-8d40-2157bd40a259" (UID: "28bf2015-50ef-41f9-8d40-2157bd40a259"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:03:14.033927 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:14.033869    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28bf2015-50ef-41f9-8d40-2157bd40a259-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "28bf2015-50ef-41f9-8d40-2157bd40a259" (UID: "28bf2015-50ef-41f9-8d40-2157bd40a259"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:03:14.035578 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:14.035548    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/28bf2015-50ef-41f9-8d40-2157bd40a259-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "28bf2015-50ef-41f9-8d40-2157bd40a259" (UID: "28bf2015-50ef-41f9-8d40-2157bd40a259"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:03:14.035578 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:14.035569    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28bf2015-50ef-41f9-8d40-2157bd40a259-dshm" (OuterVolumeSpecName: "dshm") pod "28bf2015-50ef-41f9-8d40-2157bd40a259" (UID: "28bf2015-50ef-41f9-8d40-2157bd40a259"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:03:14.035719 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:14.035677    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28bf2015-50ef-41f9-8d40-2157bd40a259-kube-api-access-tx6pw" (OuterVolumeSpecName: "kube-api-access-tx6pw") pod "28bf2015-50ef-41f9-8d40-2157bd40a259" (UID: "28bf2015-50ef-41f9-8d40-2157bd40a259"). InnerVolumeSpecName "kube-api-access-tx6pw". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:03:14.135062 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:14.135028    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/28bf2015-50ef-41f9-8d40-2157bd40a259-tmp-dir\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 13:03:14.135062 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:14.135062    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tx6pw\" (UniqueName: \"kubernetes.io/projected/28bf2015-50ef-41f9-8d40-2157bd40a259-kube-api-access-tx6pw\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 13:03:14.135273 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:14.135076    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/28bf2015-50ef-41f9-8d40-2157bd40a259-dshm\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 13:03:14.135273 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:14.135088    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/28bf2015-50ef-41f9-8d40-2157bd40a259-tls-certs\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 13:03:14.135273 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:14.135099    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/28bf2015-50ef-41f9-8d40-2157bd40a259-home\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 13:03:14.135273 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:14.135109    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/28bf2015-50ef-41f9-8d40-2157bd40a259-model-cache\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 13:03:14.616529 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:14.616486    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-70ed7b/auth-test-model-70ed7b-kserve-858d9f6fbc-b27xj" podUID="d065e326-4743-4f66-8fd3-33ac9f3ecd00" containerName="main" containerID="cri-o://e9adcfe3edee33ebd03f6297311bbaebb40bb60fc59bce3d6a3dfad3f9ffacfa" gracePeriod=45
Jul 15 13:03:14.812352 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:14.812320    2559 generic.go:356] "Generic (PLEG): container finished" podID="d065e326-4743-4f66-8fd3-33ac9f3ecd00" containerID="e9adcfe3edee33ebd03f6297311bbaebb40bb60fc59bce3d6a3dfad3f9ffacfa" exitCode=0
Jul 15 13:03:14.812699 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:14.812401    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-70ed7b/auth-test-model-70ed7b-kserve-858d9f6fbc-b27xj" event={"ID":"d065e326-4743-4f66-8fd3-33ac9f3ecd00","Type":"ContainerDied","Data":"e9adcfe3edee33ebd03f6297311bbaebb40bb60fc59bce3d6a3dfad3f9ffacfa"}
Jul 15 13:03:14.813782 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:14.813754    2559 generic.go:356] "Generic (PLEG): container finished" podID="28bf2015-50ef-41f9-8d40-2157bd40a259" containerID="cab7baaa83fe7764ee36d31f680548e383197a2fd377571e21d1fe87c3da5532" exitCode=0
Jul 15 13:03:14.813906 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:14.813808    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3af497/auth-test-model-3af497-kserve-7689d987-69qgz"
Jul 15 13:03:14.813906 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:14.813811    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3af497/auth-test-model-3af497-kserve-7689d987-69qgz" event={"ID":"28bf2015-50ef-41f9-8d40-2157bd40a259","Type":"ContainerDied","Data":"cab7baaa83fe7764ee36d31f680548e383197a2fd377571e21d1fe87c3da5532"}
Jul 15 13:03:14.813906 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:14.813850    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3af497/auth-test-model-3af497-kserve-7689d987-69qgz" event={"ID":"28bf2015-50ef-41f9-8d40-2157bd40a259","Type":"ContainerDied","Data":"5bd2ee800fd2e34fe990b378f18fdb197f92a77a6355e3e87ac2376c85a8afa8"}
Jul 15 13:03:14.813906 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:14.813877    2559 scope.go:117] "RemoveContainer" containerID="cab7baaa83fe7764ee36d31f680548e383197a2fd377571e21d1fe87c3da5532"
Jul 15 13:03:14.822468 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:14.822451    2559 scope.go:117] "RemoveContainer" containerID="cab7baaa83fe7764ee36d31f680548e383197a2fd377571e21d1fe87c3da5532"
Jul 15 13:03:14.822764 ip-10-0-140-67 kubenswrapper[2559]: E0715 13:03:14.822741    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cab7baaa83fe7764ee36d31f680548e383197a2fd377571e21d1fe87c3da5532\": container with ID starting with cab7baaa83fe7764ee36d31f680548e383197a2fd377571e21d1fe87c3da5532 not found: ID does not exist" containerID="cab7baaa83fe7764ee36d31f680548e383197a2fd377571e21d1fe87c3da5532"
Jul 15 13:03:14.822841 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:14.822772    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cab7baaa83fe7764ee36d31f680548e383197a2fd377571e21d1fe87c3da5532"} err="failed to get container status \"cab7baaa83fe7764ee36d31f680548e383197a2fd377571e21d1fe87c3da5532\": rpc error: code = NotFound desc = could not find container \"cab7baaa83fe7764ee36d31f680548e383197a2fd377571e21d1fe87c3da5532\": container with ID starting with cab7baaa83fe7764ee36d31f680548e383197a2fd377571e21d1fe87c3da5532 not found: ID does not exist"
Jul 15 13:03:14.829573 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:14.829551    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-3af497/auth-test-model-3af497-kserve-7689d987-69qgz"]
Jul 15 13:03:14.835775 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:14.835756    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-3af497/auth-test-model-3af497-kserve-7689d987-69qgz"]
Jul 15 13:03:14.865401 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:14.865379    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-70ed7b/auth-test-model-70ed7b-kserve-858d9f6fbc-b27xj"
Jul 15 13:03:14.941057 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:14.941017    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d065e326-4743-4f66-8fd3-33ac9f3ecd00-home\") pod \"d065e326-4743-4f66-8fd3-33ac9f3ecd00\" (UID: \"d065e326-4743-4f66-8fd3-33ac9f3ecd00\") "
Jul 15 13:03:14.941251 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:14.941067    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d065e326-4743-4f66-8fd3-33ac9f3ecd00-tmp-dir\") pod \"d065e326-4743-4f66-8fd3-33ac9f3ecd00\" (UID: \"d065e326-4743-4f66-8fd3-33ac9f3ecd00\") "
Jul 15 13:03:14.941251 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:14.941086    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d065e326-4743-4f66-8fd3-33ac9f3ecd00-tls-certs\") pod \"d065e326-4743-4f66-8fd3-33ac9f3ecd00\" (UID: \"d065e326-4743-4f66-8fd3-33ac9f3ecd00\") "
Jul 15 13:03:14.941251 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:14.941106    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d065e326-4743-4f66-8fd3-33ac9f3ecd00-dshm\") pod \"d065e326-4743-4f66-8fd3-33ac9f3ecd00\" (UID: \"d065e326-4743-4f66-8fd3-33ac9f3ecd00\") "
Jul 15 13:03:14.941251 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:14.941127    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8dr9r\" (UniqueName: \"kubernetes.io/projected/d065e326-4743-4f66-8fd3-33ac9f3ecd00-kube-api-access-8dr9r\") pod \"d065e326-4743-4f66-8fd3-33ac9f3ecd00\" (UID: \"d065e326-4743-4f66-8fd3-33ac9f3ecd00\") "
Jul 15 13:03:14.941251 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:14.941159    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d065e326-4743-4f66-8fd3-33ac9f3ecd00-model-cache\") pod \"d065e326-4743-4f66-8fd3-33ac9f3ecd00\" (UID: \"d065e326-4743-4f66-8fd3-33ac9f3ecd00\") "
Jul 15 13:03:14.941533 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:14.941345    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d065e326-4743-4f66-8fd3-33ac9f3ecd00-home" (OuterVolumeSpecName: "home") pod "d065e326-4743-4f66-8fd3-33ac9f3ecd00" (UID: "d065e326-4743-4f66-8fd3-33ac9f3ecd00"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:03:14.941533 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:14.941356    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d065e326-4743-4f66-8fd3-33ac9f3ecd00-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "d065e326-4743-4f66-8fd3-33ac9f3ecd00" (UID: "d065e326-4743-4f66-8fd3-33ac9f3ecd00"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:03:14.941602 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:14.941568    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d065e326-4743-4f66-8fd3-33ac9f3ecd00-model-cache" (OuterVolumeSpecName: "model-cache") pod "d065e326-4743-4f66-8fd3-33ac9f3ecd00" (UID: "d065e326-4743-4f66-8fd3-33ac9f3ecd00"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:03:14.943425 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:14.943398    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d065e326-4743-4f66-8fd3-33ac9f3ecd00-dshm" (OuterVolumeSpecName: "dshm") pod "d065e326-4743-4f66-8fd3-33ac9f3ecd00" (UID: "d065e326-4743-4f66-8fd3-33ac9f3ecd00"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:03:14.943425 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:14.943419    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d065e326-4743-4f66-8fd3-33ac9f3ecd00-kube-api-access-8dr9r" (OuterVolumeSpecName: "kube-api-access-8dr9r") pod "d065e326-4743-4f66-8fd3-33ac9f3ecd00" (UID: "d065e326-4743-4f66-8fd3-33ac9f3ecd00"). InnerVolumeSpecName "kube-api-access-8dr9r". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:03:14.943589 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:14.943443    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d065e326-4743-4f66-8fd3-33ac9f3ecd00-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "d065e326-4743-4f66-8fd3-33ac9f3ecd00" (UID: "d065e326-4743-4f66-8fd3-33ac9f3ecd00"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:03:15.041720 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:15.041688    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/d065e326-4743-4f66-8fd3-33ac9f3ecd00-home\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 13:03:15.041720 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:15.041718    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/d065e326-4743-4f66-8fd3-33ac9f3ecd00-tmp-dir\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 13:03:15.041720 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:15.041729    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/d065e326-4743-4f66-8fd3-33ac9f3ecd00-tls-certs\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 13:03:15.041995 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:15.041741    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/d065e326-4743-4f66-8fd3-33ac9f3ecd00-dshm\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 13:03:15.041995 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:15.041753    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8dr9r\" (UniqueName: \"kubernetes.io/projected/d065e326-4743-4f66-8fd3-33ac9f3ecd00-kube-api-access-8dr9r\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 13:03:15.041995 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:15.041764    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/d065e326-4743-4f66-8fd3-33ac9f3ecd00-model-cache\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 13:03:15.820525 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:15.820483    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-70ed7b/auth-test-model-70ed7b-kserve-858d9f6fbc-b27xj" event={"ID":"d065e326-4743-4f66-8fd3-33ac9f3ecd00","Type":"ContainerDied","Data":"0445f1d761d77961314fd063464874bcf7e4a5731b591cd61b38267a9c42974c"}
Jul 15 13:03:15.820945 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:15.820536    2559 scope.go:117] "RemoveContainer" containerID="e9adcfe3edee33ebd03f6297311bbaebb40bb60fc59bce3d6a3dfad3f9ffacfa"
Jul 15 13:03:15.820945 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:15.820502    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-70ed7b/auth-test-model-70ed7b-kserve-858d9f6fbc-b27xj"
Jul 15 13:03:15.846561 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:15.846528    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-70ed7b/auth-test-model-70ed7b-kserve-858d9f6fbc-b27xj"]
Jul 15 13:03:15.852064 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:15.852043    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-70ed7b/auth-test-model-70ed7b-kserve-858d9f6fbc-b27xj"]
Jul 15 13:03:16.320106 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:16.320076    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-3af497/sub-test-model-3af497-kserve-b9948b987-t4rkm"]
Jul 15 13:03:16.320438 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:16.320425    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d065e326-4743-4f66-8fd3-33ac9f3ecd00" containerName="main"
Jul 15 13:03:16.320491 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:16.320440    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="d065e326-4743-4f66-8fd3-33ac9f3ecd00" containerName="main"
Jul 15 13:03:16.320491 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:16.320456    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28bf2015-50ef-41f9-8d40-2157bd40a259" containerName="main"
Jul 15 13:03:16.320491 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:16.320462    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="28bf2015-50ef-41f9-8d40-2157bd40a259" containerName="main"
Jul 15 13:03:16.320584 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:16.320530    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="d065e326-4743-4f66-8fd3-33ac9f3ecd00" containerName="main"
Jul 15 13:03:16.320584 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:16.320540    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="28bf2015-50ef-41f9-8d40-2157bd40a259" containerName="main"
Jul 15 13:03:16.324763 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:16.324744    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3af497/sub-test-model-3af497-kserve-b9948b987-t4rkm"
Jul 15 13:03:16.327902 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:16.327883    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-3af497\"/\"kube-root-ca.crt\""
Jul 15 13:03:16.328641 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:16.328623    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-3af497\"/\"sub-test-model-3af497-kserve-self-signed-certs\""
Jul 15 13:03:16.328735 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:16.328684    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-3af497\"/\"default-dockercfg-5rt8n\""
Jul 15 13:03:16.328803 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:16.328733    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-3af497\"/\"openshift-service-ca.crt\""
Jul 15 13:03:16.340436 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:16.340417    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-3af497/sub-test-model-3af497-kserve-b9948b987-t4rkm"]
Jul 15 13:03:16.350579 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:16.350552    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c31f64e9-5e5f-4c84-96a6-05209d56e75a-dshm\") pod \"sub-test-model-3af497-kserve-b9948b987-t4rkm\" (UID: \"c31f64e9-5e5f-4c84-96a6-05209d56e75a\") " pod="ai-tenant-e2e-shared-a-3af497/sub-test-model-3af497-kserve-b9948b987-t4rkm"
Jul 15 13:03:16.350704 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:16.350627    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c31f64e9-5e5f-4c84-96a6-05209d56e75a-model-cache\") pod \"sub-test-model-3af497-kserve-b9948b987-t4rkm\" (UID: \"c31f64e9-5e5f-4c84-96a6-05209d56e75a\") " pod="ai-tenant-e2e-shared-a-3af497/sub-test-model-3af497-kserve-b9948b987-t4rkm"
Jul 15 13:03:16.350776 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:16.350716    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c31f64e9-5e5f-4c84-96a6-05209d56e75a-tmp-dir\") pod \"sub-test-model-3af497-kserve-b9948b987-t4rkm\" (UID: \"c31f64e9-5e5f-4c84-96a6-05209d56e75a\") " pod="ai-tenant-e2e-shared-a-3af497/sub-test-model-3af497-kserve-b9948b987-t4rkm"
Jul 15 13:03:16.350776 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:16.350757    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gq64k\" (UniqueName: \"kubernetes.io/projected/c31f64e9-5e5f-4c84-96a6-05209d56e75a-kube-api-access-gq64k\") pod \"sub-test-model-3af497-kserve-b9948b987-t4rkm\" (UID: \"c31f64e9-5e5f-4c84-96a6-05209d56e75a\") " pod="ai-tenant-e2e-shared-a-3af497/sub-test-model-3af497-kserve-b9948b987-t4rkm"
Jul 15 13:03:16.350894 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:16.350799    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c31f64e9-5e5f-4c84-96a6-05209d56e75a-home\") pod \"sub-test-model-3af497-kserve-b9948b987-t4rkm\" (UID: \"c31f64e9-5e5f-4c84-96a6-05209d56e75a\") " pod="ai-tenant-e2e-shared-a-3af497/sub-test-model-3af497-kserve-b9948b987-t4rkm"
Jul 15 13:03:16.350894 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:16.350881    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c31f64e9-5e5f-4c84-96a6-05209d56e75a-tls-certs\") pod \"sub-test-model-3af497-kserve-b9948b987-t4rkm\" (UID: \"c31f64e9-5e5f-4c84-96a6-05209d56e75a\") " pod="ai-tenant-e2e-shared-a-3af497/sub-test-model-3af497-kserve-b9948b987-t4rkm"
Jul 15 13:03:16.358617 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:16.358586    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 13:03:16.451754 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:16.451717    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c31f64e9-5e5f-4c84-96a6-05209d56e75a-tls-certs\") pod \"sub-test-model-3af497-kserve-b9948b987-t4rkm\" (UID: \"c31f64e9-5e5f-4c84-96a6-05209d56e75a\") " pod="ai-tenant-e2e-shared-a-3af497/sub-test-model-3af497-kserve-b9948b987-t4rkm"
Jul 15 13:03:16.451917 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:16.451778    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c31f64e9-5e5f-4c84-96a6-05209d56e75a-dshm\") pod \"sub-test-model-3af497-kserve-b9948b987-t4rkm\" (UID: \"c31f64e9-5e5f-4c84-96a6-05209d56e75a\") " pod="ai-tenant-e2e-shared-a-3af497/sub-test-model-3af497-kserve-b9948b987-t4rkm"
Jul 15 13:03:16.451917 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:16.451806    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c31f64e9-5e5f-4c84-96a6-05209d56e75a-model-cache\") pod \"sub-test-model-3af497-kserve-b9948b987-t4rkm\" (UID: \"c31f64e9-5e5f-4c84-96a6-05209d56e75a\") " pod="ai-tenant-e2e-shared-a-3af497/sub-test-model-3af497-kserve-b9948b987-t4rkm"
Jul 15 13:03:16.451917 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:16.451825    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c31f64e9-5e5f-4c84-96a6-05209d56e75a-tmp-dir\") pod \"sub-test-model-3af497-kserve-b9948b987-t4rkm\" (UID: \"c31f64e9-5e5f-4c84-96a6-05209d56e75a\") " pod="ai-tenant-e2e-shared-a-3af497/sub-test-model-3af497-kserve-b9948b987-t4rkm"
Jul 15 13:03:16.451917 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:16.451841    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gq64k\" (UniqueName: \"kubernetes.io/projected/c31f64e9-5e5f-4c84-96a6-05209d56e75a-kube-api-access-gq64k\") pod \"sub-test-model-3af497-kserve-b9948b987-t4rkm\" (UID: \"c31f64e9-5e5f-4c84-96a6-05209d56e75a\") " pod="ai-tenant-e2e-shared-a-3af497/sub-test-model-3af497-kserve-b9948b987-t4rkm"
Jul 15 13:03:16.451917 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:16.451864    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c31f64e9-5e5f-4c84-96a6-05209d56e75a-home\") pod \"sub-test-model-3af497-kserve-b9948b987-t4rkm\" (UID: \"c31f64e9-5e5f-4c84-96a6-05209d56e75a\") " pod="ai-tenant-e2e-shared-a-3af497/sub-test-model-3af497-kserve-b9948b987-t4rkm"
Jul 15 13:03:16.452288 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:16.452266    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c31f64e9-5e5f-4c84-96a6-05209d56e75a-model-cache\") pod \"sub-test-model-3af497-kserve-b9948b987-t4rkm\" (UID: \"c31f64e9-5e5f-4c84-96a6-05209d56e75a\") " pod="ai-tenant-e2e-shared-a-3af497/sub-test-model-3af497-kserve-b9948b987-t4rkm"
Jul 15 13:03:16.452354 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:16.452318    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c31f64e9-5e5f-4c84-96a6-05209d56e75a-tmp-dir\") pod \"sub-test-model-3af497-kserve-b9948b987-t4rkm\" (UID: \"c31f64e9-5e5f-4c84-96a6-05209d56e75a\") " pod="ai-tenant-e2e-shared-a-3af497/sub-test-model-3af497-kserve-b9948b987-t4rkm"
Jul 15 13:03:16.452354 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:16.452335    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c31f64e9-5e5f-4c84-96a6-05209d56e75a-home\") pod \"sub-test-model-3af497-kserve-b9948b987-t4rkm\" (UID: \"c31f64e9-5e5f-4c84-96a6-05209d56e75a\") " pod="ai-tenant-e2e-shared-a-3af497/sub-test-model-3af497-kserve-b9948b987-t4rkm"
Jul 15 13:03:16.454136 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:16.454115    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c31f64e9-5e5f-4c84-96a6-05209d56e75a-dshm\") pod \"sub-test-model-3af497-kserve-b9948b987-t4rkm\" (UID: \"c31f64e9-5e5f-4c84-96a6-05209d56e75a\") " pod="ai-tenant-e2e-shared-a-3af497/sub-test-model-3af497-kserve-b9948b987-t4rkm"
Jul 15 13:03:16.454433 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:16.454412    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c31f64e9-5e5f-4c84-96a6-05209d56e75a-tls-certs\") pod \"sub-test-model-3af497-kserve-b9948b987-t4rkm\" (UID: \"c31f64e9-5e5f-4c84-96a6-05209d56e75a\") " pod="ai-tenant-e2e-shared-a-3af497/sub-test-model-3af497-kserve-b9948b987-t4rkm"
Jul 15 13:03:16.460188 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:16.460165    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gq64k\" (UniqueName: \"kubernetes.io/projected/c31f64e9-5e5f-4c84-96a6-05209d56e75a-kube-api-access-gq64k\") pod \"sub-test-model-3af497-kserve-b9948b987-t4rkm\" (UID: \"c31f64e9-5e5f-4c84-96a6-05209d56e75a\") " pod="ai-tenant-e2e-shared-a-3af497/sub-test-model-3af497-kserve-b9948b987-t4rkm"
Jul 15 13:03:16.583731 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:16.583649    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="28bf2015-50ef-41f9-8d40-2157bd40a259" path="/var/lib/kubelet/pods/28bf2015-50ef-41f9-8d40-2157bd40a259/volumes"
Jul 15 13:03:16.584045 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:16.584033    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d065e326-4743-4f66-8fd3-33ac9f3ecd00" path="/var/lib/kubelet/pods/d065e326-4743-4f66-8fd3-33ac9f3ecd00/volumes"
Jul 15 13:03:16.633495 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:16.633464    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3af497/sub-test-model-3af497-kserve-b9948b987-t4rkm"
Jul 15 13:03:16.767914 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:16.767886    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-3af497/sub-test-model-3af497-kserve-b9948b987-t4rkm"]
Jul 15 13:03:16.769765 ip-10-0-140-67 kubenswrapper[2559]: W0715 13:03:16.769737    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podc31f64e9_5e5f_4c84_96a6_05209d56e75a.slice/crio-2ac91e1da0702ba989d0b72684650efe0525d0a6ee536ac5e4bd1a4b171d1425 WatchSource:0}: Error finding container 2ac91e1da0702ba989d0b72684650efe0525d0a6ee536ac5e4bd1a4b171d1425: Status 404 returned error can't find the container with id 2ac91e1da0702ba989d0b72684650efe0525d0a6ee536ac5e4bd1a4b171d1425
Jul 15 13:03:16.831995 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:16.831971    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3af497/sub-test-model-3af497-kserve-b9948b987-t4rkm" event={"ID":"c31f64e9-5e5f-4c84-96a6-05209d56e75a","Type":"ContainerStarted","Data":"a1cf01fa89c9068bc817e6cb18dfb8dd73a49be5ad35af5f1b1a1fc91a7bea90"}
Jul 15 13:03:16.832353 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:16.832006    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3af497/sub-test-model-3af497-kserve-b9948b987-t4rkm" event={"ID":"c31f64e9-5e5f-4c84-96a6-05209d56e75a","Type":"ContainerStarted","Data":"2ac91e1da0702ba989d0b72684650efe0525d0a6ee536ac5e4bd1a4b171d1425"}
Jul 15 13:03:16.851718 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:16.851628    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-3af497/sub-test-model-3af497-kserve-b9948b987-t4rkm" podStartSLOduration=0.851611799 podStartE2EDuration="851.611799ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:03:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:03:16.850486442 +0000 UTC m=+2566.823057611" watchObservedRunningTime="2026-07-15 13:03:16.851611799 +0000 UTC m=+2566.824182957"
Jul 15 13:03:20.127930 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:20.127892    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 13:03:26.633868 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:26.633827    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-3af497/sub-test-model-3af497-kserve-b9948b987-t4rkm"
Jul 15 13:03:26.634268 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:26.633885    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-3af497/sub-test-model-3af497-kserve-b9948b987-t4rkm"
Jul 15 13:03:26.646874 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:26.646844    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-3af497/sub-test-model-3af497-kserve-b9948b987-t4rkm"
Jul 15 13:03:26.890615 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:26.890524    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-3af497/sub-test-model-3af497-kserve-b9948b987-t4rkm"
Jul 15 13:03:46.191994 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:46.191960    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-70ed7b/sub-test-model-70ed7b-kserve-565d4945-trsls"]
Jul 15 13:03:46.195013 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:46.194991    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-70ed7b/sub-test-model-70ed7b-kserve-565d4945-trsls"
Jul 15 13:03:46.205525 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:46.205507    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-70ed7b\"/\"kube-root-ca.crt\""
Jul 15 13:03:46.208902 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:46.208878    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-70ed7b\"/\"sub-test-model-70ed7b-kserve-self-signed-certs\""
Jul 15 13:03:46.208995 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:46.208913    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-70ed7b\"/\"openshift-service-ca.crt\""
Jul 15 13:03:46.208995 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:46.208975    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-70ed7b\"/\"default-dockercfg-sk5wg\""
Jul 15 13:03:46.229866 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:46.229836    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-70ed7b/sub-test-model-70ed7b-kserve-565d4945-trsls"]
Jul 15 13:03:46.260489 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:46.260461    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 13:03:46.314954 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:46.314916    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03a879b2-45cc-4f6a-b3de-6ab0548893c3-home\") pod \"sub-test-model-70ed7b-kserve-565d4945-trsls\" (UID: \"03a879b2-45cc-4f6a-b3de-6ab0548893c3\") " pod="ai-tenant-e2e-shared-b-70ed7b/sub-test-model-70ed7b-kserve-565d4945-trsls"
Jul 15 13:03:46.314954 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:46.314956    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03a879b2-45cc-4f6a-b3de-6ab0548893c3-tmp-dir\") pod \"sub-test-model-70ed7b-kserve-565d4945-trsls\" (UID: \"03a879b2-45cc-4f6a-b3de-6ab0548893c3\") " pod="ai-tenant-e2e-shared-b-70ed7b/sub-test-model-70ed7b-kserve-565d4945-trsls"
Jul 15 13:03:46.315155 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:46.314976    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w98qx\" (UniqueName: \"kubernetes.io/projected/03a879b2-45cc-4f6a-b3de-6ab0548893c3-kube-api-access-w98qx\") pod \"sub-test-model-70ed7b-kserve-565d4945-trsls\" (UID: \"03a879b2-45cc-4f6a-b3de-6ab0548893c3\") " pod="ai-tenant-e2e-shared-b-70ed7b/sub-test-model-70ed7b-kserve-565d4945-trsls"
Jul 15 13:03:46.315155 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:46.315033    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03a879b2-45cc-4f6a-b3de-6ab0548893c3-dshm\") pod \"sub-test-model-70ed7b-kserve-565d4945-trsls\" (UID: \"03a879b2-45cc-4f6a-b3de-6ab0548893c3\") " pod="ai-tenant-e2e-shared-b-70ed7b/sub-test-model-70ed7b-kserve-565d4945-trsls"
Jul 15 13:03:46.315155 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:46.315051    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03a879b2-45cc-4f6a-b3de-6ab0548893c3-model-cache\") pod \"sub-test-model-70ed7b-kserve-565d4945-trsls\" (UID: \"03a879b2-45cc-4f6a-b3de-6ab0548893c3\") " pod="ai-tenant-e2e-shared-b-70ed7b/sub-test-model-70ed7b-kserve-565d4945-trsls"
Jul 15 13:03:46.315252 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:46.315170    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03a879b2-45cc-4f6a-b3de-6ab0548893c3-tls-certs\") pod \"sub-test-model-70ed7b-kserve-565d4945-trsls\" (UID: \"03a879b2-45cc-4f6a-b3de-6ab0548893c3\") " pod="ai-tenant-e2e-shared-b-70ed7b/sub-test-model-70ed7b-kserve-565d4945-trsls"
Jul 15 13:03:46.416035 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:46.416004    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w98qx\" (UniqueName: \"kubernetes.io/projected/03a879b2-45cc-4f6a-b3de-6ab0548893c3-kube-api-access-w98qx\") pod \"sub-test-model-70ed7b-kserve-565d4945-trsls\" (UID: \"03a879b2-45cc-4f6a-b3de-6ab0548893c3\") " pod="ai-tenant-e2e-shared-b-70ed7b/sub-test-model-70ed7b-kserve-565d4945-trsls"
Jul 15 13:03:46.416035 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:46.416040    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03a879b2-45cc-4f6a-b3de-6ab0548893c3-dshm\") pod \"sub-test-model-70ed7b-kserve-565d4945-trsls\" (UID: \"03a879b2-45cc-4f6a-b3de-6ab0548893c3\") " pod="ai-tenant-e2e-shared-b-70ed7b/sub-test-model-70ed7b-kserve-565d4945-trsls"
Jul 15 13:03:46.416270 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:46.416059    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03a879b2-45cc-4f6a-b3de-6ab0548893c3-model-cache\") pod \"sub-test-model-70ed7b-kserve-565d4945-trsls\" (UID: \"03a879b2-45cc-4f6a-b3de-6ab0548893c3\") " pod="ai-tenant-e2e-shared-b-70ed7b/sub-test-model-70ed7b-kserve-565d4945-trsls"
Jul 15 13:03:46.416270 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:46.416121    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03a879b2-45cc-4f6a-b3de-6ab0548893c3-tls-certs\") pod \"sub-test-model-70ed7b-kserve-565d4945-trsls\" (UID: \"03a879b2-45cc-4f6a-b3de-6ab0548893c3\") " pod="ai-tenant-e2e-shared-b-70ed7b/sub-test-model-70ed7b-kserve-565d4945-trsls"
Jul 15 13:03:46.416270 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:46.416163    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03a879b2-45cc-4f6a-b3de-6ab0548893c3-home\") pod \"sub-test-model-70ed7b-kserve-565d4945-trsls\" (UID: \"03a879b2-45cc-4f6a-b3de-6ab0548893c3\") " pod="ai-tenant-e2e-shared-b-70ed7b/sub-test-model-70ed7b-kserve-565d4945-trsls"
Jul 15 13:03:46.416270 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:46.416186    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03a879b2-45cc-4f6a-b3de-6ab0548893c3-tmp-dir\") pod \"sub-test-model-70ed7b-kserve-565d4945-trsls\" (UID: \"03a879b2-45cc-4f6a-b3de-6ab0548893c3\") " pod="ai-tenant-e2e-shared-b-70ed7b/sub-test-model-70ed7b-kserve-565d4945-trsls"
Jul 15 13:03:46.416576 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:46.416545    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03a879b2-45cc-4f6a-b3de-6ab0548893c3-model-cache\") pod \"sub-test-model-70ed7b-kserve-565d4945-trsls\" (UID: \"03a879b2-45cc-4f6a-b3de-6ab0548893c3\") " pod="ai-tenant-e2e-shared-b-70ed7b/sub-test-model-70ed7b-kserve-565d4945-trsls"
Jul 15 13:03:46.416693 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:46.416560    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03a879b2-45cc-4f6a-b3de-6ab0548893c3-tmp-dir\") pod \"sub-test-model-70ed7b-kserve-565d4945-trsls\" (UID: \"03a879b2-45cc-4f6a-b3de-6ab0548893c3\") " pod="ai-tenant-e2e-shared-b-70ed7b/sub-test-model-70ed7b-kserve-565d4945-trsls"
Jul 15 13:03:46.416693 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:46.416594    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03a879b2-45cc-4f6a-b3de-6ab0548893c3-home\") pod \"sub-test-model-70ed7b-kserve-565d4945-trsls\" (UID: \"03a879b2-45cc-4f6a-b3de-6ab0548893c3\") " pod="ai-tenant-e2e-shared-b-70ed7b/sub-test-model-70ed7b-kserve-565d4945-trsls"
Jul 15 13:03:46.418321 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:46.418302    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03a879b2-45cc-4f6a-b3de-6ab0548893c3-dshm\") pod \"sub-test-model-70ed7b-kserve-565d4945-trsls\" (UID: \"03a879b2-45cc-4f6a-b3de-6ab0548893c3\") " pod="ai-tenant-e2e-shared-b-70ed7b/sub-test-model-70ed7b-kserve-565d4945-trsls"
Jul 15 13:03:46.418512 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:46.418496    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03a879b2-45cc-4f6a-b3de-6ab0548893c3-tls-certs\") pod \"sub-test-model-70ed7b-kserve-565d4945-trsls\" (UID: \"03a879b2-45cc-4f6a-b3de-6ab0548893c3\") " pod="ai-tenant-e2e-shared-b-70ed7b/sub-test-model-70ed7b-kserve-565d4945-trsls"
Jul 15 13:03:46.427667 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:46.427647    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w98qx\" (UniqueName: \"kubernetes.io/projected/03a879b2-45cc-4f6a-b3de-6ab0548893c3-kube-api-access-w98qx\") pod \"sub-test-model-70ed7b-kserve-565d4945-trsls\" (UID: \"03a879b2-45cc-4f6a-b3de-6ab0548893c3\") " pod="ai-tenant-e2e-shared-b-70ed7b/sub-test-model-70ed7b-kserve-565d4945-trsls"
Jul 15 13:03:46.503693 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:46.503662    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-70ed7b/sub-test-model-70ed7b-kserve-565d4945-trsls"
Jul 15 13:03:46.635738 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:46.635714    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-70ed7b/sub-test-model-70ed7b-kserve-565d4945-trsls"]
Jul 15 13:03:46.637861 ip-10-0-140-67 kubenswrapper[2559]: W0715 13:03:46.637837    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod03a879b2_45cc_4f6a_b3de_6ab0548893c3.slice/crio-3289c8d4d33631ccf2ff952aa0935675b98d70f10642a26f9add1b8f525dbc80 WatchSource:0}: Error finding container 3289c8d4d33631ccf2ff952aa0935675b98d70f10642a26f9add1b8f525dbc80: Status 404 returned error can't find the container with id 3289c8d4d33631ccf2ff952aa0935675b98d70f10642a26f9add1b8f525dbc80
Jul 15 13:03:46.978410 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:46.978355    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-70ed7b/sub-test-model-70ed7b-kserve-565d4945-trsls" event={"ID":"03a879b2-45cc-4f6a-b3de-6ab0548893c3","Type":"ContainerStarted","Data":"ca0040140d695544dd393a165ccec59a2be9a164daeadcf7b64181086ff21e50"}
Jul 15 13:03:46.978578 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:46.978418    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-70ed7b/sub-test-model-70ed7b-kserve-565d4945-trsls" event={"ID":"03a879b2-45cc-4f6a-b3de-6ab0548893c3","Type":"ContainerStarted","Data":"3289c8d4d33631ccf2ff952aa0935675b98d70f10642a26f9add1b8f525dbc80"}
Jul 15 13:03:46.995830 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:46.995778    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-70ed7b/sub-test-model-70ed7b-kserve-565d4945-trsls" podStartSLOduration=0.995761419 podStartE2EDuration="995.761419ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:03:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:03:46.995163203 +0000 UTC m=+2596.967734361" watchObservedRunningTime="2026-07-15 13:03:46.995761419 +0000 UTC m=+2596.968332602"
Jul 15 13:03:50.428011 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:50.427967    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 13:03:56.504061 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:56.503963    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-70ed7b/sub-test-model-70ed7b-kserve-565d4945-trsls"
Jul 15 13:03:56.504061 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:56.504021    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-70ed7b/sub-test-model-70ed7b-kserve-565d4945-trsls"
Jul 15 13:03:56.516948 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:56.516923    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-70ed7b/sub-test-model-70ed7b-kserve-565d4945-trsls"
Jul 15 13:03:57.035445 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:03:57.035414    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-70ed7b/sub-test-model-70ed7b-kserve-565d4945-trsls"
Jul 15 13:04:33.600237 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:04:33.600202    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 13:04:41.395795 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:04:41.395754    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 13:04:41.493842 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:04:41.493794    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 13:04:50.324904 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:04:50.324870    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 13:04:53.314326 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:04:53.314274    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 13:04:53.411203 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:04:53.411169    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 13:04:57.637812 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:04:57.637771    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-3af497/sub-test-model-3af497-kserve-b9948b987-t4rkm"]
Jul 15 13:04:57.650795 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:04:57.650760    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 13:04:58.378922 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:04:58.378888    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-70ed7b/sub-test-model-70ed7b-kserve-565d4945-trsls"]
Jul 15 13:04:58.417466 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:04:58.417434    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 13:05:01.008709 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:01.008678    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 13:05:01.108609 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:01.108572    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 13:05:08.617807 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:08.617773    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 13:05:12.657905 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:12.657838    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-3af497/sub-test-model-3af497-kserve-b9948b987-t4rkm" podUID="c31f64e9-5e5f-4c84-96a6-05209d56e75a" containerName="main" containerID="cri-o://a1cf01fa89c9068bc817e6cb18dfb8dd73a49be5ad35af5f1b1a1fc91a7bea90" gracePeriod=45
Jul 15 13:05:12.902210 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:12.902182    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3af497/sub-test-model-3af497-kserve-b9948b987-t4rkm"
Jul 15 13:05:13.030022 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:13.029990    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gq64k\" (UniqueName: \"kubernetes.io/projected/c31f64e9-5e5f-4c84-96a6-05209d56e75a-kube-api-access-gq64k\") pod \"c31f64e9-5e5f-4c84-96a6-05209d56e75a\" (UID: \"c31f64e9-5e5f-4c84-96a6-05209d56e75a\") "
Jul 15 13:05:13.030216 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:13.030058    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c31f64e9-5e5f-4c84-96a6-05209d56e75a-dshm\") pod \"c31f64e9-5e5f-4c84-96a6-05209d56e75a\" (UID: \"c31f64e9-5e5f-4c84-96a6-05209d56e75a\") "
Jul 15 13:05:13.030216 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:13.030093    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c31f64e9-5e5f-4c84-96a6-05209d56e75a-model-cache\") pod \"c31f64e9-5e5f-4c84-96a6-05209d56e75a\" (UID: \"c31f64e9-5e5f-4c84-96a6-05209d56e75a\") "
Jul 15 13:05:13.030216 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:13.030110    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c31f64e9-5e5f-4c84-96a6-05209d56e75a-tls-certs\") pod \"c31f64e9-5e5f-4c84-96a6-05209d56e75a\" (UID: \"c31f64e9-5e5f-4c84-96a6-05209d56e75a\") "
Jul 15 13:05:13.030216 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:13.030139    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c31f64e9-5e5f-4c84-96a6-05209d56e75a-home\") pod \"c31f64e9-5e5f-4c84-96a6-05209d56e75a\" (UID: \"c31f64e9-5e5f-4c84-96a6-05209d56e75a\") "
Jul 15 13:05:13.030216 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:13.030171    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c31f64e9-5e5f-4c84-96a6-05209d56e75a-tmp-dir\") pod \"c31f64e9-5e5f-4c84-96a6-05209d56e75a\" (UID: \"c31f64e9-5e5f-4c84-96a6-05209d56e75a\") "
Jul 15 13:05:13.030530 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:13.030449    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c31f64e9-5e5f-4c84-96a6-05209d56e75a-model-cache" (OuterVolumeSpecName: "model-cache") pod "c31f64e9-5e5f-4c84-96a6-05209d56e75a" (UID: "c31f64e9-5e5f-4c84-96a6-05209d56e75a"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:05:13.030530 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:13.030511    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c31f64e9-5e5f-4c84-96a6-05209d56e75a-home" (OuterVolumeSpecName: "home") pod "c31f64e9-5e5f-4c84-96a6-05209d56e75a" (UID: "c31f64e9-5e5f-4c84-96a6-05209d56e75a"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:05:13.030616 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:13.030518    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c31f64e9-5e5f-4c84-96a6-05209d56e75a-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "c31f64e9-5e5f-4c84-96a6-05209d56e75a" (UID: "c31f64e9-5e5f-4c84-96a6-05209d56e75a"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:05:13.032332 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:13.032308    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c31f64e9-5e5f-4c84-96a6-05209d56e75a-dshm" (OuterVolumeSpecName: "dshm") pod "c31f64e9-5e5f-4c84-96a6-05209d56e75a" (UID: "c31f64e9-5e5f-4c84-96a6-05209d56e75a"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:05:13.032422 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:13.032392    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c31f64e9-5e5f-4c84-96a6-05209d56e75a-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "c31f64e9-5e5f-4c84-96a6-05209d56e75a" (UID: "c31f64e9-5e5f-4c84-96a6-05209d56e75a"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:05:13.032422 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:13.032400    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c31f64e9-5e5f-4c84-96a6-05209d56e75a-kube-api-access-gq64k" (OuterVolumeSpecName: "kube-api-access-gq64k") pod "c31f64e9-5e5f-4c84-96a6-05209d56e75a" (UID: "c31f64e9-5e5f-4c84-96a6-05209d56e75a"). InnerVolumeSpecName "kube-api-access-gq64k". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:05:13.131914 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:13.131881    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/c31f64e9-5e5f-4c84-96a6-05209d56e75a-dshm\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 13:05:13.131914 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:13.131913    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/c31f64e9-5e5f-4c84-96a6-05209d56e75a-model-cache\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 13:05:13.131914 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:13.131924    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/c31f64e9-5e5f-4c84-96a6-05209d56e75a-tls-certs\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 13:05:13.132196 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:13.131931    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/c31f64e9-5e5f-4c84-96a6-05209d56e75a-home\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 13:05:13.132196 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:13.131939    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/c31f64e9-5e5f-4c84-96a6-05209d56e75a-tmp-dir\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 13:05:13.132196 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:13.131949    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gq64k\" (UniqueName: \"kubernetes.io/projected/c31f64e9-5e5f-4c84-96a6-05209d56e75a-kube-api-access-gq64k\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 13:05:13.393122 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:13.393018    2559 generic.go:356] "Generic (PLEG): container finished" podID="c31f64e9-5e5f-4c84-96a6-05209d56e75a" containerID="a1cf01fa89c9068bc817e6cb18dfb8dd73a49be5ad35af5f1b1a1fc91a7bea90" exitCode=0
Jul 15 13:05:13.393122 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:13.393072    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3af497/sub-test-model-3af497-kserve-b9948b987-t4rkm"
Jul 15 13:05:13.393122 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:13.393106    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3af497/sub-test-model-3af497-kserve-b9948b987-t4rkm" event={"ID":"c31f64e9-5e5f-4c84-96a6-05209d56e75a","Type":"ContainerDied","Data":"a1cf01fa89c9068bc817e6cb18dfb8dd73a49be5ad35af5f1b1a1fc91a7bea90"}
Jul 15 13:05:13.393332 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:13.393150    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3af497/sub-test-model-3af497-kserve-b9948b987-t4rkm" event={"ID":"c31f64e9-5e5f-4c84-96a6-05209d56e75a","Type":"ContainerDied","Data":"2ac91e1da0702ba989d0b72684650efe0525d0a6ee536ac5e4bd1a4b171d1425"}
Jul 15 13:05:13.393332 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:13.393173    2559 scope.go:117] "RemoveContainer" containerID="a1cf01fa89c9068bc817e6cb18dfb8dd73a49be5ad35af5f1b1a1fc91a7bea90"
Jul 15 13:05:13.402800 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:13.402730    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-70ed7b/sub-test-model-70ed7b-kserve-565d4945-trsls" podUID="03a879b2-45cc-4f6a-b3de-6ab0548893c3" containerName="main" containerID="cri-o://ca0040140d695544dd393a165ccec59a2be9a164daeadcf7b64181086ff21e50" gracePeriod=45
Jul 15 13:05:13.409223 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:13.409198    2559 scope.go:117] "RemoveContainer" containerID="a1cf01fa89c9068bc817e6cb18dfb8dd73a49be5ad35af5f1b1a1fc91a7bea90"
Jul 15 13:05:13.409633 ip-10-0-140-67 kubenswrapper[2559]: E0715 13:05:13.409604    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a1cf01fa89c9068bc817e6cb18dfb8dd73a49be5ad35af5f1b1a1fc91a7bea90\": container with ID starting with a1cf01fa89c9068bc817e6cb18dfb8dd73a49be5ad35af5f1b1a1fc91a7bea90 not found: ID does not exist" containerID="a1cf01fa89c9068bc817e6cb18dfb8dd73a49be5ad35af5f1b1a1fc91a7bea90"
Jul 15 13:05:13.409719 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:13.409643    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a1cf01fa89c9068bc817e6cb18dfb8dd73a49be5ad35af5f1b1a1fc91a7bea90"} err="failed to get container status \"a1cf01fa89c9068bc817e6cb18dfb8dd73a49be5ad35af5f1b1a1fc91a7bea90\": rpc error: code = NotFound desc = could not find container \"a1cf01fa89c9068bc817e6cb18dfb8dd73a49be5ad35af5f1b1a1fc91a7bea90\": container with ID starting with a1cf01fa89c9068bc817e6cb18dfb8dd73a49be5ad35af5f1b1a1fc91a7bea90 not found: ID does not exist"
Jul 15 13:05:13.418739 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:13.418711    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-3af497/sub-test-model-3af497-kserve-b9948b987-t4rkm"]
Jul 15 13:05:13.425004 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:13.424980    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-3af497/sub-test-model-3af497-kserve-b9948b987-t4rkm"]
Jul 15 13:05:13.640413 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:13.640387    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-70ed7b/sub-test-model-70ed7b-kserve-565d4945-trsls"
Jul 15 13:05:13.737860 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:13.737816    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-w98qx\" (UniqueName: \"kubernetes.io/projected/03a879b2-45cc-4f6a-b3de-6ab0548893c3-kube-api-access-w98qx\") pod \"03a879b2-45cc-4f6a-b3de-6ab0548893c3\" (UID: \"03a879b2-45cc-4f6a-b3de-6ab0548893c3\") "
Jul 15 13:05:13.738285 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:13.737871    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03a879b2-45cc-4f6a-b3de-6ab0548893c3-home\") pod \"03a879b2-45cc-4f6a-b3de-6ab0548893c3\" (UID: \"03a879b2-45cc-4f6a-b3de-6ab0548893c3\") "
Jul 15 13:05:13.738285 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:13.737920    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03a879b2-45cc-4f6a-b3de-6ab0548893c3-tmp-dir\") pod \"03a879b2-45cc-4f6a-b3de-6ab0548893c3\" (UID: \"03a879b2-45cc-4f6a-b3de-6ab0548893c3\") "
Jul 15 13:05:13.738285 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:13.737987    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03a879b2-45cc-4f6a-b3de-6ab0548893c3-model-cache\") pod \"03a879b2-45cc-4f6a-b3de-6ab0548893c3\" (UID: \"03a879b2-45cc-4f6a-b3de-6ab0548893c3\") "
Jul 15 13:05:13.738285 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:13.738015    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03a879b2-45cc-4f6a-b3de-6ab0548893c3-dshm\") pod \"03a879b2-45cc-4f6a-b3de-6ab0548893c3\" (UID: \"03a879b2-45cc-4f6a-b3de-6ab0548893c3\") "
Jul 15 13:05:13.738285 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:13.738076    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03a879b2-45cc-4f6a-b3de-6ab0548893c3-tls-certs\") pod \"03a879b2-45cc-4f6a-b3de-6ab0548893c3\" (UID: \"03a879b2-45cc-4f6a-b3de-6ab0548893c3\") "
Jul 15 13:05:13.738285 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:13.738204    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03a879b2-45cc-4f6a-b3de-6ab0548893c3-home" (OuterVolumeSpecName: "home") pod "03a879b2-45cc-4f6a-b3de-6ab0548893c3" (UID: "03a879b2-45cc-4f6a-b3de-6ab0548893c3"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:05:13.738285 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:13.738222    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03a879b2-45cc-4f6a-b3de-6ab0548893c3-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "03a879b2-45cc-4f6a-b3de-6ab0548893c3" (UID: "03a879b2-45cc-4f6a-b3de-6ab0548893c3"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:05:13.738731 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:13.738285    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03a879b2-45cc-4f6a-b3de-6ab0548893c3-model-cache" (OuterVolumeSpecName: "model-cache") pod "03a879b2-45cc-4f6a-b3de-6ab0548893c3" (UID: "03a879b2-45cc-4f6a-b3de-6ab0548893c3"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:05:13.738731 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:13.738486    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/03a879b2-45cc-4f6a-b3de-6ab0548893c3-model-cache\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 13:05:13.738731 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:13.738508    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/03a879b2-45cc-4f6a-b3de-6ab0548893c3-home\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 13:05:13.738731 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:13.738522    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/03a879b2-45cc-4f6a-b3de-6ab0548893c3-tmp-dir\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 13:05:13.740283 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:13.740252    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/03a879b2-45cc-4f6a-b3de-6ab0548893c3-dshm" (OuterVolumeSpecName: "dshm") pod "03a879b2-45cc-4f6a-b3de-6ab0548893c3" (UID: "03a879b2-45cc-4f6a-b3de-6ab0548893c3"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:05:13.740580 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:13.740550    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/03a879b2-45cc-4f6a-b3de-6ab0548893c3-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "03a879b2-45cc-4f6a-b3de-6ab0548893c3" (UID: "03a879b2-45cc-4f6a-b3de-6ab0548893c3"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:05:13.740678 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:13.740576    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/03a879b2-45cc-4f6a-b3de-6ab0548893c3-kube-api-access-w98qx" (OuterVolumeSpecName: "kube-api-access-w98qx") pod "03a879b2-45cc-4f6a-b3de-6ab0548893c3" (UID: "03a879b2-45cc-4f6a-b3de-6ab0548893c3"). InnerVolumeSpecName "kube-api-access-w98qx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:05:13.839926 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:13.839886    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/03a879b2-45cc-4f6a-b3de-6ab0548893c3-dshm\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 13:05:13.839926 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:13.839916    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/03a879b2-45cc-4f6a-b3de-6ab0548893c3-tls-certs\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 13:05:13.839926 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:13.839928    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-w98qx\" (UniqueName: \"kubernetes.io/projected/03a879b2-45cc-4f6a-b3de-6ab0548893c3-kube-api-access-w98qx\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 13:05:14.400073 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:14.400042    2559 generic.go:356] "Generic (PLEG): container finished" podID="03a879b2-45cc-4f6a-b3de-6ab0548893c3" containerID="ca0040140d695544dd393a165ccec59a2be9a164daeadcf7b64181086ff21e50" exitCode=0
Jul 15 13:05:14.400266 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:14.400086    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-70ed7b/sub-test-model-70ed7b-kserve-565d4945-trsls"
Jul 15 13:05:14.400266 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:14.400130    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-70ed7b/sub-test-model-70ed7b-kserve-565d4945-trsls" event={"ID":"03a879b2-45cc-4f6a-b3de-6ab0548893c3","Type":"ContainerDied","Data":"ca0040140d695544dd393a165ccec59a2be9a164daeadcf7b64181086ff21e50"}
Jul 15 13:05:14.400266 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:14.400172    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-70ed7b/sub-test-model-70ed7b-kserve-565d4945-trsls" event={"ID":"03a879b2-45cc-4f6a-b3de-6ab0548893c3","Type":"ContainerDied","Data":"3289c8d4d33631ccf2ff952aa0935675b98d70f10642a26f9add1b8f525dbc80"}
Jul 15 13:05:14.400266 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:14.400188    2559 scope.go:117] "RemoveContainer" containerID="ca0040140d695544dd393a165ccec59a2be9a164daeadcf7b64181086ff21e50"
Jul 15 13:05:14.409171 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:14.409156    2559 scope.go:117] "RemoveContainer" containerID="ca0040140d695544dd393a165ccec59a2be9a164daeadcf7b64181086ff21e50"
Jul 15 13:05:14.409478 ip-10-0-140-67 kubenswrapper[2559]: E0715 13:05:14.409461    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca0040140d695544dd393a165ccec59a2be9a164daeadcf7b64181086ff21e50\": container with ID starting with ca0040140d695544dd393a165ccec59a2be9a164daeadcf7b64181086ff21e50 not found: ID does not exist" containerID="ca0040140d695544dd393a165ccec59a2be9a164daeadcf7b64181086ff21e50"
Jul 15 13:05:14.409535 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:14.409488    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca0040140d695544dd393a165ccec59a2be9a164daeadcf7b64181086ff21e50"} err="failed to get container status \"ca0040140d695544dd393a165ccec59a2be9a164daeadcf7b64181086ff21e50\": rpc error: code = NotFound desc = could not find container \"ca0040140d695544dd393a165ccec59a2be9a164daeadcf7b64181086ff21e50\": container with ID starting with ca0040140d695544dd393a165ccec59a2be9a164daeadcf7b64181086ff21e50 not found: ID does not exist"
Jul 15 13:05:14.426118 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:14.426086    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-70ed7b/sub-test-model-70ed7b-kserve-565d4945-trsls"]
Jul 15 13:05:14.432339 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:14.432312    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-70ed7b/sub-test-model-70ed7b-kserve-565d4945-trsls"]
Jul 15 13:05:14.582864 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:14.582835    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="03a879b2-45cc-4f6a-b3de-6ab0548893c3" path="/var/lib/kubelet/pods/03a879b2-45cc-4f6a-b3de-6ab0548893c3/volumes"
Jul 15 13:05:14.583227 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:14.583214    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c31f64e9-5e5f-4c84-96a6-05209d56e75a" path="/var/lib/kubelet/pods/c31f64e9-5e5f-4c84-96a6-05209d56e75a/volumes"
Jul 15 13:05:22.799978 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:22.799885    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-a-3af497/rate-test-model-3af497-kserve-58c78ddcf-6z8hk"]
Jul 15 13:05:22.800333 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:22.800240    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="03a879b2-45cc-4f6a-b3de-6ab0548893c3" containerName="main"
Jul 15 13:05:22.800333 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:22.800252    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="03a879b2-45cc-4f6a-b3de-6ab0548893c3" containerName="main"
Jul 15 13:05:22.800333 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:22.800274    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c31f64e9-5e5f-4c84-96a6-05209d56e75a" containerName="main"
Jul 15 13:05:22.800333 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:22.800282    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="c31f64e9-5e5f-4c84-96a6-05209d56e75a" containerName="main"
Jul 15 13:05:22.800479 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:22.800341    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="03a879b2-45cc-4f6a-b3de-6ab0548893c3" containerName="main"
Jul 15 13:05:22.800479 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:22.800352    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="c31f64e9-5e5f-4c84-96a6-05209d56e75a" containerName="main"
Jul 15 13:05:22.804842 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:22.804809    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3af497/rate-test-model-3af497-kserve-58c78ddcf-6z8hk"
Jul 15 13:05:22.809223 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:22.809079    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-3af497\"/\"openshift-service-ca.crt\""
Jul 15 13:05:22.809223 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:22.809090    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-3af497\"/\"rate-test-model-3af497-kserve-self-signed-certs\""
Jul 15 13:05:22.809223 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:22.809085    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-a-3af497\"/\"kube-root-ca.crt\""
Jul 15 13:05:22.809223 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:22.809148    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-a-3af497\"/\"default-dockercfg-5rt8n\""
Jul 15 13:05:22.815129 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:22.815104    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-3af497/rate-test-model-3af497-kserve-58c78ddcf-6z8hk"]
Jul 15 13:05:22.839848 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:22.839815    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 13:05:22.914495 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:22.914461    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e587cd84-2750-4180-a8bf-b2504cf1db20-model-cache\") pod \"rate-test-model-3af497-kserve-58c78ddcf-6z8hk\" (UID: \"e587cd84-2750-4180-a8bf-b2504cf1db20\") " pod="ai-tenant-e2e-shared-a-3af497/rate-test-model-3af497-kserve-58c78ddcf-6z8hk"
Jul 15 13:05:22.914683 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:22.914516    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e587cd84-2750-4180-a8bf-b2504cf1db20-dshm\") pod \"rate-test-model-3af497-kserve-58c78ddcf-6z8hk\" (UID: \"e587cd84-2750-4180-a8bf-b2504cf1db20\") " pod="ai-tenant-e2e-shared-a-3af497/rate-test-model-3af497-kserve-58c78ddcf-6z8hk"
Jul 15 13:05:22.914683 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:22.914557    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e587cd84-2750-4180-a8bf-b2504cf1db20-tmp-dir\") pod \"rate-test-model-3af497-kserve-58c78ddcf-6z8hk\" (UID: \"e587cd84-2750-4180-a8bf-b2504cf1db20\") " pod="ai-tenant-e2e-shared-a-3af497/rate-test-model-3af497-kserve-58c78ddcf-6z8hk"
Jul 15 13:05:22.914683 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:22.914581    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e587cd84-2750-4180-a8bf-b2504cf1db20-tls-certs\") pod \"rate-test-model-3af497-kserve-58c78ddcf-6z8hk\" (UID: \"e587cd84-2750-4180-a8bf-b2504cf1db20\") " pod="ai-tenant-e2e-shared-a-3af497/rate-test-model-3af497-kserve-58c78ddcf-6z8hk"
Jul 15 13:05:22.914683 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:22.914603    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhtpt\" (UniqueName: \"kubernetes.io/projected/e587cd84-2750-4180-a8bf-b2504cf1db20-kube-api-access-dhtpt\") pod \"rate-test-model-3af497-kserve-58c78ddcf-6z8hk\" (UID: \"e587cd84-2750-4180-a8bf-b2504cf1db20\") " pod="ai-tenant-e2e-shared-a-3af497/rate-test-model-3af497-kserve-58c78ddcf-6z8hk"
Jul 15 13:05:22.914683 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:22.914628    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e587cd84-2750-4180-a8bf-b2504cf1db20-home\") pod \"rate-test-model-3af497-kserve-58c78ddcf-6z8hk\" (UID: \"e587cd84-2750-4180-a8bf-b2504cf1db20\") " pod="ai-tenant-e2e-shared-a-3af497/rate-test-model-3af497-kserve-58c78ddcf-6z8hk"
Jul 15 13:05:23.015267 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:23.015229    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhtpt\" (UniqueName: \"kubernetes.io/projected/e587cd84-2750-4180-a8bf-b2504cf1db20-kube-api-access-dhtpt\") pod \"rate-test-model-3af497-kserve-58c78ddcf-6z8hk\" (UID: \"e587cd84-2750-4180-a8bf-b2504cf1db20\") " pod="ai-tenant-e2e-shared-a-3af497/rate-test-model-3af497-kserve-58c78ddcf-6z8hk"
Jul 15 13:05:23.015267 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:23.015266    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e587cd84-2750-4180-a8bf-b2504cf1db20-home\") pod \"rate-test-model-3af497-kserve-58c78ddcf-6z8hk\" (UID: \"e587cd84-2750-4180-a8bf-b2504cf1db20\") " pod="ai-tenant-e2e-shared-a-3af497/rate-test-model-3af497-kserve-58c78ddcf-6z8hk"
Jul 15 13:05:23.015567 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:23.015302    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e587cd84-2750-4180-a8bf-b2504cf1db20-model-cache\") pod \"rate-test-model-3af497-kserve-58c78ddcf-6z8hk\" (UID: \"e587cd84-2750-4180-a8bf-b2504cf1db20\") " pod="ai-tenant-e2e-shared-a-3af497/rate-test-model-3af497-kserve-58c78ddcf-6z8hk"
Jul 15 13:05:23.015567 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:23.015339    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e587cd84-2750-4180-a8bf-b2504cf1db20-dshm\") pod \"rate-test-model-3af497-kserve-58c78ddcf-6z8hk\" (UID: \"e587cd84-2750-4180-a8bf-b2504cf1db20\") " pod="ai-tenant-e2e-shared-a-3af497/rate-test-model-3af497-kserve-58c78ddcf-6z8hk"
Jul 15 13:05:23.015567 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:23.015358    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e587cd84-2750-4180-a8bf-b2504cf1db20-tmp-dir\") pod \"rate-test-model-3af497-kserve-58c78ddcf-6z8hk\" (UID: \"e587cd84-2750-4180-a8bf-b2504cf1db20\") " pod="ai-tenant-e2e-shared-a-3af497/rate-test-model-3af497-kserve-58c78ddcf-6z8hk"
Jul 15 13:05:23.015567 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:23.015403    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e587cd84-2750-4180-a8bf-b2504cf1db20-tls-certs\") pod \"rate-test-model-3af497-kserve-58c78ddcf-6z8hk\" (UID: \"e587cd84-2750-4180-a8bf-b2504cf1db20\") " pod="ai-tenant-e2e-shared-a-3af497/rate-test-model-3af497-kserve-58c78ddcf-6z8hk"
Jul 15 13:05:23.015770 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:23.015733    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e587cd84-2750-4180-a8bf-b2504cf1db20-home\") pod \"rate-test-model-3af497-kserve-58c78ddcf-6z8hk\" (UID: \"e587cd84-2750-4180-a8bf-b2504cf1db20\") " pod="ai-tenant-e2e-shared-a-3af497/rate-test-model-3af497-kserve-58c78ddcf-6z8hk"
Jul 15 13:05:23.015823 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:23.015787    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e587cd84-2750-4180-a8bf-b2504cf1db20-model-cache\") pod \"rate-test-model-3af497-kserve-58c78ddcf-6z8hk\" (UID: \"e587cd84-2750-4180-a8bf-b2504cf1db20\") " pod="ai-tenant-e2e-shared-a-3af497/rate-test-model-3af497-kserve-58c78ddcf-6z8hk"
Jul 15 13:05:23.015823 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:23.015797    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e587cd84-2750-4180-a8bf-b2504cf1db20-tmp-dir\") pod \"rate-test-model-3af497-kserve-58c78ddcf-6z8hk\" (UID: \"e587cd84-2750-4180-a8bf-b2504cf1db20\") " pod="ai-tenant-e2e-shared-a-3af497/rate-test-model-3af497-kserve-58c78ddcf-6z8hk"
Jul 15 13:05:23.017718 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:23.017695    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e587cd84-2750-4180-a8bf-b2504cf1db20-dshm\") pod \"rate-test-model-3af497-kserve-58c78ddcf-6z8hk\" (UID: \"e587cd84-2750-4180-a8bf-b2504cf1db20\") " pod="ai-tenant-e2e-shared-a-3af497/rate-test-model-3af497-kserve-58c78ddcf-6z8hk"
Jul 15 13:05:23.017935 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:23.017920    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e587cd84-2750-4180-a8bf-b2504cf1db20-tls-certs\") pod \"rate-test-model-3af497-kserve-58c78ddcf-6z8hk\" (UID: \"e587cd84-2750-4180-a8bf-b2504cf1db20\") " pod="ai-tenant-e2e-shared-a-3af497/rate-test-model-3af497-kserve-58c78ddcf-6z8hk"
Jul 15 13:05:23.024838 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:23.024816    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhtpt\" (UniqueName: \"kubernetes.io/projected/e587cd84-2750-4180-a8bf-b2504cf1db20-kube-api-access-dhtpt\") pod \"rate-test-model-3af497-kserve-58c78ddcf-6z8hk\" (UID: \"e587cd84-2750-4180-a8bf-b2504cf1db20\") " pod="ai-tenant-e2e-shared-a-3af497/rate-test-model-3af497-kserve-58c78ddcf-6z8hk"
Jul 15 13:05:23.116729 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:23.116628    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3af497/rate-test-model-3af497-kserve-58c78ddcf-6z8hk"
Jul 15 13:05:23.254940 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:23.254909    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-a-3af497/rate-test-model-3af497-kserve-58c78ddcf-6z8hk"]
Jul 15 13:05:23.258156 ip-10-0-140-67 kubenswrapper[2559]: W0715 13:05:23.258132    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode587cd84_2750_4180_a8bf_b2504cf1db20.slice/crio-1a9a712fdb156157bd4c88740c540b74a7400eb7c682f6ddcb10fde28f8aec11 WatchSource:0}: Error finding container 1a9a712fdb156157bd4c88740c540b74a7400eb7c682f6ddcb10fde28f8aec11: Status 404 returned error can't find the container with id 1a9a712fdb156157bd4c88740c540b74a7400eb7c682f6ddcb10fde28f8aec11
Jul 15 13:05:23.446313 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:23.446213    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3af497/rate-test-model-3af497-kserve-58c78ddcf-6z8hk" event={"ID":"e587cd84-2750-4180-a8bf-b2504cf1db20","Type":"ContainerStarted","Data":"b0b2527ff33ce7a3536bdf407c66286aef6d640969d8f64ea1b7ca21d1fe4a3f"}
Jul 15 13:05:23.446313 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:23.446266    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3af497/rate-test-model-3af497-kserve-58c78ddcf-6z8hk" event={"ID":"e587cd84-2750-4180-a8bf-b2504cf1db20","Type":"ContainerStarted","Data":"1a9a712fdb156157bd4c88740c540b74a7400eb7c682f6ddcb10fde28f8aec11"}
Jul 15 13:05:23.467014 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:23.466964    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-a-3af497/rate-test-model-3af497-kserve-58c78ddcf-6z8hk" podStartSLOduration=1.466947508 podStartE2EDuration="1.466947508s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:05:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:05:23.464449122 +0000 UTC m=+2693.437020298" watchObservedRunningTime="2026-07-15 13:05:23.466947508 +0000 UTC m=+2693.439518666"
Jul 15 13:05:26.734736 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:26.734687    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 13:05:30.614591 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:30.614559    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vp8z_009c50dc-2f9e-455b-95f2-a03e7ed3defd/ovn-acl-logging/0.log"
Jul 15 13:05:30.619975 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:30.619953    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-2vp8z_009c50dc-2f9e-455b-95f2-a03e7ed3defd/ovn-acl-logging/0.log"
Jul 15 13:05:33.117797 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:33.117753    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-a-3af497/rate-test-model-3af497-kserve-58c78ddcf-6z8hk"
Jul 15 13:05:33.118172 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:33.117815    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-a-3af497/rate-test-model-3af497-kserve-58c78ddcf-6z8hk"
Jul 15 13:05:33.130324 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:33.130293    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-a-3af497/rate-test-model-3af497-kserve-58c78ddcf-6z8hk"
Jul 15 13:05:33.506600 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:33.506565    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-a-3af497/rate-test-model-3af497-kserve-58c78ddcf-6z8hk"
Jul 15 13:05:44.901648 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:44.901611    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["ai-tenant-e2e-shared-b-70ed7b/rate-test-model-70ed7b-kserve-7b4d5487f9-fsvkl"]
Jul 15 13:05:44.905011 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:44.904990    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-70ed7b/rate-test-model-70ed7b-kserve-7b4d5487f9-fsvkl"
Jul 15 13:05:44.907908 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:44.907881    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-70ed7b\"/\"rate-test-model-70ed7b-kserve-self-signed-certs\""
Jul 15 13:05:44.908831 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:44.908812    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-70ed7b\"/\"kube-root-ca.crt\""
Jul 15 13:05:44.908927 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:44.908812    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"ai-tenant-e2e-shared-b-70ed7b\"/\"openshift-service-ca.crt\""
Jul 15 13:05:44.909121 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:44.909104    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"ai-tenant-e2e-shared-b-70ed7b\"/\"default-dockercfg-sk5wg\""
Jul 15 13:05:44.917041 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:44.917010    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-70ed7b/rate-test-model-70ed7b-kserve-7b4d5487f9-fsvkl"]
Jul 15 13:05:45.004919 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:45.004882    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bdcf18c4-67c1-4e97-a99b-eb6aede34b8c-model-cache\") pod \"rate-test-model-70ed7b-kserve-7b4d5487f9-fsvkl\" (UID: \"bdcf18c4-67c1-4e97-a99b-eb6aede34b8c\") " pod="ai-tenant-e2e-shared-b-70ed7b/rate-test-model-70ed7b-kserve-7b4d5487f9-fsvkl"
Jul 15 13:05:45.005105 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:45.004941    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bdcf18c4-67c1-4e97-a99b-eb6aede34b8c-dshm\") pod \"rate-test-model-70ed7b-kserve-7b4d5487f9-fsvkl\" (UID: \"bdcf18c4-67c1-4e97-a99b-eb6aede34b8c\") " pod="ai-tenant-e2e-shared-b-70ed7b/rate-test-model-70ed7b-kserve-7b4d5487f9-fsvkl"
Jul 15 13:05:45.005105 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:45.005015    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bdcf18c4-67c1-4e97-a99b-eb6aede34b8c-tmp-dir\") pod \"rate-test-model-70ed7b-kserve-7b4d5487f9-fsvkl\" (UID: \"bdcf18c4-67c1-4e97-a99b-eb6aede34b8c\") " pod="ai-tenant-e2e-shared-b-70ed7b/rate-test-model-70ed7b-kserve-7b4d5487f9-fsvkl"
Jul 15 13:05:45.005105 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:45.005081    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bdcf18c4-67c1-4e97-a99b-eb6aede34b8c-home\") pod \"rate-test-model-70ed7b-kserve-7b4d5487f9-fsvkl\" (UID: \"bdcf18c4-67c1-4e97-a99b-eb6aede34b8c\") " pod="ai-tenant-e2e-shared-b-70ed7b/rate-test-model-70ed7b-kserve-7b4d5487f9-fsvkl"
Jul 15 13:05:45.005218 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:45.005108    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bdcf18c4-67c1-4e97-a99b-eb6aede34b8c-tls-certs\") pod \"rate-test-model-70ed7b-kserve-7b4d5487f9-fsvkl\" (UID: \"bdcf18c4-67c1-4e97-a99b-eb6aede34b8c\") " pod="ai-tenant-e2e-shared-b-70ed7b/rate-test-model-70ed7b-kserve-7b4d5487f9-fsvkl"
Jul 15 13:05:45.005218 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:45.005155    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4t7hg\" (UniqueName: \"kubernetes.io/projected/bdcf18c4-67c1-4e97-a99b-eb6aede34b8c-kube-api-access-4t7hg\") pod \"rate-test-model-70ed7b-kserve-7b4d5487f9-fsvkl\" (UID: \"bdcf18c4-67c1-4e97-a99b-eb6aede34b8c\") " pod="ai-tenant-e2e-shared-b-70ed7b/rate-test-model-70ed7b-kserve-7b4d5487f9-fsvkl"
Jul 15 13:05:45.090644 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:45.090612    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 13:05:45.105695 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:45.105666    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4t7hg\" (UniqueName: \"kubernetes.io/projected/bdcf18c4-67c1-4e97-a99b-eb6aede34b8c-kube-api-access-4t7hg\") pod \"rate-test-model-70ed7b-kserve-7b4d5487f9-fsvkl\" (UID: \"bdcf18c4-67c1-4e97-a99b-eb6aede34b8c\") " pod="ai-tenant-e2e-shared-b-70ed7b/rate-test-model-70ed7b-kserve-7b4d5487f9-fsvkl"
Jul 15 13:05:45.105804 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:45.105704    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bdcf18c4-67c1-4e97-a99b-eb6aede34b8c-model-cache\") pod \"rate-test-model-70ed7b-kserve-7b4d5487f9-fsvkl\" (UID: \"bdcf18c4-67c1-4e97-a99b-eb6aede34b8c\") " pod="ai-tenant-e2e-shared-b-70ed7b/rate-test-model-70ed7b-kserve-7b4d5487f9-fsvkl"
Jul 15 13:05:45.105804 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:45.105747    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bdcf18c4-67c1-4e97-a99b-eb6aede34b8c-dshm\") pod \"rate-test-model-70ed7b-kserve-7b4d5487f9-fsvkl\" (UID: \"bdcf18c4-67c1-4e97-a99b-eb6aede34b8c\") " pod="ai-tenant-e2e-shared-b-70ed7b/rate-test-model-70ed7b-kserve-7b4d5487f9-fsvkl"
Jul 15 13:05:45.105804 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:45.105787    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bdcf18c4-67c1-4e97-a99b-eb6aede34b8c-tmp-dir\") pod \"rate-test-model-70ed7b-kserve-7b4d5487f9-fsvkl\" (UID: \"bdcf18c4-67c1-4e97-a99b-eb6aede34b8c\") " pod="ai-tenant-e2e-shared-b-70ed7b/rate-test-model-70ed7b-kserve-7b4d5487f9-fsvkl"
Jul 15 13:05:45.105924 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:45.105827    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bdcf18c4-67c1-4e97-a99b-eb6aede34b8c-home\") pod \"rate-test-model-70ed7b-kserve-7b4d5487f9-fsvkl\" (UID: \"bdcf18c4-67c1-4e97-a99b-eb6aede34b8c\") " pod="ai-tenant-e2e-shared-b-70ed7b/rate-test-model-70ed7b-kserve-7b4d5487f9-fsvkl"
Jul 15 13:05:45.105924 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:45.105852    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bdcf18c4-67c1-4e97-a99b-eb6aede34b8c-tls-certs\") pod \"rate-test-model-70ed7b-kserve-7b4d5487f9-fsvkl\" (UID: \"bdcf18c4-67c1-4e97-a99b-eb6aede34b8c\") " pod="ai-tenant-e2e-shared-b-70ed7b/rate-test-model-70ed7b-kserve-7b4d5487f9-fsvkl"
Jul 15 13:05:45.106257 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:45.106238    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bdcf18c4-67c1-4e97-a99b-eb6aede34b8c-model-cache\") pod \"rate-test-model-70ed7b-kserve-7b4d5487f9-fsvkl\" (UID: \"bdcf18c4-67c1-4e97-a99b-eb6aede34b8c\") " pod="ai-tenant-e2e-shared-b-70ed7b/rate-test-model-70ed7b-kserve-7b4d5487f9-fsvkl"
Jul 15 13:05:45.106331 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:45.106268    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bdcf18c4-67c1-4e97-a99b-eb6aede34b8c-tmp-dir\") pod \"rate-test-model-70ed7b-kserve-7b4d5487f9-fsvkl\" (UID: \"bdcf18c4-67c1-4e97-a99b-eb6aede34b8c\") " pod="ai-tenant-e2e-shared-b-70ed7b/rate-test-model-70ed7b-kserve-7b4d5487f9-fsvkl"
Jul 15 13:05:45.106331 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:45.106309    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bdcf18c4-67c1-4e97-a99b-eb6aede34b8c-home\") pod \"rate-test-model-70ed7b-kserve-7b4d5487f9-fsvkl\" (UID: \"bdcf18c4-67c1-4e97-a99b-eb6aede34b8c\") " pod="ai-tenant-e2e-shared-b-70ed7b/rate-test-model-70ed7b-kserve-7b4d5487f9-fsvkl"
Jul 15 13:05:45.108140 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:45.108120    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bdcf18c4-67c1-4e97-a99b-eb6aede34b8c-dshm\") pod \"rate-test-model-70ed7b-kserve-7b4d5487f9-fsvkl\" (UID: \"bdcf18c4-67c1-4e97-a99b-eb6aede34b8c\") " pod="ai-tenant-e2e-shared-b-70ed7b/rate-test-model-70ed7b-kserve-7b4d5487f9-fsvkl"
Jul 15 13:05:45.108256 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:45.108241    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bdcf18c4-67c1-4e97-a99b-eb6aede34b8c-tls-certs\") pod \"rate-test-model-70ed7b-kserve-7b4d5487f9-fsvkl\" (UID: \"bdcf18c4-67c1-4e97-a99b-eb6aede34b8c\") " pod="ai-tenant-e2e-shared-b-70ed7b/rate-test-model-70ed7b-kserve-7b4d5487f9-fsvkl"
Jul 15 13:05:45.115180 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:45.115160    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4t7hg\" (UniqueName: \"kubernetes.io/projected/bdcf18c4-67c1-4e97-a99b-eb6aede34b8c-kube-api-access-4t7hg\") pod \"rate-test-model-70ed7b-kserve-7b4d5487f9-fsvkl\" (UID: \"bdcf18c4-67c1-4e97-a99b-eb6aede34b8c\") " pod="ai-tenant-e2e-shared-b-70ed7b/rate-test-model-70ed7b-kserve-7b4d5487f9-fsvkl"
Jul 15 13:05:45.213681 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:45.213643    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-70ed7b/rate-test-model-70ed7b-kserve-7b4d5487f9-fsvkl"
Jul 15 13:05:45.351035 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:45.351008    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["ai-tenant-e2e-shared-b-70ed7b/rate-test-model-70ed7b-kserve-7b4d5487f9-fsvkl"]
Jul 15 13:05:45.353049 ip-10-0-140-67 kubenswrapper[2559]: W0715 13:05:45.353014    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbdcf18c4_67c1_4e97_a99b_eb6aede34b8c.slice/crio-e309881ac03dea16a95c175fe0819df908c4e4ceb9a93138039cada048e3de46 WatchSource:0}: Error finding container e309881ac03dea16a95c175fe0819df908c4e4ceb9a93138039cada048e3de46: Status 404 returned error can't find the container with id e309881ac03dea16a95c175fe0819df908c4e4ceb9a93138039cada048e3de46
Jul 15 13:05:45.558965 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:45.558867    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-70ed7b/rate-test-model-70ed7b-kserve-7b4d5487f9-fsvkl" event={"ID":"bdcf18c4-67c1-4e97-a99b-eb6aede34b8c","Type":"ContainerStarted","Data":"8302e1d3381e2be35afc13acbe0c60b188f321e148c795a4a7c605f731b480e4"}
Jul 15 13:05:45.558965 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:45.558911    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-70ed7b/rate-test-model-70ed7b-kserve-7b4d5487f9-fsvkl" event={"ID":"bdcf18c4-67c1-4e97-a99b-eb6aede34b8c","Type":"ContainerStarted","Data":"e309881ac03dea16a95c175fe0819df908c4e4ceb9a93138039cada048e3de46"}
Jul 15 13:05:45.581264 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:45.581209    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="ai-tenant-e2e-shared-b-70ed7b/rate-test-model-70ed7b-kserve-7b4d5487f9-fsvkl" podStartSLOduration=1.5811913899999999 podStartE2EDuration="1.58119139s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:05:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:05:45.579490272 +0000 UTC m=+2715.552061458" watchObservedRunningTime="2026-07-15 13:05:45.58119139 +0000 UTC m=+2715.553762547"
Jul 15 13:05:48.924848 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:48.924811    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 13:05:55.214755 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:55.214704    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="ai-tenant-e2e-shared-b-70ed7b/rate-test-model-70ed7b-kserve-7b4d5487f9-fsvkl"
Jul 15 13:05:55.215263 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:55.215017    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="ai-tenant-e2e-shared-b-70ed7b/rate-test-model-70ed7b-kserve-7b4d5487f9-fsvkl"
Jul 15 13:05:55.227298 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:55.227271    2559 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="ai-tenant-e2e-shared-b-70ed7b/rate-test-model-70ed7b-kserve-7b4d5487f9-fsvkl"
Jul 15 13:05:55.619533 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:05:55.619441    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="ai-tenant-e2e-shared-b-70ed7b/rate-test-model-70ed7b-kserve-7b4d5487f9-fsvkl"
Jul 15 13:06:03.264329 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:03.264290    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 13:06:14.612699 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:14.612658    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 13:06:14.641375 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:14.641337    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 13:06:14.711736 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:14.711705    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 13:06:29.861801 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:29.861768    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 13:06:37.221406 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:37.221358    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-3af497/rate-test-model-3af497-kserve-58c78ddcf-6z8hk"]
Jul 15 13:06:37.254443 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:37.254408    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 13:06:38.035741 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:38.035712    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-70ed7b/rate-test-model-70ed7b-kserve-7b4d5487f9-fsvkl"]
Jul 15 13:06:38.818260 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:38.818229    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 13:06:38.970607 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:38.970567    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7606-139635308449584"]
Jul 15 13:06:38.978207 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:38.978179    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7606-139635308449584"
Jul 15 13:06:38.980880 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:38.980856    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-664xg\""
Jul 15 13:06:38.983034 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:38.983010    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7606-139635308449584"]
Jul 15 13:06:39.078934 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:39.078850    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlmsz\" (UniqueName: \"kubernetes.io/projected/a2d058fb-40f8-4a33-90b9-5411daf6fada-kube-api-access-nlmsz\") pod \"test-curl-7606-139635308449584\" (UID: \"a2d058fb-40f8-4a33-90b9-5411daf6fada\") " pod="opendatahub/test-curl-7606-139635308449584"
Jul 15 13:06:39.180013 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:39.179974    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlmsz\" (UniqueName: \"kubernetes.io/projected/a2d058fb-40f8-4a33-90b9-5411daf6fada-kube-api-access-nlmsz\") pod \"test-curl-7606-139635308449584\" (UID: \"a2d058fb-40f8-4a33-90b9-5411daf6fada\") " pod="opendatahub/test-curl-7606-139635308449584"
Jul 15 13:06:39.188584 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:39.188561    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlmsz\" (UniqueName: \"kubernetes.io/projected/a2d058fb-40f8-4a33-90b9-5411daf6fada-kube-api-access-nlmsz\") pod \"test-curl-7606-139635308449584\" (UID: \"a2d058fb-40f8-4a33-90b9-5411daf6fada\") " pod="opendatahub/test-curl-7606-139635308449584"
Jul 15 13:06:39.289010 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:39.288967    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7606-139635308449584"
Jul 15 13:06:39.419439 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:39.419407    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7606-139635308449584"]
Jul 15 13:06:39.422009 ip-10-0-140-67 kubenswrapper[2559]: W0715 13:06:39.421971    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-poda2d058fb_40f8_4a33_90b9_5411daf6fada.slice/crio-cf9331854bf521247203ad880d35ecc38a196307b535587703befa73e62a507f WatchSource:0}: Error finding container cf9331854bf521247203ad880d35ecc38a196307b535587703befa73e62a507f: Status 404 returned error can't find the container with id cf9331854bf521247203ad880d35ecc38a196307b535587703befa73e62a507f
Jul 15 13:06:39.423332 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:39.423316    2559 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 15 13:06:39.827174 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:39.826862    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7606-139635308449584" event={"ID":"a2d058fb-40f8-4a33-90b9-5411daf6fada","Type":"ContainerStarted","Data":"cf9331854bf521247203ad880d35ecc38a196307b535587703befa73e62a507f"}
Jul 15 13:06:40.833436 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:40.833395    2559 generic.go:356] "Generic (PLEG): container finished" podID="a2d058fb-40f8-4a33-90b9-5411daf6fada" containerID="4c66b32e293e14aea82dab4464c8d255d5a0488d610271baebabc2f3d11458c3" exitCode=0
Jul 15 13:06:40.833818 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:40.833453    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7606-139635308449584" event={"ID":"a2d058fb-40f8-4a33-90b9-5411daf6fada","Type":"ContainerDied","Data":"4c66b32e293e14aea82dab4464c8d255d5a0488d610271baebabc2f3d11458c3"}
Jul 15 13:06:41.969320 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:41.969292    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7606-139635308449584"
Jul 15 13:06:41.990232 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:41.990209    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7606-139635308449584_a2d058fb-40f8-4a33-90b9-5411daf6fada/test-curl-7606-139635308449584/0.log"
Jul 15 13:06:42.015379 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:42.015342    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7606-139635308449584"]
Jul 15 13:06:42.019269 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:42.019248    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7606-139635308449584"]
Jul 15 13:06:42.104718 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:42.104643    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nlmsz\" (UniqueName: \"kubernetes.io/projected/a2d058fb-40f8-4a33-90b9-5411daf6fada-kube-api-access-nlmsz\") pod \"a2d058fb-40f8-4a33-90b9-5411daf6fada\" (UID: \"a2d058fb-40f8-4a33-90b9-5411daf6fada\") "
Jul 15 13:06:42.106861 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:42.106836    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a2d058fb-40f8-4a33-90b9-5411daf6fada-kube-api-access-nlmsz" (OuterVolumeSpecName: "kube-api-access-nlmsz") pod "a2d058fb-40f8-4a33-90b9-5411daf6fada" (UID: "a2d058fb-40f8-4a33-90b9-5411daf6fada"). InnerVolumeSpecName "kube-api-access-nlmsz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:06:42.206161 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:42.206130    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nlmsz\" (UniqueName: \"kubernetes.io/projected/a2d058fb-40f8-4a33-90b9-5411daf6fada-kube-api-access-nlmsz\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 13:06:42.584416 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:42.584386    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a2d058fb-40f8-4a33-90b9-5411daf6fada" path="/var/lib/kubelet/pods/a2d058fb-40f8-4a33-90b9-5411daf6fada/volumes"
Jul 15 13:06:42.844016 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:42.843942    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7606-139635308449584"
Jul 15 13:06:42.844016 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:42.843962    2559 scope.go:117] "RemoveContainer" containerID="4c66b32e293e14aea82dab4464c8d255d5a0488d610271baebabc2f3d11458c3"
Jul 15 13:06:44.018423 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:44.018389    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 13:06:45.034992 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:45.034965    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7606-139635308478160"]
Jul 15 13:06:45.035325 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:45.035268    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a2d058fb-40f8-4a33-90b9-5411daf6fada" containerName="test-curl-7606-139635308449584"
Jul 15 13:06:45.035325 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:45.035279    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="a2d058fb-40f8-4a33-90b9-5411daf6fada" containerName="test-curl-7606-139635308449584"
Jul 15 13:06:45.035433 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:45.035343    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="a2d058fb-40f8-4a33-90b9-5411daf6fada" containerName="test-curl-7606-139635308449584"
Jul 15 13:06:45.039673 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:45.039655    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7606-139635308478160"
Jul 15 13:06:45.042381 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:45.042351    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-664xg\""
Jul 15 13:06:45.045825 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:45.045803    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7606-139635308478160"]
Jul 15 13:06:45.133748 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:45.133714    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szhc2\" (UniqueName: \"kubernetes.io/projected/825fbe7b-1ea2-46ad-aa2c-af3609bb4a09-kube-api-access-szhc2\") pod \"test-curl-7606-139635308478160\" (UID: \"825fbe7b-1ea2-46ad-aa2c-af3609bb4a09\") " pod="opendatahub/test-curl-7606-139635308478160"
Jul 15 13:06:45.234279 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:45.234247    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szhc2\" (UniqueName: \"kubernetes.io/projected/825fbe7b-1ea2-46ad-aa2c-af3609bb4a09-kube-api-access-szhc2\") pod \"test-curl-7606-139635308478160\" (UID: \"825fbe7b-1ea2-46ad-aa2c-af3609bb4a09\") " pod="opendatahub/test-curl-7606-139635308478160"
Jul 15 13:06:45.243858 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:45.243832    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-szhc2\" (UniqueName: \"kubernetes.io/projected/825fbe7b-1ea2-46ad-aa2c-af3609bb4a09-kube-api-access-szhc2\") pod \"test-curl-7606-139635308478160\" (UID: \"825fbe7b-1ea2-46ad-aa2c-af3609bb4a09\") " pod="opendatahub/test-curl-7606-139635308478160"
Jul 15 13:06:45.348891 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:45.348801    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7606-139635308478160"
Jul 15 13:06:45.479669 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:45.479641    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7606-139635308478160"]
Jul 15 13:06:45.481024 ip-10-0-140-67 kubenswrapper[2559]: W0715 13:06:45.480990    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod825fbe7b_1ea2_46ad_aa2c_af3609bb4a09.slice/crio-9dd68f143eefa5c52c20d61ba59b1f0c1d510a4de5379046e9a386f34db943d9 WatchSource:0}: Error finding container 9dd68f143eefa5c52c20d61ba59b1f0c1d510a4de5379046e9a386f34db943d9: Status 404 returned error can't find the container with id 9dd68f143eefa5c52c20d61ba59b1f0c1d510a4de5379046e9a386f34db943d9
Jul 15 13:06:45.866118 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:45.866061    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7606-139635308478160" event={"ID":"825fbe7b-1ea2-46ad-aa2c-af3609bb4a09","Type":"ContainerStarted","Data":"9dd68f143eefa5c52c20d61ba59b1f0c1d510a4de5379046e9a386f34db943d9"}
Jul 15 13:06:46.872672 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:46.872635    2559 generic.go:356] "Generic (PLEG): container finished" podID="825fbe7b-1ea2-46ad-aa2c-af3609bb4a09" containerID="5a7bbe789bdd76963d6c58fd65f53d24a1489e5e753a093bd0191ccfcf11b8a4" exitCode=0
Jul 15 13:06:46.873033 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:46.872713    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7606-139635308478160" event={"ID":"825fbe7b-1ea2-46ad-aa2c-af3609bb4a09","Type":"ContainerDied","Data":"5a7bbe789bdd76963d6c58fd65f53d24a1489e5e753a093bd0191ccfcf11b8a4"}
Jul 15 13:06:48.002065 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:48.002043    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7606-139635308478160"
Jul 15 13:06:48.023008 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:48.022984    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7606-139635308478160_825fbe7b-1ea2-46ad-aa2c-af3609bb4a09/test-curl-7606-139635308478160/0.log"
Jul 15 13:06:48.047911 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:48.047888    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7606-139635308478160"]
Jul 15 13:06:48.051573 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:48.051545    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7606-139635308478160"]
Jul 15 13:06:48.161197 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:48.161118    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-szhc2\" (UniqueName: \"kubernetes.io/projected/825fbe7b-1ea2-46ad-aa2c-af3609bb4a09-kube-api-access-szhc2\") pod \"825fbe7b-1ea2-46ad-aa2c-af3609bb4a09\" (UID: \"825fbe7b-1ea2-46ad-aa2c-af3609bb4a09\") "
Jul 15 13:06:48.163183 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:48.163157    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/825fbe7b-1ea2-46ad-aa2c-af3609bb4a09-kube-api-access-szhc2" (OuterVolumeSpecName: "kube-api-access-szhc2") pod "825fbe7b-1ea2-46ad-aa2c-af3609bb4a09" (UID: "825fbe7b-1ea2-46ad-aa2c-af3609bb4a09"). InnerVolumeSpecName "kube-api-access-szhc2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:06:48.181897 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:48.181873    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7606-139635308478160"]
Jul 15 13:06:48.182187 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:48.182175    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="825fbe7b-1ea2-46ad-aa2c-af3609bb4a09" containerName="test-curl-7606-139635308478160"
Jul 15 13:06:48.182235 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:48.182190    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="825fbe7b-1ea2-46ad-aa2c-af3609bb4a09" containerName="test-curl-7606-139635308478160"
Jul 15 13:06:48.182270 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:48.182240    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="825fbe7b-1ea2-46ad-aa2c-af3609bb4a09" containerName="test-curl-7606-139635308478160"
Jul 15 13:06:48.185079 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:48.185062    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7606-139635308478160"
Jul 15 13:06:48.192118 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:48.192099    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7606-139635308478160"]
Jul 15 13:06:48.262006 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:48.261978    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-szhc2\" (UniqueName: \"kubernetes.io/projected/825fbe7b-1ea2-46ad-aa2c-af3609bb4a09-kube-api-access-szhc2\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 13:06:48.362648 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:48.362616    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p64fh\" (UniqueName: \"kubernetes.io/projected/f9a49c01-9a95-49d1-950a-91ec4fcd1b27-kube-api-access-p64fh\") pod \"test-curl-7606-139635308478160\" (UID: \"f9a49c01-9a95-49d1-950a-91ec4fcd1b27\") " pod="opendatahub/test-curl-7606-139635308478160"
Jul 15 13:06:48.463821 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:48.463792    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p64fh\" (UniqueName: \"kubernetes.io/projected/f9a49c01-9a95-49d1-950a-91ec4fcd1b27-kube-api-access-p64fh\") pod \"test-curl-7606-139635308478160\" (UID: \"f9a49c01-9a95-49d1-950a-91ec4fcd1b27\") " pod="opendatahub/test-curl-7606-139635308478160"
Jul 15 13:06:48.471286 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:48.471257    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p64fh\" (UniqueName: \"kubernetes.io/projected/f9a49c01-9a95-49d1-950a-91ec4fcd1b27-kube-api-access-p64fh\") pod \"test-curl-7606-139635308478160\" (UID: \"f9a49c01-9a95-49d1-950a-91ec4fcd1b27\") " pod="opendatahub/test-curl-7606-139635308478160"
Jul 15 13:06:48.494465 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:48.494443    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7606-139635308478160"
Jul 15 13:06:48.586034 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:48.586006    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="825fbe7b-1ea2-46ad-aa2c-af3609bb4a09" path="/var/lib/kubelet/pods/825fbe7b-1ea2-46ad-aa2c-af3609bb4a09/volumes"
Jul 15 13:06:48.625330 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:48.625306    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7606-139635308478160"]
Jul 15 13:06:48.627577 ip-10-0-140-67 kubenswrapper[2559]: W0715 13:06:48.627554    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf9a49c01_9a95_49d1_950a_91ec4fcd1b27.slice/crio-26bdbb8ac3415d35d12b0ececb403d2c194a3d76c84f81e23120ffb7123e26b1 WatchSource:0}: Error finding container 26bdbb8ac3415d35d12b0ececb403d2c194a3d76c84f81e23120ffb7123e26b1: Status 404 returned error can't find the container with id 26bdbb8ac3415d35d12b0ececb403d2c194a3d76c84f81e23120ffb7123e26b1
Jul 15 13:06:48.882981 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:48.882915    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7606-139635308478160"
Jul 15 13:06:48.882981 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:48.882973    2559 scope.go:117] "RemoveContainer" containerID="5a7bbe789bdd76963d6c58fd65f53d24a1489e5e753a093bd0191ccfcf11b8a4"
Jul 15 13:06:48.884218 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:48.884109    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7606-139635308478160" event={"ID":"f9a49c01-9a95-49d1-950a-91ec4fcd1b27","Type":"ContainerStarted","Data":"26bdbb8ac3415d35d12b0ececb403d2c194a3d76c84f81e23120ffb7123e26b1"}
Jul 15 13:06:49.891329 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:49.891293    2559 generic.go:356] "Generic (PLEG): container finished" podID="f9a49c01-9a95-49d1-950a-91ec4fcd1b27" containerID="7351f2cc4096cf94c5d9a582330202261c5196b813ad71616619cda04332d9de" exitCode=0
Jul 15 13:06:49.891783 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:49.891381    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7606-139635308478160" event={"ID":"f9a49c01-9a95-49d1-950a-91ec4fcd1b27","Type":"ContainerDied","Data":"7351f2cc4096cf94c5d9a582330202261c5196b813ad71616619cda04332d9de"}
Jul 15 13:06:51.028717 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:51.028690    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7606-139635308478160"
Jul 15 13:06:51.051267 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:51.051236    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7606-139635308478160_f9a49c01-9a95-49d1-950a-91ec4fcd1b27/test-curl-7606-139635308478160/0.log"
Jul 15 13:06:51.077974 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:51.077939    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7606-139635308478160"]
Jul 15 13:06:51.080646 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:51.080624    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7606-139635308478160"]
Jul 15 13:06:51.190750 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:51.190677    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p64fh\" (UniqueName: \"kubernetes.io/projected/f9a49c01-9a95-49d1-950a-91ec4fcd1b27-kube-api-access-p64fh\") pod \"f9a49c01-9a95-49d1-950a-91ec4fcd1b27\" (UID: \"f9a49c01-9a95-49d1-950a-91ec4fcd1b27\") "
Jul 15 13:06:51.192663 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:51.192631    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f9a49c01-9a95-49d1-950a-91ec4fcd1b27-kube-api-access-p64fh" (OuterVolumeSpecName: "kube-api-access-p64fh") pod "f9a49c01-9a95-49d1-950a-91ec4fcd1b27" (UID: "f9a49c01-9a95-49d1-950a-91ec4fcd1b27"). InnerVolumeSpecName "kube-api-access-p64fh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:06:51.291439 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:51.291403    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p64fh\" (UniqueName: \"kubernetes.io/projected/f9a49c01-9a95-49d1-950a-91ec4fcd1b27-kube-api-access-p64fh\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 13:06:51.902025 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:51.902002    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7606-139635308478160"
Jul 15 13:06:51.902190 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:51.902045    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="26bdbb8ac3415d35d12b0ececb403d2c194a3d76c84f81e23120ffb7123e26b1"
Jul 15 13:06:51.911909 ip-10-0-140-67 kubenswrapper[2559]: E0715 13:06:51.911876    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7606-139635308478160\" is forbidden: User \"system:node:ip-10-0-140-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-67.ec2.internal' and this object" podUID="f9a49c01-9a95-49d1-950a-91ec4fcd1b27" pod="opendatahub/test-curl-7606-139635308478160"
Jul 15 13:06:52.240591 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:52.240553    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-a-3af497/rate-test-model-3af497-kserve-58c78ddcf-6z8hk" podUID="e587cd84-2750-4180-a8bf-b2504cf1db20" containerName="main" containerID="cri-o://b0b2527ff33ce7a3536bdf407c66286aef6d640969d8f64ea1b7ca21d1fe4a3f" gracePeriod=45
Jul 15 13:06:52.486002 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:52.485976    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3af497/rate-test-model-3af497-kserve-58c78ddcf-6z8hk"
Jul 15 13:06:52.488078 ip-10-0-140-67 kubenswrapper[2559]: E0715 13:06:52.488052    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7606-139635308478160\" is forbidden: User \"system:node:ip-10-0-140-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-67.ec2.internal' and this object" podUID="f9a49c01-9a95-49d1-950a-91ec4fcd1b27" pod="opendatahub/test-curl-7606-139635308478160"
Jul 15 13:06:52.584498 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:52.584416    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f9a49c01-9a95-49d1-950a-91ec4fcd1b27" path="/var/lib/kubelet/pods/f9a49c01-9a95-49d1-950a-91ec4fcd1b27/volumes"
Jul 15 13:06:52.602445 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:52.602414    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e587cd84-2750-4180-a8bf-b2504cf1db20-tls-certs\") pod \"e587cd84-2750-4180-a8bf-b2504cf1db20\" (UID: \"e587cd84-2750-4180-a8bf-b2504cf1db20\") "
Jul 15 13:06:52.602595 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:52.602473    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e587cd84-2750-4180-a8bf-b2504cf1db20-model-cache\") pod \"e587cd84-2750-4180-a8bf-b2504cf1db20\" (UID: \"e587cd84-2750-4180-a8bf-b2504cf1db20\") "
Jul 15 13:06:52.602595 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:52.602507    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e587cd84-2750-4180-a8bf-b2504cf1db20-home\") pod \"e587cd84-2750-4180-a8bf-b2504cf1db20\" (UID: \"e587cd84-2750-4180-a8bf-b2504cf1db20\") "
Jul 15 13:06:52.602595 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:52.602573    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dhtpt\" (UniqueName: \"kubernetes.io/projected/e587cd84-2750-4180-a8bf-b2504cf1db20-kube-api-access-dhtpt\") pod \"e587cd84-2750-4180-a8bf-b2504cf1db20\" (UID: \"e587cd84-2750-4180-a8bf-b2504cf1db20\") "
Jul 15 13:06:52.602862 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:52.602615    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e587cd84-2750-4180-a8bf-b2504cf1db20-dshm\") pod \"e587cd84-2750-4180-a8bf-b2504cf1db20\" (UID: \"e587cd84-2750-4180-a8bf-b2504cf1db20\") "
Jul 15 13:06:52.602862 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:52.602638    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e587cd84-2750-4180-a8bf-b2504cf1db20-tmp-dir\") pod \"e587cd84-2750-4180-a8bf-b2504cf1db20\" (UID: \"e587cd84-2750-4180-a8bf-b2504cf1db20\") "
Jul 15 13:06:52.602862 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:52.602766    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e587cd84-2750-4180-a8bf-b2504cf1db20-model-cache" (OuterVolumeSpecName: "model-cache") pod "e587cd84-2750-4180-a8bf-b2504cf1db20" (UID: "e587cd84-2750-4180-a8bf-b2504cf1db20"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:06:52.602981 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:52.602873    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e587cd84-2750-4180-a8bf-b2504cf1db20-model-cache\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 13:06:52.603043 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:52.602974    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e587cd84-2750-4180-a8bf-b2504cf1db20-home" (OuterVolumeSpecName: "home") pod "e587cd84-2750-4180-a8bf-b2504cf1db20" (UID: "e587cd84-2750-4180-a8bf-b2504cf1db20"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:06:52.603100 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:52.603058    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e587cd84-2750-4180-a8bf-b2504cf1db20-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "e587cd84-2750-4180-a8bf-b2504cf1db20" (UID: "e587cd84-2750-4180-a8bf-b2504cf1db20"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:06:52.604796 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:52.604774    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e587cd84-2750-4180-a8bf-b2504cf1db20-kube-api-access-dhtpt" (OuterVolumeSpecName: "kube-api-access-dhtpt") pod "e587cd84-2750-4180-a8bf-b2504cf1db20" (UID: "e587cd84-2750-4180-a8bf-b2504cf1db20"). InnerVolumeSpecName "kube-api-access-dhtpt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:06:52.604796 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:52.604783    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e587cd84-2750-4180-a8bf-b2504cf1db20-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "e587cd84-2750-4180-a8bf-b2504cf1db20" (UID: "e587cd84-2750-4180-a8bf-b2504cf1db20"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:06:52.604930 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:52.604784    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e587cd84-2750-4180-a8bf-b2504cf1db20-dshm" (OuterVolumeSpecName: "dshm") pod "e587cd84-2750-4180-a8bf-b2504cf1db20" (UID: "e587cd84-2750-4180-a8bf-b2504cf1db20"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:06:52.704131 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:52.704098    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e587cd84-2750-4180-a8bf-b2504cf1db20-home\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 13:06:52.704131 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:52.704129    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dhtpt\" (UniqueName: \"kubernetes.io/projected/e587cd84-2750-4180-a8bf-b2504cf1db20-kube-api-access-dhtpt\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 13:06:52.704131 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:52.704140    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e587cd84-2750-4180-a8bf-b2504cf1db20-dshm\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 13:06:52.704398 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:52.704148    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e587cd84-2750-4180-a8bf-b2504cf1db20-tmp-dir\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 13:06:52.704398 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:52.704157    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e587cd84-2750-4180-a8bf-b2504cf1db20-tls-certs\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 13:06:52.908706 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:52.908617    2559 generic.go:356] "Generic (PLEG): container finished" podID="e587cd84-2750-4180-a8bf-b2504cf1db20" containerID="b0b2527ff33ce7a3536bdf407c66286aef6d640969d8f64ea1b7ca21d1fe4a3f" exitCode=0
Jul 15 13:06:52.908706 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:52.908656    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-a-3af497/rate-test-model-3af497-kserve-58c78ddcf-6z8hk"
Jul 15 13:06:52.908934 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:52.908695    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3af497/rate-test-model-3af497-kserve-58c78ddcf-6z8hk" event={"ID":"e587cd84-2750-4180-a8bf-b2504cf1db20","Type":"ContainerDied","Data":"b0b2527ff33ce7a3536bdf407c66286aef6d640969d8f64ea1b7ca21d1fe4a3f"}
Jul 15 13:06:52.908934 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:52.908742    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-a-3af497/rate-test-model-3af497-kserve-58c78ddcf-6z8hk" event={"ID":"e587cd84-2750-4180-a8bf-b2504cf1db20","Type":"ContainerDied","Data":"1a9a712fdb156157bd4c88740c540b74a7400eb7c682f6ddcb10fde28f8aec11"}
Jul 15 13:06:52.908934 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:52.908759    2559 scope.go:117] "RemoveContainer" containerID="b0b2527ff33ce7a3536bdf407c66286aef6d640969d8f64ea1b7ca21d1fe4a3f"
Jul 15 13:06:52.917608 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:52.917592    2559 scope.go:117] "RemoveContainer" containerID="b0b2527ff33ce7a3536bdf407c66286aef6d640969d8f64ea1b7ca21d1fe4a3f"
Jul 15 13:06:52.917857 ip-10-0-140-67 kubenswrapper[2559]: E0715 13:06:52.917841    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b0b2527ff33ce7a3536bdf407c66286aef6d640969d8f64ea1b7ca21d1fe4a3f\": container with ID starting with b0b2527ff33ce7a3536bdf407c66286aef6d640969d8f64ea1b7ca21d1fe4a3f not found: ID does not exist" containerID="b0b2527ff33ce7a3536bdf407c66286aef6d640969d8f64ea1b7ca21d1fe4a3f"
Jul 15 13:06:52.917908 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:52.917866    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b0b2527ff33ce7a3536bdf407c66286aef6d640969d8f64ea1b7ca21d1fe4a3f"} err="failed to get container status \"b0b2527ff33ce7a3536bdf407c66286aef6d640969d8f64ea1b7ca21d1fe4a3f\": rpc error: code = NotFound desc = could not find container \"b0b2527ff33ce7a3536bdf407c66286aef6d640969d8f64ea1b7ca21d1fe4a3f\": container with ID starting with b0b2527ff33ce7a3536bdf407c66286aef6d640969d8f64ea1b7ca21d1fe4a3f not found: ID does not exist"
Jul 15 13:06:52.930621 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:52.930601    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-a-3af497/rate-test-model-3af497-kserve-58c78ddcf-6z8hk"]
Jul 15 13:06:52.935228 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:52.935208    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-a-3af497/rate-test-model-3af497-kserve-58c78ddcf-6z8hk"]
Jul 15 13:06:53.054758 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:53.054720    2559 kuberuntime_container.go:873] "Killing container with a grace period" pod="ai-tenant-e2e-shared-b-70ed7b/rate-test-model-70ed7b-kserve-7b4d5487f9-fsvkl" podUID="bdcf18c4-67c1-4e97-a99b-eb6aede34b8c" containerName="main" containerID="cri-o://8302e1d3381e2be35afc13acbe0c60b188f321e148c795a4a7c605f731b480e4" gracePeriod=45
Jul 15 13:06:53.308066 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:53.308042    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-70ed7b/rate-test-model-70ed7b-kserve-7b4d5487f9-fsvkl"
Jul 15 13:06:53.411065 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:53.411027    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bdcf18c4-67c1-4e97-a99b-eb6aede34b8c-home\") pod \"bdcf18c4-67c1-4e97-a99b-eb6aede34b8c\" (UID: \"bdcf18c4-67c1-4e97-a99b-eb6aede34b8c\") "
Jul 15 13:06:53.411065 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:53.411064    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bdcf18c4-67c1-4e97-a99b-eb6aede34b8c-tls-certs\") pod \"bdcf18c4-67c1-4e97-a99b-eb6aede34b8c\" (UID: \"bdcf18c4-67c1-4e97-a99b-eb6aede34b8c\") "
Jul 15 13:06:53.411310 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:53.411101    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bdcf18c4-67c1-4e97-a99b-eb6aede34b8c-model-cache\") pod \"bdcf18c4-67c1-4e97-a99b-eb6aede34b8c\" (UID: \"bdcf18c4-67c1-4e97-a99b-eb6aede34b8c\") "
Jul 15 13:06:53.411310 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:53.411152    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bdcf18c4-67c1-4e97-a99b-eb6aede34b8c-dshm\") pod \"bdcf18c4-67c1-4e97-a99b-eb6aede34b8c\" (UID: \"bdcf18c4-67c1-4e97-a99b-eb6aede34b8c\") "
Jul 15 13:06:53.411310 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:53.411186    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4t7hg\" (UniqueName: \"kubernetes.io/projected/bdcf18c4-67c1-4e97-a99b-eb6aede34b8c-kube-api-access-4t7hg\") pod \"bdcf18c4-67c1-4e97-a99b-eb6aede34b8c\" (UID: \"bdcf18c4-67c1-4e97-a99b-eb6aede34b8c\") "
Jul 15 13:06:53.411310 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:53.411236    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bdcf18c4-67c1-4e97-a99b-eb6aede34b8c-tmp-dir\") pod \"bdcf18c4-67c1-4e97-a99b-eb6aede34b8c\" (UID: \"bdcf18c4-67c1-4e97-a99b-eb6aede34b8c\") "
Jul 15 13:06:53.411523 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:53.411350    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdcf18c4-67c1-4e97-a99b-eb6aede34b8c-home" (OuterVolumeSpecName: "home") pod "bdcf18c4-67c1-4e97-a99b-eb6aede34b8c" (UID: "bdcf18c4-67c1-4e97-a99b-eb6aede34b8c"). InnerVolumeSpecName "home". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:06:53.411523 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:53.411457    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdcf18c4-67c1-4e97-a99b-eb6aede34b8c-model-cache" (OuterVolumeSpecName: "model-cache") pod "bdcf18c4-67c1-4e97-a99b-eb6aede34b8c" (UID: "bdcf18c4-67c1-4e97-a99b-eb6aede34b8c"). InnerVolumeSpecName "model-cache". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:06:53.411607 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:53.411535    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdcf18c4-67c1-4e97-a99b-eb6aede34b8c-tmp-dir" (OuterVolumeSpecName: "tmp-dir") pod "bdcf18c4-67c1-4e97-a99b-eb6aede34b8c" (UID: "bdcf18c4-67c1-4e97-a99b-eb6aede34b8c"). InnerVolumeSpecName "tmp-dir". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:06:53.411607 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:53.411592    2559 reconciler_common.go:299] "Volume detached for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bdcf18c4-67c1-4e97-a99b-eb6aede34b8c-home\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 13:06:53.411687 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:53.411610    2559 reconciler_common.go:299] "Volume detached for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bdcf18c4-67c1-4e97-a99b-eb6aede34b8c-model-cache\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 13:06:53.413302 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:53.413270    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/bdcf18c4-67c1-4e97-a99b-eb6aede34b8c-dshm" (OuterVolumeSpecName: "dshm") pod "bdcf18c4-67c1-4e97-a99b-eb6aede34b8c" (UID: "bdcf18c4-67c1-4e97-a99b-eb6aede34b8c"). InnerVolumeSpecName "dshm". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 15 13:06:53.413302 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:53.413287    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bdcf18c4-67c1-4e97-a99b-eb6aede34b8c-tls-certs" (OuterVolumeSpecName: "tls-certs") pod "bdcf18c4-67c1-4e97-a99b-eb6aede34b8c" (UID: "bdcf18c4-67c1-4e97-a99b-eb6aede34b8c"). InnerVolumeSpecName "tls-certs". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 15 13:06:53.413471 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:53.413310    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bdcf18c4-67c1-4e97-a99b-eb6aede34b8c-kube-api-access-4t7hg" (OuterVolumeSpecName: "kube-api-access-4t7hg") pod "bdcf18c4-67c1-4e97-a99b-eb6aede34b8c" (UID: "bdcf18c4-67c1-4e97-a99b-eb6aede34b8c"). InnerVolumeSpecName "kube-api-access-4t7hg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:06:53.512769 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:53.512737    2559 reconciler_common.go:299] "Volume detached for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bdcf18c4-67c1-4e97-a99b-eb6aede34b8c-dshm\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 13:06:53.512769 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:53.512768    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4t7hg\" (UniqueName: \"kubernetes.io/projected/bdcf18c4-67c1-4e97-a99b-eb6aede34b8c-kube-api-access-4t7hg\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 13:06:53.512966 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:53.512782    2559 reconciler_common.go:299] "Volume detached for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bdcf18c4-67c1-4e97-a99b-eb6aede34b8c-tmp-dir\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 13:06:53.512966 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:53.512793    2559 reconciler_common.go:299] "Volume detached for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bdcf18c4-67c1-4e97-a99b-eb6aede34b8c-tls-certs\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 13:06:53.916468 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:53.916383    2559 generic.go:356] "Generic (PLEG): container finished" podID="bdcf18c4-67c1-4e97-a99b-eb6aede34b8c" containerID="8302e1d3381e2be35afc13acbe0c60b188f321e148c795a4a7c605f731b480e4" exitCode=0
Jul 15 13:06:53.916468 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:53.916432    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="ai-tenant-e2e-shared-b-70ed7b/rate-test-model-70ed7b-kserve-7b4d5487f9-fsvkl"
Jul 15 13:06:53.916468 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:53.916458    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-70ed7b/rate-test-model-70ed7b-kserve-7b4d5487f9-fsvkl" event={"ID":"bdcf18c4-67c1-4e97-a99b-eb6aede34b8c","Type":"ContainerDied","Data":"8302e1d3381e2be35afc13acbe0c60b188f321e148c795a4a7c605f731b480e4"}
Jul 15 13:06:53.916723 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:53.916493    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="ai-tenant-e2e-shared-b-70ed7b/rate-test-model-70ed7b-kserve-7b4d5487f9-fsvkl" event={"ID":"bdcf18c4-67c1-4e97-a99b-eb6aede34b8c","Type":"ContainerDied","Data":"e309881ac03dea16a95c175fe0819df908c4e4ceb9a93138039cada048e3de46"}
Jul 15 13:06:53.916723 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:53.916508    2559 scope.go:117] "RemoveContainer" containerID="8302e1d3381e2be35afc13acbe0c60b188f321e148c795a4a7c605f731b480e4"
Jul 15 13:06:53.925464 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:53.925445    2559 scope.go:117] "RemoveContainer" containerID="8302e1d3381e2be35afc13acbe0c60b188f321e148c795a4a7c605f731b480e4"
Jul 15 13:06:53.925712 ip-10-0-140-67 kubenswrapper[2559]: E0715 13:06:53.925693    2559 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8302e1d3381e2be35afc13acbe0c60b188f321e148c795a4a7c605f731b480e4\": container with ID starting with 8302e1d3381e2be35afc13acbe0c60b188f321e148c795a4a7c605f731b480e4 not found: ID does not exist" containerID="8302e1d3381e2be35afc13acbe0c60b188f321e148c795a4a7c605f731b480e4"
Jul 15 13:06:53.925760 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:53.925722    2559 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8302e1d3381e2be35afc13acbe0c60b188f321e148c795a4a7c605f731b480e4"} err="failed to get container status \"8302e1d3381e2be35afc13acbe0c60b188f321e148c795a4a7c605f731b480e4\": rpc error: code = NotFound desc = could not find container \"8302e1d3381e2be35afc13acbe0c60b188f321e148c795a4a7c605f731b480e4\": container with ID starting with 8302e1d3381e2be35afc13acbe0c60b188f321e148c795a4a7c605f731b480e4 not found: ID does not exist"
Jul 15 13:06:53.938019 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:53.937999    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["ai-tenant-e2e-shared-b-70ed7b/rate-test-model-70ed7b-kserve-7b4d5487f9-fsvkl"]
Jul 15 13:06:53.942470 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:53.942452    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["ai-tenant-e2e-shared-b-70ed7b/rate-test-model-70ed7b-kserve-7b4d5487f9-fsvkl"]
Jul 15 13:06:54.036627 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:54.036592    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/test-curl-7606-139635315250352"]
Jul 15 13:06:54.036968 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:54.036950    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e587cd84-2750-4180-a8bf-b2504cf1db20" containerName="main"
Jul 15 13:06:54.037046 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:54.036970    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="e587cd84-2750-4180-a8bf-b2504cf1db20" containerName="main"
Jul 15 13:06:54.037046 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:54.036996    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdcf18c4-67c1-4e97-a99b-eb6aede34b8c" containerName="main"
Jul 15 13:06:54.037046 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:54.037005    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdcf18c4-67c1-4e97-a99b-eb6aede34b8c" containerName="main"
Jul 15 13:06:54.037046 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:54.037032    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f9a49c01-9a95-49d1-950a-91ec4fcd1b27" containerName="test-curl-7606-139635308478160"
Jul 15 13:06:54.037046 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:54.037043    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="f9a49c01-9a95-49d1-950a-91ec4fcd1b27" containerName="test-curl-7606-139635308478160"
Jul 15 13:06:54.037292 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:54.037131    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="e587cd84-2750-4180-a8bf-b2504cf1db20" containerName="main"
Jul 15 13:06:54.037292 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:54.037142    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="bdcf18c4-67c1-4e97-a99b-eb6aede34b8c" containerName="main"
Jul 15 13:06:54.037292 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:54.037152    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="f9a49c01-9a95-49d1-950a-91ec4fcd1b27" containerName="test-curl-7606-139635308478160"
Jul 15 13:06:54.041341 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:54.041319    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7606-139635315250352"
Jul 15 13:06:54.043738 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:54.043698    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-664xg\""
Jul 15 13:06:54.046866 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:54.046845    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7606-139635315250352"]
Jul 15 13:06:54.218999 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:54.218964    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m7ks4\" (UniqueName: \"kubernetes.io/projected/4aa6d37f-5359-413b-8c29-93ed064d149e-kube-api-access-m7ks4\") pod \"test-curl-7606-139635315250352\" (UID: \"4aa6d37f-5359-413b-8c29-93ed064d149e\") " pod="opendatahub/test-curl-7606-139635315250352"
Jul 15 13:06:54.320407 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:54.320351    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m7ks4\" (UniqueName: \"kubernetes.io/projected/4aa6d37f-5359-413b-8c29-93ed064d149e-kube-api-access-m7ks4\") pod \"test-curl-7606-139635315250352\" (UID: \"4aa6d37f-5359-413b-8c29-93ed064d149e\") " pod="opendatahub/test-curl-7606-139635315250352"
Jul 15 13:06:54.330241 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:54.330210    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m7ks4\" (UniqueName: \"kubernetes.io/projected/4aa6d37f-5359-413b-8c29-93ed064d149e-kube-api-access-m7ks4\") pod \"test-curl-7606-139635315250352\" (UID: \"4aa6d37f-5359-413b-8c29-93ed064d149e\") " pod="opendatahub/test-curl-7606-139635315250352"
Jul 15 13:06:54.352058 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:54.352027    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7606-139635315250352"
Jul 15 13:06:54.477675 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:54.477598    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/test-curl-7606-139635315250352"]
Jul 15 13:06:54.480598 ip-10-0-140-67 kubenswrapper[2559]: W0715 13:06:54.480572    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod4aa6d37f_5359_413b_8c29_93ed064d149e.slice/crio-47f6f3cdbba95c56e3f225ecba9814e5773f47c195756b4f2699b5785ef7d13c WatchSource:0}: Error finding container 47f6f3cdbba95c56e3f225ecba9814e5773f47c195756b4f2699b5785ef7d13c: Status 404 returned error can't find the container with id 47f6f3cdbba95c56e3f225ecba9814e5773f47c195756b4f2699b5785ef7d13c
Jul 15 13:06:54.582704 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:54.582672    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bdcf18c4-67c1-4e97-a99b-eb6aede34b8c" path="/var/lib/kubelet/pods/bdcf18c4-67c1-4e97-a99b-eb6aede34b8c/volumes"
Jul 15 13:06:54.583053 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:54.583040    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e587cd84-2750-4180-a8bf-b2504cf1db20" path="/var/lib/kubelet/pods/e587cd84-2750-4180-a8bf-b2504cf1db20/volumes"
Jul 15 13:06:54.923567 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:54.923517    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7606-139635315250352" event={"ID":"4aa6d37f-5359-413b-8c29-93ed064d149e","Type":"ContainerStarted","Data":"47f6f3cdbba95c56e3f225ecba9814e5773f47c195756b4f2699b5785ef7d13c"}
Jul 15 13:06:55.933719 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:55.933682    2559 generic.go:356] "Generic (PLEG): container finished" podID="4aa6d37f-5359-413b-8c29-93ed064d149e" containerID="750d0e7b385966ff550f26493f24698a1c8c25e28bce4039868f5a9e25724c25" exitCode=0
Jul 15 13:06:55.934072 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:55.933743    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/test-curl-7606-139635315250352" event={"ID":"4aa6d37f-5359-413b-8c29-93ed064d149e","Type":"ContainerDied","Data":"750d0e7b385966ff550f26493f24698a1c8c25e28bce4039868f5a9e25724c25"}
Jul 15 13:06:57.071719 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:57.071694    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7606-139635315250352"
Jul 15 13:06:57.092408 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:57.092384    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_test-curl-7606-139635315250352_4aa6d37f-5359-413b-8c29-93ed064d149e/test-curl-7606-139635315250352/0.log"
Jul 15 13:06:57.117329 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:57.117296    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/test-curl-7606-139635315250352"]
Jul 15 13:06:57.123697 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:57.123671    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/test-curl-7606-139635315250352"]
Jul 15 13:06:57.143916 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:57.143889    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m7ks4\" (UniqueName: \"kubernetes.io/projected/4aa6d37f-5359-413b-8c29-93ed064d149e-kube-api-access-m7ks4\") pod \"4aa6d37f-5359-413b-8c29-93ed064d149e\" (UID: \"4aa6d37f-5359-413b-8c29-93ed064d149e\") "
Jul 15 13:06:57.145910 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:57.145889    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4aa6d37f-5359-413b-8c29-93ed064d149e-kube-api-access-m7ks4" (OuterVolumeSpecName: "kube-api-access-m7ks4") pod "4aa6d37f-5359-413b-8c29-93ed064d149e" (UID: "4aa6d37f-5359-413b-8c29-93ed064d149e"). InnerVolumeSpecName "kube-api-access-m7ks4". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 15 13:06:57.244409 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:57.244354    2559 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m7ks4\" (UniqueName: \"kubernetes.io/projected/4aa6d37f-5359-413b-8c29-93ed064d149e-kube-api-access-m7ks4\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 13:06:57.310031 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:57.309998    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3af497-rbb59"]
Jul 15 13:06:57.310322 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:57.310309    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4aa6d37f-5359-413b-8c29-93ed064d149e" containerName="test-curl-7606-139635315250352"
Jul 15 13:06:57.310385 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:57.310324    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="4aa6d37f-5359-413b-8c29-93ed064d149e" containerName="test-curl-7606-139635315250352"
Jul 15 13:06:57.310426 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:57.310394    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="4aa6d37f-5359-413b-8c29-93ed064d149e" containerName="test-curl-7606-139635315250352"
Jul 15 13:06:57.313261 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:57.313244    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3af497-rbb59"
Jul 15 13:06:57.315665 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:57.315642    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-267b6\""
Jul 15 13:06:57.315665 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:57.315663    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 13:06:57.319867 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:57.319841    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3af497-rbb59"]
Jul 15 13:06:57.344627 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:57.344591    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/df32a8bf-47b0-4691-bf65-b9200ce73ce6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-3af497-rbb59\" (UID: \"df32a8bf-47b0-4691-bf65-b9200ce73ce6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3af497-rbb59"
Jul 15 13:06:57.445553 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:57.445517    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/df32a8bf-47b0-4691-bf65-b9200ce73ce6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-3af497-rbb59\" (UID: \"df32a8bf-47b0-4691-bf65-b9200ce73ce6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3af497-rbb59"
Jul 15 13:06:57.446146 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:57.446123    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/df32a8bf-47b0-4691-bf65-b9200ce73ce6-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-a-3af497-rbb59\" (UID: \"df32a8bf-47b0-4691-bf65-b9200ce73ce6\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3af497-rbb59"
Jul 15 13:06:57.625897 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:57.625815    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3af497-rbb59"
Jul 15 13:06:57.766533 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:57.766503    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3af497-rbb59"]
Jul 15 13:06:57.768795 ip-10-0-140-67 kubenswrapper[2559]: W0715 13:06:57.768765    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddf32a8bf_47b0_4691_bf65_b9200ce73ce6.slice/crio-9b848bca3fd7c30031b3db0cc0c042ddace1705234a3f2c53c7f174823b01b88 WatchSource:0}: Error finding container 9b848bca3fd7c30031b3db0cc0c042ddace1705234a3f2c53c7f174823b01b88: Status 404 returned error can't find the container with id 9b848bca3fd7c30031b3db0cc0c042ddace1705234a3f2c53c7f174823b01b88
Jul 15 13:06:57.837662 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:57.837632    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 13:06:57.939140 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:57.939023    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 13:06:57.945550 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:57.945532    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/test-curl-7606-139635315250352"
Jul 15 13:06:57.945666 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:57.945538    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="47f6f3cdbba95c56e3f225ecba9814e5773f47c195756b4f2699b5785ef7d13c"
Jul 15 13:06:57.946809 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:57.946785    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3af497-rbb59" event={"ID":"df32a8bf-47b0-4691-bf65-b9200ce73ce6","Type":"ContainerStarted","Data":"9b848bca3fd7c30031b3db0cc0c042ddace1705234a3f2c53c7f174823b01b88"}
Jul 15 13:06:57.955882 ip-10-0-140-67 kubenswrapper[2559]: E0715 13:06:57.955856    2559 status_manager.go:1018] "Failed to get status for pod" err="pods \"test-curl-7606-139635315250352\" is forbidden: User \"system:node:ip-10-0-140-67.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"opendatahub\": no relationship found between node 'ip-10-0-140-67.ec2.internal' and this object" podUID="4aa6d37f-5359-413b-8c29-93ed064d149e" pod="opendatahub/test-curl-7606-139635315250352"
Jul 15 13:06:58.584018 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:58.583971    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4aa6d37f-5359-413b-8c29-93ed064d149e" path="/var/lib/kubelet/pods/4aa6d37f-5359-413b-8c29-93ed064d149e/volumes"
Jul 15 13:06:58.953272 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:58.953190    2559 generic.go:356] "Generic (PLEG): container finished" podID="df32a8bf-47b0-4691-bf65-b9200ce73ce6" containerID="47fabf0acc0083285e8e8e606697eac33a66549a2defde59974ac8184fb67484" exitCode=0
Jul 15 13:06:58.953437 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:06:58.953274    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3af497-rbb59" event={"ID":"df32a8bf-47b0-4691-bf65-b9200ce73ce6","Type":"ContainerDied","Data":"47fabf0acc0083285e8e8e606697eac33a66549a2defde59974ac8184fb67484"}
Jul 15 13:07:00.086703 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:00.086675    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3af497-rbb59"
Jul 15 13:07:00.164933 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:00.164893    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/df32a8bf-47b0-4691-bf65-b9200ce73ce6-maas-api-service-ca\") pod \"df32a8bf-47b0-4691-bf65-b9200ce73ce6\" (UID: \"df32a8bf-47b0-4691-bf65-b9200ce73ce6\") "
Jul 15 13:07:00.165307 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:00.165281    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/df32a8bf-47b0-4691-bf65-b9200ce73ce6-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "df32a8bf-47b0-4691-bf65-b9200ce73ce6" (UID: "df32a8bf-47b0-4691-bf65-b9200ce73ce6"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:07:00.265610 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:00.265527    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/df32a8bf-47b0-4691-bf65-b9200ce73ce6-maas-api-service-ca\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 13:07:00.964476 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:00.964448    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3af497-rbb59"
Jul 15 13:07:00.964761 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:00.964492    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-a-3af497-rbb59" event={"ID":"df32a8bf-47b0-4691-bf65-b9200ce73ce6","Type":"ContainerDied","Data":"9b848bca3fd7c30031b3db0cc0c042ddace1705234a3f2c53c7f174823b01b88"}
Jul 15 13:07:00.964761 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:00.964537    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="9b848bca3fd7c30031b3db0cc0c042ddace1705234a3f2c53c7f174823b01b88"
Jul 15 13:07:08.176307 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:08.176275    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 13:07:08.189742 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:08.189713    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-3af497-29735340-p2h2b"]
Jul 15 13:07:08.192814 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:08.192792    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-3af497-29735340-p2h2b"]
Jul 15 13:07:08.582919 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:08.582891    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7429077-809c-4717-b3f9-24f3d944434b" path="/var/lib/kubelet/pods/d7429077-809c-4717-b3f9-24f3d944434b/volumes"
Jul 15 13:07:12.019320 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:12.019286    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 13:07:12.422169 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:12.422085    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 13:07:18.822120 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:18.822086    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 13:07:18.907714 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:18.907677    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 13:07:23.154525 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:23.154492    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 13:07:23.389322 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:23.389288    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 13:07:23.496211 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:23.496181    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-70ed7b-7tswt"]
Jul 15 13:07:23.496529 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:23.496516    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="df32a8bf-47b0-4691-bf65-b9200ce73ce6" containerName="revoke-keys"
Jul 15 13:07:23.496580 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:23.496531    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="df32a8bf-47b0-4691-bf65-b9200ce73ce6" containerName="revoke-keys"
Jul 15 13:07:23.496616 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:23.496597    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="df32a8bf-47b0-4691-bf65-b9200ce73ce6" containerName="revoke-keys"
Jul 15 13:07:23.501692 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:23.501678    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-70ed7b-7tswt"
Jul 15 13:07:23.504321 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:23.504302    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\""
Jul 15 13:07:23.504464 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:23.504448    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-267b6\""
Jul 15 13:07:23.509178 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:23.509155    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-70ed7b-7tswt"]
Jul 15 13:07:23.562602 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:23.562567    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b8af7c2-08ee-471e-8132-a399be259fa2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-70ed7b-7tswt\" (UID: \"7b8af7c2-08ee-471e-8132-a399be259fa2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-70ed7b-7tswt"
Jul 15 13:07:23.663584 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:23.663542    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b8af7c2-08ee-471e-8132-a399be259fa2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-70ed7b-7tswt\" (UID: \"7b8af7c2-08ee-471e-8132-a399be259fa2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-70ed7b-7tswt"
Jul 15 13:07:23.664230 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:23.664210    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b8af7c2-08ee-471e-8132-a399be259fa2-maas-api-service-ca\") pod \"maas-api-revoke-keys-e2e-shared-b-70ed7b-7tswt\" (UID: \"7b8af7c2-08ee-471e-8132-a399be259fa2\") " pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-70ed7b-7tswt"
Jul 15 13:07:23.812506 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:23.812421    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-70ed7b-7tswt"
Jul 15 13:07:23.945592 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:23.945566    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-70ed7b-7tswt"]
Jul 15 13:07:23.948038 ip-10-0-140-67 kubenswrapper[2559]: W0715 13:07:23.948011    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b8af7c2_08ee_471e_8132_a399be259fa2.slice/crio-74d088c6c67ed0ecf3d4850feb2b806d34c8df3f50108656a34ab2148c99fab8 WatchSource:0}: Error finding container 74d088c6c67ed0ecf3d4850feb2b806d34c8df3f50108656a34ab2148c99fab8: Status 404 returned error can't find the container with id 74d088c6c67ed0ecf3d4850feb2b806d34c8df3f50108656a34ab2148c99fab8
Jul 15 13:07:24.081798 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:24.081715    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-70ed7b-7tswt" event={"ID":"7b8af7c2-08ee-471e-8132-a399be259fa2","Type":"ContainerStarted","Data":"74d088c6c67ed0ecf3d4850feb2b806d34c8df3f50108656a34ab2148c99fab8"}
Jul 15 13:07:24.180557 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:24.180528    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 13:07:24.287863 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:24.287838    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 13:07:25.088017 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:25.087982    2559 generic.go:356] "Generic (PLEG): container finished" podID="7b8af7c2-08ee-471e-8132-a399be259fa2" containerID="e9b5127899383cb80728307221a4bfd5e1da242edc75977f162076ef460cf788" exitCode=0
Jul 15 13:07:25.088216 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:25.088053    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-70ed7b-7tswt" event={"ID":"7b8af7c2-08ee-471e-8132-a399be259fa2","Type":"ContainerDied","Data":"e9b5127899383cb80728307221a4bfd5e1da242edc75977f162076ef460cf788"}
Jul 15 13:07:26.218112 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:26.218090    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-70ed7b-7tswt"
Jul 15 13:07:26.286615 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:26.286587    2559 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b8af7c2-08ee-471e-8132-a399be259fa2-maas-api-service-ca\") pod \"7b8af7c2-08ee-471e-8132-a399be259fa2\" (UID: \"7b8af7c2-08ee-471e-8132-a399be259fa2\") "
Jul 15 13:07:26.286953 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:26.286928    2559 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/7b8af7c2-08ee-471e-8132-a399be259fa2-maas-api-service-ca" (OuterVolumeSpecName: "maas-api-service-ca") pod "7b8af7c2-08ee-471e-8132-a399be259fa2" (UID: "7b8af7c2-08ee-471e-8132-a399be259fa2"). InnerVolumeSpecName "maas-api-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 15 13:07:26.387469 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:26.387382    2559 reconciler_common.go:299] "Volume detached for volume \"maas-api-service-ca\" (UniqueName: \"kubernetes.io/configmap/7b8af7c2-08ee-471e-8132-a399be259fa2-maas-api-service-ca\") on node \"ip-10-0-140-67.ec2.internal\" DevicePath \"\""
Jul 15 13:07:27.099693 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:27.099667    2559 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-70ed7b-7tswt"
Jul 15 13:07:27.099850 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:27.099703    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-revoke-keys-e2e-shared-b-70ed7b-7tswt" event={"ID":"7b8af7c2-08ee-471e-8132-a399be259fa2","Type":"ContainerDied","Data":"74d088c6c67ed0ecf3d4850feb2b806d34c8df3f50108656a34ab2148c99fab8"}
Jul 15 13:07:27.099850 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:27.099750    2559 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="74d088c6c67ed0ecf3d4850feb2b806d34c8df3f50108656a34ab2148c99fab8"
Jul 15 13:07:30.754333 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:30.754299    2559 scope.go:117] "RemoveContainer" containerID="43011c516dc6a3a0e1321f6211d7949e4a42ec2fd2fbb5e4976fd8f5f79fd0fa"
Jul 15 13:07:34.035190 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:34.035160    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 13:07:34.043508 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:34.043479    2559 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-70ed7b-29735340-bngts"]
Jul 15 13:07:34.047577 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:34.047554    2559 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-70ed7b-29735340-bngts"]
Jul 15 13:07:34.588539 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:34.588507    2559 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e165a78e-8df1-44ec-996b-9027f2d230f1" path="/var/lib/kubelet/pods/e165a78e-8df1-44ec-996b-9027f2d230f1/volumes"
Jul 15 13:07:37.245533 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:37.245492    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-nbghp"]
Jul 15 13:07:38.584108 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:38.584078    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 13:07:47.601267 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:47.601235    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 13:07:47.666199 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:47.666154    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 13:07:49.271037 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:49.271012    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 13:07:49.507944 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:49.507911    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 13:07:49.911769 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:49.911736    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5c6cd74488-hqw2x_37f90423-8f45-45cb-8bd6-b07c02618515/authorino/0.log"
Jul 15 13:07:56.229977 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:56.229951    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f56ddd455-x5ptk_24648ba5-de32-4acd-bc6a-328322102365/copy-manifests/0.log"
Jul 15 13:07:56.237253 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:56.237234    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f56ddd455-x5ptk_24648ba5-de32-4acd-bc6a-328322102365/manager/0.log"
Jul 15 13:07:56.820012 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:56.819987    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29735340-486h9_6d6807e1-1542-40ed-8f15-d8df411544e2/cleanup/0.log"
Jul 15 13:07:57.037428 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:57.037397    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-ait-691083d1-qc7n5_2f398458-9027-4770-82ce-81163f584cd2/revoke-keys/0.log"
Jul 15 13:07:57.145026 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:57.144950    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-a-d0ed97-7w5kb_950c8c6b-3099-4ab8-bbc0-de97467712ab/revoke-keys/0.log"
Jul 15 13:07:57.253744 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:57.253712    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-api-b-aed9ee-wnjhj_645532a9-c72f-41a0-b357-8a9f0abd130e/revoke-keys/0.log"
Jul 15 13:07:57.366888 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:57.366858    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-derive-a074e0bb-5lh5n_00ebf612-43d4-48e9-bee7-516f8764f094/revoke-keys/0.log"
Jul 15 13:07:57.593786 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:57.593757    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-inf-b-ee3fe5-ccq9p_859ab969-f1cc-4d45-bf16-5984d2617ece/revoke-keys/0.log"
Jul 15 13:07:57.704823 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:57.704795    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-migrate-907cfafc-8mrcv_54dcf7ed-334d-40d7-801f-0e5d9a8a2a73/revoke-keys/0.log"
Jul 15 13:07:57.814577 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:57.814551    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-1f25dafc-vczm6_7b8d0004-31a4-4f43-83ea-66f20d862c6d/revoke-keys/0.log"
Jul 15 13:07:57.921504 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:57.921431    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-mt-8a28be15-cpgfl_40663aa0-27d9-4f4e-9e46-2ace56bada46/revoke-keys/0.log"
Jul 15 13:07:58.032570 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:58.032542    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-a-3af497-rbb59_df32a8bf-47b0-4691-bf65-b9200ce73ce6/revoke-keys/0.log"
Jul 15 13:07:58.141661 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:58.141631    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-revoke-keys-e2e-shared-b-70ed7b-7tswt_7b8af7c2-08ee-471e-8132-a399be259fa2/revoke-keys/0.log"
Jul 15 13:07:59.530291 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:59.530257    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5c6cd74488-hqw2x_37f90423-8f45-45cb-8bd6-b07c02618515/authorino/0.log"
Jul 15 13:07:59.647765 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:07:59.647724    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-mgc8t_2e4fa205-1279-4e67-bcf8-feb81a023b5b/manager/0.log"
Jul 15 13:08:00.235147 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:00.235118    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-nbghp_15f9d695-6430-4f27-b41c-f3b93a14207f/limitador/0.log"
Jul 15 13:08:00.944384 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:00.944332    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6c484c84b4-5rh5h_22eac3d8-e8df-443c-99d0-15237dc20453/kube-auth-proxy/0.log"
Jul 15 13:08:02.438297 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:02.438267    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_premium-simulated-simulated-premium-kserve-5fc6fb456f-44mnc_94bf6677-5a99-4a4a-8cf0-d64b7af3253d/main/0.log"
Jul 15 13:08:07.454104 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:07.454070    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8mxws/must-gather-g6kzj"]
Jul 15 13:08:07.454589 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:07.454382    2559 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b8af7c2-08ee-471e-8132-a399be259fa2" containerName="revoke-keys"
Jul 15 13:08:07.454589 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:07.454398    2559 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b8af7c2-08ee-471e-8132-a399be259fa2" containerName="revoke-keys"
Jul 15 13:08:07.454589 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:07.454478    2559 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b8af7c2-08ee-471e-8132-a399be259fa2" containerName="revoke-keys"
Jul 15 13:08:07.457738 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:07.457718    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8mxws/must-gather-g6kzj"
Jul 15 13:08:07.461601 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:07.461583    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8mxws\"/\"kube-root-ca.crt\""
Jul 15 13:08:07.461730 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:07.461696    2559 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-8mxws\"/\"default-dockercfg-7bjhq\""
Jul 15 13:08:07.462489 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:07.462473    2559 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-8mxws\"/\"openshift-service-ca.crt\""
Jul 15 13:08:07.473865 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:07.473846    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8mxws/must-gather-g6kzj"]
Jul 15 13:08:07.482490 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:07.482468    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 13:08:07.522130 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:07.522103    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0173d11c-800e-47d5-8240-e3025fdcd9b2-must-gather-output\") pod \"must-gather-g6kzj\" (UID: \"0173d11c-800e-47d5-8240-e3025fdcd9b2\") " pod="openshift-must-gather-8mxws/must-gather-g6kzj"
Jul 15 13:08:07.522286 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:07.522154    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bcnkb\" (UniqueName: \"kubernetes.io/projected/0173d11c-800e-47d5-8240-e3025fdcd9b2-kube-api-access-bcnkb\") pod \"must-gather-g6kzj\" (UID: \"0173d11c-800e-47d5-8240-e3025fdcd9b2\") " pod="openshift-must-gather-8mxws/must-gather-g6kzj"
Jul 15 13:08:07.576254 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:07.576219    2559 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log" limit=1024
Jul 15 13:08:07.623563 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:07.623527    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bcnkb\" (UniqueName: \"kubernetes.io/projected/0173d11c-800e-47d5-8240-e3025fdcd9b2-kube-api-access-bcnkb\") pod \"must-gather-g6kzj\" (UID: \"0173d11c-800e-47d5-8240-e3025fdcd9b2\") " pod="openshift-must-gather-8mxws/must-gather-g6kzj"
Jul 15 13:08:07.623754 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:07.623619    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0173d11c-800e-47d5-8240-e3025fdcd9b2-must-gather-output\") pod \"must-gather-g6kzj\" (UID: \"0173d11c-800e-47d5-8240-e3025fdcd9b2\") " pod="openshift-must-gather-8mxws/must-gather-g6kzj"
Jul 15 13:08:07.623979 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:07.623960    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"must-gather-output\" (UniqueName: \"kubernetes.io/empty-dir/0173d11c-800e-47d5-8240-e3025fdcd9b2-must-gather-output\") pod \"must-gather-g6kzj\" (UID: \"0173d11c-800e-47d5-8240-e3025fdcd9b2\") " pod="openshift-must-gather-8mxws/must-gather-g6kzj"
Jul 15 13:08:07.632299 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:07.632273    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bcnkb\" (UniqueName: \"kubernetes.io/projected/0173d11c-800e-47d5-8240-e3025fdcd9b2-kube-api-access-bcnkb\") pod \"must-gather-g6kzj\" (UID: \"0173d11c-800e-47d5-8240-e3025fdcd9b2\") " pod="openshift-must-gather-8mxws/must-gather-g6kzj"
Jul 15 13:08:07.766416 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:07.766381    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8mxws/must-gather-g6kzj"
Jul 15 13:08:07.894109 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:07.894088    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8mxws/must-gather-g6kzj"]
Jul 15 13:08:07.896010 ip-10-0-140-67 kubenswrapper[2559]: W0715 13:08:07.895985    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod0173d11c_800e_47d5_8240_e3025fdcd9b2.slice/crio-013eef1b0ed0558c8f6d44c69ea1a8887411963f68a83c56a1b85d24f417dde2 WatchSource:0}: Error finding container 013eef1b0ed0558c8f6d44c69ea1a8887411963f68a83c56a1b85d24f417dde2: Status 404 returned error can't find the container with id 013eef1b0ed0558c8f6d44c69ea1a8887411963f68a83c56a1b85d24f417dde2
Jul 15 13:08:08.296226 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:08.296191    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8mxws/must-gather-g6kzj" event={"ID":"0173d11c-800e-47d5-8240-e3025fdcd9b2","Type":"ContainerStarted","Data":"013eef1b0ed0558c8f6d44c69ea1a8887411963f68a83c56a1b85d24f417dde2"}
Jul 15 13:08:09.302426 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:09.302389    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8mxws/must-gather-g6kzj" event={"ID":"0173d11c-800e-47d5-8240-e3025fdcd9b2","Type":"ContainerStarted","Data":"f245531fdc0de1eb6343de62d1e7d38ecec2a3952ff4565b2b594c6d6ffc3f0a"}
Jul 15 13:08:09.302925 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:09.302440    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8mxws/must-gather-g6kzj" event={"ID":"0173d11c-800e-47d5-8240-e3025fdcd9b2","Type":"ContainerStarted","Data":"55528bf525c2125daadeda24626088940370c315bfc143feb8b50634cb122513"}
Jul 15 13:08:09.821582 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:09.821512    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8mxws/must-gather-g6kzj" podStartSLOduration=2.011889876 podStartE2EDuration="2.821488485s" totalImagesPullingTime="809.598609ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 13:08:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:08:09.818748843 +0000 UTC m=+2859.791320002" watchObservedRunningTime="2026-07-15 13:08:09.821488485 +0000 UTC m=+2859.794059657"
Jul 15 13:08:11.149954 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:11.149922    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-8ghwr_df4bf5c7-9413-4a70-8d17-9eaca62b4373/global-pull-secret-syncer/0.log"
Jul 15 13:08:11.209045 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:11.209012    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-ckzbm_712fac2c-94a4-4863-84b0-d251b4fcd155/konnectivity-agent/0.log"
Jul 15 13:08:11.354572 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:11.354532    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-67.ec2.internal_52d9088551c115f98811f24856a62fc9/haproxy/0.log"
Jul 15 13:08:15.966109 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:15.963737    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-5c6cd74488-hqw2x_37f90423-8f45-45cb-8bd6-b07c02618515/authorino/0.log"
Jul 15 13:08:16.004834 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:16.004805    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-mgc8t_2e4fa205-1279-4e67-bcf8-feb81a023b5b/manager/0.log"
Jul 15 13:08:16.271450 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:16.271355    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-nbghp_15f9d695-6430-4f27-b41c-f3b93a14207f/limitador/0.log"
Jul 15 13:08:18.505010 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:18.504925    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-lz79j_2dce94f6-6164-470e-b10e-11c38e8d9079/monitoring-plugin/0.log"
Jul 15 13:08:18.629760 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:18.629730    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9bjhz_7590b1af-34ef-4426-bad8-b6267195e1ff/node-exporter/0.log"
Jul 15 13:08:18.653862 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:18.653834    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9bjhz_7590b1af-34ef-4426-bad8-b6267195e1ff/kube-rbac-proxy/0.log"
Jul 15 13:08:18.680845 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:18.680817    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-9bjhz_7590b1af-34ef-4426-bad8-b6267195e1ff/init-textfile/0.log"
Jul 15 13:08:18.915273 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:18.915199    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d835edf7-920f-45dd-add2-567e986269f5/prometheus/0.log"
Jul 15 13:08:18.946997 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:18.946936    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d835edf7-920f-45dd-add2-567e986269f5/config-reloader/0.log"
Jul 15 13:08:18.970851 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:18.970827    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d835edf7-920f-45dd-add2-567e986269f5/thanos-sidecar/0.log"
Jul 15 13:08:18.996030 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:18.995973    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d835edf7-920f-45dd-add2-567e986269f5/kube-rbac-proxy-web/0.log"
Jul 15 13:08:19.022194 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:19.022163    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d835edf7-920f-45dd-add2-567e986269f5/kube-rbac-proxy/0.log"
Jul 15 13:08:19.046161 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:19.046140    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d835edf7-920f-45dd-add2-567e986269f5/kube-rbac-proxy-thanos/0.log"
Jul 15 13:08:19.068536 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:19.068501    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_d835edf7-920f-45dd-add2-567e986269f5/init-config-reloader/0.log"
Jul 15 13:08:19.100549 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:19.100503    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-wwt49_19aaff9c-cf93-40c2-bbcb-d22df6cc0c20/prometheus-operator/0.log"
Jul 15 13:08:19.121786 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:19.121747    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-wwt49_19aaff9c-cf93-40c2-bbcb-d22df6cc0c20/kube-rbac-proxy/0.log"
Jul 15 13:08:19.149463 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:19.149331    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-admission-webhook-77d98bc786-5kvn4_c0c7b146-9d0d-4ff6-8fba-6628314b35dc/prometheus-operator-admission-webhook/0.log"
Jul 15 13:08:20.927987 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:20.927954    2559 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-8mxws/perf-node-gather-daemonset-xpvx5"]
Jul 15 13:08:20.934190 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:20.934160    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8mxws/perf-node-gather-daemonset-xpvx5"
Jul 15 13:08:20.941218 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:20.941188    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8mxws/perf-node-gather-daemonset-xpvx5"]
Jul 15 13:08:21.070694 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:21.070640    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8d335157-af3a-4000-b80e-80ff6a3bbbca-sys\") pod \"perf-node-gather-daemonset-xpvx5\" (UID: \"8d335157-af3a-4000-b80e-80ff6a3bbbca\") " pod="openshift-must-gather-8mxws/perf-node-gather-daemonset-xpvx5"
Jul 15 13:08:21.070889 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:21.070737    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8d335157-af3a-4000-b80e-80ff6a3bbbca-proc\") pod \"perf-node-gather-daemonset-xpvx5\" (UID: \"8d335157-af3a-4000-b80e-80ff6a3bbbca\") " pod="openshift-must-gather-8mxws/perf-node-gather-daemonset-xpvx5"
Jul 15 13:08:21.070889 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:21.070771    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8d335157-af3a-4000-b80e-80ff6a3bbbca-lib-modules\") pod \"perf-node-gather-daemonset-xpvx5\" (UID: \"8d335157-af3a-4000-b80e-80ff6a3bbbca\") " pod="openshift-must-gather-8mxws/perf-node-gather-daemonset-xpvx5"
Jul 15 13:08:21.070889 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:21.070820    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9k4f\" (UniqueName: \"kubernetes.io/projected/8d335157-af3a-4000-b80e-80ff6a3bbbca-kube-api-access-b9k4f\") pod \"perf-node-gather-daemonset-xpvx5\" (UID: \"8d335157-af3a-4000-b80e-80ff6a3bbbca\") " pod="openshift-must-gather-8mxws/perf-node-gather-daemonset-xpvx5"
Jul 15 13:08:21.070889 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:21.070845    2559 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8d335157-af3a-4000-b80e-80ff6a3bbbca-podres\") pod \"perf-node-gather-daemonset-xpvx5\" (UID: \"8d335157-af3a-4000-b80e-80ff6a3bbbca\") " pod="openshift-must-gather-8mxws/perf-node-gather-daemonset-xpvx5"
Jul 15 13:08:21.172037 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:21.171999    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9k4f\" (UniqueName: \"kubernetes.io/projected/8d335157-af3a-4000-b80e-80ff6a3bbbca-kube-api-access-b9k4f\") pod \"perf-node-gather-daemonset-xpvx5\" (UID: \"8d335157-af3a-4000-b80e-80ff6a3bbbca\") " pod="openshift-must-gather-8mxws/perf-node-gather-daemonset-xpvx5"
Jul 15 13:08:21.172239 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:21.172053    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8d335157-af3a-4000-b80e-80ff6a3bbbca-podres\") pod \"perf-node-gather-daemonset-xpvx5\" (UID: \"8d335157-af3a-4000-b80e-80ff6a3bbbca\") " pod="openshift-must-gather-8mxws/perf-node-gather-daemonset-xpvx5"
Jul 15 13:08:21.172239 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:21.172119    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8d335157-af3a-4000-b80e-80ff6a3bbbca-sys\") pod \"perf-node-gather-daemonset-xpvx5\" (UID: \"8d335157-af3a-4000-b80e-80ff6a3bbbca\") " pod="openshift-must-gather-8mxws/perf-node-gather-daemonset-xpvx5"
Jul 15 13:08:21.172239 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:21.172176    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8d335157-af3a-4000-b80e-80ff6a3bbbca-proc\") pod \"perf-node-gather-daemonset-xpvx5\" (UID: \"8d335157-af3a-4000-b80e-80ff6a3bbbca\") " pod="openshift-must-gather-8mxws/perf-node-gather-daemonset-xpvx5"
Jul 15 13:08:21.172239 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:21.172199    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/8d335157-af3a-4000-b80e-80ff6a3bbbca-podres\") pod \"perf-node-gather-daemonset-xpvx5\" (UID: \"8d335157-af3a-4000-b80e-80ff6a3bbbca\") " pod="openshift-must-gather-8mxws/perf-node-gather-daemonset-xpvx5"
Jul 15 13:08:21.172239 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:21.172206    2559 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8d335157-af3a-4000-b80e-80ff6a3bbbca-lib-modules\") pod \"perf-node-gather-daemonset-xpvx5\" (UID: \"8d335157-af3a-4000-b80e-80ff6a3bbbca\") " pod="openshift-must-gather-8mxws/perf-node-gather-daemonset-xpvx5"
Jul 15 13:08:21.172589 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:21.172241    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/8d335157-af3a-4000-b80e-80ff6a3bbbca-sys\") pod \"perf-node-gather-daemonset-xpvx5\" (UID: \"8d335157-af3a-4000-b80e-80ff6a3bbbca\") " pod="openshift-must-gather-8mxws/perf-node-gather-daemonset-xpvx5"
Jul 15 13:08:21.172589 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:21.172305    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/8d335157-af3a-4000-b80e-80ff6a3bbbca-proc\") pod \"perf-node-gather-daemonset-xpvx5\" (UID: \"8d335157-af3a-4000-b80e-80ff6a3bbbca\") " pod="openshift-must-gather-8mxws/perf-node-gather-daemonset-xpvx5"
Jul 15 13:08:21.172589 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:21.172315    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/8d335157-af3a-4000-b80e-80ff6a3bbbca-lib-modules\") pod \"perf-node-gather-daemonset-xpvx5\" (UID: \"8d335157-af3a-4000-b80e-80ff6a3bbbca\") " pod="openshift-must-gather-8mxws/perf-node-gather-daemonset-xpvx5"
Jul 15 13:08:21.183086 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:21.183008    2559 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9k4f\" (UniqueName: \"kubernetes.io/projected/8d335157-af3a-4000-b80e-80ff6a3bbbca-kube-api-access-b9k4f\") pod \"perf-node-gather-daemonset-xpvx5\" (UID: \"8d335157-af3a-4000-b80e-80ff6a3bbbca\") " pod="openshift-must-gather-8mxws/perf-node-gather-daemonset-xpvx5"
Jul 15 13:08:21.251677 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:21.251649    2559 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-8mxws/perf-node-gather-daemonset-xpvx5"
Jul 15 13:08:21.451676 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:21.451643    2559 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-8mxws/perf-node-gather-daemonset-xpvx5"]
Jul 15 13:08:21.454408 ip-10-0-140-67 kubenswrapper[2559]: W0715 13:08:21.454377    2559 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod8d335157_af3a_4000_b80e_80ff6a3bbbca.slice/crio-868761b8ad0e434fdda92335a63be0948f91f973d90579bd96065a6d149a6063 WatchSource:0}: Error finding container 868761b8ad0e434fdda92335a63be0948f91f973d90579bd96065a6d149a6063: Status 404 returned error can't find the container with id 868761b8ad0e434fdda92335a63be0948f91f973d90579bd96065a6d149a6063
Jul 15 13:08:21.825775 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:21.825743    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-69945c44d-xf8x8_f4b0861d-323c-4d1a-8bbe-b3de874b595d/console/0.log"
Jul 15 13:08:21.862769 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:21.862736    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-n6j58_40930240-d18f-4a26-a9fe-37807e26fc01/download-server/0.log"
Jul 15 13:08:22.394174 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:22.394137    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8mxws/perf-node-gather-daemonset-xpvx5" event={"ID":"8d335157-af3a-4000-b80e-80ff6a3bbbca","Type":"ContainerStarted","Data":"4b16f48ed39276b513707d6e7ac75915c62a4534d7565e2c50cd54f2cba8de44"}
Jul 15 13:08:22.394775 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:22.394743    2559 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-8mxws/perf-node-gather-daemonset-xpvx5" event={"ID":"8d335157-af3a-4000-b80e-80ff6a3bbbca","Type":"ContainerStarted","Data":"868761b8ad0e434fdda92335a63be0948f91f973d90579bd96065a6d149a6063"}
Jul 15 13:08:22.394879 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:22.394789    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-8mxws/perf-node-gather-daemonset-xpvx5"
Jul 15 13:08:23.610858 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:23.610830    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-95f4q_30e01808-eee5-4f36-b335-fbb9a7d9b9db/dns/0.log"
Jul 15 13:08:23.637162 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:23.637129    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-95f4q_30e01808-eee5-4f36-b335-fbb9a7d9b9db/kube-rbac-proxy/0.log"
Jul 15 13:08:23.772902 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:23.772874    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-qfb4c_b7a79dc6-aa77-49fa-87dd-08ed78b9f4f5/dns-node-resolver/0.log"
Jul 15 13:08:24.364922 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:24.364874    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-bctct_f2f64511-8f06-4610-a112-0cd46f0fd503/node-ca/0.log"
Jul 15 13:08:25.599205 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:25.599176    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6c484c84b4-5rh5h_22eac3d8-e8df-443c-99d0-15237dc20453/kube-auth-proxy/0.log"
Jul 15 13:08:26.572449 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:26.572349    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-vk2s9_17004ef7-ba8a-417e-b928-f9b789137824/serve-healthcheck-canary/0.log"
Jul 15 13:08:27.275992 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:27.275938    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wgkkl_caf85504-b314-4a69-a6e2-e4fb79f5a561/kube-rbac-proxy/0.log"
Jul 15 13:08:27.298723 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:27.298689    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wgkkl_caf85504-b314-4a69-a6e2-e4fb79f5a561/exporter/0.log"
Jul 15 13:08:27.321569 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:27.321539    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-wgkkl_caf85504-b314-4a69-a6e2-e4fb79f5a561/extractor/0.log"
Jul 15 13:08:28.412337 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:28.412312    2559 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-8mxws/perf-node-gather-daemonset-xpvx5"
Jul 15 13:08:28.430050 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:28.429993    2559 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-8mxws/perf-node-gather-daemonset-xpvx5" podStartSLOduration=8.429971447 podStartE2EDuration="8.429971447s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 13:08:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 13:08:22.41523182 +0000 UTC m=+2872.387803003" watchObservedRunningTime="2026-07-15 13:08:28.429971447 +0000 UTC m=+2878.402542606"
Jul 15 13:08:30.241357 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:30.241323    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f56ddd455-x5ptk_24648ba5-de32-4acd-bc6a-328322102365/manager/0.log"
Jul 15 13:08:30.266177 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:30.266140    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f56ddd455-x5ptk_24648ba5-de32-4acd-bc6a-328322102365/copy-manifests/0.log"
Jul 15 13:08:30.790707 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:30.790676    2559 scope.go:117] "RemoveContainer" containerID="3d4f2fa33ddd2a99f6f52835993c3082afde631771e36394bcb705ce3e7fd42c"
Jul 15 13:08:31.646918 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:31.646882    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-595c7f4b4c-dc6tc_d033e7a0-e799-4c2a-841a-f44eb31eac6e/manager/0.log"
Jul 15 13:08:31.657377 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:31.657344    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6c484c84b4-5rh5h_22eac3d8-e8df-443c-99d0-15237dc20453/kube-auth-proxy/0.log"
Jul 15 13:08:33.254818 ip-10-0-140-67 kubenswrapper[2559]: I0715 13:08:33.254787    2559 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-6c484c84b4-5rh5h_22eac3d8-e8df-443c-99d0-15237dc20453/kube-auth-proxy/0.log"