Jul 07 17:05:41.836789 ip-10-0-140-36 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory
Jul 07 17:05:41.836800 ip-10-0-140-36 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory
Jul 07 17:05:41.836809 ip-10-0-140-36 systemd[1]: kubelet.service: Failed with result 'resources'.
Jul 07 17:05:41.837138 ip-10-0-140-36 systemd[1]: Failed to start Kubernetes Kubelet.
Jul 07 17:05:51.967520 ip-10-0-140-36 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found.
Jul 07 17:05:51.967540 ip-10-0-140-36 systemd[1]: kubelet.service: Failed with result 'resources'.
-- Boot 8fc4c947ab8a4eec82f82335edfd11a5 --
Jul 07 17:07:55.177475 ip-10-0-140-36 systemd[1]: Starting Kubernetes Kubelet...
Jul 07 17:07:55.596296 ip-10-0-140-36 systemd[1]: Started Kubernetes Kubelet.
Jul 07 17:07:55.635438 ip-10-0-140-36 kubenswrapper[2562]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 17:07:55.635438 ip-10-0-140-36 kubenswrapper[2562]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version.
Jul 07 17:07:55.635438 ip-10-0-140-36 kubenswrapper[2562]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 17:07:55.635438 ip-10-0-140-36 kubenswrapper[2562]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI.
Jul 07 17:07:55.635438 ip-10-0-140-36 kubenswrapper[2562]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information.
Jul 07 17:07:55.635438 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.519174    2562 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime"
Jul 07 17:07:55.635438 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523557    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 17:07:55.635438 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523574    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 17:07:55.635438 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523580    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 17:07:55.635438 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523583    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 17:07:55.635438 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523587    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 17:07:55.635438 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523589    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 17:07:55.635438 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523592    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 17:07:55.635438 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523595    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 17:07:55.637415 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523598    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 17:07:55.637415 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523601    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 17:07:55.637415 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523604    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 17:07:55.637415 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523607    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 17:07:55.637415 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523610    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 17:07:55.637415 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523613    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 17:07:55.637415 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523616    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 17:07:55.637415 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523626    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 17:07:55.637415 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523631    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 17:07:55.637415 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523635    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 17:07:55.637415 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523638    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 17:07:55.637415 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523641    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 17:07:55.637415 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523645    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 17:07:55.637415 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523648    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 17:07:55.637415 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523651    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 17:07:55.637415 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523654    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 17:07:55.637415 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523657    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 17:07:55.637415 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523660    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 17:07:55.637415 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523663    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 17:07:55.638170 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523665    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 17:07:55.638170 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523668    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 17:07:55.638170 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523670    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 17:07:55.638170 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523673    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 17:07:55.638170 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523675    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 17:07:55.638170 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523678    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 17:07:55.638170 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523681    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 17:07:55.638170 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523683    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 17:07:55.638170 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523686    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 17:07:55.638170 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523689    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 17:07:55.638170 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523691    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 17:07:55.638170 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523694    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 17:07:55.638170 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523696    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 17:07:55.638170 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523699    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 17:07:55.638170 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523702    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 17:07:55.638170 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523704    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 17:07:55.638170 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523708    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 17:07:55.638170 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523711    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 17:07:55.638170 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523714    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 17:07:55.638170 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523717    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 17:07:55.638871 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523720    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 17:07:55.638871 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523723    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 17:07:55.638871 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523726    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 17:07:55.638871 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523730    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 17:07:55.638871 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523733    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 17:07:55.638871 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523736    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 17:07:55.638871 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523739    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 17:07:55.638871 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523741    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 17:07:55.638871 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523744    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 17:07:55.638871 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523747    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 17:07:55.638871 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523749    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 17:07:55.638871 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523751    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 17:07:55.638871 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523754    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 17:07:55.638871 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523757    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 17:07:55.638871 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523760    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 17:07:55.638871 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523763    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 17:07:55.638871 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523765    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 17:07:55.638871 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523768    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 17:07:55.638871 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523771    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 17:07:55.638871 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523773    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 17:07:55.639787 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523776    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 17:07:55.639787 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523779    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 17:07:55.639787 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523782    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 17:07:55.639787 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523785    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 17:07:55.639787 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523788    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 17:07:55.639787 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523791    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 17:07:55.639787 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523794    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 17:07:55.639787 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523799    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 17:07:55.639787 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523802    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 17:07:55.639787 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523804    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 17:07:55.639787 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523807    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 17:07:55.639787 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523810    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 17:07:55.639787 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523812    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 17:07:55.639787 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523815    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 17:07:55.639787 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523818    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 17:07:55.639787 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523820    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 17:07:55.639787 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523823    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 17:07:55.639787 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523826    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 17:07:55.639787 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523829    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 17:07:55.639787 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523832    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 17:07:55.640643 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523836    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 17:07:55.640643 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523840    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 17:07:55.640643 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523843    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 17:07:55.640643 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523846    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 17:07:55.640643 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523849    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 17:07:55.640643 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523852    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 17:07:55.640643 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523855    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 17:07:55.640643 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523857    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 17:07:55.640643 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523859    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 17:07:55.640643 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523862    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 17:07:55.640643 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523864    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 17:07:55.640643 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.523867    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 17:07:55.640643 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524602    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 17:07:55.640643 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524609    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 17:07:55.640643 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524612    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 17:07:55.640643 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524615    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 17:07:55.640643 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524618    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 17:07:55.640643 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524623    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 17:07:55.640643 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524627    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 17:07:55.641464 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524631    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 17:07:55.641464 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524634    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 17:07:55.641464 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524637    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 17:07:55.641464 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524640    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 17:07:55.641464 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524643    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 17:07:55.641464 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524646    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 17:07:55.641464 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524649    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 17:07:55.641464 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524652    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 17:07:55.641464 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524655    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 17:07:55.641464 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524658    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 17:07:55.641464 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524661    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 17:07:55.641464 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524664    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 17:07:55.641464 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524666    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 17:07:55.641464 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524669    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 17:07:55.641464 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524672    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 17:07:55.641464 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524674    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 17:07:55.641464 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524677    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 17:07:55.641464 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524679    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 17:07:55.641464 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524683    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 17:07:55.641464 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524686    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 17:07:55.642330 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524689    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 17:07:55.642330 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524692    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 17:07:55.642330 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524695    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 17:07:55.642330 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524698    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 17:07:55.642330 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524701    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 17:07:55.642330 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524703    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 17:07:55.642330 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524706    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 17:07:55.642330 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524709    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 17:07:55.642330 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524711    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 17:07:55.642330 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524714    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 17:07:55.642330 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524717    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 17:07:55.642330 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524719    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 17:07:55.642330 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524722    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 17:07:55.642330 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524725    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 17:07:55.642330 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524728    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 17:07:55.642330 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524730    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 17:07:55.642330 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524733    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 17:07:55.642330 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524735    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 17:07:55.642330 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524738    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 17:07:55.642330 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524741    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 17:07:55.643105 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524743    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 17:07:55.643105 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524746    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 17:07:55.643105 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524748    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 17:07:55.643105 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524751    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 17:07:55.643105 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524754    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 17:07:55.643105 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524756    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 17:07:55.643105 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524760    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 17:07:55.643105 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524763    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 17:07:55.643105 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524765    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 17:07:55.643105 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524768    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 17:07:55.643105 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524773    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 17:07:55.643105 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524778    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 17:07:55.643105 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524781    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 17:07:55.643105 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524785    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 17:07:55.643105 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524788    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 17:07:55.643105 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524792    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 17:07:55.643105 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524795    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 17:07:55.643105 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524798    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 17:07:55.643105 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524802    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 17:07:55.643757 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524804    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 17:07:55.643757 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524807    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 17:07:55.643757 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524810    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 17:07:55.643757 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524813    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 17:07:55.643757 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524816    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 17:07:55.643757 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524819    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 17:07:55.643757 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524823    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 17:07:55.643757 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524827    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 17:07:55.643757 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524830    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 17:07:55.643757 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524832    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 17:07:55.643757 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524835    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 17:07:55.643757 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524838    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 17:07:55.643757 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524840    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 17:07:55.643757 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524843    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 17:07:55.643757 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524846    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 17:07:55.643757 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524849    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 17:07:55.643757 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524852    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 17:07:55.643757 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524855    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 17:07:55.643757 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524857    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 17:07:55.643757 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524860    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 17:07:55.644451 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524862    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 17:07:55.644451 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524865    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 17:07:55.644451 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524867    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 17:07:55.644451 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524870    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 17:07:55.644451 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524873    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 17:07:55.644451 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524875    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 17:07:55.644451 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524878    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 17:07:55.644451 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524881    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 17:07:55.644451 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524883    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 17:07:55.644451 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524886    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 17:07:55.644451 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524888    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 17:07:55.644451 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524890    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 17:07:55.644451 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.524893    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 17:07:55.644451 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525402    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 17:07:55.644451 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525409    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 17:07:55.644451 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525412    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 17:07:55.644451 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525416    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 17:07:55.644451 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525419    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 17:07:55.644451 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525423    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 17:07:55.644451 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525427    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 17:07:55.644451 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525430    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 17:07:55.645159 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525433    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 17:07:55.645159 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525436    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 17:07:55.645159 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525438    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 17:07:55.645159 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525441    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 17:07:55.645159 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525443    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 17:07:55.645159 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525446    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 17:07:55.645159 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525449    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 17:07:55.645159 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525451    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 17:07:55.645159 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525454    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 17:07:55.645159 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525457    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 17:07:55.645159 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525460    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 17:07:55.645159 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525463    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 17:07:55.645159 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525465    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 17:07:55.645159 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525468    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 17:07:55.645159 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525471    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 17:07:55.645159 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525476    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 17:07:55.645159 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525479    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 17:07:55.645159 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525481    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 17:07:55.645159 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525486    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 17:07:55.645796 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525488    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 17:07:55.645796 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525491    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 17:07:55.645796 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525493    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 17:07:55.645796 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525496    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 17:07:55.645796 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525499    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 17:07:55.645796 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525501    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 17:07:55.645796 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525504    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 17:07:55.645796 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525507    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 17:07:55.645796 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525509    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 17:07:55.645796 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525512    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 17:07:55.645796 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525515    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 17:07:55.645796 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525518    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 17:07:55.645796 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525521    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 17:07:55.645796 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525523    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 17:07:55.645796 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525526    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 17:07:55.645796 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525529    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 17:07:55.645796 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525531    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 17:07:55.645796 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525534    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 17:07:55.645796 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525536    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 17:07:55.645796 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525539    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 17:07:55.646470 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525542    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 17:07:55.646470 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525544    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 17:07:55.646470 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525547    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 17:07:55.646470 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525549    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 17:07:55.646470 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525551    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 17:07:55.646470 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525554    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 17:07:55.646470 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525556    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 17:07:55.646470 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525559    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 17:07:55.646470 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525563    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 17:07:55.646470 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525565    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 17:07:55.646470 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525568    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 17:07:55.646470 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525572    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 17:07:55.646470 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525574    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 17:07:55.646470 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525577    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 17:07:55.646470 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525580    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 17:07:55.646470 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525582    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 17:07:55.646470 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525585    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 17:07:55.646470 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525587    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 17:07:55.646470 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525589    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 17:07:55.646470 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525592    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 17:07:55.647070 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525594    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 17:07:55.647070 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525597    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 17:07:55.647070 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525599    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 17:07:55.647070 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525603    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 17:07:55.647070 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525605    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 17:07:55.647070 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525607    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 17:07:55.647070 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525610    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 17:07:55.647070 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525612    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 17:07:55.647070 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525615    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 17:07:55.647070 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525617    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 17:07:55.647070 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525620    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 17:07:55.647070 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525622    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 17:07:55.647070 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525624    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 17:07:55.647070 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525627    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 17:07:55.647070 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525629    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 17:07:55.647070 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525633    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 17:07:55.647070 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525636    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 17:07:55.647070 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525640    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 17:07:55.647070 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525644    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 17:07:55.839085 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525648    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 17:07:55.839085 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525652    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 17:07:55.839085 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525655    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 17:07:55.839085 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525658    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 17:07:55.839085 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525663    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 17:07:55.839085 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525666    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 17:07:55.839085 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525669    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 17:07:55.839085 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525671    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 17:07:55.839085 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525674    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 17:07:55.839085 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525676    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 17:07:55.839085 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525679    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 17:07:55.839085 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525681    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 17:07:55.839085 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.525684    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 17:07:55.839085 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525754    2562 flags.go:64] FLAG: --address="0.0.0.0"
Jul 07 17:07:55.839085 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525762    2562 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]"
Jul 07 17:07:55.839085 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525768    2562 flags.go:64] FLAG: --anonymous-auth="true"
Jul 07 17:07:55.839085 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525773    2562 flags.go:64] FLAG: --application-metrics-count-limit="100"
Jul 07 17:07:55.839085 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525779    2562 flags.go:64] FLAG: --authentication-token-webhook="false"
Jul 07 17:07:55.839085 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525782    2562 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s"
Jul 07 17:07:55.839085 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525786    2562 flags.go:64] FLAG: --authorization-mode="AlwaysAllow"
Jul 07 17:07:55.839085 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525791    2562 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s"
Jul 07 17:07:55.855364 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525794    2562 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s"
Jul 07 17:07:55.855364 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525797    2562 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id"
Jul 07 17:07:55.855364 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525800    2562 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig"
Jul 07 17:07:55.855364 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525804    2562 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki"
Jul 07 17:07:55.855364 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525807    2562 flags.go:64] FLAG: --cgroup-driver="cgroupfs"
Jul 07 17:07:55.855364 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525810    2562 flags.go:64] FLAG: --cgroup-root=""
Jul 07 17:07:55.855364 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525813    2562 flags.go:64] FLAG: --cgroups-per-qos="true"
Jul 07 17:07:55.855364 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525816    2562 flags.go:64] FLAG: --client-ca-file=""
Jul 07 17:07:55.855364 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525819    2562 flags.go:64] FLAG: --cloud-provider="external"
Jul 07 17:07:55.855364 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525822    2562 flags.go:64] FLAG: --cluster-dns="[]"
Jul 07 17:07:55.855364 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525826    2562 flags.go:64] FLAG: --cluster-domain=""
Jul 07 17:07:55.855364 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525829    2562 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf"
Jul 07 17:07:55.855364 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525833    2562 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d"
Jul 07 17:07:55.855364 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525836    2562 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json"
Jul 07 17:07:55.855364 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525839    2562 flags.go:64] FLAG: --container-log-max-files="5"
Jul 07 17:07:55.855364 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525844    2562 flags.go:64] FLAG: --container-log-max-size="10Mi"
Jul 07 17:07:55.855364 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525847    2562 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock"
Jul 07 17:07:55.855364 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525851    2562 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock"
Jul 07 17:07:55.855364 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525854    2562 flags.go:64] FLAG: --containerd-namespace="k8s.io"
Jul 07 17:07:55.855364 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525857    2562 flags.go:64] FLAG: --contention-profiling="false"
Jul 07 17:07:55.855364 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525860    2562 flags.go:64] FLAG: --cpu-cfs-quota="true"
Jul 07 17:07:55.855364 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525863    2562 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms"
Jul 07 17:07:55.855364 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525866    2562 flags.go:64] FLAG: --cpu-manager-policy="none"
Jul 07 17:07:55.855364 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525869    2562 flags.go:64] FLAG: --cpu-manager-policy-options=""
Jul 07 17:07:55.856627 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525874    2562 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s"
Jul 07 17:07:55.856627 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525877    2562 flags.go:64] FLAG: --enable-controller-attach-detach="true"
Jul 07 17:07:55.856627 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525879    2562 flags.go:64] FLAG: --enable-debugging-handlers="true"
Jul 07 17:07:55.856627 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525883    2562 flags.go:64] FLAG: --enable-load-reader="false"
Jul 07 17:07:55.856627 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525886    2562 flags.go:64] FLAG: --enable-server="true"
Jul 07 17:07:55.856627 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525894    2562 flags.go:64] FLAG: --enforce-node-allocatable="[pods]"
Jul 07 17:07:55.856627 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525899    2562 flags.go:64] FLAG: --event-burst="100"
Jul 07 17:07:55.856627 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525902    2562 flags.go:64] FLAG: --event-qps="50"
Jul 07 17:07:55.856627 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525905    2562 flags.go:64] FLAG: --event-storage-age-limit="default=0"
Jul 07 17:07:55.856627 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525908    2562 flags.go:64] FLAG: --event-storage-event-limit="default=0"
Jul 07 17:07:55.856627 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525911    2562 flags.go:64] FLAG: --eviction-hard=""
Jul 07 17:07:55.856627 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525915    2562 flags.go:64] FLAG: --eviction-max-pod-grace-period="0"
Jul 07 17:07:55.856627 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525918    2562 flags.go:64] FLAG: --eviction-minimum-reclaim=""
Jul 07 17:07:55.856627 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525921    2562 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s"
Jul 07 17:07:55.856627 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525924    2562 flags.go:64] FLAG: --eviction-soft=""
Jul 07 17:07:55.856627 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525927    2562 flags.go:64] FLAG: --eviction-soft-grace-period=""
Jul 07 17:07:55.856627 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525930    2562 flags.go:64] FLAG: --exit-on-lock-contention="false"
Jul 07 17:07:55.856627 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525933    2562 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false"
Jul 07 17:07:55.856627 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525936    2562 flags.go:64] FLAG: --experimental-mounter-path=""
Jul 07 17:07:55.856627 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525939    2562 flags.go:64] FLAG: --fail-cgroupv1="false"
Jul 07 17:07:55.856627 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525943    2562 flags.go:64] FLAG: --fail-swap-on="true"
Jul 07 17:07:55.856627 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525946    2562 flags.go:64] FLAG: --feature-gates=""
Jul 07 17:07:55.856627 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525950    2562 flags.go:64] FLAG: --file-check-frequency="20s"
Jul 07 17:07:55.856627 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525954    2562 flags.go:64] FLAG: --global-housekeeping-interval="1m0s"
Jul 07 17:07:55.856627 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525957    2562 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge"
Jul 07 17:07:55.858040 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525960    2562 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1"
Jul 07 17:07:55.858040 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525963    2562 flags.go:64] FLAG: --healthz-port="10248"
Jul 07 17:07:55.858040 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525966    2562 flags.go:64] FLAG: --help="false"
Jul 07 17:07:55.858040 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525969    2562 flags.go:64] FLAG: --hostname-override="ip-10-0-140-36.ec2.internal"
Jul 07 17:07:55.858040 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525972    2562 flags.go:64] FLAG: --housekeeping-interval="10s"
Jul 07 17:07:55.858040 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525976    2562 flags.go:64] FLAG: --http-check-frequency="20s"
Jul 07 17:07:55.858040 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525979    2562 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins"
Jul 07 17:07:55.858040 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525982    2562 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml"
Jul 07 17:07:55.858040 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525986    2562 flags.go:64] FLAG: --image-gc-high-threshold="85"
Jul 07 17:07:55.858040 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525990    2562 flags.go:64] FLAG: --image-gc-low-threshold="80"
Jul 07 17:07:55.858040 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525992    2562 flags.go:64] FLAG: --image-service-endpoint=""
Jul 07 17:07:55.858040 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525995    2562 flags.go:64] FLAG: --kernel-memcg-notification="false"
Jul 07 17:07:55.858040 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.525998    2562 flags.go:64] FLAG: --kube-api-burst="100"
Jul 07 17:07:55.858040 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526002    2562 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf"
Jul 07 17:07:55.858040 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526005    2562 flags.go:64] FLAG: --kube-api-qps="50"
Jul 07 17:07:55.858040 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526008    2562 flags.go:64] FLAG: --kube-reserved=""
Jul 07 17:07:55.858040 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526011    2562 flags.go:64] FLAG: --kube-reserved-cgroup=""
Jul 07 17:07:55.858040 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526013    2562 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig"
Jul 07 17:07:55.858040 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526016    2562 flags.go:64] FLAG: --kubelet-cgroups=""
Jul 07 17:07:55.858040 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526019    2562 flags.go:64] FLAG: --local-storage-capacity-isolation="true"
Jul 07 17:07:55.858040 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526022    2562 flags.go:64] FLAG: --lock-file=""
Jul 07 17:07:55.858040 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526025    2562 flags.go:64] FLAG: --log-cadvisor-usage="false"
Jul 07 17:07:55.858040 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526028    2562 flags.go:64] FLAG: --log-flush-frequency="5s"
Jul 07 17:07:55.858040 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526031    2562 flags.go:64] FLAG: --log-json-info-buffer-size="0"
Jul 07 17:07:55.859238 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526036    2562 flags.go:64] FLAG: --log-json-split-stream="false"
Jul 07 17:07:55.859238 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526039    2562 flags.go:64] FLAG: --log-text-info-buffer-size="0"
Jul 07 17:07:55.859238 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526042    2562 flags.go:64] FLAG: --log-text-split-stream="false"
Jul 07 17:07:55.859238 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526047    2562 flags.go:64] FLAG: --logging-format="text"
Jul 07 17:07:55.859238 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526050    2562 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id"
Jul 07 17:07:55.859238 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526054    2562 flags.go:64] FLAG: --make-iptables-util-chains="true"
Jul 07 17:07:55.859238 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526058    2562 flags.go:64] FLAG: --manifest-url=""
Jul 07 17:07:55.859238 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526061    2562 flags.go:64] FLAG: --manifest-url-header=""
Jul 07 17:07:55.859238 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526065    2562 flags.go:64] FLAG: --max-housekeeping-interval="15s"
Jul 07 17:07:55.859238 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526068    2562 flags.go:64] FLAG: --max-open-files="1000000"
Jul 07 17:07:55.859238 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526072    2562 flags.go:64] FLAG: --max-pods="110"
Jul 07 17:07:55.859238 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526075    2562 flags.go:64] FLAG: --maximum-dead-containers="-1"
Jul 07 17:07:55.859238 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526078    2562 flags.go:64] FLAG: --maximum-dead-containers-per-container="1"
Jul 07 17:07:55.859238 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526081    2562 flags.go:64] FLAG: --memory-manager-policy="None"
Jul 07 17:07:55.859238 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526084    2562 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s"
Jul 07 17:07:55.859238 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526087    2562 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s"
Jul 07 17:07:55.859238 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526090    2562 flags.go:64] FLAG: --node-ip="0.0.0.0"
Jul 07 17:07:55.859238 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526093    2562 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel"
Jul 07 17:07:55.859238 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526101    2562 flags.go:64] FLAG: --node-status-max-images="50"
Jul 07 17:07:55.859238 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526104    2562 flags.go:64] FLAG: --node-status-update-frequency="10s"
Jul 07 17:07:55.859238 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526107    2562 flags.go:64] FLAG: --oom-score-adj="-999"
Jul 07 17:07:55.859238 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526110    2562 flags.go:64] FLAG: --pod-cidr=""
Jul 07 17:07:55.859238 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526114    2562 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5"
Jul 07 17:07:55.860404 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526120    2562 flags.go:64] FLAG: --pod-manifest-path=""
Jul 07 17:07:55.860404 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526122    2562 flags.go:64] FLAG: --pod-max-pids="-1"
Jul 07 17:07:55.860404 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526126    2562 flags.go:64] FLAG: --pods-per-core="0"
Jul 07 17:07:55.860404 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526129    2562 flags.go:64] FLAG: --port="10250"
Jul 07 17:07:55.860404 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526132    2562 flags.go:64] FLAG: --protect-kernel-defaults="false"
Jul 07 17:07:55.860404 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526134    2562 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c14adf4d3dbb9ed7"
Jul 07 17:07:55.860404 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526138    2562 flags.go:64] FLAG: --qos-reserved=""
Jul 07 17:07:55.860404 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526141    2562 flags.go:64] FLAG: --read-only-port="10255"
Jul 07 17:07:55.860404 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526144    2562 flags.go:64] FLAG: --register-node="true"
Jul 07 17:07:55.860404 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526146    2562 flags.go:64] FLAG: --register-with-taints=""
Jul 07 17:07:55.860404 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526165    2562 flags.go:64] FLAG: --registry-burst="10"
Jul 07 17:07:55.860404 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526168    2562 flags.go:64] FLAG: --registry-qps="5"
Jul 07 17:07:55.860404 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526173    2562 flags.go:64] FLAG: --reserved-cpus=""
Jul 07 17:07:55.860404 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526176    2562 flags.go:64] FLAG: --reserved-memory=""
Jul 07 17:07:55.860404 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526180    2562 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf"
Jul 07 17:07:55.860404 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526183    2562 flags.go:64] FLAG: --root-dir="/var/lib/kubelet"
Jul 07 17:07:55.860404 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526188    2562 flags.go:64] FLAG: --rotate-certificates="false"
Jul 07 17:07:55.860404 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526191    2562 flags.go:64] FLAG: --rotate-server-certificates="false"
Jul 07 17:07:55.860404 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526194    2562 flags.go:64] FLAG: --runonce="false"
Jul 07 17:07:55.860404 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526197    2562 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service"
Jul 07 17:07:55.860404 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526200    2562 flags.go:64] FLAG: --runtime-request-timeout="2m0s"
Jul 07 17:07:55.860404 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526203    2562 flags.go:64] FLAG: --seccomp-default="false"
Jul 07 17:07:55.860404 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526206    2562 flags.go:64] FLAG: --serialize-image-pulls="true"
Jul 07 17:07:55.860404 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526210    2562 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s"
Jul 07 17:07:55.860404 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526213    2562 flags.go:64] FLAG: --storage-driver-db="cadvisor"
Jul 07 17:07:55.860404 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526216    2562 flags.go:64] FLAG: --storage-driver-host="localhost:8086"
Jul 07 17:07:55.864083 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526219    2562 flags.go:64] FLAG: --storage-driver-password="root"
Jul 07 17:07:55.864083 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526222    2562 flags.go:64] FLAG: --storage-driver-secure="false"
Jul 07 17:07:55.864083 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526225    2562 flags.go:64] FLAG: --storage-driver-table="stats"
Jul 07 17:07:55.864083 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526228    2562 flags.go:64] FLAG: --storage-driver-user="root"
Jul 07 17:07:55.864083 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526230    2562 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s"
Jul 07 17:07:55.864083 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526234    2562 flags.go:64] FLAG: --sync-frequency="1m0s"
Jul 07 17:07:55.864083 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526238    2562 flags.go:64] FLAG: --system-cgroups=""
Jul 07 17:07:55.864083 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526241    2562 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi"
Jul 07 17:07:55.864083 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526246    2562 flags.go:64] FLAG: --system-reserved-cgroup=""
Jul 07 17:07:55.864083 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526249    2562 flags.go:64] FLAG: --tls-cert-file=""
Jul 07 17:07:55.864083 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526252    2562 flags.go:64] FLAG: --tls-cipher-suites="[]"
Jul 07 17:07:55.864083 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526256    2562 flags.go:64] FLAG: --tls-min-version=""
Jul 07 17:07:55.864083 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526259    2562 flags.go:64] FLAG: --tls-private-key-file=""
Jul 07 17:07:55.864083 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526262    2562 flags.go:64] FLAG: --topology-manager-policy="none"
Jul 07 17:07:55.864083 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526265    2562 flags.go:64] FLAG: --topology-manager-policy-options=""
Jul 07 17:07:55.864083 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526267    2562 flags.go:64] FLAG: --topology-manager-scope="container"
Jul 07 17:07:55.864083 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526270    2562 flags.go:64] FLAG: --v="2"
Jul 07 17:07:55.864083 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526274    2562 flags.go:64] FLAG: --version="false"
Jul 07 17:07:55.864083 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526280    2562 flags.go:64] FLAG: --vmodule=""
Jul 07 17:07:55.864083 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526284    2562 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec"
Jul 07 17:07:55.864083 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.526287    2562 flags.go:64] FLAG: --volume-stats-agg-period="1m0s"
Jul 07 17:07:55.864083 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526408    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 17:07:55.864083 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526414    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 17:07:55.864083 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526417    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 17:07:55.865510 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526421    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 17:07:55.865510 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526424    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 17:07:55.865510 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526427    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 17:07:55.865510 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526430    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 17:07:55.865510 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526432    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 17:07:55.865510 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526436    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 17:07:55.865510 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526440    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 17:07:55.865510 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526443    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 17:07:55.865510 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526446    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 17:07:55.865510 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526449    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 17:07:55.865510 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526452    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 17:07:55.865510 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526454    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 17:07:55.865510 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526457    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 17:07:55.865510 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526460    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 17:07:55.865510 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526462    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 17:07:55.865510 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526465    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 17:07:55.865510 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526468    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 17:07:55.865510 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526471    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 17:07:55.865510 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526473    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 17:07:55.865510 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526476    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 17:07:55.872116 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526478    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 17:07:55.872116 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526481    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 17:07:55.872116 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526483    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 17:07:55.872116 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526486    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 17:07:55.872116 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526488    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 17:07:55.872116 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526491    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 17:07:55.872116 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526495    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 17:07:55.872116 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526498    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 17:07:55.872116 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526500    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 17:07:55.872116 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526503    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 17:07:55.872116 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526507    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 17:07:55.872116 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526509    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 17:07:55.872116 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526511    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 17:07:55.872116 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526514    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 17:07:55.872116 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526517    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 17:07:55.872116 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526519    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 17:07:55.872116 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526522    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 17:07:55.872116 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526524    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 17:07:55.872116 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526526    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 17:07:55.872116 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526529    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 17:07:55.872782 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526532    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 17:07:55.872782 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526534    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 17:07:55.872782 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526537    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 17:07:55.872782 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526539    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 17:07:55.872782 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526543    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 17:07:55.872782 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526546    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 17:07:55.872782 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526549    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 17:07:55.872782 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526552    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 17:07:55.872782 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526556    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 17:07:55.872782 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526559    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 17:07:55.872782 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526561    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 17:07:55.872782 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526564    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 17:07:55.872782 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526567    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 17:07:55.872782 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526569    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 17:07:55.872782 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526572    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 17:07:55.872782 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526574    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 17:07:55.872782 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526577    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 17:07:55.872782 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526579    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 17:07:55.872782 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526583    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 17:07:55.873421 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526585    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 17:07:55.873421 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526588    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 17:07:55.873421 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526590    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 17:07:55.873421 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526595    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 17:07:55.873421 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526597    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 17:07:55.873421 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526600    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 17:07:55.873421 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526602    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 17:07:55.873421 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526605    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 17:07:55.873421 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526607    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 17:07:55.873421 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526610    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 17:07:55.873421 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526613    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 17:07:55.873421 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526615    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 17:07:55.873421 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526618    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 17:07:55.873421 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526622    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 17:07:55.873421 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526625    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 17:07:55.873421 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526629    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 17:07:55.873421 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526631    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 17:07:55.873421 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526634    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 17:07:55.873421 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526637    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 17:07:55.874211 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526640    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 17:07:55.874211 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526643    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 17:07:55.874211 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526645    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 17:07:55.874211 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526648    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 17:07:55.874211 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526651    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 17:07:55.874211 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526653    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 17:07:55.874211 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526656    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 17:07:55.874211 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526658    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 17:07:55.874211 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526661    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 17:07:55.874211 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526664    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 17:07:55.874211 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526666    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 17:07:55.874211 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526668    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 17:07:55.874211 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526672    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 17:07:55.874211 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526675    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 17:07:55.874211 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526677    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 17:07:55.874211 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526680    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 17:07:55.874211 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526684    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 17:07:55.874211 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.526687    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 17:07:55.875180 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.527291    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 17:07:55.875180 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.536375    2562 server.go:529] "Kubelet version" kubeletVersion="v1.34.8"
Jul 07 17:07:55.875180 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.536396    2562 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK=""
Jul 07 17:07:55.875180 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.536419    2562 watchdog_linux.go:95] "Systemd watchdog is not enabled"
Jul 07 17:07:55.875180 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.536425    2562 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started."
Jul 07 17:07:55.875180 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536504    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 17:07:55.875180 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536511    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 17:07:55.875180 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536515    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 17:07:55.875180 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536518    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 17:07:55.875180 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536521    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 17:07:55.875180 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536525    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 17:07:55.875180 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536528    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 17:07:55.875180 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536531    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 17:07:55.875180 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536533    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 17:07:55.876128 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536536    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 17:07:55.876128 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536539    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 17:07:55.876128 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536542    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 17:07:55.876128 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536552    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 17:07:55.876128 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536555    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 17:07:55.876128 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536558    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 17:07:55.876128 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536561    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 17:07:55.876128 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536564    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 17:07:55.876128 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536566    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 17:07:55.876128 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536571    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 17:07:55.876128 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536575    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 17:07:55.876128 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536578    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 17:07:55.876128 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536581    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 17:07:55.876128 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536584    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 17:07:55.876128 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536587    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 17:07:55.876128 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536590    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 17:07:55.876128 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536593    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 17:07:55.876128 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536596    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 17:07:55.876128 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536599    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 17:07:55.876128 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536604    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 17:07:55.877087 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536607    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 17:07:55.877087 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536610    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 17:07:55.877087 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536613    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 17:07:55.877087 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536616    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 17:07:55.877087 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536618    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 17:07:55.877087 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536621    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 17:07:55.877087 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536624    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 17:07:55.877087 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536627    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 17:07:55.877087 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536629    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 17:07:55.877087 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536633    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 17:07:55.877087 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536635    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 17:07:55.877087 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536638    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 17:07:55.877087 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536641    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 17:07:55.877087 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536644    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 17:07:55.877087 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536646    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 17:07:55.877087 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536649    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 17:07:55.877087 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536659    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 17:07:55.877087 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536662    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 17:07:55.877087 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536665    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 17:07:55.877087 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536668    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 17:07:55.878506 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536671    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 17:07:55.878506 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536674    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 17:07:55.878506 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536679    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 17:07:55.878506 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536683    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 17:07:55.878506 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536686    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 17:07:55.878506 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536689    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 17:07:55.878506 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536692    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 17:07:55.878506 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536695    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 17:07:55.878506 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536698    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 17:07:55.878506 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536701    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 17:07:55.878506 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536703    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 17:07:55.878506 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536708    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 17:07:55.878506 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536711    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 17:07:55.878506 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536714    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 17:07:55.878506 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536717    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 17:07:55.878506 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536719    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 17:07:55.878506 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536722    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 17:07:55.878506 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536725    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 17:07:55.878506 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536728    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 17:07:55.879472 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536735    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 17:07:55.879472 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536738    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 17:07:55.879472 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536740    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 17:07:55.879472 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536743    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 17:07:55.879472 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536746    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 17:07:55.879472 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536749    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 17:07:55.879472 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536752    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 17:07:55.879472 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536755    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 17:07:55.879472 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536758    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 17:07:55.879472 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536761    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 17:07:55.879472 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536777    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 17:07:55.879472 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536780    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 17:07:55.879472 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536782    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 17:07:55.879472 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536785    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 17:07:55.879472 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536788    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 17:07:55.879472 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536791    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 17:07:55.879472 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536794    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 17:07:55.879472 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536797    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 17:07:55.879472 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536800    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 17:07:55.879472 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536803    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 17:07:55.880410 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536807    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 17:07:55.880410 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536811    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 17:07:55.880410 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536814    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 17:07:55.880410 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536817    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 17:07:55.880410 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536822    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 17:07:55.880410 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536825    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 17:07:55.880410 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536828    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 17:07:55.880410 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536831    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 17:07:55.880410 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536833    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 17:07:55.880410 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536836    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 17:07:55.880410 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.536839    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 17:07:55.880410 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.536844    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 17:07:55.880410 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537034    2562 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts
Jul 07 17:07:55.880410 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537039    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement
Jul 07 17:07:55.881125 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537043    2562 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig
Jul 07 17:07:55.881125 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537046    2562 feature_gate.go:328] unrecognized feature gate: NewOLM
Jul 07 17:07:55.881125 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537049    2562 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release.
Jul 07 17:07:55.881125 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537053    2562 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting
Jul 07 17:07:55.881125 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537059    2562 feature_gate.go:328] unrecognized feature gate: OVNObservability
Jul 07 17:07:55.881125 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537062    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM
Jul 07 17:07:55.881125 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537065    2562 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall
Jul 07 17:07:55.881125 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537068    2562 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator
Jul 07 17:07:55.881125 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537071    2562 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall
Jul 07 17:07:55.881125 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537079    2562 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation
Jul 07 17:07:55.881125 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537082    2562 feature_gate.go:328] unrecognized feature gate: OSStreams
Jul 07 17:07:55.881125 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537085    2562 feature_gate.go:328] unrecognized feature gate: Example
Jul 07 17:07:55.881125 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537088    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImages
Jul 07 17:07:55.881125 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537091    2562 feature_gate.go:328] unrecognized feature gate: DNSNameResolver
Jul 07 17:07:55.881125 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537093    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDC
Jul 07 17:07:55.881125 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537096    2562 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk
Jul 07 17:07:55.881125 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537098    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS
Jul 07 17:07:55.881125 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537101    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints
Jul 07 17:07:55.881125 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537104    2562 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig
Jul 07 17:07:55.881125 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537107    2562 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas
Jul 07 17:07:55.882076 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537111    2562 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release.
Jul 07 17:07:55.882076 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537114    2562 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal
Jul 07 17:07:55.882076 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537117    2562 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation
Jul 07 17:07:55.882076 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537121    2562 feature_gate.go:328] unrecognized feature gate: EventTTL
Jul 07 17:07:55.882076 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537124    2562 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot
Jul 07 17:07:55.882076 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537127    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk
Jul 07 17:07:55.882076 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537130    2562 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup
Jul 07 17:07:55.882076 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537133    2562 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration
Jul 07 17:07:55.882076 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537136    2562 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity
Jul 07 17:07:55.882076 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537138    2562 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA
Jul 07 17:07:55.882076 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537142    2562 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks
Jul 07 17:07:55.882076 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537144    2562 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets
Jul 07 17:07:55.882076 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537147    2562 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager
Jul 07 17:07:55.882076 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537150    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration
Jul 07 17:07:55.882076 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537153    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS
Jul 07 17:07:55.882076 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537155    2562 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime
Jul 07 17:07:55.882076 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537159    2562 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall
Jul 07 17:07:55.882076 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537162    2562 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission
Jul 07 17:07:55.882076 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537165    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS
Jul 07 17:07:55.883040 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537168    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPI
Jul 07 17:07:55.883040 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537170    2562 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall
Jul 07 17:07:55.883040 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537173    2562 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv
Jul 07 17:07:55.883040 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537183    2562 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy
Jul 07 17:07:55.883040 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537186    2562 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement
Jul 07 17:07:55.883040 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537189    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI
Jul 07 17:07:55.883040 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537192    2562 feature_gate.go:328] unrecognized feature gate: DualReplica
Jul 07 17:07:55.883040 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537194    2562 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace
Jul 07 17:07:55.883040 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537197    2562 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup
Jul 07 17:07:55.883040 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537200    2562 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix
Jul 07 17:07:55.883040 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537202    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryption
Jul 07 17:07:55.883040 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537205    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere
Jul 07 17:07:55.883040 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537208    2562 feature_gate.go:328] unrecognized feature gate: ShortCertRotation
Jul 07 17:07:55.883040 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537210    2562 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts
Jul 07 17:07:55.883040 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537213    2562 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall
Jul 07 17:07:55.883040 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537216    2562 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall
Jul 07 17:07:55.883040 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537220    2562 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud
Jul 07 17:07:55.883040 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537223    2562 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig
Jul 07 17:07:55.883040 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537225    2562 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup
Jul 07 17:07:55.883040 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537247    2562 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release.
Jul 07 17:07:55.884000 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537251    2562 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter
Jul 07 17:07:55.884000 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537254    2562 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall
Jul 07 17:07:55.884000 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537257    2562 feature_gate.go:328] unrecognized feature gate: Example2
Jul 07 17:07:55.884000 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537260    2562 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes
Jul 07 17:07:55.884000 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537263    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall
Jul 07 17:07:55.884000 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537266    2562 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements
Jul 07 17:07:55.884000 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537269    2562 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall
Jul 07 17:07:55.884000 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537271    2562 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation
Jul 07 17:07:55.884000 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537274    2562 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses
Jul 07 17:07:55.884000 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537278    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere
Jul 07 17:07:55.884000 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537291    2562 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController
Jul 07 17:07:55.884000 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537294    2562 feature_gate.go:328] unrecognized feature gate: InsightsConfig
Jul 07 17:07:55.884000 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537297    2562 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification
Jul 07 17:07:55.884000 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537300    2562 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform
Jul 07 17:07:55.884000 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537303    2562 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather
Jul 07 17:07:55.884000 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537305    2562 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes
Jul 07 17:07:55.884000 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537314    2562 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode
Jul 07 17:07:55.884000 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537317    2562 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles
Jul 07 17:07:55.884000 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537320    2562 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities
Jul 07 17:07:55.885006 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537323    2562 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration
Jul 07 17:07:55.885006 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537326    2562 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable
Jul 07 17:07:55.885006 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537329    2562 feature_gate.go:328] unrecognized feature gate: UpgradeStatus
Jul 07 17:07:55.885006 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537332    2562 feature_gate.go:328] unrecognized feature gate: GatewayAPIController
Jul 07 17:07:55.885006 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537334    2562 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks
Jul 07 17:07:55.885006 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537337    2562 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode
Jul 07 17:07:55.885006 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537340    2562 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy
Jul 07 17:07:55.885006 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537343    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS
Jul 07 17:07:55.885006 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537346    2562 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure
Jul 07 17:07:55.885006 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537350    2562 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords
Jul 07 17:07:55.885006 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537353    2562 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement
Jul 07 17:07:55.885006 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537355    2562 feature_gate.go:328] unrecognized feature gate: SignatureStores
Jul 07 17:07:55.885006 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537358    2562 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings
Jul 07 17:07:55.885006 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537361    2562 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider
Jul 07 17:07:55.885006 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537364    2562 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata
Jul 07 17:07:55.885006 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537367    2562 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota
Jul 07 17:07:55.885006 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537369    2562 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud
Jul 07 17:07:55.885006 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537372    2562 feature_gate.go:328] unrecognized feature gate: PinnedImages
Jul 07 17:07:55.885006 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:55.537375    2562 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure
Jul 07 17:07:55.885933 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.537380    2562 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]}
Jul 07 17:07:55.885933 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.537525    2562 server.go:962] "Client rotation is on, will bootstrap in background"
Jul 07 17:07:55.885933 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.541367    2562 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir"
Jul 07 17:07:55.885933 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.542659    2562 server.go:1019] "Starting client certificate rotation"
Jul 07 17:07:55.885933 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.542776    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 17:07:55.885933 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.543436    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet"
Jul 07 17:07:55.885933 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.544913    2562 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 17:07:55.885933 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.546218    2562 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt"
Jul 07 17:07:55.885933 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.553353    2562 log.go:25] "Validated CRI v1 runtime API"
Jul 07 17:07:55.885933 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.556183    2562 log.go:25] "Validated CRI v1 image API"
Jul 07 17:07:55.885933 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.558517    2562 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd"
Jul 07 17:07:55.885933 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.560971    2562 fs.go:135] Filesystem UUIDs: map[35a70ce2-1869-4b5d-b7a4-a2c08d921134:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 e146c68b-99fe-4669-96da-ac15e35b6677:/dev/nvme0n1p3]
Jul 07 17:07:55.886656 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.560989    2562 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}]
Jul 07 17:07:56.056052 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.567640    2562 manager.go:216] Machine: {Timestamp:2026-07-07 17:07:55.566204035 +0000 UTC m=+0.289457226 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3097416 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec23612fe5dd371a658cc40ce711c3e7 SystemUUID:ec23612f-e5dd-371a-658c-c40ce711c3e7 BootID:8fc4c947-ab8a-4eec-82f8-2335edfd11a5 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:ed:e6:f6:86:19 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:ed:e6:f6:86:19 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:16:b8:02:18:f7:77 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None}
Jul 07 17:07:56.056052 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.567773    2562 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available.
Jul 07 17:07:56.056052 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.567877    2562 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:}
Jul 07 17:07:56.056052 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.570615    2562 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[]
Jul 07 17:07:56.056052 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.570659    2562 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-140-36.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2}
Jul 07 17:07:56.056052 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.571808    2562 topology_manager.go:138] "Creating topology manager with none policy"
Jul 07 17:07:56.056052 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.571820    2562 container_manager_linux.go:309] "Creating device plugin manager"
Jul 07 17:07:56.056052 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.571829    2562 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 17:07:56.057531 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.572374    2562 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock"
Jul 07 17:07:56.057531 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.573921    2562 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager"
Jul 07 17:07:56.057531 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.577380    2562 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 17:07:56.057531 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.577530    2562 server.go:1240] "Using root directory" path="/var/lib/kubelet"
Jul 07 17:07:56.057531 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.578166    2562 kubelet.go:486] "Attempting to sync node with API server"
Jul 07 17:07:56.057531 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.578178    2562 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests"
Jul 07 17:07:56.057531 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.578198    2562 file.go:69] "Watching path" path="/etc/kubernetes/manifests"
Jul 07 17:07:56.057531 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.578208    2562 kubelet.go:398] "Adding apiserver pod source"
Jul 07 17:07:56.057531 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.578219    2562 apiserver.go:42] "Waiting for node sync before watching apiserver pods"
Jul 07 17:07:56.057531 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.578594    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 17:07:56.057531 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.578611    2562 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking"
Jul 07 17:07:56.057531 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.587364    2562 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1"
Jul 07 17:07:56.057531 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.587929    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 17:07:56.057531 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.589265    2562 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled"
Jul 07 17:07:56.057531 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.589303    2562 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled"
Jul 07 17:07:56.057531 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.590213    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume"
Jul 07 17:07:56.057531 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.590246    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir"
Jul 07 17:07:56.057531 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.590256    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo"
Jul 07 17:07:56.057531 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.590262    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path"
Jul 07 17:07:56.057531 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.590272    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs"
Jul 07 17:07:56.057531 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.590278    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret"
Jul 07 17:07:56.057531 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.590286    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi"
Jul 07 17:07:56.057531 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.590292    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api"
Jul 07 17:07:56.057531 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.590300    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc"
Jul 07 17:07:56.057531 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.590306    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap"
Jul 07 17:07:56.057531 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.590315    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected"
Jul 07 17:07:56.057531 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.590321    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume"
Jul 07 17:07:56.057531 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.591675    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi"
Jul 07 17:07:56.057531 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.591688    2562 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image"
Jul 07 17:07:56.057531 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:07:55.592457    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service"
Jul 07 17:07:56.057531 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:07:55.592717    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-140-36.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node"
Jul 07 17:07:56.057531 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.595312    2562 server.go:1268] "Started kubelet"
Jul 07 17:07:56.057531 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.595406    2562 server.go:180] "Starting to listen" address="0.0.0.0" port=10250
Jul 07 17:07:56.057531 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.595417    2562 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10
Jul 07 17:07:56.057531 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.595520    2562 server_v1.go:49] "podresources" method="list" useActivePods=true
Jul 07 17:07:56.057531 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.595745    2562 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-140-36.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope
Jul 07 17:07:56.057531 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.598439    2562 server.go:310] "Adding debug handlers to kubelet server"
Jul 07 17:07:56.057531 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.598781    2562 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock"
Jul 07 17:07:56.057531 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:07:55.605064    2562 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache"
Jul 07 17:07:56.059760 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.605244    2562 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer"
Jul 07 17:07:56.059760 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.605266    2562 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving"
Jul 07 17:07:56.059760 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:07:55.605338    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-36.ec2.internal\" not found"
Jul 07 17:07:56.059760 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.605867    2562 volume_manager.go:311] "The desired_state_of_world populator starts"
Jul 07 17:07:56.059760 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.605897    2562 volume_manager.go:313] "Starting Kubelet Volume Manager"
Jul 07 17:07:56.059760 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.605983    2562 desired_state_of_world_populator.go:146] "Desired state populator starts to run"
Jul 07 17:07:56.059760 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.606037    2562 reconstruct.go:97] "Volume reconstruction finished"
Jul 07 17:07:56.059760 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.606048    2562 reconciler.go:29] "Reconciler: start to sync state"
Jul 07 17:07:56.059760 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.606120    2562 factory.go:55] Registering systemd factory
Jul 07 17:07:56.059760 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.606141    2562 factory.go:223] Registration of the systemd container factory successfully
Jul 07 17:07:56.059760 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.606431    2562 factory.go:153] Registering CRI-O factory
Jul 07 17:07:56.059760 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.606448    2562 factory.go:223] Registration of the crio container factory successfully
Jul 07 17:07:56.059760 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.606530    2562 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory
Jul 07 17:07:56.059760 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.606578    2562 factory.go:103] Registering Raw factory
Jul 07 17:07:56.059760 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.606597    2562 manager.go:1196] Started watching for new ooms in manager
Jul 07 17:07:56.059760 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.607038    2562 manager.go:349] Starting recovery of all containers
Jul 07 17:07:56.059760 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:07:55.611444    2562 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver"
Jul 07 17:07:56.059760 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:07:55.611658    2562 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-140-36.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms"
Jul 07 17:07:56.059760 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:07:55.612053    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-36.ec2.internal.18c010f00aa1b3fd  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-36.ec2.internal,UID:ip-10-0-140-36.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-140-36.ec2.internal,},FirstTimestamp:2026-07-07 17:07:55.595281405 +0000 UTC m=+0.318534597,LastTimestamp:2026-07-07 17:07:55.595281405 +0000 UTC m=+0.318534597,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-36.ec2.internal,}"
Jul 07 17:07:56.059760 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.627778    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-79xbk"
Jul 07 17:07:56.059760 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.629245    2562 manager.go:354] Recovery completed
Jul 07 17:07:56.059760 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.631329    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-79xbk"
Jul 07 17:07:56.059760 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.635742    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 17:07:56.059760 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.639081    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-36.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 17:07:56.059760 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.639113    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-36.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 17:07:56.059760 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.639124    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-36.ec2.internal" event="NodeHasSufficientPID"
Jul 07 17:07:56.059760 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.639784    2562 cpu_manager.go:222] "Starting CPU manager" policy="none"
Jul 07 17:07:56.059760 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.639796    2562 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s"
Jul 07 17:07:56.059760 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.639815    2562 state_mem.go:36] "Initialized new in-memory state store"
Jul 07 17:07:56.059760 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.639796    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 17:07:56.059760 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.641991    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-36.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 17:07:56.059760 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.642028    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-36.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 17:07:56.065270 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.642039    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-36.ec2.internal" event="NodeHasSufficientPID"
Jul 07 17:07:56.065270 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.643906    2562 policy_none.go:49] "None policy: Start"
Jul 07 17:07:56.065270 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.643921    2562 memory_manager.go:187] "Starting memorymanager" policy="None"
Jul 07 17:07:56.065270 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.643932    2562 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint"
Jul 07 17:07:56.065270 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.645074    2562 policy_none.go:47] "Start"
Jul 07 17:07:56.065270 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:07:55.646256    2562 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-140-36.ec2.internal.18c010f00d3e465e  default    0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-36.ec2.internal,UID:ip-10-0-140-36.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-140-36.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-140-36.ec2.internal,},FirstTimestamp:2026-07-07 17:07:55.639096926 +0000 UTC m=+0.362350116,LastTimestamp:2026-07-07 17:07:55.639096926 +0000 UTC m=+0.362350116,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-36.ec2.internal,}"
Jul 07 17:07:56.065270 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.690985    2562 manager.go:337] "Starting Device Plugin manager"
Jul 07 17:07:56.065270 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:07:55.691049    2562 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint"
Jul 07 17:07:56.065270 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.691064    2562 server.go:87] "Starting device plugin registration server"
Jul 07 17:07:56.065270 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.691411    2562 eviction_manager.go:189] "Eviction manager: starting control loop"
Jul 07 17:07:56.065270 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.691426    2562 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s"
Jul 07 17:07:56.065270 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.691556    2562 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry"
Jul 07 17:07:56.065270 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.691659    2562 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts"
Jul 07 17:07:56.065270 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.691669    2562 plugin_manager.go:118] "Starting Kubelet Plugin Manager"
Jul 07 17:07:56.065270 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:07:55.692318    2562 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\""
Jul 07 17:07:56.065270 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:07:55.692366    2562 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-140-36.ec2.internal\" not found"
Jul 07 17:07:56.065270 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.791776    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 17:07:56.065270 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.793017    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-36.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 17:07:56.065270 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.793052    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-36.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 17:07:56.065270 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.793063    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-36.ec2.internal" event="NodeHasSufficientPID"
Jul 07 17:07:56.065270 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.793097    2562 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-140-36.ec2.internal"
Jul 07 17:07:56.065270 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.800653    2562 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-140-36.ec2.internal"
Jul 07 17:07:56.065270 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:07:55.800683    2562 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-140-36.ec2.internal\": node \"ip-10-0-140-36.ec2.internal\" not found"
Jul 07 17:07:56.065270 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:07:55.823846    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-36.ec2.internal\" not found"
Jul 07 17:07:56.065270 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.838085    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4"
Jul 07 17:07:56.065270 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.839388    2562 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6"
Jul 07 17:07:56.065270 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.839428    2562 status_manager.go:244] "Starting to sync pod status with apiserver"
Jul 07 17:07:56.065270 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.839454    2562 kubelet.go:2448] "Starting kubelet main sync loop"
Jul 07 17:07:56.065270 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:07:55.839491    2562 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful"
Jul 07 17:07:56.065270 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.842348    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 17:07:56.065270 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:07:55.924786    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-36.ec2.internal\" not found"
Jul 07 17:07:56.065270 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.940062    2562 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-36.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-140-36.ec2.internal"]
Jul 07 17:07:56.065270 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.940160    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 17:07:56.066920 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.941380    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-36.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 17:07:56.066920 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.941423    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-36.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 17:07:56.066920 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.941436    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-36.ec2.internal" event="NodeHasSufficientPID"
Jul 07 17:07:56.066920 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.942885    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 17:07:56.066920 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.943028    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-36.ec2.internal"
Jul 07 17:07:56.066920 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.943066    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 17:07:56.066920 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.943843    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-36.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 17:07:56.066920 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.943867    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-36.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 17:07:56.066920 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.943877    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-36.ec2.internal" event="NodeHasSufficientPID"
Jul 07 17:07:56.066920 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.945388    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-36.ec2.internal"
Jul 07 17:07:56.066920 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.945423    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 17:07:56.066920 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.945988    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-36.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 17:07:56.066920 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.946018    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-36.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 17:07:56.066920 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.946030    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-36.ec2.internal" event="NodeHasSufficientPID"
Jul 07 17:07:56.066920 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.946350    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-36.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 17:07:56.066920 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.946370    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-36.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 17:07:56.066920 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:55.946382    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-36.ec2.internal" event="NodeHasSufficientPID"
Jul 07 17:07:56.066920 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:07:55.978494    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-36.ec2.internal\" not found" node="ip-10-0-140-36.ec2.internal"
Jul 07 17:07:56.066920 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:07:55.988821    2562 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-140-36.ec2.internal\" not found" node="ip-10-0-140-36.ec2.internal"
Jul 07 17:07:56.066920 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:56.008011    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/71d4bb0248f30f22223d1d1fcd98e897-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-36.ec2.internal\" (UID: \"71d4bb0248f30f22223d1d1fcd98e897\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-36.ec2.internal"
Jul 07 17:07:56.066920 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:56.008039    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/71d4bb0248f30f22223d1d1fcd98e897-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-36.ec2.internal\" (UID: \"71d4bb0248f30f22223d1d1fcd98e897\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-36.ec2.internal"
Jul 07 17:07:56.066920 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:56.008059    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/49aaaf0707b9d67c20e84f9fb50f9adf-config\") pod \"kube-apiserver-proxy-ip-10-0-140-36.ec2.internal\" (UID: \"49aaaf0707b9d67c20e84f9fb50f9adf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-36.ec2.internal"
Jul 07 17:07:56.066920 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:07:56.025390    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-36.ec2.internal\" not found"
Jul 07 17:07:56.193904 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:56.108329    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/71d4bb0248f30f22223d1d1fcd98e897-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-36.ec2.internal\" (UID: \"71d4bb0248f30f22223d1d1fcd98e897\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-36.ec2.internal"
Jul 07 17:07:56.193904 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:56.108380    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/71d4bb0248f30f22223d1d1fcd98e897-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-36.ec2.internal\" (UID: \"71d4bb0248f30f22223d1d1fcd98e897\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-36.ec2.internal"
Jul 07 17:07:56.193904 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:56.108401    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/49aaaf0707b9d67c20e84f9fb50f9adf-config\") pod \"kube-apiserver-proxy-ip-10-0-140-36.ec2.internal\" (UID: \"49aaaf0707b9d67c20e84f9fb50f9adf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-36.ec2.internal"
Jul 07 17:07:56.193904 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:56.108396    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/71d4bb0248f30f22223d1d1fcd98e897-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-140-36.ec2.internal\" (UID: \"71d4bb0248f30f22223d1d1fcd98e897\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-36.ec2.internal"
Jul 07 17:07:56.193904 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:56.108419    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/71d4bb0248f30f22223d1d1fcd98e897-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-140-36.ec2.internal\" (UID: \"71d4bb0248f30f22223d1d1fcd98e897\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-36.ec2.internal"
Jul 07 17:07:56.193904 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:56.108458    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/49aaaf0707b9d67c20e84f9fb50f9adf-config\") pod \"kube-apiserver-proxy-ip-10-0-140-36.ec2.internal\" (UID: \"49aaaf0707b9d67c20e84f9fb50f9adf\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-140-36.ec2.internal"
Jul 07 17:07:56.193904 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:07:56.126426    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-36.ec2.internal\" not found"
Jul 07 17:07:56.317451 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:07:56.226809    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-36.ec2.internal\" not found"
Jul 07 17:07:56.317451 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:56.282558    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-36.ec2.internal"
Jul 07 17:07:56.317451 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:56.292852    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-36.ec2.internal"
Jul 07 17:07:56.329090 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:07:56.327363    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-36.ec2.internal\" not found"
Jul 07 17:07:56.442063 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:07:56.428174    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-36.ec2.internal\" not found"
Jul 07 17:07:56.573305 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:07:56.528711    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-36.ec2.internal\" not found"
Jul 07 17:07:56.573305 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:56.541962    2562 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials"
Jul 07 17:07:56.573305 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:56.542180    2562 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received"
Jul 07 17:07:56.573305 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:07:56.542155    2562 event.go:368] "Unable to write event (may retry after sleeping)" err="Patch \"https://a27d38acbc8d7479e8d90028197de7f1-e46d8e0d467e974e.elb.us-east-1.amazonaws.com:6443/api/v1/namespaces/default/events/ip-10-0-140-36.ec2.internal.18c010f00d3ec03f\": read tcp 10.0.140.36:51360->44.208.141.241:6443: use of closed network connection" event="&Event{ObjectMeta:{ip-10-0-140-36.ec2.internal.18c010f00d3ec03f  default   6070 0 0001-01-01 00:00:00 +0000 UTC <nil> <nil> map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-140-36.ec2.internal,UID:ip-10-0-140-36.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-140-36.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-140-36.ec2.internal,},FirstTimestamp:2026-07-07 17:07:55 +0000 UTC,LastTimestamp:2026-07-07 17:07:55.946387363 +0000 UTC m=+0.669640554,Count:7,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-140-36.ec2.internal,}"
Jul 07 17:07:56.705020 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:07:56.629202    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-36.ec2.internal\" not found"
Jul 07 17:07:56.705020 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:56.634345    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-06 17:02:56 +0000 UTC" deadline="2028-02-18 11:44:07.312821882 +0000 UTC"
Jul 07 17:07:56.705020 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:56.634378    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14178h36m10.67844733s"
Jul 07 17:07:56.732184 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:07:56.729284    2562 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-140-36.ec2.internal\" not found"
Jul 07 17:07:56.848074 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:56.747447    2562 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach"
Jul 07 17:07:56.848074 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:56.748585    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-36.ec2.internal" event="NodeHasSufficientMemory"
Jul 07 17:07:56.848074 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:56.748622    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-36.ec2.internal" event="NodeHasNoDiskPressure"
Jul 07 17:07:56.848074 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:56.748639    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-36.ec2.internal" event="NodeHasSufficientPID"
Jul 07 17:07:56.848074 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:56.827626    2562 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 17:07:56.990715 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:56.906032    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-36.ec2.internal"
Jul 07 17:07:56.990715 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:56.921662    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 17:07:56.990715 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:56.923309    2562 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-36.ec2.internal"
Jul 07 17:07:56.990715 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:56.934342    2562 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]"
Jul 07 17:07:56.990715 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:56.948824    2562 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 17:07:57.446806 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:57.446775    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49aaaf0707b9d67c20e84f9fb50f9adf.slice/crio-146fe3f227aadabdb2145d96d50b7ee91fdd3d2a4eed7be4155d9b6b5c10f281 WatchSource:0}: Error finding container 146fe3f227aadabdb2145d96d50b7ee91fdd3d2a4eed7be4155d9b6b5c10f281: Status 404 returned error can't find the container with id 146fe3f227aadabdb2145d96d50b7ee91fdd3d2a4eed7be4155d9b6b5c10f281
Jul 07 17:07:57.451005 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.450990    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 17:07:57.550255 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.550162    2562 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 17:07:57.580405 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.580362    2562 apiserver.go:52] "Watching apiserver"
Jul 07 17:07:57.588619 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.588591    2562 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66"
Jul 07 17:07:57.589574 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.589540    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-vl6kx","openshift-multus/network-metrics-daemon-rqsv7","openshift-network-diagnostics/network-check-target-7kh6b","kube-system/konnectivity-agent-28xn9","kube-system/kube-apiserver-proxy-ip-10-0-140-36.ec2.internal","openshift-dns/node-resolver-7xdlh","openshift-multus/multus-additional-cni-plugins-w9xzb","openshift-network-operator/iptables-alerter-4mshv","openshift-ovn-kubernetes/ovnkube-node-tf68j","kube-system/global-pull-secret-syncer-mhc8x","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zw77m","openshift-cluster-node-tuning-operator/tuned-kk5zr","openshift-image-registry/node-ca-v72rm","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-36.ec2.internal"]
Jul 07 17:07:57.592526 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.592504    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-w9xzb"
Jul 07 17:07:57.594010 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.593987    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zw77m"
Jul 07 17:07:57.595101 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.595068    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kh6b"
Jul 07 17:07:57.595218 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:07:57.595146    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kh6b" podUID="4a516c8b-0593-47ed-9e9c-40eea299b87c"
Jul 07 17:07:57.595362 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.595343    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\""
Jul 07 17:07:57.595583 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.595569    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\""
Jul 07 17:07:57.596035 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.596008    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-dm86w\""
Jul 07 17:07:57.596116 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.596032    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\""
Jul 07 17:07:57.596116 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.596070    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\""
Jul 07 17:07:57.596116 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.596075    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\""
Jul 07 17:07:57.596392 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.596200    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\""
Jul 07 17:07:57.596392 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.596221    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-l2799\""
Jul 07 17:07:57.596512 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.596492    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\""
Jul 07 17:07:57.596580 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.596549    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-28xn9"
Jul 07 17:07:57.597033 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.597016    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\""
Jul 07 17:07:57.597710 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.597695    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4mshv"
Jul 07 17:07:57.598829 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.598813    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7xdlh"
Jul 07 17:07:57.599240 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.599214    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-fmd2k\""
Jul 07 17:07:57.599686 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.599670    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\""
Jul 07 17:07:57.599816 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.599794    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\""
Jul 07 17:07:57.599908 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.599837    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\""
Jul 07 17:07:57.600205 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.600190    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tf68j"
Jul 07 17:07:57.600521 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.600496    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\""
Jul 07 17:07:57.600971 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.600950    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-xb2rc\""
Jul 07 17:07:57.601069 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.600952    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\""
Jul 07 17:07:57.601069 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.601022    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-wtm4c\""
Jul 07 17:07:57.601416 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.601396    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\""
Jul 07 17:07:57.601523 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.601456    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\""
Jul 07 17:07:57.601597 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.601582    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-v72rm"
Jul 07 17:07:57.602324 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.602306    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-46lhr\""
Jul 07 17:07:57.602415 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.602399    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\""
Jul 07 17:07:57.602482 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.602438    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\""
Jul 07 17:07:57.602724 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.602708    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rqsv7"
Jul 07 17:07:57.602797 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:07:57.602777    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rqsv7" podUID="3982c405-1bdb-4b6c-928a-fc6fb9e7b360"
Jul 07 17:07:57.603928 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.603909    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mhc8x"
Jul 07 17:07:57.604000 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:07:57.603980    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mhc8x" podUID="c1a36a2e-2dad-43d1-b604-e538cc26c66d"
Jul 07 17:07:57.604436 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.604390    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\""
Jul 07 17:07:57.604436 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.604409    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\""
Jul 07 17:07:57.604436 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.604434    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\""
Jul 07 17:07:57.604688 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.604446    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\""
Jul 07 17:07:57.604688 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.604398    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\""
Jul 07 17:07:57.604688 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.604540    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\""
Jul 07 17:07:57.604688 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.604544    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\""
Jul 07 17:07:57.604859 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.604772    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8fdrb\""
Jul 07 17:07:57.606327 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.606300    2562 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving"
Jul 07 17:07:57.606533 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.606504    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vl6kx"
Jul 07 17:07:57.607877 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.607804    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kk5zr"
Jul 07 17:07:57.611070 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.611037    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\""
Jul 07 17:07:57.611246 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.611214    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\""
Jul 07 17:07:57.611421 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.611398    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\""
Jul 07 17:07:57.611640 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.611624    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-bwqpt\""
Jul 07 17:07:57.612289 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.612271    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-k4snr\""
Jul 07 17:07:57.616538 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.616516    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/03d68eb3-35c7-4d4a-8a5a-5f541b098e44-host-run-netns\") pod \"multus-vl6kx\" (UID: \"03d68eb3-35c7-4d4a-8a5a-5f541b098e44\") " pod="openshift-multus/multus-vl6kx"
Jul 07 17:07:57.616633 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.616553    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/03d68eb3-35c7-4d4a-8a5a-5f541b098e44-host-var-lib-kubelet\") pod \"multus-vl6kx\" (UID: \"03d68eb3-35c7-4d4a-8a5a-5f541b098e44\") " pod="openshift-multus/multus-vl6kx"
Jul 07 17:07:57.616633 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.616579    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b9942424-da4e-4c79-ad5a-3979e01b04b4-etc-selinux\") pod \"aws-ebs-csi-driver-node-zw77m\" (UID: \"b9942424-da4e-4c79-ad5a-3979e01b04b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zw77m"
Jul 07 17:07:57.616633 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.616601    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/58ef1985-a201-4a7b-9bf9-37dc0aa0e656-host-slash\") pod \"ovnkube-node-tf68j\" (UID: \"58ef1985-a201-4a7b-9bf9-37dc0aa0e656\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf68j"
Jul 07 17:07:57.616633 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.616619    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/58ef1985-a201-4a7b-9bf9-37dc0aa0e656-run-openvswitch\") pod \"ovnkube-node-tf68j\" (UID: \"58ef1985-a201-4a7b-9bf9-37dc0aa0e656\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf68j"
Jul 07 17:07:57.616789 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.616674    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/58ef1985-a201-4a7b-9bf9-37dc0aa0e656-host-run-ovn-kubernetes\") pod \"ovnkube-node-tf68j\" (UID: \"58ef1985-a201-4a7b-9bf9-37dc0aa0e656\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf68j"
Jul 07 17:07:57.616789 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.616722    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvqzj\" (UniqueName: \"kubernetes.io/projected/58ef1985-a201-4a7b-9bf9-37dc0aa0e656-kube-api-access-vvqzj\") pod \"ovnkube-node-tf68j\" (UID: \"58ef1985-a201-4a7b-9bf9-37dc0aa0e656\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf68j"
Jul 07 17:07:57.616789 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.616762    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gdj2r\" (UniqueName: \"kubernetes.io/projected/b9942424-da4e-4c79-ad5a-3979e01b04b4-kube-api-access-gdj2r\") pod \"aws-ebs-csi-driver-node-zw77m\" (UID: \"b9942424-da4e-4c79-ad5a-3979e01b04b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zw77m"
Jul 07 17:07:57.616889 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.616804    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/03d68eb3-35c7-4d4a-8a5a-5f541b098e44-multus-conf-dir\") pod \"multus-vl6kx\" (UID: \"03d68eb3-35c7-4d4a-8a5a-5f541b098e44\") " pod="openshift-multus/multus-vl6kx"
Jul 07 17:07:57.616889 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.616839    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/58ef1985-a201-4a7b-9bf9-37dc0aa0e656-host-cni-bin\") pod \"ovnkube-node-tf68j\" (UID: \"58ef1985-a201-4a7b-9bf9-37dc0aa0e656\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf68j"
Jul 07 17:07:57.616889 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.616868    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/58ef1985-a201-4a7b-9bf9-37dc0aa0e656-ovnkube-script-lib\") pod \"ovnkube-node-tf68j\" (UID: \"58ef1985-a201-4a7b-9bf9-37dc0aa0e656\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf68j"
Jul 07 17:07:57.617002 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.616898    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b876547b-7002-4de2-bbbe-cb70ea03a96b-cni-binary-copy\") pod \"multus-additional-cni-plugins-w9xzb\" (UID: \"b876547b-7002-4de2-bbbe-cb70ea03a96b\") " pod="openshift-multus/multus-additional-cni-plugins-w9xzb"
Jul 07 17:07:57.617002 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.616918    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b876547b-7002-4de2-bbbe-cb70ea03a96b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w9xzb\" (UID: \"b876547b-7002-4de2-bbbe-cb70ea03a96b\") " pod="openshift-multus/multus-additional-cni-plugins-w9xzb"
Jul 07 17:07:57.617002 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.616949    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/50fc3df0-8a43-48db-9b3e-80d9bd4c03eb-konnectivity-ca\") pod \"konnectivity-agent-28xn9\" (UID: \"50fc3df0-8a43-48db-9b3e-80d9bd4c03eb\") " pod="kube-system/konnectivity-agent-28xn9"
Jul 07 17:07:57.617002 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.616978    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/36340fd9-83c5-4baf-b02d-9fc7f5e86485-hosts-file\") pod \"node-resolver-7xdlh\" (UID: \"36340fd9-83c5-4baf-b02d-9fc7f5e86485\") " pod="openshift-dns/node-resolver-7xdlh"
Jul 07 17:07:57.617002 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.616995    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36340fd9-83c5-4baf-b02d-9fc7f5e86485-tmp-dir\") pod \"node-resolver-7xdlh\" (UID: \"36340fd9-83c5-4baf-b02d-9fc7f5e86485\") " pod="openshift-dns/node-resolver-7xdlh"
Jul 07 17:07:57.617270 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.617039    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b9942424-da4e-4c79-ad5a-3979e01b04b4-registration-dir\") pod \"aws-ebs-csi-driver-node-zw77m\" (UID: \"b9942424-da4e-4c79-ad5a-3979e01b04b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zw77m"
Jul 07 17:07:57.617270 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.617086    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5tdvr\" (UniqueName: \"kubernetes.io/projected/79353616-7bb8-4034-b3d5-c59eff433273-kube-api-access-5tdvr\") pod \"node-ca-v72rm\" (UID: \"79353616-7bb8-4034-b3d5-c59eff433273\") " pod="openshift-image-registry/node-ca-v72rm"
Jul 07 17:07:57.617270 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.617120    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/03d68eb3-35c7-4d4a-8a5a-5f541b098e44-system-cni-dir\") pod \"multus-vl6kx\" (UID: \"03d68eb3-35c7-4d4a-8a5a-5f541b098e44\") " pod="openshift-multus/multus-vl6kx"
Jul 07 17:07:57.617270 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.617153    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/58ef1985-a201-4a7b-9bf9-37dc0aa0e656-run-systemd\") pod \"ovnkube-node-tf68j\" (UID: \"58ef1985-a201-4a7b-9bf9-37dc0aa0e656\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf68j"
Jul 07 17:07:57.617270 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.617208    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/58ef1985-a201-4a7b-9bf9-37dc0aa0e656-node-log\") pod \"ovnkube-node-tf68j\" (UID: \"58ef1985-a201-4a7b-9bf9-37dc0aa0e656\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf68j"
Jul 07 17:07:57.617270 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.617236    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b9942424-da4e-4c79-ad5a-3979e01b04b4-device-dir\") pod \"aws-ebs-csi-driver-node-zw77m\" (UID: \"b9942424-da4e-4c79-ad5a-3979e01b04b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zw77m"
Jul 07 17:07:57.617270 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.617262    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/03d68eb3-35c7-4d4a-8a5a-5f541b098e44-host-var-lib-cni-multus\") pod \"multus-vl6kx\" (UID: \"03d68eb3-35c7-4d4a-8a5a-5f541b098e44\") " pod="openshift-multus/multus-vl6kx"
Jul 07 17:07:57.617620 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.617288    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9sbr\" (UniqueName: \"kubernetes.io/projected/302d72fd-91f1-4d4d-beb5-39e75d18f600-kube-api-access-m9sbr\") pod \"iptables-alerter-4mshv\" (UID: \"302d72fd-91f1-4d4d-beb5-39e75d18f600\") " pod="openshift-network-operator/iptables-alerter-4mshv"
Jul 07 17:07:57.617620 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.617314    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/58ef1985-a201-4a7b-9bf9-37dc0aa0e656-ovn-node-metrics-cert\") pod \"ovnkube-node-tf68j\" (UID: \"58ef1985-a201-4a7b-9bf9-37dc0aa0e656\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf68j"
Jul 07 17:07:57.617620 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.617339    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3982c405-1bdb-4b6c-928a-fc6fb9e7b360-metrics-certs\") pod \"network-metrics-daemon-rqsv7\" (UID: \"3982c405-1bdb-4b6c-928a-fc6fb9e7b360\") " pod="openshift-multus/network-metrics-daemon-rqsv7"
Jul 07 17:07:57.617620 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.617366    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b9942424-da4e-4c79-ad5a-3979e01b04b4-socket-dir\") pod \"aws-ebs-csi-driver-node-zw77m\" (UID: \"b9942424-da4e-4c79-ad5a-3979e01b04b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zw77m"
Jul 07 17:07:57.617620 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.617408    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/50fc3df0-8a43-48db-9b3e-80d9bd4c03eb-agent-certs\") pod \"konnectivity-agent-28xn9\" (UID: \"50fc3df0-8a43-48db-9b3e-80d9bd4c03eb\") " pod="kube-system/konnectivity-agent-28xn9"
Jul 07 17:07:57.617620 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.617433    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/58ef1985-a201-4a7b-9bf9-37dc0aa0e656-systemd-units\") pod \"ovnkube-node-tf68j\" (UID: \"58ef1985-a201-4a7b-9bf9-37dc0aa0e656\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf68j"
Jul 07 17:07:57.617620 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.617460    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/58ef1985-a201-4a7b-9bf9-37dc0aa0e656-host-cni-netd\") pod \"ovnkube-node-tf68j\" (UID: \"58ef1985-a201-4a7b-9bf9-37dc0aa0e656\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf68j"
Jul 07 17:07:57.617620 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.617487    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r2jgg\" (UniqueName: \"kubernetes.io/projected/b876547b-7002-4de2-bbbe-cb70ea03a96b-kube-api-access-r2jgg\") pod \"multus-additional-cni-plugins-w9xzb\" (UID: \"b876547b-7002-4de2-bbbe-cb70ea03a96b\") " pod="openshift-multus/multus-additional-cni-plugins-w9xzb"
Jul 07 17:07:57.617620 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.617520    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b9942424-da4e-4c79-ad5a-3979e01b04b4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zw77m\" (UID: \"b9942424-da4e-4c79-ad5a-3979e01b04b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zw77m"
Jul 07 17:07:57.617620 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.617566    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/03d68eb3-35c7-4d4a-8a5a-5f541b098e44-host-run-k8s-cni-cncf-io\") pod \"multus-vl6kx\" (UID: \"03d68eb3-35c7-4d4a-8a5a-5f541b098e44\") " pod="openshift-multus/multus-vl6kx"
Jul 07 17:07:57.617620 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.617591    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03d68eb3-35c7-4d4a-8a5a-5f541b098e44-etc-kubernetes\") pod \"multus-vl6kx\" (UID: \"03d68eb3-35c7-4d4a-8a5a-5f541b098e44\") " pod="openshift-multus/multus-vl6kx"
Jul 07 17:07:57.618117 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.617626    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f9hqw\" (UniqueName: \"kubernetes.io/projected/36340fd9-83c5-4baf-b02d-9fc7f5e86485-kube-api-access-f9hqw\") pod \"node-resolver-7xdlh\" (UID: \"36340fd9-83c5-4baf-b02d-9fc7f5e86485\") " pod="openshift-dns/node-resolver-7xdlh"
Jul 07 17:07:57.618117 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.617662    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/58ef1985-a201-4a7b-9bf9-37dc0aa0e656-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tf68j\" (UID: \"58ef1985-a201-4a7b-9bf9-37dc0aa0e656\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf68j"
Jul 07 17:07:57.618117 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.617688    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b876547b-7002-4de2-bbbe-cb70ea03a96b-os-release\") pod \"multus-additional-cni-plugins-w9xzb\" (UID: \"b876547b-7002-4de2-bbbe-cb70ea03a96b\") " pod="openshift-multus/multus-additional-cni-plugins-w9xzb"
Jul 07 17:07:57.618117 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.617750    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b876547b-7002-4de2-bbbe-cb70ea03a96b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w9xzb\" (UID: \"b876547b-7002-4de2-bbbe-cb70ea03a96b\") " pod="openshift-multus/multus-additional-cni-plugins-w9xzb"
Jul 07 17:07:57.618117 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.617779    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/03d68eb3-35c7-4d4a-8a5a-5f541b098e44-os-release\") pod \"multus-vl6kx\" (UID: \"03d68eb3-35c7-4d4a-8a5a-5f541b098e44\") " pod="openshift-multus/multus-vl6kx"
Jul 07 17:07:57.618117 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.617799    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/03d68eb3-35c7-4d4a-8a5a-5f541b098e44-multus-socket-dir-parent\") pod \"multus-vl6kx\" (UID: \"03d68eb3-35c7-4d4a-8a5a-5f541b098e44\") " pod="openshift-multus/multus-vl6kx"
Jul 07 17:07:57.618117 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.617820    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b9942424-da4e-4c79-ad5a-3979e01b04b4-sys-fs\") pod \"aws-ebs-csi-driver-node-zw77m\" (UID: \"b9942424-da4e-4c79-ad5a-3979e01b04b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zw77m"
Jul 07 17:07:57.618117 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.617836    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/03d68eb3-35c7-4d4a-8a5a-5f541b098e44-cnibin\") pod \"multus-vl6kx\" (UID: \"03d68eb3-35c7-4d4a-8a5a-5f541b098e44\") " pod="openshift-multus/multus-vl6kx"
Jul 07 17:07:57.618117 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.617860    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/03d68eb3-35c7-4d4a-8a5a-5f541b098e44-cni-binary-copy\") pod \"multus-vl6kx\" (UID: \"03d68eb3-35c7-4d4a-8a5a-5f541b098e44\") " pod="openshift-multus/multus-vl6kx"
Jul 07 17:07:57.618117 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.617882    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/03d68eb3-35c7-4d4a-8a5a-5f541b098e44-host-var-lib-cni-bin\") pod \"multus-vl6kx\" (UID: \"03d68eb3-35c7-4d4a-8a5a-5f541b098e44\") " pod="openshift-multus/multus-vl6kx"
Jul 07 17:07:57.618117 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.617905    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gkvm2\" (UniqueName: \"kubernetes.io/projected/03d68eb3-35c7-4d4a-8a5a-5f541b098e44-kube-api-access-gkvm2\") pod \"multus-vl6kx\" (UID: \"03d68eb3-35c7-4d4a-8a5a-5f541b098e44\") " pod="openshift-multus/multus-vl6kx"
Jul 07 17:07:57.618117 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.617938    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/58ef1985-a201-4a7b-9bf9-37dc0aa0e656-host-kubelet\") pod \"ovnkube-node-tf68j\" (UID: \"58ef1985-a201-4a7b-9bf9-37dc0aa0e656\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf68j"
Jul 07 17:07:57.618117 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.617960    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/58ef1985-a201-4a7b-9bf9-37dc0aa0e656-run-ovn\") pod \"ovnkube-node-tf68j\" (UID: \"58ef1985-a201-4a7b-9bf9-37dc0aa0e656\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf68j"
Jul 07 17:07:57.618117 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.617976    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/58ef1985-a201-4a7b-9bf9-37dc0aa0e656-ovnkube-config\") pod \"ovnkube-node-tf68j\" (UID: \"58ef1985-a201-4a7b-9bf9-37dc0aa0e656\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf68j"
Jul 07 17:07:57.619009 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.618001    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1a36a2e-2dad-43d1-b604-e538cc26c66d-original-pull-secret\") pod \"global-pull-secret-syncer-mhc8x\" (UID: \"c1a36a2e-2dad-43d1-b604-e538cc26c66d\") " pod="kube-system/global-pull-secret-syncer-mhc8x"
Jul 07 17:07:57.619009 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.618021    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b876547b-7002-4de2-bbbe-cb70ea03a96b-system-cni-dir\") pod \"multus-additional-cni-plugins-w9xzb\" (UID: \"b876547b-7002-4de2-bbbe-cb70ea03a96b\") " pod="openshift-multus/multus-additional-cni-plugins-w9xzb"
Jul 07 17:07:57.619009 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.618047    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/79353616-7bb8-4034-b3d5-c59eff433273-host\") pod \"node-ca-v72rm\" (UID: \"79353616-7bb8-4034-b3d5-c59eff433273\") " pod="openshift-image-registry/node-ca-v72rm"
Jul 07 17:07:57.619009 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.618076    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/03d68eb3-35c7-4d4a-8a5a-5f541b098e44-host-run-multus-certs\") pod \"multus-vl6kx\" (UID: \"03d68eb3-35c7-4d4a-8a5a-5f541b098e44\") " pod="openshift-multus/multus-vl6kx"
Jul 07 17:07:57.619009 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.618095    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/302d72fd-91f1-4d4d-beb5-39e75d18f600-iptables-alerter-script\") pod \"iptables-alerter-4mshv\" (UID: \"302d72fd-91f1-4d4d-beb5-39e75d18f600\") " pod="openshift-network-operator/iptables-alerter-4mshv"
Jul 07 17:07:57.619009 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.618112    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/58ef1985-a201-4a7b-9bf9-37dc0aa0e656-var-lib-openvswitch\") pod \"ovnkube-node-tf68j\" (UID: \"58ef1985-a201-4a7b-9bf9-37dc0aa0e656\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf68j"
Jul 07 17:07:57.619009 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.618134    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/58ef1985-a201-4a7b-9bf9-37dc0aa0e656-env-overrides\") pod \"ovnkube-node-tf68j\" (UID: \"58ef1985-a201-4a7b-9bf9-37dc0aa0e656\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf68j"
Jul 07 17:07:57.619009 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.618178    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tnlt7\" (UniqueName: \"kubernetes.io/projected/3982c405-1bdb-4b6c-928a-fc6fb9e7b360-kube-api-access-tnlt7\") pod \"network-metrics-daemon-rqsv7\" (UID: \"3982c405-1bdb-4b6c-928a-fc6fb9e7b360\") " pod="openshift-multus/network-metrics-daemon-rqsv7"
Jul 07 17:07:57.619009 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.618205    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c1a36a2e-2dad-43d1-b604-e538cc26c66d-dbus\") pod \"global-pull-secret-syncer-mhc8x\" (UID: \"c1a36a2e-2dad-43d1-b604-e538cc26c66d\") " pod="kube-system/global-pull-secret-syncer-mhc8x"
Jul 07 17:07:57.619009 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.618222    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/03d68eb3-35c7-4d4a-8a5a-5f541b098e44-multus-daemon-config\") pod \"multus-vl6kx\" (UID: \"03d68eb3-35c7-4d4a-8a5a-5f541b098e44\") " pod="openshift-multus/multus-vl6kx"
Jul 07 17:07:57.619009 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.618238    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/58ef1985-a201-4a7b-9bf9-37dc0aa0e656-log-socket\") pod \"ovnkube-node-tf68j\" (UID: \"58ef1985-a201-4a7b-9bf9-37dc0aa0e656\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf68j"
Jul 07 17:07:57.619009 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.618260    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b876547b-7002-4de2-bbbe-cb70ea03a96b-cnibin\") pod \"multus-additional-cni-plugins-w9xzb\" (UID: \"b876547b-7002-4de2-bbbe-cb70ea03a96b\") " pod="openshift-multus/multus-additional-cni-plugins-w9xzb"
Jul 07 17:07:57.619009 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.618283    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/03d68eb3-35c7-4d4a-8a5a-5f541b098e44-hostroot\") pod \"multus-vl6kx\" (UID: \"03d68eb3-35c7-4d4a-8a5a-5f541b098e44\") " pod="openshift-multus/multus-vl6kx"
Jul 07 17:07:57.619009 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.618310    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/302d72fd-91f1-4d4d-beb5-39e75d18f600-host-slash\") pod \"iptables-alerter-4mshv\" (UID: \"302d72fd-91f1-4d4d-beb5-39e75d18f600\") " pod="openshift-network-operator/iptables-alerter-4mshv"
Jul 07 17:07:57.619883 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.618325    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/58ef1985-a201-4a7b-9bf9-37dc0aa0e656-host-run-netns\") pod \"ovnkube-node-tf68j\" (UID: \"58ef1985-a201-4a7b-9bf9-37dc0aa0e656\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf68j"
Jul 07 17:07:57.619883 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.618341    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/58ef1985-a201-4a7b-9bf9-37dc0aa0e656-etc-openvswitch\") pod \"ovnkube-node-tf68j\" (UID: \"58ef1985-a201-4a7b-9bf9-37dc0aa0e656\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf68j"
Jul 07 17:07:57.619883 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.618357    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c1a36a2e-2dad-43d1-b604-e538cc26c66d-kubelet-config\") pod \"global-pull-secret-syncer-mhc8x\" (UID: \"c1a36a2e-2dad-43d1-b604-e538cc26c66d\") " pod="kube-system/global-pull-secret-syncer-mhc8x"
Jul 07 17:07:57.619883 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.618375    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x2bt8\" (UniqueName: \"kubernetes.io/projected/4a516c8b-0593-47ed-9e9c-40eea299b87c-kube-api-access-x2bt8\") pod \"network-check-target-7kh6b\" (UID: \"4a516c8b-0593-47ed-9e9c-40eea299b87c\") " pod="openshift-network-diagnostics/network-check-target-7kh6b"
Jul 07 17:07:57.619883 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.618404    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/79353616-7bb8-4034-b3d5-c59eff433273-serviceca\") pod \"node-ca-v72rm\" (UID: \"79353616-7bb8-4034-b3d5-c59eff433273\") " pod="openshift-image-registry/node-ca-v72rm"
Jul 07 17:07:57.619883 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.618425    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/03d68eb3-35c7-4d4a-8a5a-5f541b098e44-multus-cni-dir\") pod \"multus-vl6kx\" (UID: \"03d68eb3-35c7-4d4a-8a5a-5f541b098e44\") " pod="openshift-multus/multus-vl6kx"
Jul 07 17:07:57.619883 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.618442    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b876547b-7002-4de2-bbbe-cb70ea03a96b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w9xzb\" (UID: \"b876547b-7002-4de2-bbbe-cb70ea03a96b\") " pod="openshift-multus/multus-additional-cni-plugins-w9xzb"
Jul 07 17:07:57.624781 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.624759    2562 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162"
Jul 07 17:07:57.669057 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.669021    2562 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-mkqvd"
Jul 07 17:07:57.683716 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.683695    2562 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-mkqvd"
Jul 07 17:07:57.707078 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.707036    2562 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world"
Jul 07 17:07:57.718722 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.718686    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b876547b-7002-4de2-bbbe-cb70ea03a96b-os-release\") pod \"multus-additional-cni-plugins-w9xzb\" (UID: \"b876547b-7002-4de2-bbbe-cb70ea03a96b\") " pod="openshift-multus/multus-additional-cni-plugins-w9xzb"
Jul 07 17:07:57.718785 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.718729    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b876547b-7002-4de2-bbbe-cb70ea03a96b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w9xzb\" (UID: \"b876547b-7002-4de2-bbbe-cb70ea03a96b\") " pod="openshift-multus/multus-additional-cni-plugins-w9xzb"
Jul 07 17:07:57.718785 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.718749    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/03d68eb3-35c7-4d4a-8a5a-5f541b098e44-os-release\") pod \"multus-vl6kx\" (UID: \"03d68eb3-35c7-4d4a-8a5a-5f541b098e44\") " pod="openshift-multus/multus-vl6kx"
Jul 07 17:07:57.718785 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.718770    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/03d68eb3-35c7-4d4a-8a5a-5f541b098e44-multus-socket-dir-parent\") pod \"multus-vl6kx\" (UID: \"03d68eb3-35c7-4d4a-8a5a-5f541b098e44\") " pod="openshift-multus/multus-vl6kx"
Jul 07 17:07:57.718955 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.718797    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7858ec1a-a0d9-4713-b7ae-461a584e165a-sys\") pod \"tuned-kk5zr\" (UID: \"7858ec1a-a0d9-4713-b7ae-461a584e165a\") " pod="openshift-cluster-node-tuning-operator/tuned-kk5zr"
Jul 07 17:07:57.718955 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.718815    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7858ec1a-a0d9-4713-b7ae-461a584e165a-etc-tuned\") pod \"tuned-kk5zr\" (UID: \"7858ec1a-a0d9-4713-b7ae-461a584e165a\") " pod="openshift-cluster-node-tuning-operator/tuned-kk5zr"
Jul 07 17:07:57.718955 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.718841    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b9942424-da4e-4c79-ad5a-3979e01b04b4-sys-fs\") pod \"aws-ebs-csi-driver-node-zw77m\" (UID: \"b9942424-da4e-4c79-ad5a-3979e01b04b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zw77m"
Jul 07 17:07:57.718955 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.718848    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b876547b-7002-4de2-bbbe-cb70ea03a96b-os-release\") pod \"multus-additional-cni-plugins-w9xzb\" (UID: \"b876547b-7002-4de2-bbbe-cb70ea03a96b\") " pod="openshift-multus/multus-additional-cni-plugins-w9xzb"
Jul 07 17:07:57.718955 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.718864    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/03d68eb3-35c7-4d4a-8a5a-5f541b098e44-os-release\") pod \"multus-vl6kx\" (UID: \"03d68eb3-35c7-4d4a-8a5a-5f541b098e44\") " pod="openshift-multus/multus-vl6kx"
Jul 07 17:07:57.718955 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.718867    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/03d68eb3-35c7-4d4a-8a5a-5f541b098e44-cnibin\") pod \"multus-vl6kx\" (UID: \"03d68eb3-35c7-4d4a-8a5a-5f541b098e44\") " pod="openshift-multus/multus-vl6kx"
Jul 07 17:07:57.718955 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.718891    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/03d68eb3-35c7-4d4a-8a5a-5f541b098e44-multus-socket-dir-parent\") pod \"multus-vl6kx\" (UID: \"03d68eb3-35c7-4d4a-8a5a-5f541b098e44\") " pod="openshift-multus/multus-vl6kx"
Jul 07 17:07:57.718955 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.718927    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/03d68eb3-35c7-4d4a-8a5a-5f541b098e44-cnibin\") pod \"multus-vl6kx\" (UID: \"03d68eb3-35c7-4d4a-8a5a-5f541b098e44\") " pod="openshift-multus/multus-vl6kx"
Jul 07 17:07:57.718955 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.718938    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/03d68eb3-35c7-4d4a-8a5a-5f541b098e44-cni-binary-copy\") pod \"multus-vl6kx\" (UID: \"03d68eb3-35c7-4d4a-8a5a-5f541b098e44\") " pod="openshift-multus/multus-vl6kx"
Jul 07 17:07:57.719422 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.718941    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/b9942424-da4e-4c79-ad5a-3979e01b04b4-sys-fs\") pod \"aws-ebs-csi-driver-node-zw77m\" (UID: \"b9942424-da4e-4c79-ad5a-3979e01b04b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zw77m"
Jul 07 17:07:57.719422 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.719028    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/03d68eb3-35c7-4d4a-8a5a-5f541b098e44-host-var-lib-cni-bin\") pod \"multus-vl6kx\" (UID: \"03d68eb3-35c7-4d4a-8a5a-5f541b098e44\") " pod="openshift-multus/multus-vl6kx"
Jul 07 17:07:57.719422 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.719054    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gkvm2\" (UniqueName: \"kubernetes.io/projected/03d68eb3-35c7-4d4a-8a5a-5f541b098e44-kube-api-access-gkvm2\") pod \"multus-vl6kx\" (UID: \"03d68eb3-35c7-4d4a-8a5a-5f541b098e44\") " pod="openshift-multus/multus-vl6kx"
Jul 07 17:07:57.719422 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.719074    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7858ec1a-a0d9-4713-b7ae-461a584e165a-tmp\") pod \"tuned-kk5zr\" (UID: \"7858ec1a-a0d9-4713-b7ae-461a584e165a\") " pod="openshift-cluster-node-tuning-operator/tuned-kk5zr"
Jul 07 17:07:57.719422 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.719091    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5r6wv\" (UniqueName: \"kubernetes.io/projected/7858ec1a-a0d9-4713-b7ae-461a584e165a-kube-api-access-5r6wv\") pod \"tuned-kk5zr\" (UID: \"7858ec1a-a0d9-4713-b7ae-461a584e165a\") " pod="openshift-cluster-node-tuning-operator/tuned-kk5zr"
Jul 07 17:07:57.719422 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.719110    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/58ef1985-a201-4a7b-9bf9-37dc0aa0e656-host-kubelet\") pod \"ovnkube-node-tf68j\" (UID: \"58ef1985-a201-4a7b-9bf9-37dc0aa0e656\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf68j"
Jul 07 17:07:57.719422 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.719135    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/58ef1985-a201-4a7b-9bf9-37dc0aa0e656-run-ovn\") pod \"ovnkube-node-tf68j\" (UID: \"58ef1985-a201-4a7b-9bf9-37dc0aa0e656\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf68j"
Jul 07 17:07:57.719422 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.719157    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/58ef1985-a201-4a7b-9bf9-37dc0aa0e656-ovnkube-config\") pod \"ovnkube-node-tf68j\" (UID: \"58ef1985-a201-4a7b-9bf9-37dc0aa0e656\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf68j"
Jul 07 17:07:57.719422 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.719189    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1a36a2e-2dad-43d1-b604-e538cc26c66d-original-pull-secret\") pod \"global-pull-secret-syncer-mhc8x\" (UID: \"c1a36a2e-2dad-43d1-b604-e538cc26c66d\") " pod="kube-system/global-pull-secret-syncer-mhc8x"
Jul 07 17:07:57.719422 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.719190    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/58ef1985-a201-4a7b-9bf9-37dc0aa0e656-host-kubelet\") pod \"ovnkube-node-tf68j\" (UID: \"58ef1985-a201-4a7b-9bf9-37dc0aa0e656\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf68j"
Jul 07 17:07:57.719422 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.719220    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b876547b-7002-4de2-bbbe-cb70ea03a96b-system-cni-dir\") pod \"multus-additional-cni-plugins-w9xzb\" (UID: \"b876547b-7002-4de2-bbbe-cb70ea03a96b\") " pod="openshift-multus/multus-additional-cni-plugins-w9xzb"
Jul 07 17:07:57.719422 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.719220    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/58ef1985-a201-4a7b-9bf9-37dc0aa0e656-run-ovn\") pod \"ovnkube-node-tf68j\" (UID: \"58ef1985-a201-4a7b-9bf9-37dc0aa0e656\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf68j"
Jul 07 17:07:57.719422 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.719247    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/79353616-7bb8-4034-b3d5-c59eff433273-host\") pod \"node-ca-v72rm\" (UID: \"79353616-7bb8-4034-b3d5-c59eff433273\") " pod="openshift-image-registry/node-ca-v72rm"
Jul 07 17:07:57.719422 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.719244    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/03d68eb3-35c7-4d4a-8a5a-5f541b098e44-host-var-lib-cni-bin\") pod \"multus-vl6kx\" (UID: \"03d68eb3-35c7-4d4a-8a5a-5f541b098e44\") " pod="openshift-multus/multus-vl6kx"
Jul 07 17:07:57.720575 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.719290    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b876547b-7002-4de2-bbbe-cb70ea03a96b-system-cni-dir\") pod \"multus-additional-cni-plugins-w9xzb\" (UID: \"b876547b-7002-4de2-bbbe-cb70ea03a96b\") " pod="openshift-multus/multus-additional-cni-plugins-w9xzb"
Jul 07 17:07:57.720575 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.719293    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/79353616-7bb8-4034-b3d5-c59eff433273-host\") pod \"node-ca-v72rm\" (UID: \"79353616-7bb8-4034-b3d5-c59eff433273\") " pod="openshift-image-registry/node-ca-v72rm"
Jul 07 17:07:57.720575 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.719314    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/03d68eb3-35c7-4d4a-8a5a-5f541b098e44-host-run-multus-certs\") pod \"multus-vl6kx\" (UID: \"03d68eb3-35c7-4d4a-8a5a-5f541b098e44\") " pod="openshift-multus/multus-vl6kx"
Jul 07 17:07:57.720575 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.719351    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7858ec1a-a0d9-4713-b7ae-461a584e165a-run\") pod \"tuned-kk5zr\" (UID: \"7858ec1a-a0d9-4713-b7ae-461a584e165a\") " pod="openshift-cluster-node-tuning-operator/tuned-kk5zr"
Jul 07 17:07:57.720575 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.719378    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/302d72fd-91f1-4d4d-beb5-39e75d18f600-iptables-alerter-script\") pod \"iptables-alerter-4mshv\" (UID: \"302d72fd-91f1-4d4d-beb5-39e75d18f600\") " pod="openshift-network-operator/iptables-alerter-4mshv"
Jul 07 17:07:57.720575 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.719396    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/58ef1985-a201-4a7b-9bf9-37dc0aa0e656-var-lib-openvswitch\") pod \"ovnkube-node-tf68j\" (UID: \"58ef1985-a201-4a7b-9bf9-37dc0aa0e656\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf68j"
Jul 07 17:07:57.720575 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.719415    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/58ef1985-a201-4a7b-9bf9-37dc0aa0e656-env-overrides\") pod \"ovnkube-node-tf68j\" (UID: \"58ef1985-a201-4a7b-9bf9-37dc0aa0e656\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf68j"
Jul 07 17:07:57.720575 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.719440    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tnlt7\" (UniqueName: \"kubernetes.io/projected/3982c405-1bdb-4b6c-928a-fc6fb9e7b360-kube-api-access-tnlt7\") pod \"network-metrics-daemon-rqsv7\" (UID: \"3982c405-1bdb-4b6c-928a-fc6fb9e7b360\") " pod="openshift-multus/network-metrics-daemon-rqsv7"
Jul 07 17:07:57.720575 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.719460    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/58ef1985-a201-4a7b-9bf9-37dc0aa0e656-var-lib-openvswitch\") pod \"ovnkube-node-tf68j\" (UID: \"58ef1985-a201-4a7b-9bf9-37dc0aa0e656\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf68j"
Jul 07 17:07:57.720575 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.719466    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c1a36a2e-2dad-43d1-b604-e538cc26c66d-dbus\") pod \"global-pull-secret-syncer-mhc8x\" (UID: \"c1a36a2e-2dad-43d1-b604-e538cc26c66d\") " pod="kube-system/global-pull-secret-syncer-mhc8x"
Jul 07 17:07:57.720575 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:07:57.719315    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 17:07:57.720575 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.719493    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/03d68eb3-35c7-4d4a-8a5a-5f541b098e44-multus-daemon-config\") pod \"multus-vl6kx\" (UID: \"03d68eb3-35c7-4d4a-8a5a-5f541b098e44\") " pod="openshift-multus/multus-vl6kx"
Jul 07 17:07:57.720575 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.719350    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/03d68eb3-35c7-4d4a-8a5a-5f541b098e44-host-run-multus-certs\") pod \"multus-vl6kx\" (UID: \"03d68eb3-35c7-4d4a-8a5a-5f541b098e44\") " pod="openshift-multus/multus-vl6kx"
Jul 07 17:07:57.720575 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:07:57.719580    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1a36a2e-2dad-43d1-b604-e538cc26c66d-original-pull-secret podName:c1a36a2e-2dad-43d1-b604-e538cc26c66d nodeName:}" failed. No retries permitted until 2026-07-07 17:07:58.219535703 +0000 UTC m=+2.942788881 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c1a36a2e-2dad-43d1-b604-e538cc26c66d-original-pull-secret") pod "global-pull-secret-syncer-mhc8x" (UID: "c1a36a2e-2dad-43d1-b604-e538cc26c66d") : object "kube-system"/"original-pull-secret" not registered
Jul 07 17:07:57.721281 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.719607    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7858ec1a-a0d9-4713-b7ae-461a584e165a-etc-modprobe-d\") pod \"tuned-kk5zr\" (UID: \"7858ec1a-a0d9-4713-b7ae-461a584e165a\") " pod="openshift-cluster-node-tuning-operator/tuned-kk5zr"
Jul 07 17:07:57.721281 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.719645    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/c1a36a2e-2dad-43d1-b604-e538cc26c66d-dbus\") pod \"global-pull-secret-syncer-mhc8x\" (UID: \"c1a36a2e-2dad-43d1-b604-e538cc26c66d\") " pod="kube-system/global-pull-secret-syncer-mhc8x"
Jul 07 17:07:57.721281 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.719644    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7858ec1a-a0d9-4713-b7ae-461a584e165a-etc-sysconfig\") pod \"tuned-kk5zr\" (UID: \"7858ec1a-a0d9-4713-b7ae-461a584e165a\") " pod="openshift-cluster-node-tuning-operator/tuned-kk5zr"
Jul 07 17:07:57.721281 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.719664    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/03d68eb3-35c7-4d4a-8a5a-5f541b098e44-cni-binary-copy\") pod \"multus-vl6kx\" (UID: \"03d68eb3-35c7-4d4a-8a5a-5f541b098e44\") " pod="openshift-multus/multus-vl6kx"
Jul 07 17:07:57.721281 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.719691    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/58ef1985-a201-4a7b-9bf9-37dc0aa0e656-log-socket\") pod \"ovnkube-node-tf68j\" (UID: \"58ef1985-a201-4a7b-9bf9-37dc0aa0e656\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf68j"
Jul 07 17:07:57.721281 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.719721    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b876547b-7002-4de2-bbbe-cb70ea03a96b-cnibin\") pod \"multus-additional-cni-plugins-w9xzb\" (UID: \"b876547b-7002-4de2-bbbe-cb70ea03a96b\") " pod="openshift-multus/multus-additional-cni-plugins-w9xzb"
Jul 07 17:07:57.721281 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.719751    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/03d68eb3-35c7-4d4a-8a5a-5f541b098e44-hostroot\") pod \"multus-vl6kx\" (UID: \"03d68eb3-35c7-4d4a-8a5a-5f541b098e44\") " pod="openshift-multus/multus-vl6kx"
Jul 07 17:07:57.721281 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.719779    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7858ec1a-a0d9-4713-b7ae-461a584e165a-lib-modules\") pod \"tuned-kk5zr\" (UID: \"7858ec1a-a0d9-4713-b7ae-461a584e165a\") " pod="openshift-cluster-node-tuning-operator/tuned-kk5zr"
Jul 07 17:07:57.721281 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.719791    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/58ef1985-a201-4a7b-9bf9-37dc0aa0e656-log-socket\") pod \"ovnkube-node-tf68j\" (UID: \"58ef1985-a201-4a7b-9bf9-37dc0aa0e656\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf68j"
Jul 07 17:07:57.721281 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.719816    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/302d72fd-91f1-4d4d-beb5-39e75d18f600-host-slash\") pod \"iptables-alerter-4mshv\" (UID: \"302d72fd-91f1-4d4d-beb5-39e75d18f600\") " pod="openshift-network-operator/iptables-alerter-4mshv"
Jul 07 17:07:57.721281 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.719825    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b876547b-7002-4de2-bbbe-cb70ea03a96b-cnibin\") pod \"multus-additional-cni-plugins-w9xzb\" (UID: \"b876547b-7002-4de2-bbbe-cb70ea03a96b\") " pod="openshift-multus/multus-additional-cni-plugins-w9xzb"
Jul 07 17:07:57.721281 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.719842    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/58ef1985-a201-4a7b-9bf9-37dc0aa0e656-host-run-netns\") pod \"ovnkube-node-tf68j\" (UID: \"58ef1985-a201-4a7b-9bf9-37dc0aa0e656\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf68j"
Jul 07 17:07:57.721281 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.719850    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/03d68eb3-35c7-4d4a-8a5a-5f541b098e44-hostroot\") pod \"multus-vl6kx\" (UID: \"03d68eb3-35c7-4d4a-8a5a-5f541b098e44\") " pod="openshift-multus/multus-vl6kx"
Jul 07 17:07:57.721281 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.719858    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/58ef1985-a201-4a7b-9bf9-37dc0aa0e656-ovnkube-config\") pod \"ovnkube-node-tf68j\" (UID: \"58ef1985-a201-4a7b-9bf9-37dc0aa0e656\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf68j"
Jul 07 17:07:57.721281 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.719870    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/58ef1985-a201-4a7b-9bf9-37dc0aa0e656-etc-openvswitch\") pod \"ovnkube-node-tf68j\" (UID: \"58ef1985-a201-4a7b-9bf9-37dc0aa0e656\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf68j"
Jul 07 17:07:57.721969 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.719904    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/302d72fd-91f1-4d4d-beb5-39e75d18f600-host-slash\") pod \"iptables-alerter-4mshv\" (UID: \"302d72fd-91f1-4d4d-beb5-39e75d18f600\") " pod="openshift-network-operator/iptables-alerter-4mshv"
Jul 07 17:07:57.721969 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.719907    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c1a36a2e-2dad-43d1-b604-e538cc26c66d-kubelet-config\") pod \"global-pull-secret-syncer-mhc8x\" (UID: \"c1a36a2e-2dad-43d1-b604-e538cc26c66d\") " pod="kube-system/global-pull-secret-syncer-mhc8x"
Jul 07 17:07:57.721969 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.719939    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/58ef1985-a201-4a7b-9bf9-37dc0aa0e656-etc-openvswitch\") pod \"ovnkube-node-tf68j\" (UID: \"58ef1985-a201-4a7b-9bf9-37dc0aa0e656\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf68j"
Jul 07 17:07:57.721969 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.719952    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2bt8\" (UniqueName: \"kubernetes.io/projected/4a516c8b-0593-47ed-9e9c-40eea299b87c-kube-api-access-x2bt8\") pod \"network-check-target-7kh6b\" (UID: \"4a516c8b-0593-47ed-9e9c-40eea299b87c\") " pod="openshift-network-diagnostics/network-check-target-7kh6b"
Jul 07 17:07:57.721969 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.719958    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/c1a36a2e-2dad-43d1-b604-e538cc26c66d-kubelet-config\") pod \"global-pull-secret-syncer-mhc8x\" (UID: \"c1a36a2e-2dad-43d1-b604-e538cc26c66d\") " pod="kube-system/global-pull-secret-syncer-mhc8x"
Jul 07 17:07:57.721969 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.719907    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/58ef1985-a201-4a7b-9bf9-37dc0aa0e656-host-run-netns\") pod \"ovnkube-node-tf68j\" (UID: \"58ef1985-a201-4a7b-9bf9-37dc0aa0e656\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf68j"
Jul 07 17:07:57.721969 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.719998    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/79353616-7bb8-4034-b3d5-c59eff433273-serviceca\") pod \"node-ca-v72rm\" (UID: \"79353616-7bb8-4034-b3d5-c59eff433273\") " pod="openshift-image-registry/node-ca-v72rm"
Jul 07 17:07:57.721969 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.720029    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/58ef1985-a201-4a7b-9bf9-37dc0aa0e656-env-overrides\") pod \"ovnkube-node-tf68j\" (UID: \"58ef1985-a201-4a7b-9bf9-37dc0aa0e656\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf68j"
Jul 07 17:07:57.721969 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.720040    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/03d68eb3-35c7-4d4a-8a5a-5f541b098e44-multus-cni-dir\") pod \"multus-vl6kx\" (UID: \"03d68eb3-35c7-4d4a-8a5a-5f541b098e44\") " pod="openshift-multus/multus-vl6kx"
Jul 07 17:07:57.721969 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.720079    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b876547b-7002-4de2-bbbe-cb70ea03a96b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w9xzb\" (UID: \"b876547b-7002-4de2-bbbe-cb70ea03a96b\") " pod="openshift-multus/multus-additional-cni-plugins-w9xzb"
Jul 07 17:07:57.721969 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.720100    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/03d68eb3-35c7-4d4a-8a5a-5f541b098e44-host-run-netns\") pod \"multus-vl6kx\" (UID: \"03d68eb3-35c7-4d4a-8a5a-5f541b098e44\") " pod="openshift-multus/multus-vl6kx"
Jul 07 17:07:57.721969 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.720116    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/03d68eb3-35c7-4d4a-8a5a-5f541b098e44-host-var-lib-kubelet\") pod \"multus-vl6kx\" (UID: \"03d68eb3-35c7-4d4a-8a5a-5f541b098e44\") " pod="openshift-multus/multus-vl6kx"
Jul 07 17:07:57.721969 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.720118    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/03d68eb3-35c7-4d4a-8a5a-5f541b098e44-multus-cni-dir\") pod \"multus-vl6kx\" (UID: \"03d68eb3-35c7-4d4a-8a5a-5f541b098e44\") " pod="openshift-multus/multus-vl6kx"
Jul 07 17:07:57.721969 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.720143    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/302d72fd-91f1-4d4d-beb5-39e75d18f600-iptables-alerter-script\") pod \"iptables-alerter-4mshv\" (UID: \"302d72fd-91f1-4d4d-beb5-39e75d18f600\") " pod="openshift-network-operator/iptables-alerter-4mshv"
Jul 07 17:07:57.721969 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.720155    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/03d68eb3-35c7-4d4a-8a5a-5f541b098e44-host-var-lib-kubelet\") pod \"multus-vl6kx\" (UID: \"03d68eb3-35c7-4d4a-8a5a-5f541b098e44\") " pod="openshift-multus/multus-vl6kx"
Jul 07 17:07:57.722464 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.720167    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/b876547b-7002-4de2-bbbe-cb70ea03a96b-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w9xzb\" (UID: \"b876547b-7002-4de2-bbbe-cb70ea03a96b\") " pod="openshift-multus/multus-additional-cni-plugins-w9xzb"
Jul 07 17:07:57.722464 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.720186    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7858ec1a-a0d9-4713-b7ae-461a584e165a-etc-sysctl-d\") pod \"tuned-kk5zr\" (UID: \"7858ec1a-a0d9-4713-b7ae-461a584e165a\") " pod="openshift-cluster-node-tuning-operator/tuned-kk5zr"
Jul 07 17:07:57.722464 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.720224    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/03d68eb3-35c7-4d4a-8a5a-5f541b098e44-host-run-netns\") pod \"multus-vl6kx\" (UID: \"03d68eb3-35c7-4d4a-8a5a-5f541b098e44\") " pod="openshift-multus/multus-vl6kx"
Jul 07 17:07:57.722464 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.720226    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7858ec1a-a0d9-4713-b7ae-461a584e165a-host\") pod \"tuned-kk5zr\" (UID: \"7858ec1a-a0d9-4713-b7ae-461a584e165a\") " pod="openshift-cluster-node-tuning-operator/tuned-kk5zr"
Jul 07 17:07:57.722464 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.720244    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/03d68eb3-35c7-4d4a-8a5a-5f541b098e44-multus-daemon-config\") pod \"multus-vl6kx\" (UID: \"03d68eb3-35c7-4d4a-8a5a-5f541b098e44\") " pod="openshift-multus/multus-vl6kx"
Jul 07 17:07:57.722464 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.720271    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b9942424-da4e-4c79-ad5a-3979e01b04b4-etc-selinux\") pod \"aws-ebs-csi-driver-node-zw77m\" (UID: \"b9942424-da4e-4c79-ad5a-3979e01b04b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zw77m"
Jul 07 17:07:57.722464 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.720301    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b876547b-7002-4de2-bbbe-cb70ea03a96b-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w9xzb\" (UID: \"b876547b-7002-4de2-bbbe-cb70ea03a96b\") " pod="openshift-multus/multus-additional-cni-plugins-w9xzb"
Jul 07 17:07:57.722464 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.720301    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7858ec1a-a0d9-4713-b7ae-461a584e165a-etc-sysctl-conf\") pod \"tuned-kk5zr\" (UID: \"7858ec1a-a0d9-4713-b7ae-461a584e165a\") " pod="openshift-cluster-node-tuning-operator/tuned-kk5zr"
Jul 07 17:07:57.722464 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.720366    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/58ef1985-a201-4a7b-9bf9-37dc0aa0e656-host-slash\") pod \"ovnkube-node-tf68j\" (UID: \"58ef1985-a201-4a7b-9bf9-37dc0aa0e656\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf68j"
Jul 07 17:07:57.722464 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.720396    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/b9942424-da4e-4c79-ad5a-3979e01b04b4-etc-selinux\") pod \"aws-ebs-csi-driver-node-zw77m\" (UID: \"b9942424-da4e-4c79-ad5a-3979e01b04b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zw77m"
Jul 07 17:07:57.722464 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.720395    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/58ef1985-a201-4a7b-9bf9-37dc0aa0e656-run-openvswitch\") pod \"ovnkube-node-tf68j\" (UID: \"58ef1985-a201-4a7b-9bf9-37dc0aa0e656\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf68j"
Jul 07 17:07:57.722464 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.720422    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/79353616-7bb8-4034-b3d5-c59eff433273-serviceca\") pod \"node-ca-v72rm\" (UID: \"79353616-7bb8-4034-b3d5-c59eff433273\") " pod="openshift-image-registry/node-ca-v72rm"
Jul 07 17:07:57.722464 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.720426    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/58ef1985-a201-4a7b-9bf9-37dc0aa0e656-host-slash\") pod \"ovnkube-node-tf68j\" (UID: \"58ef1985-a201-4a7b-9bf9-37dc0aa0e656\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf68j"
Jul 07 17:07:57.722464 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.720449    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/58ef1985-a201-4a7b-9bf9-37dc0aa0e656-run-openvswitch\") pod \"ovnkube-node-tf68j\" (UID: \"58ef1985-a201-4a7b-9bf9-37dc0aa0e656\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf68j"
Jul 07 17:07:57.722880 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.720464    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/58ef1985-a201-4a7b-9bf9-37dc0aa0e656-host-run-ovn-kubernetes\") pod \"ovnkube-node-tf68j\" (UID: \"58ef1985-a201-4a7b-9bf9-37dc0aa0e656\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf68j"
Jul 07 17:07:57.722880 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.720486    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvqzj\" (UniqueName: \"kubernetes.io/projected/58ef1985-a201-4a7b-9bf9-37dc0aa0e656-kube-api-access-vvqzj\") pod \"ovnkube-node-tf68j\" (UID: \"58ef1985-a201-4a7b-9bf9-37dc0aa0e656\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf68j"
Jul 07 17:07:57.722880 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.720509    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gdj2r\" (UniqueName: \"kubernetes.io/projected/b9942424-da4e-4c79-ad5a-3979e01b04b4-kube-api-access-gdj2r\") pod \"aws-ebs-csi-driver-node-zw77m\" (UID: \"b9942424-da4e-4c79-ad5a-3979e01b04b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zw77m"
Jul 07 17:07:57.722880 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.720531    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/03d68eb3-35c7-4d4a-8a5a-5f541b098e44-multus-conf-dir\") pod \"multus-vl6kx\" (UID: \"03d68eb3-35c7-4d4a-8a5a-5f541b098e44\") " pod="openshift-multus/multus-vl6kx"
Jul 07 17:07:57.722880 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.720552    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/58ef1985-a201-4a7b-9bf9-37dc0aa0e656-host-run-ovn-kubernetes\") pod \"ovnkube-node-tf68j\" (UID: \"58ef1985-a201-4a7b-9bf9-37dc0aa0e656\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf68j"
Jul 07 17:07:57.722880 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.720556    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/58ef1985-a201-4a7b-9bf9-37dc0aa0e656-host-cni-bin\") pod \"ovnkube-node-tf68j\" (UID: \"58ef1985-a201-4a7b-9bf9-37dc0aa0e656\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf68j"
Jul 07 17:07:57.722880 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.720591    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/58ef1985-a201-4a7b-9bf9-37dc0aa0e656-host-cni-bin\") pod \"ovnkube-node-tf68j\" (UID: \"58ef1985-a201-4a7b-9bf9-37dc0aa0e656\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf68j"
Jul 07 17:07:57.722880 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.720601    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/58ef1985-a201-4a7b-9bf9-37dc0aa0e656-ovnkube-script-lib\") pod \"ovnkube-node-tf68j\" (UID: \"58ef1985-a201-4a7b-9bf9-37dc0aa0e656\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf68j"
Jul 07 17:07:57.722880 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.720631    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/03d68eb3-35c7-4d4a-8a5a-5f541b098e44-multus-conf-dir\") pod \"multus-vl6kx\" (UID: \"03d68eb3-35c7-4d4a-8a5a-5f541b098e44\") " pod="openshift-multus/multus-vl6kx"
Jul 07 17:07:57.722880 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.720656    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b876547b-7002-4de2-bbbe-cb70ea03a96b-cni-binary-copy\") pod \"multus-additional-cni-plugins-w9xzb\" (UID: \"b876547b-7002-4de2-bbbe-cb70ea03a96b\") " pod="openshift-multus/multus-additional-cni-plugins-w9xzb"
Jul 07 17:07:57.722880 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.720681    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b876547b-7002-4de2-bbbe-cb70ea03a96b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w9xzb\" (UID: \"b876547b-7002-4de2-bbbe-cb70ea03a96b\") " pod="openshift-multus/multus-additional-cni-plugins-w9xzb"
Jul 07 17:07:57.722880 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.720705    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/50fc3df0-8a43-48db-9b3e-80d9bd4c03eb-konnectivity-ca\") pod \"konnectivity-agent-28xn9\" (UID: \"50fc3df0-8a43-48db-9b3e-80d9bd4c03eb\") " pod="kube-system/konnectivity-agent-28xn9"
Jul 07 17:07:57.722880 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.720723    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/36340fd9-83c5-4baf-b02d-9fc7f5e86485-hosts-file\") pod \"node-resolver-7xdlh\" (UID: \"36340fd9-83c5-4baf-b02d-9fc7f5e86485\") " pod="openshift-dns/node-resolver-7xdlh"
Jul 07 17:07:57.722880 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.720740    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36340fd9-83c5-4baf-b02d-9fc7f5e86485-tmp-dir\") pod \"node-resolver-7xdlh\" (UID: \"36340fd9-83c5-4baf-b02d-9fc7f5e86485\") " pod="openshift-dns/node-resolver-7xdlh"
Jul 07 17:07:57.723369 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.720843    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b9942424-da4e-4c79-ad5a-3979e01b04b4-registration-dir\") pod \"aws-ebs-csi-driver-node-zw77m\" (UID: \"b9942424-da4e-4c79-ad5a-3979e01b04b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zw77m"
Jul 07 17:07:57.723369 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.720898    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/b9942424-da4e-4c79-ad5a-3979e01b04b4-registration-dir\") pod \"aws-ebs-csi-driver-node-zw77m\" (UID: \"b9942424-da4e-4c79-ad5a-3979e01b04b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zw77m"
Jul 07 17:07:57.723369 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.720903    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/36340fd9-83c5-4baf-b02d-9fc7f5e86485-hosts-file\") pod \"node-resolver-7xdlh\" (UID: \"36340fd9-83c5-4baf-b02d-9fc7f5e86485\") " pod="openshift-dns/node-resolver-7xdlh"
Jul 07 17:07:57.723369 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.720931    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5tdvr\" (UniqueName: \"kubernetes.io/projected/79353616-7bb8-4034-b3d5-c59eff433273-kube-api-access-5tdvr\") pod \"node-ca-v72rm\" (UID: \"79353616-7bb8-4034-b3d5-c59eff433273\") " pod="openshift-image-registry/node-ca-v72rm"
Jul 07 17:07:57.723369 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.720959    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/03d68eb3-35c7-4d4a-8a5a-5f541b098e44-system-cni-dir\") pod \"multus-vl6kx\" (UID: \"03d68eb3-35c7-4d4a-8a5a-5f541b098e44\") " pod="openshift-multus/multus-vl6kx"
Jul 07 17:07:57.723369 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.720983    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/58ef1985-a201-4a7b-9bf9-37dc0aa0e656-run-systemd\") pod \"ovnkube-node-tf68j\" (UID: \"58ef1985-a201-4a7b-9bf9-37dc0aa0e656\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf68j"
Jul 07 17:07:57.723369 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.721006    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/58ef1985-a201-4a7b-9bf9-37dc0aa0e656-node-log\") pod \"ovnkube-node-tf68j\" (UID: \"58ef1985-a201-4a7b-9bf9-37dc0aa0e656\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf68j"
Jul 07 17:07:57.723369 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.721030    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b9942424-da4e-4c79-ad5a-3979e01b04b4-device-dir\") pod \"aws-ebs-csi-driver-node-zw77m\" (UID: \"b9942424-da4e-4c79-ad5a-3979e01b04b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zw77m"
Jul 07 17:07:57.723369 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.721059    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/03d68eb3-35c7-4d4a-8a5a-5f541b098e44-host-var-lib-cni-multus\") pod \"multus-vl6kx\" (UID: \"03d68eb3-35c7-4d4a-8a5a-5f541b098e44\") " pod="openshift-multus/multus-vl6kx"
Jul 07 17:07:57.723369 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.721091    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7858ec1a-a0d9-4713-b7ae-461a584e165a-var-lib-kubelet\") pod \"tuned-kk5zr\" (UID: \"7858ec1a-a0d9-4713-b7ae-461a584e165a\") " pod="openshift-cluster-node-tuning-operator/tuned-kk5zr"
Jul 07 17:07:57.723369 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.721108    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/36340fd9-83c5-4baf-b02d-9fc7f5e86485-tmp-dir\") pod \"node-resolver-7xdlh\" (UID: \"36340fd9-83c5-4baf-b02d-9fc7f5e86485\") " pod="openshift-dns/node-resolver-7xdlh"
Jul 07 17:07:57.723369 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.721120    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9sbr\" (UniqueName: \"kubernetes.io/projected/302d72fd-91f1-4d4d-beb5-39e75d18f600-kube-api-access-m9sbr\") pod \"iptables-alerter-4mshv\" (UID: \"302d72fd-91f1-4d4d-beb5-39e75d18f600\") " pod="openshift-network-operator/iptables-alerter-4mshv"
Jul 07 17:07:57.723369 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.721128    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/58ef1985-a201-4a7b-9bf9-37dc0aa0e656-ovnkube-script-lib\") pod \"ovnkube-node-tf68j\" (UID: \"58ef1985-a201-4a7b-9bf9-37dc0aa0e656\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf68j"
Jul 07 17:07:57.723369 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.721146    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/58ef1985-a201-4a7b-9bf9-37dc0aa0e656-ovn-node-metrics-cert\") pod \"ovnkube-node-tf68j\" (UID: \"58ef1985-a201-4a7b-9bf9-37dc0aa0e656\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf68j"
Jul 07 17:07:57.723784 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.721183    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/b9942424-da4e-4c79-ad5a-3979e01b04b4-device-dir\") pod \"aws-ebs-csi-driver-node-zw77m\" (UID: \"b9942424-da4e-4c79-ad5a-3979e01b04b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zw77m"
Jul 07 17:07:57.723784 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.721166    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/58ef1985-a201-4a7b-9bf9-37dc0aa0e656-node-log\") pod \"ovnkube-node-tf68j\" (UID: \"58ef1985-a201-4a7b-9bf9-37dc0aa0e656\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf68j"
Jul 07 17:07:57.723784 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.721183    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/03d68eb3-35c7-4d4a-8a5a-5f541b098e44-host-var-lib-cni-multus\") pod \"multus-vl6kx\" (UID: \"03d68eb3-35c7-4d4a-8a5a-5f541b098e44\") " pod="openshift-multus/multus-vl6kx"
Jul 07 17:07:57.723784 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.721199    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3982c405-1bdb-4b6c-928a-fc6fb9e7b360-metrics-certs\") pod \"network-metrics-daemon-rqsv7\" (UID: \"3982c405-1bdb-4b6c-928a-fc6fb9e7b360\") " pod="openshift-multus/network-metrics-daemon-rqsv7"
Jul 07 17:07:57.723784 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.721252    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/58ef1985-a201-4a7b-9bf9-37dc0aa0e656-run-systemd\") pod \"ovnkube-node-tf68j\" (UID: \"58ef1985-a201-4a7b-9bf9-37dc0aa0e656\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf68j"
Jul 07 17:07:57.723784 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.721253    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b9942424-da4e-4c79-ad5a-3979e01b04b4-socket-dir\") pod \"aws-ebs-csi-driver-node-zw77m\" (UID: \"b9942424-da4e-4c79-ad5a-3979e01b04b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zw77m"
Jul 07 17:07:57.723784 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:07:57.721284    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:07:57.723784 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.721288    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7858ec1a-a0d9-4713-b7ae-461a584e165a-etc-kubernetes\") pod \"tuned-kk5zr\" (UID: \"7858ec1a-a0d9-4713-b7ae-461a584e165a\") " pod="openshift-cluster-node-tuning-operator/tuned-kk5zr"
Jul 07 17:07:57.723784 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.721316    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/50fc3df0-8a43-48db-9b3e-80d9bd4c03eb-agent-certs\") pod \"konnectivity-agent-28xn9\" (UID: \"50fc3df0-8a43-48db-9b3e-80d9bd4c03eb\") " pod="kube-system/konnectivity-agent-28xn9"
Jul 07 17:07:57.723784 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:07:57.721338    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3982c405-1bdb-4b6c-928a-fc6fb9e7b360-metrics-certs podName:3982c405-1bdb-4b6c-928a-fc6fb9e7b360 nodeName:}" failed. No retries permitted until 2026-07-07 17:07:58.221318732 +0000 UTC m=+2.944571921 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3982c405-1bdb-4b6c-928a-fc6fb9e7b360-metrics-certs") pod "network-metrics-daemon-rqsv7" (UID: "3982c405-1bdb-4b6c-928a-fc6fb9e7b360") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:07:57.723784 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.721359    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/b9942424-da4e-4c79-ad5a-3979e01b04b4-socket-dir\") pod \"aws-ebs-csi-driver-node-zw77m\" (UID: \"b9942424-da4e-4c79-ad5a-3979e01b04b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zw77m"
Jul 07 17:07:57.723784 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.721366    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/58ef1985-a201-4a7b-9bf9-37dc0aa0e656-systemd-units\") pod \"ovnkube-node-tf68j\" (UID: \"58ef1985-a201-4a7b-9bf9-37dc0aa0e656\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf68j"
Jul 07 17:07:57.723784 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.721394    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/58ef1985-a201-4a7b-9bf9-37dc0aa0e656-host-cni-netd\") pod \"ovnkube-node-tf68j\" (UID: \"58ef1985-a201-4a7b-9bf9-37dc0aa0e656\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf68j"
Jul 07 17:07:57.723784 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.721407    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/b876547b-7002-4de2-bbbe-cb70ea03a96b-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w9xzb\" (UID: \"b876547b-7002-4de2-bbbe-cb70ea03a96b\") " pod="openshift-multus/multus-additional-cni-plugins-w9xzb"
Jul 07 17:07:57.724207 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.721421    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/03d68eb3-35c7-4d4a-8a5a-5f541b098e44-system-cni-dir\") pod \"multus-vl6kx\" (UID: \"03d68eb3-35c7-4d4a-8a5a-5f541b098e44\") " pod="openshift-multus/multus-vl6kx"
Jul 07 17:07:57.724207 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.721424    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r2jgg\" (UniqueName: \"kubernetes.io/projected/b876547b-7002-4de2-bbbe-cb70ea03a96b-kube-api-access-r2jgg\") pod \"multus-additional-cni-plugins-w9xzb\" (UID: \"b876547b-7002-4de2-bbbe-cb70ea03a96b\") " pod="openshift-multus/multus-additional-cni-plugins-w9xzb"
Jul 07 17:07:57.724207 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.721452    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/58ef1985-a201-4a7b-9bf9-37dc0aa0e656-systemd-units\") pod \"ovnkube-node-tf68j\" (UID: \"58ef1985-a201-4a7b-9bf9-37dc0aa0e656\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf68j"
Jul 07 17:07:57.724207 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.721408    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b876547b-7002-4de2-bbbe-cb70ea03a96b-cni-binary-copy\") pod \"multus-additional-cni-plugins-w9xzb\" (UID: \"b876547b-7002-4de2-bbbe-cb70ea03a96b\") " pod="openshift-multus/multus-additional-cni-plugins-w9xzb"
Jul 07 17:07:57.724207 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.721408    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/50fc3df0-8a43-48db-9b3e-80d9bd4c03eb-konnectivity-ca\") pod \"konnectivity-agent-28xn9\" (UID: \"50fc3df0-8a43-48db-9b3e-80d9bd4c03eb\") " pod="kube-system/konnectivity-agent-28xn9"
Jul 07 17:07:57.724207 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.721453    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b9942424-da4e-4c79-ad5a-3979e01b04b4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zw77m\" (UID: \"b9942424-da4e-4c79-ad5a-3979e01b04b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zw77m"
Jul 07 17:07:57.724207 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.721455    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/58ef1985-a201-4a7b-9bf9-37dc0aa0e656-host-cni-netd\") pod \"ovnkube-node-tf68j\" (UID: \"58ef1985-a201-4a7b-9bf9-37dc0aa0e656\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf68j"
Jul 07 17:07:57.724207 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.721508    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/03d68eb3-35c7-4d4a-8a5a-5f541b098e44-host-run-k8s-cni-cncf-io\") pod \"multus-vl6kx\" (UID: \"03d68eb3-35c7-4d4a-8a5a-5f541b098e44\") " pod="openshift-multus/multus-vl6kx"
Jul 07 17:07:57.724207 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.721512    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/b9942424-da4e-4c79-ad5a-3979e01b04b4-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zw77m\" (UID: \"b9942424-da4e-4c79-ad5a-3979e01b04b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zw77m"
Jul 07 17:07:57.724207 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.721536    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03d68eb3-35c7-4d4a-8a5a-5f541b098e44-etc-kubernetes\") pod \"multus-vl6kx\" (UID: \"03d68eb3-35c7-4d4a-8a5a-5f541b098e44\") " pod="openshift-multus/multus-vl6kx"
Jul 07 17:07:57.724207 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.721557    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/03d68eb3-35c7-4d4a-8a5a-5f541b098e44-host-run-k8s-cni-cncf-io\") pod \"multus-vl6kx\" (UID: \"03d68eb3-35c7-4d4a-8a5a-5f541b098e44\") " pod="openshift-multus/multus-vl6kx"
Jul 07 17:07:57.724207 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.721564    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7858ec1a-a0d9-4713-b7ae-461a584e165a-etc-systemd\") pod \"tuned-kk5zr\" (UID: \"7858ec1a-a0d9-4713-b7ae-461a584e165a\") " pod="openshift-cluster-node-tuning-operator/tuned-kk5zr"
Jul 07 17:07:57.724207 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.721576    2562 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory"
Jul 07 17:07:57.724207 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.721599    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f9hqw\" (UniqueName: \"kubernetes.io/projected/36340fd9-83c5-4baf-b02d-9fc7f5e86485-kube-api-access-f9hqw\") pod \"node-resolver-7xdlh\" (UID: \"36340fd9-83c5-4baf-b02d-9fc7f5e86485\") " pod="openshift-dns/node-resolver-7xdlh"
Jul 07 17:07:57.724207 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.721604    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/03d68eb3-35c7-4d4a-8a5a-5f541b098e44-etc-kubernetes\") pod \"multus-vl6kx\" (UID: \"03d68eb3-35c7-4d4a-8a5a-5f541b098e44\") " pod="openshift-multus/multus-vl6kx"
Jul 07 17:07:57.724694 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.721621    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/58ef1985-a201-4a7b-9bf9-37dc0aa0e656-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tf68j\" (UID: \"58ef1985-a201-4a7b-9bf9-37dc0aa0e656\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf68j"
Jul 07 17:07:57.724694 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.721693    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/58ef1985-a201-4a7b-9bf9-37dc0aa0e656-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-tf68j\" (UID: \"58ef1985-a201-4a7b-9bf9-37dc0aa0e656\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf68j"
Jul 07 17:07:57.725138 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.725107    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/58ef1985-a201-4a7b-9bf9-37dc0aa0e656-ovn-node-metrics-cert\") pod \"ovnkube-node-tf68j\" (UID: \"58ef1985-a201-4a7b-9bf9-37dc0aa0e656\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf68j"
Jul 07 17:07:57.725259 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.725195    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/50fc3df0-8a43-48db-9b3e-80d9bd4c03eb-agent-certs\") pod \"konnectivity-agent-28xn9\" (UID: \"50fc3df0-8a43-48db-9b3e-80d9bd4c03eb\") " pod="kube-system/konnectivity-agent-28xn9"
Jul 07 17:07:57.730128 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.730105    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gkvm2\" (UniqueName: \"kubernetes.io/projected/03d68eb3-35c7-4d4a-8a5a-5f541b098e44-kube-api-access-gkvm2\") pod \"multus-vl6kx\" (UID: \"03d68eb3-35c7-4d4a-8a5a-5f541b098e44\") " pod="openshift-multus/multus-vl6kx"
Jul 07 17:07:57.730333 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.730114    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tnlt7\" (UniqueName: \"kubernetes.io/projected/3982c405-1bdb-4b6c-928a-fc6fb9e7b360-kube-api-access-tnlt7\") pod \"network-metrics-daemon-rqsv7\" (UID: \"3982c405-1bdb-4b6c-928a-fc6fb9e7b360\") " pod="openshift-multus/network-metrics-daemon-rqsv7"
Jul 07 17:07:57.730392 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:07:57.730377    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 17:07:57.730432 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:07:57.730394    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 17:07:57.730432 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:07:57.730405    2562 projected.go:196] Error preparing data for projected volume kube-api-access-x2bt8 for pod openshift-network-diagnostics/network-check-target-7kh6b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:07:57.730494 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:07:57.730456    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a516c8b-0593-47ed-9e9c-40eea299b87c-kube-api-access-x2bt8 podName:4a516c8b-0593-47ed-9e9c-40eea299b87c nodeName:}" failed. No retries permitted until 2026-07-07 17:07:58.230440882 +0000 UTC m=+2.953694059 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-x2bt8" (UniqueName: "kubernetes.io/projected/4a516c8b-0593-47ed-9e9c-40eea299b87c-kube-api-access-x2bt8") pod "network-check-target-7kh6b" (UID: "4a516c8b-0593-47ed-9e9c-40eea299b87c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:07:57.732067 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.732042    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gdj2r\" (UniqueName: \"kubernetes.io/projected/b9942424-da4e-4c79-ad5a-3979e01b04b4-kube-api-access-gdj2r\") pod \"aws-ebs-csi-driver-node-zw77m\" (UID: \"b9942424-da4e-4c79-ad5a-3979e01b04b4\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zw77m"
Jul 07 17:07:57.733879 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.733851    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5tdvr\" (UniqueName: \"kubernetes.io/projected/79353616-7bb8-4034-b3d5-c59eff433273-kube-api-access-5tdvr\") pod \"node-ca-v72rm\" (UID: \"79353616-7bb8-4034-b3d5-c59eff433273\") " pod="openshift-image-registry/node-ca-v72rm"
Jul 07 17:07:57.733978 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.733889    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvqzj\" (UniqueName: \"kubernetes.io/projected/58ef1985-a201-4a7b-9bf9-37dc0aa0e656-kube-api-access-vvqzj\") pod \"ovnkube-node-tf68j\" (UID: \"58ef1985-a201-4a7b-9bf9-37dc0aa0e656\") " pod="openshift-ovn-kubernetes/ovnkube-node-tf68j"
Jul 07 17:07:57.735085 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.735057    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9sbr\" (UniqueName: \"kubernetes.io/projected/302d72fd-91f1-4d4d-beb5-39e75d18f600-kube-api-access-m9sbr\") pod \"iptables-alerter-4mshv\" (UID: \"302d72fd-91f1-4d4d-beb5-39e75d18f600\") " pod="openshift-network-operator/iptables-alerter-4mshv"
Jul 07 17:07:57.736660 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.736640    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f9hqw\" (UniqueName: \"kubernetes.io/projected/36340fd9-83c5-4baf-b02d-9fc7f5e86485-kube-api-access-f9hqw\") pod \"node-resolver-7xdlh\" (UID: \"36340fd9-83c5-4baf-b02d-9fc7f5e86485\") " pod="openshift-dns/node-resolver-7xdlh"
Jul 07 17:07:57.736943 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.736921    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r2jgg\" (UniqueName: \"kubernetes.io/projected/b876547b-7002-4de2-bbbe-cb70ea03a96b-kube-api-access-r2jgg\") pod \"multus-additional-cni-plugins-w9xzb\" (UID: \"b876547b-7002-4de2-bbbe-cb70ea03a96b\") " pod="openshift-multus/multus-additional-cni-plugins-w9xzb"
Jul 07 17:07:57.823032 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.822924    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7858ec1a-a0d9-4713-b7ae-461a584e165a-etc-tuned\") pod \"tuned-kk5zr\" (UID: \"7858ec1a-a0d9-4713-b7ae-461a584e165a\") " pod="openshift-cluster-node-tuning-operator/tuned-kk5zr"
Jul 07 17:07:57.823032 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.822971    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7858ec1a-a0d9-4713-b7ae-461a584e165a-tmp\") pod \"tuned-kk5zr\" (UID: \"7858ec1a-a0d9-4713-b7ae-461a584e165a\") " pod="openshift-cluster-node-tuning-operator/tuned-kk5zr"
Jul 07 17:07:57.823032 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.823028    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5r6wv\" (UniqueName: \"kubernetes.io/projected/7858ec1a-a0d9-4713-b7ae-461a584e165a-kube-api-access-5r6wv\") pod \"tuned-kk5zr\" (UID: \"7858ec1a-a0d9-4713-b7ae-461a584e165a\") " pod="openshift-cluster-node-tuning-operator/tuned-kk5zr"
Jul 07 17:07:57.823352 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.823071    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7858ec1a-a0d9-4713-b7ae-461a584e165a-run\") pod \"tuned-kk5zr\" (UID: \"7858ec1a-a0d9-4713-b7ae-461a584e165a\") " pod="openshift-cluster-node-tuning-operator/tuned-kk5zr"
Jul 07 17:07:57.823352 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.823096    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7858ec1a-a0d9-4713-b7ae-461a584e165a-etc-modprobe-d\") pod \"tuned-kk5zr\" (UID: \"7858ec1a-a0d9-4713-b7ae-461a584e165a\") " pod="openshift-cluster-node-tuning-operator/tuned-kk5zr"
Jul 07 17:07:57.823352 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.823123    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7858ec1a-a0d9-4713-b7ae-461a584e165a-etc-sysconfig\") pod \"tuned-kk5zr\" (UID: \"7858ec1a-a0d9-4713-b7ae-461a584e165a\") " pod="openshift-cluster-node-tuning-operator/tuned-kk5zr"
Jul 07 17:07:57.823352 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.823149    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7858ec1a-a0d9-4713-b7ae-461a584e165a-lib-modules\") pod \"tuned-kk5zr\" (UID: \"7858ec1a-a0d9-4713-b7ae-461a584e165a\") " pod="openshift-cluster-node-tuning-operator/tuned-kk5zr"
Jul 07 17:07:57.823352 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.823210    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/7858ec1a-a0d9-4713-b7ae-461a584e165a-run\") pod \"tuned-kk5zr\" (UID: \"7858ec1a-a0d9-4713-b7ae-461a584e165a\") " pod="openshift-cluster-node-tuning-operator/tuned-kk5zr"
Jul 07 17:07:57.823352 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.823233    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/7858ec1a-a0d9-4713-b7ae-461a584e165a-etc-sysconfig\") pod \"tuned-kk5zr\" (UID: \"7858ec1a-a0d9-4713-b7ae-461a584e165a\") " pod="openshift-cluster-node-tuning-operator/tuned-kk5zr"
Jul 07 17:07:57.823352 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.823236    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7858ec1a-a0d9-4713-b7ae-461a584e165a-etc-sysctl-d\") pod \"tuned-kk5zr\" (UID: \"7858ec1a-a0d9-4713-b7ae-461a584e165a\") " pod="openshift-cluster-node-tuning-operator/tuned-kk5zr"
Jul 07 17:07:57.823352 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.823285    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7858ec1a-a0d9-4713-b7ae-461a584e165a-host\") pod \"tuned-kk5zr\" (UID: \"7858ec1a-a0d9-4713-b7ae-461a584e165a\") " pod="openshift-cluster-node-tuning-operator/tuned-kk5zr"
Jul 07 17:07:57.823352 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.823285    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/7858ec1a-a0d9-4713-b7ae-461a584e165a-etc-modprobe-d\") pod \"tuned-kk5zr\" (UID: \"7858ec1a-a0d9-4713-b7ae-461a584e165a\") " pod="openshift-cluster-node-tuning-operator/tuned-kk5zr"
Jul 07 17:07:57.823352 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.823310    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7858ec1a-a0d9-4713-b7ae-461a584e165a-etc-sysctl-conf\") pod \"tuned-kk5zr\" (UID: \"7858ec1a-a0d9-4713-b7ae-461a584e165a\") " pod="openshift-cluster-node-tuning-operator/tuned-kk5zr"
Jul 07 17:07:57.823779 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.823358    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/7858ec1a-a0d9-4713-b7ae-461a584e165a-host\") pod \"tuned-kk5zr\" (UID: \"7858ec1a-a0d9-4713-b7ae-461a584e165a\") " pod="openshift-cluster-node-tuning-operator/tuned-kk5zr"
Jul 07 17:07:57.823779 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.823362    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/7858ec1a-a0d9-4713-b7ae-461a584e165a-lib-modules\") pod \"tuned-kk5zr\" (UID: \"7858ec1a-a0d9-4713-b7ae-461a584e165a\") " pod="openshift-cluster-node-tuning-operator/tuned-kk5zr"
Jul 07 17:07:57.823779 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.823361    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/7858ec1a-a0d9-4713-b7ae-461a584e165a-etc-sysctl-d\") pod \"tuned-kk5zr\" (UID: \"7858ec1a-a0d9-4713-b7ae-461a584e165a\") " pod="openshift-cluster-node-tuning-operator/tuned-kk5zr"
Jul 07 17:07:57.823779 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.823378    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7858ec1a-a0d9-4713-b7ae-461a584e165a-var-lib-kubelet\") pod \"tuned-kk5zr\" (UID: \"7858ec1a-a0d9-4713-b7ae-461a584e165a\") " pod="openshift-cluster-node-tuning-operator/tuned-kk5zr"
Jul 07 17:07:57.823779 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.823454    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/7858ec1a-a0d9-4713-b7ae-461a584e165a-var-lib-kubelet\") pod \"tuned-kk5zr\" (UID: \"7858ec1a-a0d9-4713-b7ae-461a584e165a\") " pod="openshift-cluster-node-tuning-operator/tuned-kk5zr"
Jul 07 17:07:57.823779 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.823456    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7858ec1a-a0d9-4713-b7ae-461a584e165a-etc-kubernetes\") pod \"tuned-kk5zr\" (UID: \"7858ec1a-a0d9-4713-b7ae-461a584e165a\") " pod="openshift-cluster-node-tuning-operator/tuned-kk5zr"
Jul 07 17:07:57.823779 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.823479    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/7858ec1a-a0d9-4713-b7ae-461a584e165a-etc-sysctl-conf\") pod \"tuned-kk5zr\" (UID: \"7858ec1a-a0d9-4713-b7ae-461a584e165a\") " pod="openshift-cluster-node-tuning-operator/tuned-kk5zr"
Jul 07 17:07:57.823779 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.823500    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7858ec1a-a0d9-4713-b7ae-461a584e165a-etc-systemd\") pod \"tuned-kk5zr\" (UID: \"7858ec1a-a0d9-4713-b7ae-461a584e165a\") " pod="openshift-cluster-node-tuning-operator/tuned-kk5zr"
Jul 07 17:07:57.823779 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.823504    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/7858ec1a-a0d9-4713-b7ae-461a584e165a-etc-kubernetes\") pod \"tuned-kk5zr\" (UID: \"7858ec1a-a0d9-4713-b7ae-461a584e165a\") " pod="openshift-cluster-node-tuning-operator/tuned-kk5zr"
Jul 07 17:07:57.823779 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.823534    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7858ec1a-a0d9-4713-b7ae-461a584e165a-sys\") pod \"tuned-kk5zr\" (UID: \"7858ec1a-a0d9-4713-b7ae-461a584e165a\") " pod="openshift-cluster-node-tuning-operator/tuned-kk5zr"
Jul 07 17:07:57.823779 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.823582    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/7858ec1a-a0d9-4713-b7ae-461a584e165a-etc-systemd\") pod \"tuned-kk5zr\" (UID: \"7858ec1a-a0d9-4713-b7ae-461a584e165a\") " pod="openshift-cluster-node-tuning-operator/tuned-kk5zr"
Jul 07 17:07:57.823779 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.823609    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7858ec1a-a0d9-4713-b7ae-461a584e165a-sys\") pod \"tuned-kk5zr\" (UID: \"7858ec1a-a0d9-4713-b7ae-461a584e165a\") " pod="openshift-cluster-node-tuning-operator/tuned-kk5zr"
Jul 07 17:07:57.825453 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.825430    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/7858ec1a-a0d9-4713-b7ae-461a584e165a-etc-tuned\") pod \"tuned-kk5zr\" (UID: \"7858ec1a-a0d9-4713-b7ae-461a584e165a\") " pod="openshift-cluster-node-tuning-operator/tuned-kk5zr"
Jul 07 17:07:57.825453 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.825452    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7858ec1a-a0d9-4713-b7ae-461a584e165a-tmp\") pod \"tuned-kk5zr\" (UID: \"7858ec1a-a0d9-4713-b7ae-461a584e165a\") " pod="openshift-cluster-node-tuning-operator/tuned-kk5zr"
Jul 07 17:07:57.839690 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.839654    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5r6wv\" (UniqueName: \"kubernetes.io/projected/7858ec1a-a0d9-4713-b7ae-461a584e165a-kube-api-access-5r6wv\") pod \"tuned-kk5zr\" (UID: \"7858ec1a-a0d9-4713-b7ae-461a584e165a\") " pod="openshift-cluster-node-tuning-operator/tuned-kk5zr"
Jul 07 17:07:57.845458 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.845403    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-36.ec2.internal" event={"ID":"49aaaf0707b9d67c20e84f9fb50f9adf","Type":"ContainerStarted","Data":"146fe3f227aadabdb2145d96d50b7ee91fdd3d2a4eed7be4155d9b6b5c10f281"}
Jul 07 17:07:57.852263 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.852223    2562 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160"
Jul 07 17:07:57.904274 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.904235    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-w9xzb"
Jul 07 17:07:57.910650 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.910631    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zw77m"
Jul 07 17:07:57.915213 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:57.915180    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb876547b_7002_4de2_bbbe_cb70ea03a96b.slice/crio-52edca40290ada1c151ef068cb72d4e696287fc1cd57d8c2b7b96080d6c20ffb WatchSource:0}: Error finding container 52edca40290ada1c151ef068cb72d4e696287fc1cd57d8c2b7b96080d6c20ffb: Status 404 returned error can't find the container with id 52edca40290ada1c151ef068cb72d4e696287fc1cd57d8c2b7b96080d6c20ffb
Jul 07 17:07:57.918068 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.917977    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-28xn9"
Jul 07 17:07:57.922070 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:57.922032    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9942424_da4e_4c79_ad5a_3979e01b04b4.slice/crio-d5bee74c1ddbb3bc2ea4aca78ff215b9e70f05bc5a3da30d71084a7cb82ce5cb WatchSource:0}: Error finding container d5bee74c1ddbb3bc2ea4aca78ff215b9e70f05bc5a3da30d71084a7cb82ce5cb: Status 404 returned error can't find the container with id d5bee74c1ddbb3bc2ea4aca78ff215b9e70f05bc5a3da30d71084a7cb82ce5cb
Jul 07 17:07:57.925689 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.925607    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-4mshv"
Jul 07 17:07:57.927817 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:57.927749    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50fc3df0_8a43_48db_9b3e_80d9bd4c03eb.slice/crio-972c0b1e1512e82eb90c77d31226e0853385a5a5256ee826ab43ee97912bf8f1 WatchSource:0}: Error finding container 972c0b1e1512e82eb90c77d31226e0853385a5a5256ee826ab43ee97912bf8f1: Status 404 returned error can't find the container with id 972c0b1e1512e82eb90c77d31226e0853385a5a5256ee826ab43ee97912bf8f1
Jul 07 17:07:57.931408 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.931388    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-7xdlh"
Jul 07 17:07:57.935356 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:57.935333    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod302d72fd_91f1_4d4d_beb5_39e75d18f600.slice/crio-86fdce873d6792f845e8d21319423cb3a5afecd23f88a2218ea050b355fae34c WatchSource:0}: Error finding container 86fdce873d6792f845e8d21319423cb3a5afecd23f88a2218ea050b355fae34c: Status 404 returned error can't find the container with id 86fdce873d6792f845e8d21319423cb3a5afecd23f88a2218ea050b355fae34c
Jul 07 17:07:57.938101 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.938076    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-tf68j"
Jul 07 17:07:57.942794 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:57.942767    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod36340fd9_83c5_4baf_b02d_9fc7f5e86485.slice/crio-59001aee5d4416851f524a7ae432c43147c9842e5b0869710e98556101439234 WatchSource:0}: Error finding container 59001aee5d4416851f524a7ae432c43147c9842e5b0869710e98556101439234: Status 404 returned error can't find the container with id 59001aee5d4416851f524a7ae432c43147c9842e5b0869710e98556101439234
Jul 07 17:07:57.943563 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.943540    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-v72rm"
Jul 07 17:07:57.947795 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:57.947770    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58ef1985_a201_4a7b_9bf9_37dc0aa0e656.slice/crio-dd59ffb6c6e43463b6afc1d7284aa11d66fcfd68de80115ba151c095ed96c065 WatchSource:0}: Error finding container dd59ffb6c6e43463b6afc1d7284aa11d66fcfd68de80115ba151c095ed96c065: Status 404 returned error can't find the container with id dd59ffb6c6e43463b6afc1d7284aa11d66fcfd68de80115ba151c095ed96c065
Jul 07 17:07:57.949710 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.949664    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vl6kx"
Jul 07 17:07:57.953853 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:57.953804    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod79353616_7bb8_4034_b3d5_c59eff433273.slice/crio-3754cd2dc309a72fc76efd48bfac524b312d6436f4194b6295af975c3affadcc WatchSource:0}: Error finding container 3754cd2dc309a72fc76efd48bfac524b312d6436f4194b6295af975c3affadcc: Status 404 returned error can't find the container with id 3754cd2dc309a72fc76efd48bfac524b312d6436f4194b6295af975c3affadcc
Jul 07 17:07:57.954208 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:57.954185    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-kk5zr"
Jul 07 17:07:57.958436 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:57.958416    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03d68eb3_35c7_4d4a_8a5a_5f541b098e44.slice/crio-fc8c3ca085c0e4c02ee2355310f5ba60b4cfb1579cc3dade138c047d7b976872 WatchSource:0}: Error finding container fc8c3ca085c0e4c02ee2355310f5ba60b4cfb1579cc3dade138c047d7b976872: Status 404 returned error can't find the container with id fc8c3ca085c0e4c02ee2355310f5ba60b4cfb1579cc3dade138c047d7b976872
Jul 07 17:07:58.010328 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:07:58.010294    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71d4bb0248f30f22223d1d1fcd98e897.slice/crio-0420251385bee3bcdd7e33c79a414b4eadb3836d60f2c895d0c5df17e9093aa7 WatchSource:0}: Error finding container 0420251385bee3bcdd7e33c79a414b4eadb3836d60f2c895d0c5df17e9093aa7: Status 404 returned error can't find the container with id 0420251385bee3bcdd7e33c79a414b4eadb3836d60f2c895d0c5df17e9093aa7
Jul 07 17:07:58.227498 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:58.227465    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3982c405-1bdb-4b6c-928a-fc6fb9e7b360-metrics-certs\") pod \"network-metrics-daemon-rqsv7\" (UID: \"3982c405-1bdb-4b6c-928a-fc6fb9e7b360\") " pod="openshift-multus/network-metrics-daemon-rqsv7"
Jul 07 17:07:58.227699 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:58.227519    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1a36a2e-2dad-43d1-b604-e538cc26c66d-original-pull-secret\") pod \"global-pull-secret-syncer-mhc8x\" (UID: \"c1a36a2e-2dad-43d1-b604-e538cc26c66d\") " pod="kube-system/global-pull-secret-syncer-mhc8x"
Jul 07 17:07:58.227699 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:07:58.227632    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 17:07:58.227699 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:07:58.227699    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1a36a2e-2dad-43d1-b604-e538cc26c66d-original-pull-secret podName:c1a36a2e-2dad-43d1-b604-e538cc26c66d nodeName:}" failed. No retries permitted until 2026-07-07 17:07:59.227684279 +0000 UTC m=+3.950937455 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c1a36a2e-2dad-43d1-b604-e538cc26c66d-original-pull-secret") pod "global-pull-secret-syncer-mhc8x" (UID: "c1a36a2e-2dad-43d1-b604-e538cc26c66d") : object "kube-system"/"original-pull-secret" not registered
Jul 07 17:07:58.227814 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:07:58.227632    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:07:58.227814 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:07:58.227749    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3982c405-1bdb-4b6c-928a-fc6fb9e7b360-metrics-certs podName:3982c405-1bdb-4b6c-928a-fc6fb9e7b360 nodeName:}" failed. No retries permitted until 2026-07-07 17:07:59.227737817 +0000 UTC m=+3.950990995 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3982c405-1bdb-4b6c-928a-fc6fb9e7b360-metrics-certs") pod "network-metrics-daemon-rqsv7" (UID: "3982c405-1bdb-4b6c-928a-fc6fb9e7b360") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:07:58.328798 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:58.328750    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2bt8\" (UniqueName: \"kubernetes.io/projected/4a516c8b-0593-47ed-9e9c-40eea299b87c-kube-api-access-x2bt8\") pod \"network-check-target-7kh6b\" (UID: \"4a516c8b-0593-47ed-9e9c-40eea299b87c\") " pod="openshift-network-diagnostics/network-check-target-7kh6b"
Jul 07 17:07:58.329016 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:07:58.328952    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 17:07:58.329016 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:07:58.328983    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 17:07:58.329016 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:07:58.328998    2562 projected.go:196] Error preparing data for projected volume kube-api-access-x2bt8 for pod openshift-network-diagnostics/network-check-target-7kh6b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:07:58.329242 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:07:58.329071    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a516c8b-0593-47ed-9e9c-40eea299b87c-kube-api-access-x2bt8 podName:4a516c8b-0593-47ed-9e9c-40eea299b87c nodeName:}" failed. No retries permitted until 2026-07-07 17:07:59.329050576 +0000 UTC m=+4.052303774 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-x2bt8" (UniqueName: "kubernetes.io/projected/4a516c8b-0593-47ed-9e9c-40eea299b87c-kube-api-access-x2bt8") pod "network-check-target-7kh6b" (UID: "4a516c8b-0593-47ed-9e9c-40eea299b87c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:07:58.687011 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:58.686907    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 17:02:57 +0000 UTC" deadline="2028-02-24 16:29:37.520753395 +0000 UTC"
Jul 07 17:07:58.687011 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:58.686952    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14327h21m38.833807472s"
Jul 07 17:07:58.903893 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:58.887730    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-28xn9" event={"ID":"50fc3df0-8a43-48db-9b3e-80d9bd4c03eb","Type":"ContainerStarted","Data":"972c0b1e1512e82eb90c77d31226e0853385a5a5256ee826ab43ee97912bf8f1"}
Jul 07 17:07:58.907716 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:58.907627    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zw77m" event={"ID":"b9942424-da4e-4c79-ad5a-3979e01b04b4","Type":"ContainerStarted","Data":"d5bee74c1ddbb3bc2ea4aca78ff215b9e70f05bc5a3da30d71084a7cb82ce5cb"}
Jul 07 17:07:58.917462 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:58.917339    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w9xzb" event={"ID":"b876547b-7002-4de2-bbbe-cb70ea03a96b","Type":"ContainerStarted","Data":"52edca40290ada1c151ef068cb72d4e696287fc1cd57d8c2b7b96080d6c20ffb"}
Jul 07 17:07:58.923230 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:58.923188    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-36.ec2.internal" event={"ID":"71d4bb0248f30f22223d1d1fcd98e897","Type":"ContainerStarted","Data":"0420251385bee3bcdd7e33c79a414b4eadb3836d60f2c895d0c5df17e9093aa7"}
Jul 07 17:07:58.958282 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:58.958171    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vl6kx" event={"ID":"03d68eb3-35c7-4d4a-8a5a-5f541b098e44","Type":"ContainerStarted","Data":"fc8c3ca085c0e4c02ee2355310f5ba60b4cfb1579cc3dade138c047d7b976872"}
Jul 07 17:07:58.969960 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:58.969915    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tf68j" event={"ID":"58ef1985-a201-4a7b-9bf9-37dc0aa0e656","Type":"ContainerStarted","Data":"dd59ffb6c6e43463b6afc1d7284aa11d66fcfd68de80115ba151c095ed96c065"}
Jul 07 17:07:58.984133 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:58.984088    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4mshv" event={"ID":"302d72fd-91f1-4d4d-beb5-39e75d18f600","Type":"ContainerStarted","Data":"86fdce873d6792f845e8d21319423cb3a5afecd23f88a2218ea050b355fae34c"}
Jul 07 17:07:58.989677 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:58.989536    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kk5zr" event={"ID":"7858ec1a-a0d9-4713-b7ae-461a584e165a","Type":"ContainerStarted","Data":"29c7c5b5ddc9d9edfb2eb9915a4e563db2c90d0d0550f9b66470146d19eb737c"}
Jul 07 17:07:58.996550 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:58.996512    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-v72rm" event={"ID":"79353616-7bb8-4034-b3d5-c59eff433273","Type":"ContainerStarted","Data":"3754cd2dc309a72fc76efd48bfac524b312d6436f4194b6295af975c3affadcc"}
Jul 07 17:07:59.023108 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:59.023026    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7xdlh" event={"ID":"36340fd9-83c5-4baf-b02d-9fc7f5e86485","Type":"ContainerStarted","Data":"59001aee5d4416851f524a7ae432c43147c9842e5b0869710e98556101439234"}
Jul 07 17:07:59.238126 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:59.236972    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3982c405-1bdb-4b6c-928a-fc6fb9e7b360-metrics-certs\") pod \"network-metrics-daemon-rqsv7\" (UID: \"3982c405-1bdb-4b6c-928a-fc6fb9e7b360\") " pod="openshift-multus/network-metrics-daemon-rqsv7"
Jul 07 17:07:59.238126 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:59.237049    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1a36a2e-2dad-43d1-b604-e538cc26c66d-original-pull-secret\") pod \"global-pull-secret-syncer-mhc8x\" (UID: \"c1a36a2e-2dad-43d1-b604-e538cc26c66d\") " pod="kube-system/global-pull-secret-syncer-mhc8x"
Jul 07 17:07:59.238126 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:07:59.237261    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 17:07:59.238126 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:07:59.237329    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1a36a2e-2dad-43d1-b604-e538cc26c66d-original-pull-secret podName:c1a36a2e-2dad-43d1-b604-e538cc26c66d nodeName:}" failed. No retries permitted until 2026-07-07 17:08:01.237309614 +0000 UTC m=+5.960562794 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c1a36a2e-2dad-43d1-b604-e538cc26c66d-original-pull-secret") pod "global-pull-secret-syncer-mhc8x" (UID: "c1a36a2e-2dad-43d1-b604-e538cc26c66d") : object "kube-system"/"original-pull-secret" not registered
Jul 07 17:07:59.238126 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:07:59.237401    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:07:59.238126 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:07:59.237435    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3982c405-1bdb-4b6c-928a-fc6fb9e7b360-metrics-certs podName:3982c405-1bdb-4b6c-928a-fc6fb9e7b360 nodeName:}" failed. No retries permitted until 2026-07-07 17:08:01.237421977 +0000 UTC m=+5.960675159 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3982c405-1bdb-4b6c-928a-fc6fb9e7b360-metrics-certs") pod "network-metrics-daemon-rqsv7" (UID: "3982c405-1bdb-4b6c-928a-fc6fb9e7b360") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:07:59.338656 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:59.338610    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2bt8\" (UniqueName: \"kubernetes.io/projected/4a516c8b-0593-47ed-9e9c-40eea299b87c-kube-api-access-x2bt8\") pod \"network-check-target-7kh6b\" (UID: \"4a516c8b-0593-47ed-9e9c-40eea299b87c\") " pod="openshift-network-diagnostics/network-check-target-7kh6b"
Jul 07 17:07:59.338887 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:07:59.338868    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 17:07:59.338958 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:07:59.338898    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 17:07:59.338958 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:07:59.338911    2562 projected.go:196] Error preparing data for projected volume kube-api-access-x2bt8 for pod openshift-network-diagnostics/network-check-target-7kh6b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:07:59.339133 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:07:59.338980    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a516c8b-0593-47ed-9e9c-40eea299b87c-kube-api-access-x2bt8 podName:4a516c8b-0593-47ed-9e9c-40eea299b87c nodeName:}" failed. No retries permitted until 2026-07-07 17:08:01.338957694 +0000 UTC m=+6.062210872 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-x2bt8" (UniqueName: "kubernetes.io/projected/4a516c8b-0593-47ed-9e9c-40eea299b87c-kube-api-access-x2bt8") pod "network-check-target-7kh6b" (UID: "4a516c8b-0593-47ed-9e9c-40eea299b87c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:07:59.688382 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:59.688287    2562 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-06 17:02:57 +0000 UTC" deadline="2028-02-14 05:03:40.530477783 +0000 UTC"
Jul 07 17:07:59.688382 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:59.688340    2562 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14075h55m40.842143726s"
Jul 07 17:07:59.841472 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:59.841371    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rqsv7"
Jul 07 17:07:59.841660 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:59.841532    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kh6b"
Jul 07 17:07:59.841660 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:07:59.841531    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rqsv7" podUID="3982c405-1bdb-4b6c-928a-fc6fb9e7b360"
Jul 07 17:07:59.841660 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:07:59.841609    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kh6b" podUID="4a516c8b-0593-47ed-9e9c-40eea299b87c"
Jul 07 17:07:59.841660 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:07:59.841624    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mhc8x"
Jul 07 17:07:59.841904 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:07:59.841695    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mhc8x" podUID="c1a36a2e-2dad-43d1-b604-e538cc26c66d"
Jul 07 17:08:01.256282 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:01.255818    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3982c405-1bdb-4b6c-928a-fc6fb9e7b360-metrics-certs\") pod \"network-metrics-daemon-rqsv7\" (UID: \"3982c405-1bdb-4b6c-928a-fc6fb9e7b360\") " pod="openshift-multus/network-metrics-daemon-rqsv7"
Jul 07 17:08:01.256282 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:01.256090    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1a36a2e-2dad-43d1-b604-e538cc26c66d-original-pull-secret\") pod \"global-pull-secret-syncer-mhc8x\" (UID: \"c1a36a2e-2dad-43d1-b604-e538cc26c66d\") " pod="kube-system/global-pull-secret-syncer-mhc8x"
Jul 07 17:08:01.256282 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:01.256154    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:08:01.256282 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:01.256235    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 17:08:01.256282 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:01.256247    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3982c405-1bdb-4b6c-928a-fc6fb9e7b360-metrics-certs podName:3982c405-1bdb-4b6c-928a-fc6fb9e7b360 nodeName:}" failed. No retries permitted until 2026-07-07 17:08:05.25621228 +0000 UTC m=+9.979465463 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3982c405-1bdb-4b6c-928a-fc6fb9e7b360-metrics-certs") pod "network-metrics-daemon-rqsv7" (UID: "3982c405-1bdb-4b6c-928a-fc6fb9e7b360") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:08:01.256282 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:01.256292    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1a36a2e-2dad-43d1-b604-e538cc26c66d-original-pull-secret podName:c1a36a2e-2dad-43d1-b604-e538cc26c66d nodeName:}" failed. No retries permitted until 2026-07-07 17:08:05.256272879 +0000 UTC m=+9.979526057 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c1a36a2e-2dad-43d1-b604-e538cc26c66d-original-pull-secret") pod "global-pull-secret-syncer-mhc8x" (UID: "c1a36a2e-2dad-43d1-b604-e538cc26c66d") : object "kube-system"/"original-pull-secret" not registered
Jul 07 17:08:01.356478 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:01.356446    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2bt8\" (UniqueName: \"kubernetes.io/projected/4a516c8b-0593-47ed-9e9c-40eea299b87c-kube-api-access-x2bt8\") pod \"network-check-target-7kh6b\" (UID: \"4a516c8b-0593-47ed-9e9c-40eea299b87c\") " pod="openshift-network-diagnostics/network-check-target-7kh6b"
Jul 07 17:08:01.356676 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:01.356624    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 17:08:01.356676 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:01.356643    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 17:08:01.356676 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:01.356656    2562 projected.go:196] Error preparing data for projected volume kube-api-access-x2bt8 for pod openshift-network-diagnostics/network-check-target-7kh6b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:08:01.356858 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:01.356712    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a516c8b-0593-47ed-9e9c-40eea299b87c-kube-api-access-x2bt8 podName:4a516c8b-0593-47ed-9e9c-40eea299b87c nodeName:}" failed. No retries permitted until 2026-07-07 17:08:05.35669389 +0000 UTC m=+10.079947076 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-x2bt8" (UniqueName: "kubernetes.io/projected/4a516c8b-0593-47ed-9e9c-40eea299b87c-kube-api-access-x2bt8") pod "network-check-target-7kh6b" (UID: "4a516c8b-0593-47ed-9e9c-40eea299b87c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:08:01.841442 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:01.841254    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kh6b"
Jul 07 17:08:01.841442 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:01.841274    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rqsv7"
Jul 07 17:08:01.841442 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:01.841386    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kh6b" podUID="4a516c8b-0593-47ed-9e9c-40eea299b87c"
Jul 07 17:08:01.841721 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:01.841488    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rqsv7" podUID="3982c405-1bdb-4b6c-928a-fc6fb9e7b360"
Jul 07 17:08:01.841721 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:01.841552    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mhc8x"
Jul 07 17:08:01.841721 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:01.841622    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mhc8x" podUID="c1a36a2e-2dad-43d1-b604-e538cc26c66d"
Jul 07 17:08:03.840662 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:03.840258    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rqsv7"
Jul 07 17:08:03.840662 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:03.840415    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rqsv7" podUID="3982c405-1bdb-4b6c-928a-fc6fb9e7b360"
Jul 07 17:08:03.840662 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:03.840481    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mhc8x"
Jul 07 17:08:03.840662 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:03.840557    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mhc8x" podUID="c1a36a2e-2dad-43d1-b604-e538cc26c66d"
Jul 07 17:08:03.842533 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:03.841480    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kh6b"
Jul 07 17:08:03.842533 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:03.841583    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kh6b" podUID="4a516c8b-0593-47ed-9e9c-40eea299b87c"
Jul 07 17:08:05.288679 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:05.288640    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3982c405-1bdb-4b6c-928a-fc6fb9e7b360-metrics-certs\") pod \"network-metrics-daemon-rqsv7\" (UID: \"3982c405-1bdb-4b6c-928a-fc6fb9e7b360\") " pod="openshift-multus/network-metrics-daemon-rqsv7"
Jul 07 17:08:05.289206 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:05.288703    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1a36a2e-2dad-43d1-b604-e538cc26c66d-original-pull-secret\") pod \"global-pull-secret-syncer-mhc8x\" (UID: \"c1a36a2e-2dad-43d1-b604-e538cc26c66d\") " pod="kube-system/global-pull-secret-syncer-mhc8x"
Jul 07 17:08:05.289206 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:05.288830    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:08:05.289206 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:05.288844    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 17:08:05.289206 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:05.288923    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3982c405-1bdb-4b6c-928a-fc6fb9e7b360-metrics-certs podName:3982c405-1bdb-4b6c-928a-fc6fb9e7b360 nodeName:}" failed. No retries permitted until 2026-07-07 17:08:13.288900721 +0000 UTC m=+18.012153898 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3982c405-1bdb-4b6c-928a-fc6fb9e7b360-metrics-certs") pod "network-metrics-daemon-rqsv7" (UID: "3982c405-1bdb-4b6c-928a-fc6fb9e7b360") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:08:05.289206 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:05.288949    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1a36a2e-2dad-43d1-b604-e538cc26c66d-original-pull-secret podName:c1a36a2e-2dad-43d1-b604-e538cc26c66d nodeName:}" failed. No retries permitted until 2026-07-07 17:08:13.288936994 +0000 UTC m=+18.012190169 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c1a36a2e-2dad-43d1-b604-e538cc26c66d-original-pull-secret") pod "global-pull-secret-syncer-mhc8x" (UID: "c1a36a2e-2dad-43d1-b604-e538cc26c66d") : object "kube-system"/"original-pull-secret" not registered
Jul 07 17:08:05.389876 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:05.389826    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2bt8\" (UniqueName: \"kubernetes.io/projected/4a516c8b-0593-47ed-9e9c-40eea299b87c-kube-api-access-x2bt8\") pod \"network-check-target-7kh6b\" (UID: \"4a516c8b-0593-47ed-9e9c-40eea299b87c\") " pod="openshift-network-diagnostics/network-check-target-7kh6b"
Jul 07 17:08:05.390075 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:05.390049    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 17:08:05.390135 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:05.390075    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 17:08:05.390135 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:05.390090    2562 projected.go:196] Error preparing data for projected volume kube-api-access-x2bt8 for pod openshift-network-diagnostics/network-check-target-7kh6b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:08:05.390246 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:05.390181    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a516c8b-0593-47ed-9e9c-40eea299b87c-kube-api-access-x2bt8 podName:4a516c8b-0593-47ed-9e9c-40eea299b87c nodeName:}" failed. No retries permitted until 2026-07-07 17:08:13.390143923 +0000 UTC m=+18.113397111 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-x2bt8" (UniqueName: "kubernetes.io/projected/4a516c8b-0593-47ed-9e9c-40eea299b87c-kube-api-access-x2bt8") pod "network-check-target-7kh6b" (UID: "4a516c8b-0593-47ed-9e9c-40eea299b87c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:08:05.840913 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:05.840873    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kh6b"
Jul 07 17:08:05.841100 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:05.841021    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kh6b" podUID="4a516c8b-0593-47ed-9e9c-40eea299b87c"
Jul 07 17:08:05.841467 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:05.841443    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rqsv7"
Jul 07 17:08:05.841613 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:05.841550    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rqsv7" podUID="3982c405-1bdb-4b6c-928a-fc6fb9e7b360"
Jul 07 17:08:05.841678 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:05.841650    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mhc8x"
Jul 07 17:08:05.841748 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:05.841726    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mhc8x" podUID="c1a36a2e-2dad-43d1-b604-e538cc26c66d"
Jul 07 17:08:07.840427 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:07.840384    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mhc8x"
Jul 07 17:08:07.840887 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:07.840384    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rqsv7"
Jul 07 17:08:07.840887 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:07.840528    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mhc8x" podUID="c1a36a2e-2dad-43d1-b604-e538cc26c66d"
Jul 07 17:08:07.840887 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:07.840565    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rqsv7" podUID="3982c405-1bdb-4b6c-928a-fc6fb9e7b360"
Jul 07 17:08:07.840887 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:07.840600    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kh6b"
Jul 07 17:08:07.840887 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:07.840673    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kh6b" podUID="4a516c8b-0593-47ed-9e9c-40eea299b87c"
Jul 07 17:08:09.840429 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:09.840346    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mhc8x"
Jul 07 17:08:09.840871 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:09.840476    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rqsv7"
Jul 07 17:08:09.840871 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:09.840488    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mhc8x" podUID="c1a36a2e-2dad-43d1-b604-e538cc26c66d"
Jul 07 17:08:09.840871 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:09.840590    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rqsv7" podUID="3982c405-1bdb-4b6c-928a-fc6fb9e7b360"
Jul 07 17:08:09.840871 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:09.840636    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kh6b"
Jul 07 17:08:09.840871 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:09.840698    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kh6b" podUID="4a516c8b-0593-47ed-9e9c-40eea299b87c"
Jul 07 17:08:11.839889 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:11.839840    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rqsv7"
Jul 07 17:08:11.840396 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:11.839856    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mhc8x"
Jul 07 17:08:11.840396 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:11.839984    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rqsv7" podUID="3982c405-1bdb-4b6c-928a-fc6fb9e7b360"
Jul 07 17:08:11.840396 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:11.839856    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kh6b"
Jul 07 17:08:11.840396 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:11.840051    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mhc8x" podUID="c1a36a2e-2dad-43d1-b604-e538cc26c66d"
Jul 07 17:08:11.840396 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:11.840185    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kh6b" podUID="4a516c8b-0593-47ed-9e9c-40eea299b87c"
Jul 07 17:08:13.352810 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:13.352586    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3982c405-1bdb-4b6c-928a-fc6fb9e7b360-metrics-certs\") pod \"network-metrics-daemon-rqsv7\" (UID: \"3982c405-1bdb-4b6c-928a-fc6fb9e7b360\") " pod="openshift-multus/network-metrics-daemon-rqsv7"
Jul 07 17:08:13.353348 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:13.352839    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1a36a2e-2dad-43d1-b604-e538cc26c66d-original-pull-secret\") pod \"global-pull-secret-syncer-mhc8x\" (UID: \"c1a36a2e-2dad-43d1-b604-e538cc26c66d\") " pod="kube-system/global-pull-secret-syncer-mhc8x"
Jul 07 17:08:13.353348 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:13.352735    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:08:13.353348 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:13.352943    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 17:08:13.353348 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:13.352955    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3982c405-1bdb-4b6c-928a-fc6fb9e7b360-metrics-certs podName:3982c405-1bdb-4b6c-928a-fc6fb9e7b360 nodeName:}" failed. No retries permitted until 2026-07-07 17:08:29.352934218 +0000 UTC m=+34.076187408 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3982c405-1bdb-4b6c-928a-fc6fb9e7b360-metrics-certs") pod "network-metrics-daemon-rqsv7" (UID: "3982c405-1bdb-4b6c-928a-fc6fb9e7b360") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:08:13.353348 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:13.352979    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1a36a2e-2dad-43d1-b604-e538cc26c66d-original-pull-secret podName:c1a36a2e-2dad-43d1-b604-e538cc26c66d nodeName:}" failed. No retries permitted until 2026-07-07 17:08:29.352969665 +0000 UTC m=+34.076222847 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c1a36a2e-2dad-43d1-b604-e538cc26c66d-original-pull-secret") pod "global-pull-secret-syncer-mhc8x" (UID: "c1a36a2e-2dad-43d1-b604-e538cc26c66d") : object "kube-system"/"original-pull-secret" not registered
Jul 07 17:08:13.453396 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:13.453361    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2bt8\" (UniqueName: \"kubernetes.io/projected/4a516c8b-0593-47ed-9e9c-40eea299b87c-kube-api-access-x2bt8\") pod \"network-check-target-7kh6b\" (UID: \"4a516c8b-0593-47ed-9e9c-40eea299b87c\") " pod="openshift-network-diagnostics/network-check-target-7kh6b"
Jul 07 17:08:13.453596 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:13.453515    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 17:08:13.453596 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:13.453536    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 17:08:13.453596 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:13.453548    2562 projected.go:196] Error preparing data for projected volume kube-api-access-x2bt8 for pod openshift-network-diagnostics/network-check-target-7kh6b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:08:13.453748 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:13.453615    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a516c8b-0593-47ed-9e9c-40eea299b87c-kube-api-access-x2bt8 podName:4a516c8b-0593-47ed-9e9c-40eea299b87c nodeName:}" failed. No retries permitted until 2026-07-07 17:08:29.453595573 +0000 UTC m=+34.176848748 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-x2bt8" (UniqueName: "kubernetes.io/projected/4a516c8b-0593-47ed-9e9c-40eea299b87c-kube-api-access-x2bt8") pod "network-check-target-7kh6b" (UID: "4a516c8b-0593-47ed-9e9c-40eea299b87c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:08:13.840669 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:13.840632    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mhc8x"
Jul 07 17:08:13.840896 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:13.840632    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kh6b"
Jul 07 17:08:13.840896 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:13.840758    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mhc8x" podUID="c1a36a2e-2dad-43d1-b604-e538cc26c66d"
Jul 07 17:08:13.840896 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:13.840845    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kh6b" podUID="4a516c8b-0593-47ed-9e9c-40eea299b87c"
Jul 07 17:08:13.840896 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:13.840635    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rqsv7"
Jul 07 17:08:13.841135 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:13.840962    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rqsv7" podUID="3982c405-1bdb-4b6c-928a-fc6fb9e7b360"
Jul 07 17:08:15.840381 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:15.840340    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rqsv7"
Jul 07 17:08:15.840854 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:15.840459    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rqsv7" podUID="3982c405-1bdb-4b6c-928a-fc6fb9e7b360"
Jul 07 17:08:15.840854 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:15.840480    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mhc8x"
Jul 07 17:08:15.840854 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:15.840609    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mhc8x" podUID="c1a36a2e-2dad-43d1-b604-e538cc26c66d"
Jul 07 17:08:15.840854 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:15.840643    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kh6b"
Jul 07 17:08:15.840854 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:15.840746    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kh6b" podUID="4a516c8b-0593-47ed-9e9c-40eea299b87c"
Jul 07 17:08:17.840336 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:17.840300    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rqsv7"
Jul 07 17:08:17.840717 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:17.840300    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kh6b"
Jul 07 17:08:17.840717 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:17.840414    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rqsv7" podUID="3982c405-1bdb-4b6c-928a-fc6fb9e7b360"
Jul 07 17:08:17.840717 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:17.840505    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kh6b" podUID="4a516c8b-0593-47ed-9e9c-40eea299b87c"
Jul 07 17:08:17.840717 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:17.840300    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mhc8x"
Jul 07 17:08:17.840717 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:17.840608    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mhc8x" podUID="c1a36a2e-2dad-43d1-b604-e538cc26c66d"
Jul 07 17:08:18.080756 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:18.080700    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-36.ec2.internal" event={"ID":"49aaaf0707b9d67c20e84f9fb50f9adf","Type":"ContainerStarted","Data":"30f82abf7c0bdba57b14995d195780f12962d298ca43bd9de196b36ebbb8f284"}
Jul 07 17:08:18.082842 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:18.082772    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vl6kx" event={"ID":"03d68eb3-35c7-4d4a-8a5a-5f541b098e44","Type":"ContainerStarted","Data":"c20ddb3d690d4894bbf2bb9ba9a9123fcc79c73fb38497ef0150738c2057144d"}
Jul 07 17:08:18.085371 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:18.085336    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tf68j" event={"ID":"58ef1985-a201-4a7b-9bf9-37dc0aa0e656","Type":"ContainerStarted","Data":"ec060a9d49d4f90523b696580cb6cf8310fb80c8acd112ae11d2b0edc21b2daa"}
Jul 07 17:08:18.087300 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:18.087265    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-kk5zr" event={"ID":"7858ec1a-a0d9-4713-b7ae-461a584e165a","Type":"ContainerStarted","Data":"b13102c1f0385df6c7eccb17298998dc1b39031edfa53d8e967fd38c8b5a73c9"}
Jul 07 17:08:18.100109 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:18.099903    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-140-36.ec2.internal" podStartSLOduration=21.09988752 podStartE2EDuration="21.09988752s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:07:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:08:18.099470702 +0000 UTC m=+22.822723900" watchObservedRunningTime="2026-07-07 17:08:18.09988752 +0000 UTC m=+22.823140718"
Jul 07 17:08:18.119654 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:18.119516    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-vl6kx" podStartSLOduration=2.171986268 podStartE2EDuration="22.119498737s" totalImagesPullingTime="19.947512469s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:07:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:08:18.119497829 +0000 UTC m=+22.842751027" watchObservedRunningTime="2026-07-07 17:08:18.119498737 +0000 UTC m=+22.842751932"
Jul 07 17:08:18.138516 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:18.138429    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-kk5zr" podStartSLOduration=2.25011953 podStartE2EDuration="22.138405362s" totalImagesPullingTime="19.888285832s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:07:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:08:18.137767514 +0000 UTC m=+22.861020710" watchObservedRunningTime="2026-07-07 17:08:18.138405362 +0000 UTC m=+22.861658560"
Jul 07 17:08:19.090926 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:19.090891    2562 generic.go:356] "Generic (PLEG): container finished" podID="71d4bb0248f30f22223d1d1fcd98e897" containerID="6c2c426b22a7eea67a08b0855639c9123a87edecbc6efeaa92f8de63fbe632b4" exitCode=0
Jul 07 17:08:19.091818 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:19.090976    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-36.ec2.internal" event={"ID":"71d4bb0248f30f22223d1d1fcd98e897","Type":"ContainerDied","Data":"6c2c426b22a7eea67a08b0855639c9123a87edecbc6efeaa92f8de63fbe632b4"}
Jul 07 17:08:19.094376 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:19.094347    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tf68j" event={"ID":"58ef1985-a201-4a7b-9bf9-37dc0aa0e656","Type":"ContainerStarted","Data":"780b50dc431dfe91023e30789d61433c4379959183b61abc92c30cc1fe08e5e5"}
Jul 07 17:08:19.094493 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:19.094432    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tf68j" event={"ID":"58ef1985-a201-4a7b-9bf9-37dc0aa0e656","Type":"ContainerStarted","Data":"99506333f9f30d8f816866ada7d19b460cec369c38c500c24485f0c88d18742c"}
Jul 07 17:08:19.094561 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:19.094547    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tf68j" event={"ID":"58ef1985-a201-4a7b-9bf9-37dc0aa0e656","Type":"ContainerStarted","Data":"78a375b462fc30ce18798a0b6be038f52ede160c6dcd46244df2320cbccf285b"}
Jul 07 17:08:19.094624 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:19.094606    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tf68j" event={"ID":"58ef1985-a201-4a7b-9bf9-37dc0aa0e656","Type":"ContainerStarted","Data":"aaad775ac253838edaac3c6536a19d105251d54817d306ac2cfc45102ba4f66b"}
Jul 07 17:08:19.094682 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:19.094657    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tf68j" event={"ID":"58ef1985-a201-4a7b-9bf9-37dc0aa0e656","Type":"ContainerStarted","Data":"bca9b9234f5a8d4334ac91371f5ad6cefd8fde3851042a3bc537edad8da7e319"}
Jul 07 17:08:19.095918 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:19.095890    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-v72rm" event={"ID":"79353616-7bb8-4034-b3d5-c59eff433273","Type":"ContainerStarted","Data":"17960cb930a30dad033ddd7a07c4768876b7073bbdc06793b04953c30d435830"}
Jul 07 17:08:19.097177 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:19.097139    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-7xdlh" event={"ID":"36340fd9-83c5-4baf-b02d-9fc7f5e86485","Type":"ContainerStarted","Data":"06e7efaef392ff71f4c92ad08ccedc7fa70e5987236ccb970254c4687184417f"}
Jul 07 17:08:19.098498 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:19.098474    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-28xn9" event={"ID":"50fc3df0-8a43-48db-9b3e-80d9bd4c03eb","Type":"ContainerStarted","Data":"ab1179366f8eb17d1f9f889c93ef40093a5cefdf4bf1e9c903f47645fd125e5d"}
Jul 07 17:08:19.099793 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:19.099769    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zw77m" event={"ID":"b9942424-da4e-4c79-ad5a-3979e01b04b4","Type":"ContainerStarted","Data":"cd653be00ab07d91345bc9b006e21c088d39f4b6ec9283fba2503a5fdb6506e9"}
Jul 07 17:08:19.101128 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:19.101109    2562 generic.go:356] "Generic (PLEG): container finished" podID="b876547b-7002-4de2-bbbe-cb70ea03a96b" containerID="2e24cef38732e739bc1fd266957699c11c67f196b7ea2c0baa53c797bdc7a539" exitCode=0
Jul 07 17:08:19.101241 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:19.101197    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w9xzb" event={"ID":"b876547b-7002-4de2-bbbe-cb70ea03a96b","Type":"ContainerDied","Data":"2e24cef38732e739bc1fd266957699c11c67f196b7ea2c0baa53c797bdc7a539"}
Jul 07 17:08:19.156997 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:19.156743    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-28xn9" podStartSLOduration=3.352975616 podStartE2EDuration="23.156725402s" totalImagesPullingTime="19.803749786s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:07:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:08:19.156221695 +0000 UTC m=+23.879474893" watchObservedRunningTime="2026-07-07 17:08:19.156725402 +0000 UTC m=+23.879978599"
Jul 07 17:08:19.190255 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:19.190210    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-v72rm" podStartSLOduration=3.410922754 podStartE2EDuration="23.190192571s" totalImagesPullingTime="19.779269817s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:07:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:08:19.189950049 +0000 UTC m=+23.913203245" watchObservedRunningTime="2026-07-07 17:08:19.190192571 +0000 UTC m=+23.913445767"
Jul 07 17:08:19.190569 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:19.190538    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-7xdlh" podStartSLOduration=3.279148816 podStartE2EDuration="23.190528877s" totalImagesPullingTime="19.911380061s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:07:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:08:19.174880931 +0000 UTC m=+23.898134139" watchObservedRunningTime="2026-07-07 17:08:19.190528877 +0000 UTC m=+23.913782131"
Jul 07 17:08:19.839872 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:19.839837    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mhc8x"
Jul 07 17:08:19.840073 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:19.839838    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rqsv7"
Jul 07 17:08:19.840073 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:19.839953    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mhc8x" podUID="c1a36a2e-2dad-43d1-b604-e538cc26c66d"
Jul 07 17:08:19.840073 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:19.840059    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rqsv7" podUID="3982c405-1bdb-4b6c-928a-fc6fb9e7b360"
Jul 07 17:08:19.840212 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:19.839843    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kh6b"
Jul 07 17:08:19.840212 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:19.840148    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kh6b" podUID="4a516c8b-0593-47ed-9e9c-40eea299b87c"
Jul 07 17:08:20.108734 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:20.108625    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-36.ec2.internal" event={"ID":"71d4bb0248f30f22223d1d1fcd98e897","Type":"ContainerStarted","Data":"782b5d9dc5ecb93a4874cd159c1a694406d40d917fa7277424ddb4e31cff8bac"}
Jul 07 17:08:20.110578 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:20.110545    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-4mshv" event={"ID":"302d72fd-91f1-4d4d-beb5-39e75d18f600","Type":"ContainerStarted","Data":"60109df9022bf9823051c7ef5976960ad539a4f499833e5c39393da782d74c44"}
Jul 07 17:08:20.117303 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:20.117269    2562 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock"
Jul 07 17:08:20.130972 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:20.130919    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-140-36.ec2.internal" podStartSLOduration=23.130903007 podStartE2EDuration="23.130903007s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:07:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:08:20.130500337 +0000 UTC m=+24.853753534" watchObservedRunningTime="2026-07-07 17:08:20.130903007 +0000 UTC m=+24.854156204"
Jul 07 17:08:20.155909 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:20.155852    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-4mshv" podStartSLOduration=4.243395324 podStartE2EDuration="24.155837584s" totalImagesPullingTime="19.91244226s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:07:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:08:20.154445445 +0000 UTC m=+24.877698654" watchObservedRunningTime="2026-07-07 17:08:20.155837584 +0000 UTC m=+24.879090780"
Jul 07 17:08:20.333970 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:20.333940    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:08:20.415498 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:20.415467    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:08:20.512572 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:20.512538    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:08:20.596854 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:20.596791    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:08:20.706225 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:20.706080    2562 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-07T17:08:20.117285403Z","UUID":"555028fc-e6e5-4764-9372-814d90ecb39d","Handler":null,"Name":"","Endpoint":""}
Jul 07 17:08:20.707902 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:20.707870    2562 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0
Jul 07 17:08:20.708058 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:20.707924    2562 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock
Jul 07 17:08:21.120416 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:21.120306    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tf68j" event={"ID":"58ef1985-a201-4a7b-9bf9-37dc0aa0e656","Type":"ContainerStarted","Data":"fbefe509a28021925406d32b319881b32f5a0cba4a6108c4417ad1533078dcc3"}
Jul 07 17:08:21.122918 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:21.122852    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zw77m" event={"ID":"b9942424-da4e-4c79-ad5a-3979e01b04b4","Type":"ContainerStarted","Data":"dfec0f20cdf00181b5d908cc8e5239f6bc0aeef8d0a4c95a747a7d5d8103bdd1"}
Jul 07 17:08:21.388890 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:21.388863    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:08:21.654253 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:21.654222    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:08:21.752716 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:21.752674    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:08:21.840013 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:21.839972    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kh6b"
Jul 07 17:08:21.840204 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:21.839977    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rqsv7"
Jul 07 17:08:21.840204 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:21.840091    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kh6b" podUID="4a516c8b-0593-47ed-9e9c-40eea299b87c"
Jul 07 17:08:21.840204 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:21.840118    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mhc8x"
Jul 07 17:08:21.840332 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:21.840232    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rqsv7" podUID="3982c405-1bdb-4b6c-928a-fc6fb9e7b360"
Jul 07 17:08:21.840332 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:21.840290    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mhc8x" podUID="c1a36a2e-2dad-43d1-b604-e538cc26c66d"
Jul 07 17:08:22.127481 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:22.127448    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zw77m" event={"ID":"b9942424-da4e-4c79-ad5a-3979e01b04b4","Type":"ContainerStarted","Data":"e7beadac261e8db080edf64cb07cb941678f9a431821b8e42b3b4ecdb2aa9284"}
Jul 07 17:08:23.133845 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:23.133786    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-tf68j" event={"ID":"58ef1985-a201-4a7b-9bf9-37dc0aa0e656","Type":"ContainerStarted","Data":"2bab5dbca3a383fac85c4655b5dd937ed727543cf4c87175e04ae8f1b08cc1ad"}
Jul 07 17:08:23.168679 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:23.168617    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-tf68j" podStartSLOduration=7.199277252 podStartE2EDuration="27.168601411s" totalImagesPullingTime="19.969324159s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:07:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:08:23.168170578 +0000 UTC m=+27.891423765" watchObservedRunningTime="2026-07-07 17:08:23.168601411 +0000 UTC m=+27.891854607"
Jul 07 17:08:23.168829 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:23.168812    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zw77m" podStartSLOduration=4.322048803 podStartE2EDuration="27.168806222s" totalImagesPullingTime="22.846757419s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:07:56 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:08:22.148563366 +0000 UTC m=+26.871816562" watchObservedRunningTime="2026-07-07 17:08:23.168806222 +0000 UTC m=+27.892059469"
Jul 07 17:08:23.316798 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:23.316731    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-28xn9"
Jul 07 17:08:23.317428 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:23.317403    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-28xn9"
Jul 07 17:08:23.840335 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:23.840297    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kh6b"
Jul 07 17:08:23.840503 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:23.840306    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rqsv7"
Jul 07 17:08:23.840503 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:23.840411    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kh6b" podUID="4a516c8b-0593-47ed-9e9c-40eea299b87c"
Jul 07 17:08:23.840503 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:23.840428    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mhc8x"
Jul 07 17:08:23.840662 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:23.840530    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rqsv7" podUID="3982c405-1bdb-4b6c-928a-fc6fb9e7b360"
Jul 07 17:08:23.840662 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:23.840622    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mhc8x" podUID="c1a36a2e-2dad-43d1-b604-e538cc26c66d"
Jul 07 17:08:24.136137 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:24.136069    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-28xn9"
Jul 07 17:08:24.136699 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:24.136197    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tf68j"
Jul 07 17:08:24.136699 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:24.136276    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tf68j"
Jul 07 17:08:24.136699 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:24.136691    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-tf68j"
Jul 07 17:08:24.136843 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:24.136799    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-28xn9"
Jul 07 17:08:24.154007 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:24.153971    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tf68j"
Jul 07 17:08:24.154137 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:24.154082    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tf68j"
Jul 07 17:08:24.220261 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:24.220224    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:08:24.334704 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:24.334673    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:08:25.089249 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:25.086697    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7kh6b"]
Jul 07 17:08:25.089249 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:25.086922    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kh6b"
Jul 07 17:08:25.089249 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:25.087070    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kh6b" podUID="4a516c8b-0593-47ed-9e9c-40eea299b87c"
Jul 07 17:08:25.089249 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:25.091198    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mhc8x"]
Jul 07 17:08:25.089249 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:25.091293    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rqsv7"]
Jul 07 17:08:25.089249 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:25.091419    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rqsv7"
Jul 07 17:08:25.089249 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:25.091567    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rqsv7" podUID="3982c405-1bdb-4b6c-928a-fc6fb9e7b360"
Jul 07 17:08:25.089249 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:25.091634    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mhc8x"
Jul 07 17:08:25.089249 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:25.091776    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mhc8x" podUID="c1a36a2e-2dad-43d1-b604-e538cc26c66d"
Jul 07 17:08:26.142257 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:26.142061    2562 generic.go:356] "Generic (PLEG): container finished" podID="b876547b-7002-4de2-bbbe-cb70ea03a96b" containerID="3ef4e72fa39f7aa7e5aa86072e9f74e62047c99728cddd1ffea2203b1079108d" exitCode=0
Jul 07 17:08:26.142828 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:26.142149    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w9xzb" event={"ID":"b876547b-7002-4de2-bbbe-cb70ea03a96b","Type":"ContainerDied","Data":"3ef4e72fa39f7aa7e5aa86072e9f74e62047c99728cddd1ffea2203b1079108d"}
Jul 07 17:08:26.839670 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:26.839636    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kh6b"
Jul 07 17:08:26.839809 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:26.839639    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mhc8x"
Jul 07 17:08:26.839809 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:26.839747    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kh6b" podUID="4a516c8b-0593-47ed-9e9c-40eea299b87c"
Jul 07 17:08:26.839870 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:26.839836    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mhc8x" podUID="c1a36a2e-2dad-43d1-b604-e538cc26c66d"
Jul 07 17:08:26.839870 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:26.839641    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rqsv7"
Jul 07 17:08:26.839994 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:26.839924    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rqsv7" podUID="3982c405-1bdb-4b6c-928a-fc6fb9e7b360"
Jul 07 17:08:28.149252 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:28.149214    2562 generic.go:356] "Generic (PLEG): container finished" podID="b876547b-7002-4de2-bbbe-cb70ea03a96b" containerID="beacb933c9b4f648f15de86a8526aadad1e564d2c86921a3c1d760fd2f04a213" exitCode=0
Jul 07 17:08:28.149687 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:28.149260    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w9xzb" event={"ID":"b876547b-7002-4de2-bbbe-cb70ea03a96b","Type":"ContainerDied","Data":"beacb933c9b4f648f15de86a8526aadad1e564d2c86921a3c1d760fd2f04a213"}
Jul 07 17:08:28.242527 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:28.242493    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:08:28.334750 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:28.334716    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:08:28.418931 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:28.418843    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:08:28.840089 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:28.840012    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kh6b"
Jul 07 17:08:28.840273 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:28.840030    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rqsv7"
Jul 07 17:08:28.840273 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:28.840030    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mhc8x"
Jul 07 17:08:28.840273 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:28.840147    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-7kh6b" podUID="4a516c8b-0593-47ed-9e9c-40eea299b87c"
Jul 07 17:08:28.840273 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:28.840244    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-rqsv7" podUID="3982c405-1bdb-4b6c-928a-fc6fb9e7b360"
Jul 07 17:08:28.840461 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:28.840338    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-mhc8x" podUID="c1a36a2e-2dad-43d1-b604-e538cc26c66d"
Jul 07 17:08:29.378684 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:29.378653    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3982c405-1bdb-4b6c-928a-fc6fb9e7b360-metrics-certs\") pod \"network-metrics-daemon-rqsv7\" (UID: \"3982c405-1bdb-4b6c-928a-fc6fb9e7b360\") " pod="openshift-multus/network-metrics-daemon-rqsv7"
Jul 07 17:08:29.379128 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:29.378706    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1a36a2e-2dad-43d1-b604-e538cc26c66d-original-pull-secret\") pod \"global-pull-secret-syncer-mhc8x\" (UID: \"c1a36a2e-2dad-43d1-b604-e538cc26c66d\") " pod="kube-system/global-pull-secret-syncer-mhc8x"
Jul 07 17:08:29.379128 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:29.378812    2562 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered
Jul 07 17:08:29.379128 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:29.378833    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:08:29.379128 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:29.378869    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c1a36a2e-2dad-43d1-b604-e538cc26c66d-original-pull-secret podName:c1a36a2e-2dad-43d1-b604-e538cc26c66d nodeName:}" failed. No retries permitted until 2026-07-07 17:09:01.378853132 +0000 UTC m=+66.102106325 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/c1a36a2e-2dad-43d1-b604-e538cc26c66d-original-pull-secret") pod "global-pull-secret-syncer-mhc8x" (UID: "c1a36a2e-2dad-43d1-b604-e538cc26c66d") : object "kube-system"/"original-pull-secret" not registered
Jul 07 17:08:29.379128 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:29.378899    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3982c405-1bdb-4b6c-928a-fc6fb9e7b360-metrics-certs podName:3982c405-1bdb-4b6c-928a-fc6fb9e7b360 nodeName:}" failed. No retries permitted until 2026-07-07 17:09:01.378881702 +0000 UTC m=+66.102134876 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3982c405-1bdb-4b6c-928a-fc6fb9e7b360-metrics-certs") pod "network-metrics-daemon-rqsv7" (UID: "3982c405-1bdb-4b6c-928a-fc6fb9e7b360") : object "openshift-multus"/"metrics-daemon-secret" not registered
Jul 07 17:08:29.479607 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:29.479563    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2bt8\" (UniqueName: \"kubernetes.io/projected/4a516c8b-0593-47ed-9e9c-40eea299b87c-kube-api-access-x2bt8\") pod \"network-check-target-7kh6b\" (UID: \"4a516c8b-0593-47ed-9e9c-40eea299b87c\") " pod="openshift-network-diagnostics/network-check-target-7kh6b"
Jul 07 17:08:29.479753 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:29.479722    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered
Jul 07 17:08:29.479753 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:29.479742    2562 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered
Jul 07 17:08:29.479753 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:29.479753    2562 projected.go:196] Error preparing data for projected volume kube-api-access-x2bt8 for pod openshift-network-diagnostics/network-check-target-7kh6b: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:08:29.479872 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:29.479802    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/4a516c8b-0593-47ed-9e9c-40eea299b87c-kube-api-access-x2bt8 podName:4a516c8b-0593-47ed-9e9c-40eea299b87c nodeName:}" failed. No retries permitted until 2026-07-07 17:09:01.479789098 +0000 UTC m=+66.203042273 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-x2bt8" (UniqueName: "kubernetes.io/projected/4a516c8b-0593-47ed-9e9c-40eea299b87c-kube-api-access-x2bt8") pod "network-check-target-7kh6b" (UID: "4a516c8b-0593-47ed-9e9c-40eea299b87c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered]
Jul 07 17:08:30.156695 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:30.156664    2562 generic.go:356] "Generic (PLEG): container finished" podID="b876547b-7002-4de2-bbbe-cb70ea03a96b" containerID="7a891875c774c02b403e73a05eb3252fd216ae2a545f5755f06277799109ffdc" exitCode=0
Jul 07 17:08:30.156849 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:30.156729    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w9xzb" event={"ID":"b876547b-7002-4de2-bbbe-cb70ea03a96b","Type":"ContainerDied","Data":"7a891875c774c02b403e73a05eb3252fd216ae2a545f5755f06277799109ffdc"}
Jul 07 17:08:30.541566 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:30.541473    2562 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-140-36.ec2.internal" event="NodeReady"
Jul 07 17:08:30.542002 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:30.541642    2562 kubelet_node_status.go:489] "Fast updating node status as it just became ready"
Jul 07 17:08:30.604394 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:30.604359    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-qbfqh"]
Jul 07 17:08:30.607533 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:30.607512    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qbfqh"
Jul 07 17:08:30.611442 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:30.611416    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-9vjpm"]
Jul 07 17:08:30.611618 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:30.611528    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\""
Jul 07 17:08:30.611618 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:30.611550    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\""
Jul 07 17:08:30.611618 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:30.611554    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9r2xr\""
Jul 07 17:08:30.614215 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:30.614188    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9vjpm"
Jul 07 17:08:30.616330 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:30.616306    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\""
Jul 07 17:08:30.616447 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:30.616336    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\""
Jul 07 17:08:30.616447 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:30.616336    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-xf5p6\""
Jul 07 17:08:30.616648 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:30.616633    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\""
Jul 07 17:08:30.619957 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:30.619929    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qbfqh"]
Jul 07 17:08:30.624237 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:30.624214    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9vjpm"]
Jul 07 17:08:30.690362 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:30.690322    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lzs55\" (UniqueName: \"kubernetes.io/projected/19218ca1-9c05-41ac-9c51-978079184615-kube-api-access-lzs55\") pod \"dns-default-qbfqh\" (UID: \"19218ca1-9c05-41ac-9c51-978079184615\") " pod="openshift-dns/dns-default-qbfqh"
Jul 07 17:08:30.690362 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:30.690362    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19218ca1-9c05-41ac-9c51-978079184615-tmp-dir\") pod \"dns-default-qbfqh\" (UID: \"19218ca1-9c05-41ac-9c51-978079184615\") " pod="openshift-dns/dns-default-qbfqh"
Jul 07 17:08:30.690545 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:30.690404    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z768f\" (UniqueName: \"kubernetes.io/projected/aee49a54-f7ff-4e57-a35a-ec8e57b1fd33-kube-api-access-z768f\") pod \"ingress-canary-9vjpm\" (UID: \"aee49a54-f7ff-4e57-a35a-ec8e57b1fd33\") " pod="openshift-ingress-canary/ingress-canary-9vjpm"
Jul 07 17:08:30.690545 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:30.690474    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/19218ca1-9c05-41ac-9c51-978079184615-config-volume\") pod \"dns-default-qbfqh\" (UID: \"19218ca1-9c05-41ac-9c51-978079184615\") " pod="openshift-dns/dns-default-qbfqh"
Jul 07 17:08:30.690545 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:30.690514    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aee49a54-f7ff-4e57-a35a-ec8e57b1fd33-cert\") pod \"ingress-canary-9vjpm\" (UID: \"aee49a54-f7ff-4e57-a35a-ec8e57b1fd33\") " pod="openshift-ingress-canary/ingress-canary-9vjpm"
Jul 07 17:08:30.690545 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:30.690530    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/19218ca1-9c05-41ac-9c51-978079184615-metrics-tls\") pod \"dns-default-qbfqh\" (UID: \"19218ca1-9c05-41ac-9c51-978079184615\") " pod="openshift-dns/dns-default-qbfqh"
Jul 07 17:08:30.708752 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:30.708721    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:08:30.791131 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:30.791098    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lzs55\" (UniqueName: \"kubernetes.io/projected/19218ca1-9c05-41ac-9c51-978079184615-kube-api-access-lzs55\") pod \"dns-default-qbfqh\" (UID: \"19218ca1-9c05-41ac-9c51-978079184615\") " pod="openshift-dns/dns-default-qbfqh"
Jul 07 17:08:30.791131 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:30.791149    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19218ca1-9c05-41ac-9c51-978079184615-tmp-dir\") pod \"dns-default-qbfqh\" (UID: \"19218ca1-9c05-41ac-9c51-978079184615\") " pod="openshift-dns/dns-default-qbfqh"
Jul 07 17:08:30.791435 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:30.791399    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z768f\" (UniqueName: \"kubernetes.io/projected/aee49a54-f7ff-4e57-a35a-ec8e57b1fd33-kube-api-access-z768f\") pod \"ingress-canary-9vjpm\" (UID: \"aee49a54-f7ff-4e57-a35a-ec8e57b1fd33\") " pod="openshift-ingress-canary/ingress-canary-9vjpm"
Jul 07 17:08:30.791601 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:30.791481    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/19218ca1-9c05-41ac-9c51-978079184615-config-volume\") pod \"dns-default-qbfqh\" (UID: \"19218ca1-9c05-41ac-9c51-978079184615\") " pod="openshift-dns/dns-default-qbfqh"
Jul 07 17:08:30.791601 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:30.791500    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/19218ca1-9c05-41ac-9c51-978079184615-tmp-dir\") pod \"dns-default-qbfqh\" (UID: \"19218ca1-9c05-41ac-9c51-978079184615\") " pod="openshift-dns/dns-default-qbfqh"
Jul 07 17:08:30.791601 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:30.791521    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aee49a54-f7ff-4e57-a35a-ec8e57b1fd33-cert\") pod \"ingress-canary-9vjpm\" (UID: \"aee49a54-f7ff-4e57-a35a-ec8e57b1fd33\") " pod="openshift-ingress-canary/ingress-canary-9vjpm"
Jul 07 17:08:30.791601 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:30.791549    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/19218ca1-9c05-41ac-9c51-978079184615-metrics-tls\") pod \"dns-default-qbfqh\" (UID: \"19218ca1-9c05-41ac-9c51-978079184615\") " pod="openshift-dns/dns-default-qbfqh"
Jul 07 17:08:30.791757 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:30.791637    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 17:08:30.791757 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:30.791693    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19218ca1-9c05-41ac-9c51-978079184615-metrics-tls podName:19218ca1-9c05-41ac-9c51-978079184615 nodeName:}" failed. No retries permitted until 2026-07-07 17:08:31.29167389 +0000 UTC m=+36.014927066 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/19218ca1-9c05-41ac-9c51-978079184615-metrics-tls") pod "dns-default-qbfqh" (UID: "19218ca1-9c05-41ac-9c51-978079184615") : secret "dns-default-metrics-tls" not found
Jul 07 17:08:30.791967 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:30.791947    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/19218ca1-9c05-41ac-9c51-978079184615-config-volume\") pod \"dns-default-qbfqh\" (UID: \"19218ca1-9c05-41ac-9c51-978079184615\") " pod="openshift-dns/dns-default-qbfqh"
Jul 07 17:08:30.795856 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:30.795743    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/aee49a54-f7ff-4e57-a35a-ec8e57b1fd33-cert\") pod \"ingress-canary-9vjpm\" (UID: \"aee49a54-f7ff-4e57-a35a-ec8e57b1fd33\") " pod="openshift-ingress-canary/ingress-canary-9vjpm"
Jul 07 17:08:30.802581 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:30.802544    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lzs55\" (UniqueName: \"kubernetes.io/projected/19218ca1-9c05-41ac-9c51-978079184615-kube-api-access-lzs55\") pod \"dns-default-qbfqh\" (UID: \"19218ca1-9c05-41ac-9c51-978079184615\") " pod="openshift-dns/dns-default-qbfqh"
Jul 07 17:08:30.802963 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:30.802947    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z768f\" (UniqueName: \"kubernetes.io/projected/aee49a54-f7ff-4e57-a35a-ec8e57b1fd33-kube-api-access-z768f\") pod \"ingress-canary-9vjpm\" (UID: \"aee49a54-f7ff-4e57-a35a-ec8e57b1fd33\") " pod="openshift-ingress-canary/ingress-canary-9vjpm"
Jul 07 17:08:30.809909 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:30.809880    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:08:30.839986 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:30.839951    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rqsv7"
Jul 07 17:08:30.840178 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:30.839951    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kh6b"
Jul 07 17:08:30.840607 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:30.839951    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mhc8x"
Jul 07 17:08:30.842623 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:30.842599    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 17:08:30.842742 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:30.842691    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 17:08:30.842742 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:30.842705    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jk68m\""
Jul 07 17:08:30.842941 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:30.842926    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-chtgz\""
Jul 07 17:08:30.842986 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:30.842965    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 17:08:30.843106 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:30.843091    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 17:08:30.924734 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:30.924699    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-9vjpm"
Jul 07 17:08:31.084144 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:31.084055    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-9vjpm"]
Jul 07 17:08:31.088883 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:08:31.088853    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaee49a54_f7ff_4e57_a35a_ec8e57b1fd33.slice/crio-133fcb5fc883f4619365ab07461640c8065aa35aa6db75b751ea35d7ff47b00e WatchSource:0}: Error finding container 133fcb5fc883f4619365ab07461640c8065aa35aa6db75b751ea35d7ff47b00e: Status 404 returned error can't find the container with id 133fcb5fc883f4619365ab07461640c8065aa35aa6db75b751ea35d7ff47b00e
Jul 07 17:08:31.159819 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:31.159783    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9vjpm" event={"ID":"aee49a54-f7ff-4e57-a35a-ec8e57b1fd33","Type":"ContainerStarted","Data":"133fcb5fc883f4619365ab07461640c8065aa35aa6db75b751ea35d7ff47b00e"}
Jul 07 17:08:31.295797 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:31.295755    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/19218ca1-9c05-41ac-9c51-978079184615-metrics-tls\") pod \"dns-default-qbfqh\" (UID: \"19218ca1-9c05-41ac-9c51-978079184615\") " pod="openshift-dns/dns-default-qbfqh"
Jul 07 17:08:31.296028 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:31.295876    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 17:08:31.296028 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:31.295928    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19218ca1-9c05-41ac-9c51-978079184615-metrics-tls podName:19218ca1-9c05-41ac-9c51-978079184615 nodeName:}" failed. No retries permitted until 2026-07-07 17:08:32.295915103 +0000 UTC m=+37.019168278 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/19218ca1-9c05-41ac-9c51-978079184615-metrics-tls") pod "dns-default-qbfqh" (UID: "19218ca1-9c05-41ac-9c51-978079184615") : secret "dns-default-metrics-tls" not found
Jul 07 17:08:32.304437 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:32.304379    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/19218ca1-9c05-41ac-9c51-978079184615-metrics-tls\") pod \"dns-default-qbfqh\" (UID: \"19218ca1-9c05-41ac-9c51-978079184615\") " pod="openshift-dns/dns-default-qbfqh"
Jul 07 17:08:32.305320 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:32.304513    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 17:08:32.305320 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:32.304574    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19218ca1-9c05-41ac-9c51-978079184615-metrics-tls podName:19218ca1-9c05-41ac-9c51-978079184615 nodeName:}" failed. No retries permitted until 2026-07-07 17:08:34.304556502 +0000 UTC m=+39.027809691 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/19218ca1-9c05-41ac-9c51-978079184615-metrics-tls") pod "dns-default-qbfqh" (UID: "19218ca1-9c05-41ac-9c51-978079184615") : secret "dns-default-metrics-tls" not found
Jul 07 17:08:32.488720 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:32.488681    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:08:32.588881 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:32.588800    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:08:34.169824 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:34.169557    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-9vjpm" event={"ID":"aee49a54-f7ff-4e57-a35a-ec8e57b1fd33","Type":"ContainerStarted","Data":"65300391071bf343b353e34ae397000bdca13ef44ad472519ee9de57c3de36be"}
Jul 07 17:08:34.189408 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:34.189348    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-9vjpm" podStartSLOduration=1.40571717 podStartE2EDuration="4.189331143s" totalImagesPullingTime="2.783613973s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:08:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:08:34.187849483 +0000 UTC m=+38.911102681" watchObservedRunningTime="2026-07-07 17:08:34.189331143 +0000 UTC m=+38.912584340"
Jul 07 17:08:34.322689 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:34.322651    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/19218ca1-9c05-41ac-9c51-978079184615-metrics-tls\") pod \"dns-default-qbfqh\" (UID: \"19218ca1-9c05-41ac-9c51-978079184615\") " pod="openshift-dns/dns-default-qbfqh"
Jul 07 17:08:34.322882 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:34.322792    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 17:08:34.322882 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:34.322857    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19218ca1-9c05-41ac-9c51-978079184615-metrics-tls podName:19218ca1-9c05-41ac-9c51-978079184615 nodeName:}" failed. No retries permitted until 2026-07-07 17:08:38.322841625 +0000 UTC m=+43.046094801 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/19218ca1-9c05-41ac-9c51-978079184615-metrics-tls") pod "dns-default-qbfqh" (UID: "19218ca1-9c05-41ac-9c51-978079184615") : secret "dns-default-metrics-tls" not found
Jul 07 17:08:35.728913 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:35.728865    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:08:35.831018 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:35.830970    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:08:37.180709 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:37.180674    2562 generic.go:356] "Generic (PLEG): container finished" podID="b876547b-7002-4de2-bbbe-cb70ea03a96b" containerID="ec49ad3214896dfebd68d182107fb9c59e490cd4ce76284fe6dbf470524c29f3" exitCode=0
Jul 07 17:08:37.181101 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:37.180732    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w9xzb" event={"ID":"b876547b-7002-4de2-bbbe-cb70ea03a96b","Type":"ContainerDied","Data":"ec49ad3214896dfebd68d182107fb9c59e490cd4ce76284fe6dbf470524c29f3"}
Jul 07 17:08:37.368026 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:37.367979    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:08:37.452021 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:37.451916    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:08:38.186327 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:38.186289    2562 generic.go:356] "Generic (PLEG): container finished" podID="b876547b-7002-4de2-bbbe-cb70ea03a96b" containerID="c699970e7ca98f493bf1fefd7d66e4b2194c53dfc6ac94fe053a744276d8d833" exitCode=0
Jul 07 17:08:38.186682 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:38.186367    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w9xzb" event={"ID":"b876547b-7002-4de2-bbbe-cb70ea03a96b","Type":"ContainerDied","Data":"c699970e7ca98f493bf1fefd7d66e4b2194c53dfc6ac94fe053a744276d8d833"}
Jul 07 17:08:38.354863 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:38.354830    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/19218ca1-9c05-41ac-9c51-978079184615-metrics-tls\") pod \"dns-default-qbfqh\" (UID: \"19218ca1-9c05-41ac-9c51-978079184615\") " pod="openshift-dns/dns-default-qbfqh"
Jul 07 17:08:38.355053 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:38.354991    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 17:08:38.355096 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:38.355062    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19218ca1-9c05-41ac-9c51-978079184615-metrics-tls podName:19218ca1-9c05-41ac-9c51-978079184615 nodeName:}" failed. No retries permitted until 2026-07-07 17:08:46.355044444 +0000 UTC m=+51.078297622 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/19218ca1-9c05-41ac-9c51-978079184615-metrics-tls") pod "dns-default-qbfqh" (UID: "19218ca1-9c05-41ac-9c51-978079184615") : secret "dns-default-metrics-tls" not found
Jul 07 17:08:39.192033 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:39.191996    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w9xzb" event={"ID":"b876547b-7002-4de2-bbbe-cb70ea03a96b","Type":"ContainerStarted","Data":"5b79a45cd3abdb5a4a3c54d04fae0388a778aa19e7b5f22996a93e84ef95f2cb"}
Jul 07 17:08:39.391865 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:39.391819    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:08:39.503034 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:39.502934    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:08:39.597050 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:39.597017    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:08:39.678095 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:39.678066    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:08:39.756365 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:39.756296    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:08:46.415125 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:46.415082    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/19218ca1-9c05-41ac-9c51-978079184615-metrics-tls\") pod \"dns-default-qbfqh\" (UID: \"19218ca1-9c05-41ac-9c51-978079184615\") " pod="openshift-dns/dns-default-qbfqh"
Jul 07 17:08:46.415544 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:46.415246    2562 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found
Jul 07 17:08:46.415544 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:46.415317    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/19218ca1-9c05-41ac-9c51-978079184615-metrics-tls podName:19218ca1-9c05-41ac-9c51-978079184615 nodeName:}" failed. No retries permitted until 2026-07-07 17:09:02.415302321 +0000 UTC m=+67.138555495 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/19218ca1-9c05-41ac-9c51-978079184615-metrics-tls") pod "dns-default-qbfqh" (UID: "19218ca1-9c05-41ac-9c51-978079184615") : secret "dns-default-metrics-tls" not found
Jul 07 17:08:47.248106 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.248030    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-w9xzb" podStartSLOduration=16.291197272 podStartE2EDuration="51.248012803s" totalImagesPullingTime="34.956815531s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:07:56 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:08:39.224853339 +0000 UTC m=+43.948106574" watchObservedRunningTime="2026-07-07 17:08:47.248012803 +0000 UTC m=+51.971266003"
Jul 07 17:08:47.248712 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.248694    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-h6qjb"]
Jul 07 17:08:47.261724 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.261693    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-h6qjb"
Jul 07 17:08:47.266216 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.266181    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\""
Jul 07 17:08:47.266366 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.266185    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\""
Jul 07 17:08:47.266870 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.266848    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-h6qjb"]
Jul 07 17:08:47.267823 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.267802    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\""
Jul 07 17:08:47.267931 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.267808    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-6vhlq\""
Jul 07 17:08:47.267931 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.267886    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\""
Jul 07 17:08:47.349688 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.349655    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-qk5b2"]
Jul 07 17:08:47.365320 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.365286    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-675c858bdf-2tgn6"]
Jul 07 17:08:47.365487 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.365390    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-qk5b2"
Jul 07 17:08:47.367884 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.367858    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\""
Jul 07 17:08:47.368030 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.367935    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\""
Jul 07 17:08:47.368282 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.368261    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-4wxbl\""
Jul 07 17:08:47.368423 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.368407    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\""
Jul 07 17:08:47.369439 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.369422    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\""
Jul 07 17:08:47.376937 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.376911    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\""
Jul 07 17:08:47.379246 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.379222    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-qk5b2"]
Jul 07 17:08:47.379346 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.379258    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-675c858bdf-2tgn6"]
Jul 07 17:08:47.379346 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.379325    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-675c858bdf-2tgn6"
Jul 07 17:08:47.391306 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.391279    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\""
Jul 07 17:08:47.391790 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.391773    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-lx9xb\""
Jul 07 17:08:47.399140 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.399114    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\""
Jul 07 17:08:47.399140 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.399129    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\""
Jul 07 17:08:47.399353 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.399148    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\""
Jul 07 17:08:47.399353 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.399218    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\""
Jul 07 17:08:47.399353 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.399250    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\""
Jul 07 17:08:47.422764 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.422717    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/278dfd1c-402a-4f6f-8772-694c8c9e22b0-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-h6qjb\" (UID: \"278dfd1c-402a-4f6f-8772-694c8c9e22b0\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-h6qjb"
Jul 07 17:08:47.423201 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.422809    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/278dfd1c-402a-4f6f-8772-694c8c9e22b0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-h6qjb\" (UID: \"278dfd1c-402a-4f6f-8772-694c8c9e22b0\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-h6qjb"
Jul 07 17:08:47.423201 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.423044    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvnlb\" (UniqueName: \"kubernetes.io/projected/278dfd1c-402a-4f6f-8772-694c8c9e22b0-kube-api-access-vvnlb\") pod \"cluster-monitoring-operator-64786d9cbb-h6qjb\" (UID: \"278dfd1c-402a-4f6f-8772-694c8c9e22b0\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-h6qjb"
Jul 07 17:08:47.523607 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.523507    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40bee3fc-b922-45bb-ac62-2a9593b07e28-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-qk5b2\" (UID: \"40bee3fc-b922-45bb-ac62-2a9593b07e28\") " pod="openshift-insights/insights-operator-5c847dcfc4-qk5b2"
Jul 07 17:08:47.523607 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.523555    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pv6pp\" (UniqueName: \"kubernetes.io/projected/40bee3fc-b922-45bb-ac62-2a9593b07e28-kube-api-access-pv6pp\") pod \"insights-operator-5c847dcfc4-qk5b2\" (UID: \"40bee3fc-b922-45bb-ac62-2a9593b07e28\") " pod="openshift-insights/insights-operator-5c847dcfc4-qk5b2"
Jul 07 17:08:47.523607 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.523582    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd7890b5-693f-4e12-a5e6-feb4ab62a25b-metrics-certs\") pod \"router-default-675c858bdf-2tgn6\" (UID: \"dd7890b5-693f-4e12-a5e6-feb4ab62a25b\") " pod="openshift-ingress/router-default-675c858bdf-2tgn6"
Jul 07 17:08:47.523864 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.523612    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvnlb\" (UniqueName: \"kubernetes.io/projected/278dfd1c-402a-4f6f-8772-694c8c9e22b0-kube-api-access-vvnlb\") pod \"cluster-monitoring-operator-64786d9cbb-h6qjb\" (UID: \"278dfd1c-402a-4f6f-8772-694c8c9e22b0\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-h6qjb"
Jul 07 17:08:47.523864 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.523637    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd7890b5-693f-4e12-a5e6-feb4ab62a25b-service-ca-bundle\") pod \"router-default-675c858bdf-2tgn6\" (UID: \"dd7890b5-693f-4e12-a5e6-feb4ab62a25b\") " pod="openshift-ingress/router-default-675c858bdf-2tgn6"
Jul 07 17:08:47.523864 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.523663    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/40bee3fc-b922-45bb-ac62-2a9593b07e28-snapshots\") pod \"insights-operator-5c847dcfc4-qk5b2\" (UID: \"40bee3fc-b922-45bb-ac62-2a9593b07e28\") " pod="openshift-insights/insights-operator-5c847dcfc4-qk5b2"
Jul 07 17:08:47.523864 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.523679    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/dd7890b5-693f-4e12-a5e6-feb4ab62a25b-stats-auth\") pod \"router-default-675c858bdf-2tgn6\" (UID: \"dd7890b5-693f-4e12-a5e6-feb4ab62a25b\") " pod="openshift-ingress/router-default-675c858bdf-2tgn6"
Jul 07 17:08:47.523864 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.523728    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/278dfd1c-402a-4f6f-8772-694c8c9e22b0-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-h6qjb\" (UID: \"278dfd1c-402a-4f6f-8772-694c8c9e22b0\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-h6qjb"
Jul 07 17:08:47.523864 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.523745    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40bee3fc-b922-45bb-ac62-2a9593b07e28-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-qk5b2\" (UID: \"40bee3fc-b922-45bb-ac62-2a9593b07e28\") " pod="openshift-insights/insights-operator-5c847dcfc4-qk5b2"
Jul 07 17:08:47.523864 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.523763    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/40bee3fc-b922-45bb-ac62-2a9593b07e28-serving-cert\") pod \"insights-operator-5c847dcfc4-qk5b2\" (UID: \"40bee3fc-b922-45bb-ac62-2a9593b07e28\") " pod="openshift-insights/insights-operator-5c847dcfc4-qk5b2"
Jul 07 17:08:47.523864 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.523788    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/dd7890b5-693f-4e12-a5e6-feb4ab62a25b-default-certificate\") pod \"router-default-675c858bdf-2tgn6\" (UID: \"dd7890b5-693f-4e12-a5e6-feb4ab62a25b\") " pod="openshift-ingress/router-default-675c858bdf-2tgn6"
Jul 07 17:08:47.523864 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.523824    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/278dfd1c-402a-4f6f-8772-694c8c9e22b0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-h6qjb\" (UID: \"278dfd1c-402a-4f6f-8772-694c8c9e22b0\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-h6qjb"
Jul 07 17:08:47.523864 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.523854    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/40bee3fc-b922-45bb-ac62-2a9593b07e28-tmp\") pod \"insights-operator-5c847dcfc4-qk5b2\" (UID: \"40bee3fc-b922-45bb-ac62-2a9593b07e28\") " pod="openshift-insights/insights-operator-5c847dcfc4-qk5b2"
Jul 07 17:08:47.524244 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.523880    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jng8p\" (UniqueName: \"kubernetes.io/projected/dd7890b5-693f-4e12-a5e6-feb4ab62a25b-kube-api-access-jng8p\") pod \"router-default-675c858bdf-2tgn6\" (UID: \"dd7890b5-693f-4e12-a5e6-feb4ab62a25b\") " pod="openshift-ingress/router-default-675c858bdf-2tgn6"
Jul 07 17:08:47.524244 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:47.523952    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 17:08:47.524244 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:47.524001    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/278dfd1c-402a-4f6f-8772-694c8c9e22b0-cluster-monitoring-operator-tls podName:278dfd1c-402a-4f6f-8772-694c8c9e22b0 nodeName:}" failed. No retries permitted until 2026-07-07 17:08:48.023988584 +0000 UTC m=+52.747241759 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/278dfd1c-402a-4f6f-8772-694c8c9e22b0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-h6qjb" (UID: "278dfd1c-402a-4f6f-8772-694c8c9e22b0") : secret "cluster-monitoring-operator-tls" not found
Jul 07 17:08:47.524500 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.524479    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/278dfd1c-402a-4f6f-8772-694c8c9e22b0-telemetry-config\") pod \"cluster-monitoring-operator-64786d9cbb-h6qjb\" (UID: \"278dfd1c-402a-4f6f-8772-694c8c9e22b0\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-h6qjb"
Jul 07 17:08:47.550999 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.550960    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvnlb\" (UniqueName: \"kubernetes.io/projected/278dfd1c-402a-4f6f-8772-694c8c9e22b0-kube-api-access-vvnlb\") pod \"cluster-monitoring-operator-64786d9cbb-h6qjb\" (UID: \"278dfd1c-402a-4f6f-8772-694c8c9e22b0\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-h6qjb"
Jul 07 17:08:47.624226 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.624183    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40bee3fc-b922-45bb-ac62-2a9593b07e28-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-qk5b2\" (UID: \"40bee3fc-b922-45bb-ac62-2a9593b07e28\") " pod="openshift-insights/insights-operator-5c847dcfc4-qk5b2"
Jul 07 17:08:47.624226 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.624226    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pv6pp\" (UniqueName: \"kubernetes.io/projected/40bee3fc-b922-45bb-ac62-2a9593b07e28-kube-api-access-pv6pp\") pod \"insights-operator-5c847dcfc4-qk5b2\" (UID: \"40bee3fc-b922-45bb-ac62-2a9593b07e28\") " pod="openshift-insights/insights-operator-5c847dcfc4-qk5b2"
Jul 07 17:08:47.624438 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.624247    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd7890b5-693f-4e12-a5e6-feb4ab62a25b-metrics-certs\") pod \"router-default-675c858bdf-2tgn6\" (UID: \"dd7890b5-693f-4e12-a5e6-feb4ab62a25b\") " pod="openshift-ingress/router-default-675c858bdf-2tgn6"
Jul 07 17:08:47.624438 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.624275    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd7890b5-693f-4e12-a5e6-feb4ab62a25b-service-ca-bundle\") pod \"router-default-675c858bdf-2tgn6\" (UID: \"dd7890b5-693f-4e12-a5e6-feb4ab62a25b\") " pod="openshift-ingress/router-default-675c858bdf-2tgn6"
Jul 07 17:08:47.624438 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.624319    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/40bee3fc-b922-45bb-ac62-2a9593b07e28-snapshots\") pod \"insights-operator-5c847dcfc4-qk5b2\" (UID: \"40bee3fc-b922-45bb-ac62-2a9593b07e28\") " pod="openshift-insights/insights-operator-5c847dcfc4-qk5b2"
Jul 07 17:08:47.624438 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.624343    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/dd7890b5-693f-4e12-a5e6-feb4ab62a25b-stats-auth\") pod \"router-default-675c858bdf-2tgn6\" (UID: \"dd7890b5-693f-4e12-a5e6-feb4ab62a25b\") " pod="openshift-ingress/router-default-675c858bdf-2tgn6"
Jul 07 17:08:47.624438 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:47.624358    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 17:08:47.624438 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.624415    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40bee3fc-b922-45bb-ac62-2a9593b07e28-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-qk5b2\" (UID: \"40bee3fc-b922-45bb-ac62-2a9593b07e28\") " pod="openshift-insights/insights-operator-5c847dcfc4-qk5b2"
Jul 07 17:08:47.624438 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:47.624434    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd7890b5-693f-4e12-a5e6-feb4ab62a25b-metrics-certs podName:dd7890b5-693f-4e12-a5e6-feb4ab62a25b nodeName:}" failed. No retries permitted until 2026-07-07 17:08:48.124412859 +0000 UTC m=+52.847666047 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dd7890b5-693f-4e12-a5e6-feb4ab62a25b-metrics-certs") pod "router-default-675c858bdf-2tgn6" (UID: "dd7890b5-693f-4e12-a5e6-feb4ab62a25b") : secret "router-metrics-certs-default" not found
Jul 07 17:08:47.624767 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:47.624463    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dd7890b5-693f-4e12-a5e6-feb4ab62a25b-service-ca-bundle podName:dd7890b5-693f-4e12-a5e6-feb4ab62a25b nodeName:}" failed. No retries permitted until 2026-07-07 17:08:48.124444465 +0000 UTC m=+52.847697640 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/dd7890b5-693f-4e12-a5e6-feb4ab62a25b-service-ca-bundle") pod "router-default-675c858bdf-2tgn6" (UID: "dd7890b5-693f-4e12-a5e6-feb4ab62a25b") : configmap references non-existent config key: service-ca.crt
Jul 07 17:08:47.624767 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.624500    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/40bee3fc-b922-45bb-ac62-2a9593b07e28-serving-cert\") pod \"insights-operator-5c847dcfc4-qk5b2\" (UID: \"40bee3fc-b922-45bb-ac62-2a9593b07e28\") " pod="openshift-insights/insights-operator-5c847dcfc4-qk5b2"
Jul 07 17:08:47.624767 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.624532    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/dd7890b5-693f-4e12-a5e6-feb4ab62a25b-default-certificate\") pod \"router-default-675c858bdf-2tgn6\" (UID: \"dd7890b5-693f-4e12-a5e6-feb4ab62a25b\") " pod="openshift-ingress/router-default-675c858bdf-2tgn6"
Jul 07 17:08:47.624767 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.624591    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/40bee3fc-b922-45bb-ac62-2a9593b07e28-tmp\") pod \"insights-operator-5c847dcfc4-qk5b2\" (UID: \"40bee3fc-b922-45bb-ac62-2a9593b07e28\") " pod="openshift-insights/insights-operator-5c847dcfc4-qk5b2"
Jul 07 17:08:47.624767 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.624618    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jng8p\" (UniqueName: \"kubernetes.io/projected/dd7890b5-693f-4e12-a5e6-feb4ab62a25b-kube-api-access-jng8p\") pod \"router-default-675c858bdf-2tgn6\" (UID: \"dd7890b5-693f-4e12-a5e6-feb4ab62a25b\") " pod="openshift-ingress/router-default-675c858bdf-2tgn6"
Jul 07 17:08:47.625064 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.625041    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/40bee3fc-b922-45bb-ac62-2a9593b07e28-snapshots\") pod \"insights-operator-5c847dcfc4-qk5b2\" (UID: \"40bee3fc-b922-45bb-ac62-2a9593b07e28\") " pod="openshift-insights/insights-operator-5c847dcfc4-qk5b2"
Jul 07 17:08:47.625213 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.625095    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40bee3fc-b922-45bb-ac62-2a9593b07e28-service-ca-bundle\") pod \"insights-operator-5c847dcfc4-qk5b2\" (UID: \"40bee3fc-b922-45bb-ac62-2a9593b07e28\") " pod="openshift-insights/insights-operator-5c847dcfc4-qk5b2"
Jul 07 17:08:47.625213 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.625204    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/40bee3fc-b922-45bb-ac62-2a9593b07e28-trusted-ca-bundle\") pod \"insights-operator-5c847dcfc4-qk5b2\" (UID: \"40bee3fc-b922-45bb-ac62-2a9593b07e28\") " pod="openshift-insights/insights-operator-5c847dcfc4-qk5b2"
Jul 07 17:08:47.625392 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.625370    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/40bee3fc-b922-45bb-ac62-2a9593b07e28-tmp\") pod \"insights-operator-5c847dcfc4-qk5b2\" (UID: \"40bee3fc-b922-45bb-ac62-2a9593b07e28\") " pod="openshift-insights/insights-operator-5c847dcfc4-qk5b2"
Jul 07 17:08:47.626922 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.626898    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/dd7890b5-693f-4e12-a5e6-feb4ab62a25b-stats-auth\") pod \"router-default-675c858bdf-2tgn6\" (UID: \"dd7890b5-693f-4e12-a5e6-feb4ab62a25b\") " pod="openshift-ingress/router-default-675c858bdf-2tgn6"
Jul 07 17:08:47.627040 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.626921    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/40bee3fc-b922-45bb-ac62-2a9593b07e28-serving-cert\") pod \"insights-operator-5c847dcfc4-qk5b2\" (UID: \"40bee3fc-b922-45bb-ac62-2a9593b07e28\") " pod="openshift-insights/insights-operator-5c847dcfc4-qk5b2"
Jul 07 17:08:47.627040 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.626927    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/dd7890b5-693f-4e12-a5e6-feb4ab62a25b-default-certificate\") pod \"router-default-675c858bdf-2tgn6\" (UID: \"dd7890b5-693f-4e12-a5e6-feb4ab62a25b\") " pod="openshift-ingress/router-default-675c858bdf-2tgn6"
Jul 07 17:08:47.637699 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.637676    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pv6pp\" (UniqueName: \"kubernetes.io/projected/40bee3fc-b922-45bb-ac62-2a9593b07e28-kube-api-access-pv6pp\") pod \"insights-operator-5c847dcfc4-qk5b2\" (UID: \"40bee3fc-b922-45bb-ac62-2a9593b07e28\") " pod="openshift-insights/insights-operator-5c847dcfc4-qk5b2"
Jul 07 17:08:47.638312 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.638291    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jng8p\" (UniqueName: \"kubernetes.io/projected/dd7890b5-693f-4e12-a5e6-feb4ab62a25b-kube-api-access-jng8p\") pod \"router-default-675c858bdf-2tgn6\" (UID: \"dd7890b5-693f-4e12-a5e6-feb4ab62a25b\") " pod="openshift-ingress/router-default-675c858bdf-2tgn6"
Jul 07 17:08:47.643956 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.643933    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:08:47.677435 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.677403    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5c847dcfc4-qk5b2"
Jul 07 17:08:47.742768 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.742736    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:08:47.852189 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:47.852135    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5c847dcfc4-qk5b2"]
Jul 07 17:08:47.855015 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:08:47.854986    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40bee3fc_b922_45bb_ac62_2a9593b07e28.slice/crio-aab7498fe815ab473bfdf034f91a94d8ea58154788896e925d51709a8c0ca6ab WatchSource:0}: Error finding container aab7498fe815ab473bfdf034f91a94d8ea58154788896e925d51709a8c0ca6ab: Status 404 returned error can't find the container with id aab7498fe815ab473bfdf034f91a94d8ea58154788896e925d51709a8c0ca6ab
Jul 07 17:08:48.029011 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:48.028966    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/278dfd1c-402a-4f6f-8772-694c8c9e22b0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-h6qjb\" (UID: \"278dfd1c-402a-4f6f-8772-694c8c9e22b0\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-h6qjb"
Jul 07 17:08:48.029239 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:48.029139    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 17:08:48.029239 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:48.029227    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/278dfd1c-402a-4f6f-8772-694c8c9e22b0-cluster-monitoring-operator-tls podName:278dfd1c-402a-4f6f-8772-694c8c9e22b0 nodeName:}" failed. No retries permitted until 2026-07-07 17:08:49.029210369 +0000 UTC m=+53.752463543 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/278dfd1c-402a-4f6f-8772-694c8c9e22b0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-h6qjb" (UID: "278dfd1c-402a-4f6f-8772-694c8c9e22b0") : secret "cluster-monitoring-operator-tls" not found
Jul 07 17:08:48.129655 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:48.129621    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd7890b5-693f-4e12-a5e6-feb4ab62a25b-metrics-certs\") pod \"router-default-675c858bdf-2tgn6\" (UID: \"dd7890b5-693f-4e12-a5e6-feb4ab62a25b\") " pod="openshift-ingress/router-default-675c858bdf-2tgn6"
Jul 07 17:08:48.129860 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:48.129664    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd7890b5-693f-4e12-a5e6-feb4ab62a25b-service-ca-bundle\") pod \"router-default-675c858bdf-2tgn6\" (UID: \"dd7890b5-693f-4e12-a5e6-feb4ab62a25b\") " pod="openshift-ingress/router-default-675c858bdf-2tgn6"
Jul 07 17:08:48.129860 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:48.129771    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 17:08:48.129860 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:48.129819    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dd7890b5-693f-4e12-a5e6-feb4ab62a25b-service-ca-bundle podName:dd7890b5-693f-4e12-a5e6-feb4ab62a25b nodeName:}" failed. No retries permitted until 2026-07-07 17:08:49.129805566 +0000 UTC m=+53.853058741 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/dd7890b5-693f-4e12-a5e6-feb4ab62a25b-service-ca-bundle") pod "router-default-675c858bdf-2tgn6" (UID: "dd7890b5-693f-4e12-a5e6-feb4ab62a25b") : configmap references non-existent config key: service-ca.crt
Jul 07 17:08:48.129860 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:48.129834    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd7890b5-693f-4e12-a5e6-feb4ab62a25b-metrics-certs podName:dd7890b5-693f-4e12-a5e6-feb4ab62a25b nodeName:}" failed. No retries permitted until 2026-07-07 17:08:49.129827687 +0000 UTC m=+53.853080861 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dd7890b5-693f-4e12-a5e6-feb4ab62a25b-metrics-certs") pod "router-default-675c858bdf-2tgn6" (UID: "dd7890b5-693f-4e12-a5e6-feb4ab62a25b") : secret "router-metrics-certs-default" not found
Jul 07 17:08:48.214833 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:48.214802    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-qk5b2" event={"ID":"40bee3fc-b922-45bb-ac62-2a9593b07e28","Type":"ContainerStarted","Data":"aab7498fe815ab473bfdf034f91a94d8ea58154788896e925d51709a8c0ca6ab"}
Jul 07 17:08:49.036309 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:49.036276    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/278dfd1c-402a-4f6f-8772-694c8c9e22b0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-h6qjb\" (UID: \"278dfd1c-402a-4f6f-8772-694c8c9e22b0\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-h6qjb"
Jul 07 17:08:49.036786 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:49.036451    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 17:08:49.036786 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:49.036537    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/278dfd1c-402a-4f6f-8772-694c8c9e22b0-cluster-monitoring-operator-tls podName:278dfd1c-402a-4f6f-8772-694c8c9e22b0 nodeName:}" failed. No retries permitted until 2026-07-07 17:08:51.036516579 +0000 UTC m=+55.759769757 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/278dfd1c-402a-4f6f-8772-694c8c9e22b0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-h6qjb" (UID: "278dfd1c-402a-4f6f-8772-694c8c9e22b0") : secret "cluster-monitoring-operator-tls" not found
Jul 07 17:08:49.137586 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:49.137550    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd7890b5-693f-4e12-a5e6-feb4ab62a25b-metrics-certs\") pod \"router-default-675c858bdf-2tgn6\" (UID: \"dd7890b5-693f-4e12-a5e6-feb4ab62a25b\") " pod="openshift-ingress/router-default-675c858bdf-2tgn6"
Jul 07 17:08:49.137586 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:49.137594    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd7890b5-693f-4e12-a5e6-feb4ab62a25b-service-ca-bundle\") pod \"router-default-675c858bdf-2tgn6\" (UID: \"dd7890b5-693f-4e12-a5e6-feb4ab62a25b\") " pod="openshift-ingress/router-default-675c858bdf-2tgn6"
Jul 07 17:08:49.137797 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:49.137705    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 17:08:49.137797 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:49.137714    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dd7890b5-693f-4e12-a5e6-feb4ab62a25b-service-ca-bundle podName:dd7890b5-693f-4e12-a5e6-feb4ab62a25b nodeName:}" failed. No retries permitted until 2026-07-07 17:08:51.137696777 +0000 UTC m=+55.860949951 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/dd7890b5-693f-4e12-a5e6-feb4ab62a25b-service-ca-bundle") pod "router-default-675c858bdf-2tgn6" (UID: "dd7890b5-693f-4e12-a5e6-feb4ab62a25b") : configmap references non-existent config key: service-ca.crt
Jul 07 17:08:49.137868 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:49.137819    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd7890b5-693f-4e12-a5e6-feb4ab62a25b-metrics-certs podName:dd7890b5-693f-4e12-a5e6-feb4ab62a25b nodeName:}" failed. No retries permitted until 2026-07-07 17:08:51.137807886 +0000 UTC m=+55.861061061 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dd7890b5-693f-4e12-a5e6-feb4ab62a25b-metrics-certs") pod "router-default-675c858bdf-2tgn6" (UID: "dd7890b5-693f-4e12-a5e6-feb4ab62a25b") : secret "router-metrics-certs-default" not found
Jul 07 17:08:50.464432 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:50.464392    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:08:50.529213 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:50.529148    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:08:51.052553 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:51.052511    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/278dfd1c-402a-4f6f-8772-694c8c9e22b0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-h6qjb\" (UID: \"278dfd1c-402a-4f6f-8772-694c8c9e22b0\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-h6qjb"
Jul 07 17:08:51.052736 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:51.052697    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 17:08:51.052789 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:51.052778    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/278dfd1c-402a-4f6f-8772-694c8c9e22b0-cluster-monitoring-operator-tls podName:278dfd1c-402a-4f6f-8772-694c8c9e22b0 nodeName:}" failed. No retries permitted until 2026-07-07 17:08:55.052758924 +0000 UTC m=+59.776012103 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/278dfd1c-402a-4f6f-8772-694c8c9e22b0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-h6qjb" (UID: "278dfd1c-402a-4f6f-8772-694c8c9e22b0") : secret "cluster-monitoring-operator-tls" not found
Jul 07 17:08:51.153644 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:51.153607    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd7890b5-693f-4e12-a5e6-feb4ab62a25b-metrics-certs\") pod \"router-default-675c858bdf-2tgn6\" (UID: \"dd7890b5-693f-4e12-a5e6-feb4ab62a25b\") " pod="openshift-ingress/router-default-675c858bdf-2tgn6"
Jul 07 17:08:51.153826 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:51.153662    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd7890b5-693f-4e12-a5e6-feb4ab62a25b-service-ca-bundle\") pod \"router-default-675c858bdf-2tgn6\" (UID: \"dd7890b5-693f-4e12-a5e6-feb4ab62a25b\") " pod="openshift-ingress/router-default-675c858bdf-2tgn6"
Jul 07 17:08:51.153826 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:51.153765    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 17:08:51.153891 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:51.153849    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd7890b5-693f-4e12-a5e6-feb4ab62a25b-metrics-certs podName:dd7890b5-693f-4e12-a5e6-feb4ab62a25b nodeName:}" failed. No retries permitted until 2026-07-07 17:08:55.153831679 +0000 UTC m=+59.877084870 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dd7890b5-693f-4e12-a5e6-feb4ab62a25b-metrics-certs") pod "router-default-675c858bdf-2tgn6" (UID: "dd7890b5-693f-4e12-a5e6-feb4ab62a25b") : secret "router-metrics-certs-default" not found
Jul 07 17:08:51.153891 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:51.153864    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dd7890b5-693f-4e12-a5e6-feb4ab62a25b-service-ca-bundle podName:dd7890b5-693f-4e12-a5e6-feb4ab62a25b nodeName:}" failed. No retries permitted until 2026-07-07 17:08:55.15385803 +0000 UTC m=+59.877111205 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/dd7890b5-693f-4e12-a5e6-feb4ab62a25b-service-ca-bundle") pod "router-default-675c858bdf-2tgn6" (UID: "dd7890b5-693f-4e12-a5e6-feb4ab62a25b") : configmap references non-existent config key: service-ca.crt
Jul 07 17:08:51.224037 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:51.224000    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-qk5b2" event={"ID":"40bee3fc-b922-45bb-ac62-2a9593b07e28","Type":"ContainerStarted","Data":"3456d8a3995d24b739a0788f35093e4590477c04944c5f5e89d3f90cc03431f0"}
Jul 07 17:08:51.247887 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:51.247832    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5c847dcfc4-qk5b2" podStartSLOduration=1.535945784 podStartE2EDuration="4.247810639s" totalImagesPullingTime="2.711864855s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:08:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:08:51.247308701 +0000 UTC m=+55.970561898" watchObservedRunningTime="2026-07-07 17:08:51.247810639 +0000 UTC m=+55.971063840"
Jul 07 17:08:51.579385 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:51.579350    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-zpj9n"]
Jul 07 17:08:51.581667 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:51.581642    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zpj9n"
Jul 07 17:08:51.585787 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:51.585764    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\""
Jul 07 17:08:51.586171 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:51.586139    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kb2xx\""
Jul 07 17:08:51.587300 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:51.587279    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\""
Jul 07 17:08:51.595264 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:51.595226    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zpj9n"]
Jul 07 17:08:51.635409 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:51.635378    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:08:51.656692 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:51.656658    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/00e0f04d-964b-4a21-82cc-5dfd8ad76e8f-crio-socket\") pod \"insights-runtime-extractor-zpj9n\" (UID: \"00e0f04d-964b-4a21-82cc-5dfd8ad76e8f\") " pod="openshift-insights/insights-runtime-extractor-zpj9n"
Jul 07 17:08:51.656692 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:51.656693    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/00e0f04d-964b-4a21-82cc-5dfd8ad76e8f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zpj9n\" (UID: \"00e0f04d-964b-4a21-82cc-5dfd8ad76e8f\") " pod="openshift-insights/insights-runtime-extractor-zpj9n"
Jul 07 17:08:51.656944 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:51.656715    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/00e0f04d-964b-4a21-82cc-5dfd8ad76e8f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zpj9n\" (UID: \"00e0f04d-964b-4a21-82cc-5dfd8ad76e8f\") " pod="openshift-insights/insights-runtime-extractor-zpj9n"
Jul 07 17:08:51.656944 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:51.656785    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lml4m\" (UniqueName: \"kubernetes.io/projected/00e0f04d-964b-4a21-82cc-5dfd8ad76e8f-kube-api-access-lml4m\") pod \"insights-runtime-extractor-zpj9n\" (UID: \"00e0f04d-964b-4a21-82cc-5dfd8ad76e8f\") " pod="openshift-insights/insights-runtime-extractor-zpj9n"
Jul 07 17:08:51.656944 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:51.656834    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/00e0f04d-964b-4a21-82cc-5dfd8ad76e8f-data-volume\") pod \"insights-runtime-extractor-zpj9n\" (UID: \"00e0f04d-964b-4a21-82cc-5dfd8ad76e8f\") " pod="openshift-insights/insights-runtime-extractor-zpj9n"
Jul 07 17:08:51.697566 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:51.697532    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:08:51.757780 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:51.757747    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lml4m\" (UniqueName: \"kubernetes.io/projected/00e0f04d-964b-4a21-82cc-5dfd8ad76e8f-kube-api-access-lml4m\") pod \"insights-runtime-extractor-zpj9n\" (UID: \"00e0f04d-964b-4a21-82cc-5dfd8ad76e8f\") " pod="openshift-insights/insights-runtime-extractor-zpj9n"
Jul 07 17:08:51.757943 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:51.757794    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/00e0f04d-964b-4a21-82cc-5dfd8ad76e8f-data-volume\") pod \"insights-runtime-extractor-zpj9n\" (UID: \"00e0f04d-964b-4a21-82cc-5dfd8ad76e8f\") " pod="openshift-insights/insights-runtime-extractor-zpj9n"
Jul 07 17:08:51.757943 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:51.757866    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/00e0f04d-964b-4a21-82cc-5dfd8ad76e8f-crio-socket\") pod \"insights-runtime-extractor-zpj9n\" (UID: \"00e0f04d-964b-4a21-82cc-5dfd8ad76e8f\") " pod="openshift-insights/insights-runtime-extractor-zpj9n"
Jul 07 17:08:51.757943 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:51.757881    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/00e0f04d-964b-4a21-82cc-5dfd8ad76e8f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zpj9n\" (UID: \"00e0f04d-964b-4a21-82cc-5dfd8ad76e8f\") " pod="openshift-insights/insights-runtime-extractor-zpj9n"
Jul 07 17:08:51.757943 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:51.757903    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/00e0f04d-964b-4a21-82cc-5dfd8ad76e8f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zpj9n\" (UID: \"00e0f04d-964b-4a21-82cc-5dfd8ad76e8f\") " pod="openshift-insights/insights-runtime-extractor-zpj9n"
Jul 07 17:08:51.758094 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:51.757970    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/00e0f04d-964b-4a21-82cc-5dfd8ad76e8f-crio-socket\") pod \"insights-runtime-extractor-zpj9n\" (UID: \"00e0f04d-964b-4a21-82cc-5dfd8ad76e8f\") " pod="openshift-insights/insights-runtime-extractor-zpj9n"
Jul 07 17:08:51.758094 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:51.757981    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 17:08:51.758094 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:51.757995    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 17:08:51.758094 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:51.758059    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/00e0f04d-964b-4a21-82cc-5dfd8ad76e8f-kube-rbac-proxy-cm podName:00e0f04d-964b-4a21-82cc-5dfd8ad76e8f nodeName:}" failed. No retries permitted until 2026-07-07 17:08:52.258038883 +0000 UTC m=+56.981292058 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/00e0f04d-964b-4a21-82cc-5dfd8ad76e8f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zpj9n" (UID: "00e0f04d-964b-4a21-82cc-5dfd8ad76e8f") : configmap "kube-rbac-proxy" not found
Jul 07 17:08:51.758259 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:51.758103    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00e0f04d-964b-4a21-82cc-5dfd8ad76e8f-insights-runtime-extractor-tls podName:00e0f04d-964b-4a21-82cc-5dfd8ad76e8f nodeName:}" failed. No retries permitted until 2026-07-07 17:08:52.258087066 +0000 UTC m=+56.981340242 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/00e0f04d-964b-4a21-82cc-5dfd8ad76e8f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zpj9n" (UID: "00e0f04d-964b-4a21-82cc-5dfd8ad76e8f") : secret "insights-runtime-extractor-tls" not found
Jul 07 17:08:51.758259 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:51.758229    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/00e0f04d-964b-4a21-82cc-5dfd8ad76e8f-data-volume\") pod \"insights-runtime-extractor-zpj9n\" (UID: \"00e0f04d-964b-4a21-82cc-5dfd8ad76e8f\") " pod="openshift-insights/insights-runtime-extractor-zpj9n"
Jul 07 17:08:51.773603 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:51.773570    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lml4m\" (UniqueName: \"kubernetes.io/projected/00e0f04d-964b-4a21-82cc-5dfd8ad76e8f-kube-api-access-lml4m\") pod \"insights-runtime-extractor-zpj9n\" (UID: \"00e0f04d-964b-4a21-82cc-5dfd8ad76e8f\") " pod="openshift-insights/insights-runtime-extractor-zpj9n"
Jul 07 17:08:52.264424 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:52.264390    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/00e0f04d-964b-4a21-82cc-5dfd8ad76e8f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zpj9n\" (UID: \"00e0f04d-964b-4a21-82cc-5dfd8ad76e8f\") " pod="openshift-insights/insights-runtime-extractor-zpj9n"
Jul 07 17:08:52.264424 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:52.264424    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/00e0f04d-964b-4a21-82cc-5dfd8ad76e8f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zpj9n\" (UID: \"00e0f04d-964b-4a21-82cc-5dfd8ad76e8f\") " pod="openshift-insights/insights-runtime-extractor-zpj9n"
Jul 07 17:08:52.264663 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:52.264516    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 17:08:52.264663 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:52.264546    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 17:08:52.264663 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:52.264592    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/00e0f04d-964b-4a21-82cc-5dfd8ad76e8f-kube-rbac-proxy-cm podName:00e0f04d-964b-4a21-82cc-5dfd8ad76e8f nodeName:}" failed. No retries permitted until 2026-07-07 17:08:53.26457158 +0000 UTC m=+57.987824779 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/00e0f04d-964b-4a21-82cc-5dfd8ad76e8f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zpj9n" (UID: "00e0f04d-964b-4a21-82cc-5dfd8ad76e8f") : configmap "kube-rbac-proxy" not found
Jul 07 17:08:52.264663 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:52.264608    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00e0f04d-964b-4a21-82cc-5dfd8ad76e8f-insights-runtime-extractor-tls podName:00e0f04d-964b-4a21-82cc-5dfd8ad76e8f nodeName:}" failed. No retries permitted until 2026-07-07 17:08:53.264601857 +0000 UTC m=+57.987855032 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/00e0f04d-964b-4a21-82cc-5dfd8ad76e8f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zpj9n" (UID: "00e0f04d-964b-4a21-82cc-5dfd8ad76e8f") : secret "insights-runtime-extractor-tls" not found
Jul 07 17:08:52.652599 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:52.652568    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:08:52.703637 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:52.703605    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-qqrth"]
Jul 07 17:08:52.705473 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:52.705457    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-qqrth"
Jul 07 17:08:52.710014 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:52.709992    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-gz9gg\""
Jul 07 17:08:52.710361 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:52.710345    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\""
Jul 07 17:08:52.711148 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:52.711127    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\""
Jul 07 17:08:52.718058 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:52.718030    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-qqrth"]
Jul 07 17:08:52.751469 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:52.751431    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:08:52.768989 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:52.768951    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rdzht\" (UniqueName: \"kubernetes.io/projected/f5579872-6ce4-4d01-8e01-0333abf2f07b-kube-api-access-rdzht\") pod \"migrator-d57d58cc9-qqrth\" (UID: \"f5579872-6ce4-4d01-8e01-0333abf2f07b\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-qqrth"
Jul 07 17:08:52.852056 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:52.852024    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:08:52.870381 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:52.870349    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rdzht\" (UniqueName: \"kubernetes.io/projected/f5579872-6ce4-4d01-8e01-0333abf2f07b-kube-api-access-rdzht\") pod \"migrator-d57d58cc9-qqrth\" (UID: \"f5579872-6ce4-4d01-8e01-0333abf2f07b\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-qqrth"
Jul 07 17:08:52.891596 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:52.891556    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rdzht\" (UniqueName: \"kubernetes.io/projected/f5579872-6ce4-4d01-8e01-0333abf2f07b-kube-api-access-rdzht\") pod \"migrator-d57d58cc9-qqrth\" (UID: \"f5579872-6ce4-4d01-8e01-0333abf2f07b\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-qqrth"
Jul 07 17:08:53.014551 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:53.014456    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-qqrth"
Jul 07 17:08:53.151773 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:53.151729    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-qqrth"]
Jul 07 17:08:53.154418 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:08:53.154386    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf5579872_6ce4_4d01_8e01_0333abf2f07b.slice/crio-74b3e803dfe73067ee48f2427f2cd0cd5e4ec68527e4a79ba1a242078ab85a2e WatchSource:0}: Error finding container 74b3e803dfe73067ee48f2427f2cd0cd5e4ec68527e4a79ba1a242078ab85a2e: Status 404 returned error can't find the container with id 74b3e803dfe73067ee48f2427f2cd0cd5e4ec68527e4a79ba1a242078ab85a2e
Jul 07 17:08:53.204630 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:53.204593    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:08:53.230428 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:53.230394    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-qqrth" event={"ID":"f5579872-6ce4-4d01-8e01-0333abf2f07b","Type":"ContainerStarted","Data":"74b3e803dfe73067ee48f2427f2cd0cd5e4ec68527e4a79ba1a242078ab85a2e"}
Jul 07 17:08:53.273002 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:53.272916    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/00e0f04d-964b-4a21-82cc-5dfd8ad76e8f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zpj9n\" (UID: \"00e0f04d-964b-4a21-82cc-5dfd8ad76e8f\") " pod="openshift-insights/insights-runtime-extractor-zpj9n"
Jul 07 17:08:53.273002 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:53.272958    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/00e0f04d-964b-4a21-82cc-5dfd8ad76e8f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zpj9n\" (UID: \"00e0f04d-964b-4a21-82cc-5dfd8ad76e8f\") " pod="openshift-insights/insights-runtime-extractor-zpj9n"
Jul 07 17:08:53.273289 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:53.273047    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 17:08:53.273289 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:53.273111    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/00e0f04d-964b-4a21-82cc-5dfd8ad76e8f-kube-rbac-proxy-cm podName:00e0f04d-964b-4a21-82cc-5dfd8ad76e8f nodeName:}" failed. No retries permitted until 2026-07-07 17:08:55.273096533 +0000 UTC m=+59.996349723 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/00e0f04d-964b-4a21-82cc-5dfd8ad76e8f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zpj9n" (UID: "00e0f04d-964b-4a21-82cc-5dfd8ad76e8f") : configmap "kube-rbac-proxy" not found
Jul 07 17:08:53.273289 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:53.273148    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 17:08:53.273289 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:53.273234    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00e0f04d-964b-4a21-82cc-5dfd8ad76e8f-insights-runtime-extractor-tls podName:00e0f04d-964b-4a21-82cc-5dfd8ad76e8f nodeName:}" failed. No retries permitted until 2026-07-07 17:08:55.273219883 +0000 UTC m=+59.996473059 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/00e0f04d-964b-4a21-82cc-5dfd8ad76e8f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zpj9n" (UID: "00e0f04d-964b-4a21-82cc-5dfd8ad76e8f") : secret "insights-runtime-extractor-tls" not found
Jul 07 17:08:53.310199 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:53.310147    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:08:53.453766 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:53.453729    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:08:53.556598 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:53.556510    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:08:53.571307 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:53.571279    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7xdlh_36340fd9-83c5-4baf-b02d-9fc7f5e86485/dns-node-resolver/0.log"
Jul 07 17:08:53.927885 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:53.927853    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:08:54.021239 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:54.021202    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:08:54.234857 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:54.234826    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-qqrth" event={"ID":"f5579872-6ce4-4d01-8e01-0333abf2f07b","Type":"ContainerStarted","Data":"f5b84d367a1e3a43b9af97ccd40030006803113e82fa4e35f30f036e59ae30ce"}
Jul 07 17:08:54.769608 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:54.769579    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-v72rm_79353616-7bb8-4034-b3d5-c59eff433273/node-ca/0.log"
Jul 07 17:08:55.090306 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:55.090206    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/278dfd1c-402a-4f6f-8772-694c8c9e22b0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-h6qjb\" (UID: \"278dfd1c-402a-4f6f-8772-694c8c9e22b0\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-h6qjb"
Jul 07 17:08:55.090667 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:55.090355    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 17:08:55.090667 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:55.090420    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/278dfd1c-402a-4f6f-8772-694c8c9e22b0-cluster-monitoring-operator-tls podName:278dfd1c-402a-4f6f-8772-694c8c9e22b0 nodeName:}" failed. No retries permitted until 2026-07-07 17:09:03.090405479 +0000 UTC m=+67.813658654 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/278dfd1c-402a-4f6f-8772-694c8c9e22b0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-h6qjb" (UID: "278dfd1c-402a-4f6f-8772-694c8c9e22b0") : secret "cluster-monitoring-operator-tls" not found
Jul 07 17:08:55.172914 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:55.172859    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9vjpm_aee49a54-f7ff-4e57-a35a-ec8e57b1fd33/serve-healthcheck-canary/0.log"
Jul 07 17:08:55.191467 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:55.191428    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd7890b5-693f-4e12-a5e6-feb4ab62a25b-metrics-certs\") pod \"router-default-675c858bdf-2tgn6\" (UID: \"dd7890b5-693f-4e12-a5e6-feb4ab62a25b\") " pod="openshift-ingress/router-default-675c858bdf-2tgn6"
Jul 07 17:08:55.191467 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:55.191471    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd7890b5-693f-4e12-a5e6-feb4ab62a25b-service-ca-bundle\") pod \"router-default-675c858bdf-2tgn6\" (UID: \"dd7890b5-693f-4e12-a5e6-feb4ab62a25b\") " pod="openshift-ingress/router-default-675c858bdf-2tgn6"
Jul 07 17:08:55.191719 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:55.191605    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dd7890b5-693f-4e12-a5e6-feb4ab62a25b-service-ca-bundle podName:dd7890b5-693f-4e12-a5e6-feb4ab62a25b nodeName:}" failed. No retries permitted until 2026-07-07 17:09:03.191592791 +0000 UTC m=+67.914845966 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/dd7890b5-693f-4e12-a5e6-feb4ab62a25b-service-ca-bundle") pod "router-default-675c858bdf-2tgn6" (UID: "dd7890b5-693f-4e12-a5e6-feb4ab62a25b") : configmap references non-existent config key: service-ca.crt
Jul 07 17:08:55.191719 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:55.191604    2562 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found
Jul 07 17:08:55.191719 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:55.191638    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/dd7890b5-693f-4e12-a5e6-feb4ab62a25b-metrics-certs podName:dd7890b5-693f-4e12-a5e6-feb4ab62a25b nodeName:}" failed. No retries permitted until 2026-07-07 17:09:03.191631721 +0000 UTC m=+67.914884895 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/dd7890b5-693f-4e12-a5e6-feb4ab62a25b-metrics-certs") pod "router-default-675c858bdf-2tgn6" (UID: "dd7890b5-693f-4e12-a5e6-feb4ab62a25b") : secret "router-metrics-certs-default" not found
Jul 07 17:08:55.238885 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:55.238850    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-qqrth" event={"ID":"f5579872-6ce4-4d01-8e01-0333abf2f07b","Type":"ContainerStarted","Data":"767c190e01ff852340b8e5a3632c436a32f855eecd381ce687b58c373aa21abd"}
Jul 07 17:08:55.292747 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:55.292705    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/00e0f04d-964b-4a21-82cc-5dfd8ad76e8f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zpj9n\" (UID: \"00e0f04d-964b-4a21-82cc-5dfd8ad76e8f\") " pod="openshift-insights/insights-runtime-extractor-zpj9n"
Jul 07 17:08:55.292747 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:55.292749    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/00e0f04d-964b-4a21-82cc-5dfd8ad76e8f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zpj9n\" (UID: \"00e0f04d-964b-4a21-82cc-5dfd8ad76e8f\") " pod="openshift-insights/insights-runtime-extractor-zpj9n"
Jul 07 17:08:55.292962 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:55.292848    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 17:08:55.292962 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:55.292887    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 17:08:55.292962 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:55.292909    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00e0f04d-964b-4a21-82cc-5dfd8ad76e8f-insights-runtime-extractor-tls podName:00e0f04d-964b-4a21-82cc-5dfd8ad76e8f nodeName:}" failed. No retries permitted until 2026-07-07 17:08:59.292891863 +0000 UTC m=+64.016145060 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/00e0f04d-964b-4a21-82cc-5dfd8ad76e8f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zpj9n" (UID: "00e0f04d-964b-4a21-82cc-5dfd8ad76e8f") : secret "insights-runtime-extractor-tls" not found
Jul 07 17:08:55.292962 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:55.292929    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/00e0f04d-964b-4a21-82cc-5dfd8ad76e8f-kube-rbac-proxy-cm podName:00e0f04d-964b-4a21-82cc-5dfd8ad76e8f nodeName:}" failed. No retries permitted until 2026-07-07 17:08:59.292916888 +0000 UTC m=+64.016170077 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/00e0f04d-964b-4a21-82cc-5dfd8ad76e8f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zpj9n" (UID: "00e0f04d-964b-4a21-82cc-5dfd8ad76e8f") : configmap "kube-rbac-proxy" not found
Jul 07 17:08:55.399671 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:55.399636    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:08:55.501082 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:55.501046    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:08:55.620311 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:55.620275    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:08:55.715790 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:55.715709    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:08:56.162363 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:56.162333    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-tf68j"
Jul 07 17:08:56.202316 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:56.202267    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-qqrth" podStartSLOduration=3.190979257 podStartE2EDuration="4.202250967s" totalImagesPullingTime="1.01127171s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:08:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:08:55.264285603 +0000 UTC m=+59.987538802" watchObservedRunningTime="2026-07-07 17:08:56.202250967 +0000 UTC m=+60.925504173"
Jul 07 17:08:56.553259 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:56.553173    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:08:57.540504 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:57.540473    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:08:57.643423 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:57.643381    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:08:57.756934 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:57.756902    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:08:57.879427 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:57.879387    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:08:57.985017 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:57.984981    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:08:58.081869 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:58.081839    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:08:58.477233 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:58.477200    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:08:58.850966 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:58.850890    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:08:59.325592 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:59.325540    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/00e0f04d-964b-4a21-82cc-5dfd8ad76e8f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zpj9n\" (UID: \"00e0f04d-964b-4a21-82cc-5dfd8ad76e8f\") " pod="openshift-insights/insights-runtime-extractor-zpj9n"
Jul 07 17:08:59.325592 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:59.325589    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/00e0f04d-964b-4a21-82cc-5dfd8ad76e8f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zpj9n\" (UID: \"00e0f04d-964b-4a21-82cc-5dfd8ad76e8f\") " pod="openshift-insights/insights-runtime-extractor-zpj9n"
Jul 07 17:08:59.325816 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:59.325670    2562 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found
Jul 07 17:08:59.325816 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:59.325691    2562 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found
Jul 07 17:08:59.325816 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:59.325740    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/00e0f04d-964b-4a21-82cc-5dfd8ad76e8f-kube-rbac-proxy-cm podName:00e0f04d-964b-4a21-82cc-5dfd8ad76e8f nodeName:}" failed. No retries permitted until 2026-07-07 17:09:07.325723396 +0000 UTC m=+72.048976571 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/00e0f04d-964b-4a21-82cc-5dfd8ad76e8f-kube-rbac-proxy-cm") pod "insights-runtime-extractor-zpj9n" (UID: "00e0f04d-964b-4a21-82cc-5dfd8ad76e8f") : configmap "kube-rbac-proxy" not found
Jul 07 17:08:59.325914 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:08:59.325846    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/00e0f04d-964b-4a21-82cc-5dfd8ad76e8f-insights-runtime-extractor-tls podName:00e0f04d-964b-4a21-82cc-5dfd8ad76e8f nodeName:}" failed. No retries permitted until 2026-07-07 17:09:07.325839428 +0000 UTC m=+72.049092604 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/00e0f04d-964b-4a21-82cc-5dfd8ad76e8f-insights-runtime-extractor-tls") pod "insights-runtime-extractor-zpj9n" (UID: "00e0f04d-964b-4a21-82cc-5dfd8ad76e8f") : secret "insights-runtime-extractor-tls" not found
Jul 07 17:08:59.450280 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:59.450246    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:08:59.909957 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:08:59.909927    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:00.244517 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:00.244427    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:00.358021 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:00.357984    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:00.478188 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:00.478141    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:00.644043 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:00.644013    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:01.226119 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:01.226077    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:01.330976 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:01.330940    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:01.443232 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:01.443198    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3982c405-1bdb-4b6c-928a-fc6fb9e7b360-metrics-certs\") pod \"network-metrics-daemon-rqsv7\" (UID: \"3982c405-1bdb-4b6c-928a-fc6fb9e7b360\") " pod="openshift-multus/network-metrics-daemon-rqsv7"
Jul 07 17:09:01.443406 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:01.443251    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1a36a2e-2dad-43d1-b604-e538cc26c66d-original-pull-secret\") pod \"global-pull-secret-syncer-mhc8x\" (UID: \"c1a36a2e-2dad-43d1-b604-e538cc26c66d\") " pod="kube-system/global-pull-secret-syncer-mhc8x"
Jul 07 17:09:01.446022 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:01.446000    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\""
Jul 07 17:09:01.446085 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:01.446069    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\""
Jul 07 17:09:01.448558 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:01.448535    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:01.453540 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:09:01.453523    2562 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found
Jul 07 17:09:01.453637 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:09:01.453611    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3982c405-1bdb-4b6c-928a-fc6fb9e7b360-metrics-certs podName:3982c405-1bdb-4b6c-928a-fc6fb9e7b360 nodeName:}" failed. No retries permitted until 2026-07-07 17:10:05.453589493 +0000 UTC m=+130.176842669 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/3982c405-1bdb-4b6c-928a-fc6fb9e7b360-metrics-certs") pod "network-metrics-daemon-rqsv7" (UID: "3982c405-1bdb-4b6c-928a-fc6fb9e7b360") : secret "metrics-daemon-secret" not found
Jul 07 17:09:01.455859 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:01.455837    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/c1a36a2e-2dad-43d1-b604-e538cc26c66d-original-pull-secret\") pod \"global-pull-secret-syncer-mhc8x\" (UID: \"c1a36a2e-2dad-43d1-b604-e538cc26c66d\") " pod="kube-system/global-pull-secret-syncer-mhc8x"
Jul 07 17:09:01.465003 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:01.464977    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-mhc8x"
Jul 07 17:09:01.544445 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:01.544409    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x2bt8\" (UniqueName: \"kubernetes.io/projected/4a516c8b-0593-47ed-9e9c-40eea299b87c-kube-api-access-x2bt8\") pod \"network-check-target-7kh6b\" (UID: \"4a516c8b-0593-47ed-9e9c-40eea299b87c\") " pod="openshift-network-diagnostics/network-check-target-7kh6b"
Jul 07 17:09:01.547463 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:01.547437    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\""
Jul 07 17:09:01.558464 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:01.558432    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\""
Jul 07 17:09:01.568088 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:01.568055    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-x2bt8\" (UniqueName: \"kubernetes.io/projected/4a516c8b-0593-47ed-9e9c-40eea299b87c-kube-api-access-x2bt8\") pod \"network-check-target-7kh6b\" (UID: \"4a516c8b-0593-47ed-9e9c-40eea299b87c\") " pod="openshift-network-diagnostics/network-check-target-7kh6b"
Jul 07 17:09:01.594334 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:01.594302    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-mhc8x"]
Jul 07 17:09:01.598647 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:09:01.598617    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc1a36a2e_2dad_43d1_b604_e538cc26c66d.slice/crio-0ba669da418e237c7f3fb01bc79ec4678916705947dbf6436172c23cea73c959 WatchSource:0}: Error finding container 0ba669da418e237c7f3fb01bc79ec4678916705947dbf6436172c23cea73c959: Status 404 returned error can't find the container with id 0ba669da418e237c7f3fb01bc79ec4678916705947dbf6436172c23cea73c959
Jul 07 17:09:01.761458 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:01.761430    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jk68m\""
Jul 07 17:09:01.769545 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:01.769485    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-7kh6b"
Jul 07 17:09:01.895353 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:01.895320    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-7kh6b"]
Jul 07 17:09:01.898746 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:09:01.898719    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a516c8b_0593_47ed_9e9c_40eea299b87c.slice/crio-f2da172fc63734276ea86708df0ecbedfc15995a87603169b7afb0f7153373b6 WatchSource:0}: Error finding container f2da172fc63734276ea86708df0ecbedfc15995a87603169b7afb0f7153373b6: Status 404 returned error can't find the container with id f2da172fc63734276ea86708df0ecbedfc15995a87603169b7afb0f7153373b6
Jul 07 17:09:02.072277 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:02.072195    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:02.257731 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:02.257685    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7kh6b" event={"ID":"4a516c8b-0593-47ed-9e9c-40eea299b87c","Type":"ContainerStarted","Data":"f2da172fc63734276ea86708df0ecbedfc15995a87603169b7afb0f7153373b6"}
Jul 07 17:09:02.259073 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:02.259028    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mhc8x" event={"ID":"c1a36a2e-2dad-43d1-b604-e538cc26c66d","Type":"ContainerStarted","Data":"0ba669da418e237c7f3fb01bc79ec4678916705947dbf6436172c23cea73c959"}
Jul 07 17:09:02.289762 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:02.289733    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:02.453578 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:02.453526    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/19218ca1-9c05-41ac-9c51-978079184615-metrics-tls\") pod \"dns-default-qbfqh\" (UID: \"19218ca1-9c05-41ac-9c51-978079184615\") " pod="openshift-dns/dns-default-qbfqh"
Jul 07 17:09:02.456566 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:02.456522    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/19218ca1-9c05-41ac-9c51-978079184615-metrics-tls\") pod \"dns-default-qbfqh\" (UID: \"19218ca1-9c05-41ac-9c51-978079184615\") " pod="openshift-dns/dns-default-qbfqh"
Jul 07 17:09:02.492658 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:02.492574    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:02.641831 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:02.641795    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:02.720704 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:02.720533    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-9r2xr\""
Jul 07 17:09:02.728261 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:02.728227    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-qbfqh"
Jul 07 17:09:02.842390 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:02.842354    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:02.895092 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:02.895061    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-qbfqh"]
Jul 07 17:09:02.898557 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:09:02.898525    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19218ca1_9c05_41ac_9c51_978079184615.slice/crio-41b05babaf61ad37fc429c33c5b43f1ffa5cfbd8c6e2123a20c64e938a6f9073 WatchSource:0}: Error finding container 41b05babaf61ad37fc429c33c5b43f1ffa5cfbd8c6e2123a20c64e938a6f9073: Status 404 returned error can't find the container with id 41b05babaf61ad37fc429c33c5b43f1ffa5cfbd8c6e2123a20c64e938a6f9073
Jul 07 17:09:03.038998 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:03.038917    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:03.158586 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:03.158545    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/278dfd1c-402a-4f6f-8772-694c8c9e22b0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-h6qjb\" (UID: \"278dfd1c-402a-4f6f-8772-694c8c9e22b0\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-h6qjb"
Jul 07 17:09:03.158775 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:09:03.158695    2562 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found
Jul 07 17:09:03.158834 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:09:03.158779    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/278dfd1c-402a-4f6f-8772-694c8c9e22b0-cluster-monitoring-operator-tls podName:278dfd1c-402a-4f6f-8772-694c8c9e22b0 nodeName:}" failed. No retries permitted until 2026-07-07 17:09:19.158756813 +0000 UTC m=+83.882009991 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/278dfd1c-402a-4f6f-8772-694c8c9e22b0-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-64786d9cbb-h6qjb" (UID: "278dfd1c-402a-4f6f-8772-694c8c9e22b0") : secret "cluster-monitoring-operator-tls" not found
Jul 07 17:09:03.259213 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:03.259176    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd7890b5-693f-4e12-a5e6-feb4ab62a25b-metrics-certs\") pod \"router-default-675c858bdf-2tgn6\" (UID: \"dd7890b5-693f-4e12-a5e6-feb4ab62a25b\") " pod="openshift-ingress/router-default-675c858bdf-2tgn6"
Jul 07 17:09:03.259645 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:03.259217    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd7890b5-693f-4e12-a5e6-feb4ab62a25b-service-ca-bundle\") pod \"router-default-675c858bdf-2tgn6\" (UID: \"dd7890b5-693f-4e12-a5e6-feb4ab62a25b\") " pod="openshift-ingress/router-default-675c858bdf-2tgn6"
Jul 07 17:09:03.259645 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:09:03.259370    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/dd7890b5-693f-4e12-a5e6-feb4ab62a25b-service-ca-bundle podName:dd7890b5-693f-4e12-a5e6-feb4ab62a25b nodeName:}" failed. No retries permitted until 2026-07-07 17:09:19.259350375 +0000 UTC m=+83.982603553 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/dd7890b5-693f-4e12-a5e6-feb4ab62a25b-service-ca-bundle") pod "router-default-675c858bdf-2tgn6" (UID: "dd7890b5-693f-4e12-a5e6-feb4ab62a25b") : configmap references non-existent config key: service-ca.crt
Jul 07 17:09:03.265203 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:03.262323    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/dd7890b5-693f-4e12-a5e6-feb4ab62a25b-metrics-certs\") pod \"router-default-675c858bdf-2tgn6\" (UID: \"dd7890b5-693f-4e12-a5e6-feb4ab62a25b\") " pod="openshift-ingress/router-default-675c858bdf-2tgn6"
Jul 07 17:09:03.266390 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:03.266346    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qbfqh" event={"ID":"19218ca1-9c05-41ac-9c51-978079184615","Type":"ContainerStarted","Data":"41b05babaf61ad37fc429c33c5b43f1ffa5cfbd8c6e2123a20c64e938a6f9073"}
Jul 07 17:09:03.743578 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:03.743458    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:03.872445 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:03.872267    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:04.220746 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:04.220703    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:04.632330 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:04.632286    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:04.831000 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:04.830959    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:04.938123 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:04.937990    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:05.035608 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:05.035573    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:05.834355 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:05.834319    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:06.037169 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:06.037118    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:06.293872 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:06.293840    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:07.228213 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:07.228174    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:07.396306 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:07.395984    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/00e0f04d-964b-4a21-82cc-5dfd8ad76e8f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zpj9n\" (UID: \"00e0f04d-964b-4a21-82cc-5dfd8ad76e8f\") " pod="openshift-insights/insights-runtime-extractor-zpj9n"
Jul 07 17:09:07.396306 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:07.396064    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/00e0f04d-964b-4a21-82cc-5dfd8ad76e8f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zpj9n\" (UID: \"00e0f04d-964b-4a21-82cc-5dfd8ad76e8f\") " pod="openshift-insights/insights-runtime-extractor-zpj9n"
Jul 07 17:09:07.396666 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:07.396602    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/00e0f04d-964b-4a21-82cc-5dfd8ad76e8f-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-zpj9n\" (UID: \"00e0f04d-964b-4a21-82cc-5dfd8ad76e8f\") " pod="openshift-insights/insights-runtime-extractor-zpj9n"
Jul 07 17:09:07.399181 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:07.399141    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/00e0f04d-964b-4a21-82cc-5dfd8ad76e8f-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-zpj9n\" (UID: \"00e0f04d-964b-4a21-82cc-5dfd8ad76e8f\") " pod="openshift-insights/insights-runtime-extractor-zpj9n"
Jul 07 17:09:07.492210 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:07.492186    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-kb2xx\""
Jul 07 17:09:07.500950 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:07.500915    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-zpj9n"
Jul 07 17:09:07.628329 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:07.628229    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:07.660799 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:07.660592    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-zpj9n"]
Jul 07 17:09:07.663192 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:09:07.663150    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod00e0f04d_964b_4a21_82cc_5dfd8ad76e8f.slice/crio-1dc910d422361bf5fc88685896dd83317397a69d1d3505a071b7edf843ba5ba1 WatchSource:0}: Error finding container 1dc910d422361bf5fc88685896dd83317397a69d1d3505a071b7edf843ba5ba1: Status 404 returned error can't find the container with id 1dc910d422361bf5fc88685896dd83317397a69d1d3505a071b7edf843ba5ba1
Jul 07 17:09:07.752851 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:07.752771    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:07.853598 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:07.853560    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:08.012733 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:08.012637    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:08.222386 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:08.222350    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:08.286405 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:08.286317    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-7kh6b" event={"ID":"4a516c8b-0593-47ed-9e9c-40eea299b87c","Type":"ContainerStarted","Data":"d75d1f3335c6bec2145ece21e1f4d9ee62953c0db67a7070dea1671051975209"}
Jul 07 17:09:08.286850 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:08.286807    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-7kh6b"
Jul 07 17:09:08.289863 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:08.289828    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-mhc8x" event={"ID":"c1a36a2e-2dad-43d1-b604-e538cc26c66d","Type":"ContainerStarted","Data":"ab83463d5090858c872f7cabd1c54d3209abf9140f090afea697374e94308a9f"}
Jul 07 17:09:08.293054 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:08.293021    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qbfqh" event={"ID":"19218ca1-9c05-41ac-9c51-978079184615","Type":"ContainerStarted","Data":"3b238e31e0984e064b82b8570edca12de426f7ea59b9a596fcf4d4be7f90cfe7"}
Jul 07 17:09:08.293226 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:08.293082    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-qbfqh" event={"ID":"19218ca1-9c05-41ac-9c51-978079184615","Type":"ContainerStarted","Data":"bdd2bccb28a937620c32e1f53d5be812bb4f853503ef11688b4e76b41f819703"}
Jul 07 17:09:08.293226 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:08.293114    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-qbfqh"
Jul 07 17:09:08.294736 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:08.294711    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zpj9n" event={"ID":"00e0f04d-964b-4a21-82cc-5dfd8ad76e8f","Type":"ContainerStarted","Data":"1dc910d422361bf5fc88685896dd83317397a69d1d3505a071b7edf843ba5ba1"}
Jul 07 17:09:08.305316 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:08.304973    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-7kh6b" podStartSLOduration=66.830091711 podStartE2EDuration="1m12.304952925s" totalImagesPullingTime="5.474861214s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:07:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:09:08.303223795 +0000 UTC m=+73.026476998" watchObservedRunningTime="2026-07-07 17:09:08.304952925 +0000 UTC m=+73.028206118"
Jul 07 17:09:08.327326 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:08.327261    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-qbfqh" podStartSLOduration=33.855351683 podStartE2EDuration="38.327235136s" totalImagesPullingTime="4.471883453s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:08:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:09:08.325952783 +0000 UTC m=+73.049205984" watchObservedRunningTime="2026-07-07 17:09:08.327235136 +0000 UTC m=+73.050488334"
Jul 07 17:09:08.344213 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:08.344126    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-mhc8x" podStartSLOduration=66.576329198 podStartE2EDuration="1m12.344103244s" totalImagesPullingTime="5.767774046s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:07:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:09:08.342946634 +0000 UTC m=+73.066199832" watchObservedRunningTime="2026-07-07 17:09:08.344103244 +0000 UTC m=+73.067356445"
Jul 07 17:09:11.547545 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:11.547486    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:11.633520 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:11.633492    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:12.312430 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:12.312392    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zpj9n" event={"ID":"00e0f04d-964b-4a21-82cc-5dfd8ad76e8f","Type":"ContainerStarted","Data":"b1ba40cd54888482012f6ec2e1148950bd668057e19dd609e26fe1728d15a805"}
Jul 07 17:09:12.312600 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:12.312454    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zpj9n" event={"ID":"00e0f04d-964b-4a21-82cc-5dfd8ad76e8f","Type":"ContainerStarted","Data":"1c3780356c48b66130d694a98f5fbcd001efa9dd8f9bb2a25ddeaba969e0814f"}
Jul 07 17:09:15.324483 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:15.324383    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-zpj9n" event={"ID":"00e0f04d-964b-4a21-82cc-5dfd8ad76e8f","Type":"ContainerStarted","Data":"a995079db71c1261467de27c1444e98a05df3b3b027ef0ac917e9cfa90723aa3"}
Jul 07 17:09:15.346294 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:15.346239    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-zpj9n" podStartSLOduration=17.059805379 podStartE2EDuration="24.346222546s" totalImagesPullingTime="7.286417167s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:08:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:09:15.344790432 +0000 UTC m=+80.068043629" watchObservedRunningTime="2026-07-07 17:09:15.346222546 +0000 UTC m=+80.069475743"
Jul 07 17:09:18.300734 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:18.300605    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-qbfqh"
Jul 07 17:09:19.192545 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:19.192511    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/278dfd1c-402a-4f6f-8772-694c8c9e22b0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-h6qjb\" (UID: \"278dfd1c-402a-4f6f-8772-694c8c9e22b0\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-h6qjb"
Jul 07 17:09:19.194866 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:19.194842    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/278dfd1c-402a-4f6f-8772-694c8c9e22b0-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-64786d9cbb-h6qjb\" (UID: \"278dfd1c-402a-4f6f-8772-694c8c9e22b0\") " pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-h6qjb"
Jul 07 17:09:19.293767 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:19.293717    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd7890b5-693f-4e12-a5e6-feb4ab62a25b-service-ca-bundle\") pod \"router-default-675c858bdf-2tgn6\" (UID: \"dd7890b5-693f-4e12-a5e6-feb4ab62a25b\") " pod="openshift-ingress/router-default-675c858bdf-2tgn6"
Jul 07 17:09:19.294386 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:19.294365    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/dd7890b5-693f-4e12-a5e6-feb4ab62a25b-service-ca-bundle\") pod \"router-default-675c858bdf-2tgn6\" (UID: \"dd7890b5-693f-4e12-a5e6-feb4ab62a25b\") " pod="openshift-ingress/router-default-675c858bdf-2tgn6"
Jul 07 17:09:19.374743 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:19.374711    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-6vhlq\""
Jul 07 17:09:19.382780 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:19.382754    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-h6qjb"
Jul 07 17:09:19.490122 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:19.490095    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-lx9xb\""
Jul 07 17:09:19.498274 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:19.498241    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-675c858bdf-2tgn6"
Jul 07 17:09:19.513407 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:19.513366    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-64786d9cbb-h6qjb"]
Jul 07 17:09:19.516451 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:09:19.516419    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod278dfd1c_402a_4f6f_8772_694c8c9e22b0.slice/crio-3846b5d4762f5e06b19eba90cc0afde1e4883fc8646c97a3e760d432e1c5bc9b WatchSource:0}: Error finding container 3846b5d4762f5e06b19eba90cc0afde1e4883fc8646c97a3e760d432e1c5bc9b: Status 404 returned error can't find the container with id 3846b5d4762f5e06b19eba90cc0afde1e4883fc8646c97a3e760d432e1c5bc9b
Jul 07 17:09:19.634041 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:19.634004    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-675c858bdf-2tgn6"]
Jul 07 17:09:19.636750 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:09:19.636722    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd7890b5_693f_4e12_a5e6_feb4ab62a25b.slice/crio-9c6c24e2d247a1a6f5360e3a59d60712a4988e52532d2bb6db6ce5ee311fc3fa WatchSource:0}: Error finding container 9c6c24e2d247a1a6f5360e3a59d60712a4988e52532d2bb6db6ce5ee311fc3fa: Status 404 returned error can't find the container with id 9c6c24e2d247a1a6f5360e3a59d60712a4988e52532d2bb6db6ce5ee311fc3fa
Jul 07 17:09:20.342296 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:20.342257    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-675c858bdf-2tgn6" event={"ID":"dd7890b5-693f-4e12-a5e6-feb4ab62a25b","Type":"ContainerStarted","Data":"4796dd8e3ca9c8d32299657c12ee92dd2cb30087d641c887be395f55db2dbbbe"}
Jul 07 17:09:20.342499 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:20.342314    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-675c858bdf-2tgn6" event={"ID":"dd7890b5-693f-4e12-a5e6-feb4ab62a25b","Type":"ContainerStarted","Data":"9c6c24e2d247a1a6f5360e3a59d60712a4988e52532d2bb6db6ce5ee311fc3fa"}
Jul 07 17:09:20.343617 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:20.343585    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-h6qjb" event={"ID":"278dfd1c-402a-4f6f-8772-694c8c9e22b0","Type":"ContainerStarted","Data":"3846b5d4762f5e06b19eba90cc0afde1e4883fc8646c97a3e760d432e1c5bc9b"}
Jul 07 17:09:20.362787 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:20.362730    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-675c858bdf-2tgn6" podStartSLOduration=33.362713681 podStartE2EDuration="33.362713681s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:08:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:09:20.361629688 +0000 UTC m=+85.084882887" watchObservedRunningTime="2026-07-07 17:09:20.362713681 +0000 UTC m=+85.085966878"
Jul 07 17:09:20.498493 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:20.498453    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-675c858bdf-2tgn6"
Jul 07 17:09:20.501142 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:20.501118    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-675c858bdf-2tgn6"
Jul 07 17:09:20.889053 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:20.889016    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77cdfdb5c9-pmcm8"]
Jul 07 17:09:20.891104 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:20.891076    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77cdfdb5c9-pmcm8"
Jul 07 17:09:20.901605 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:20.901577    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-ca\""
Jul 07 17:09:20.901605 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:20.901597    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"open-cluster-management-image-pull-credentials\""
Jul 07 17:09:20.901802 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:20.901580    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-open-cluster-management.io-proxy-agent-signer-client-cert\""
Jul 07 17:09:20.901802 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:20.901699    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-hub-kubeconfig\""
Jul 07 17:09:20.903235 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:20.903214    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"kube-root-ca.crt\""
Jul 07 17:09:20.903235 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:20.903216    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"open-cluster-management-agent-addon\"/\"cluster-proxy-service-proxy-server-certificates\""
Jul 07 17:09:20.903491 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:20.903474    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"open-cluster-management-agent-addon\"/\"openshift-service-ca.crt\""
Jul 07 17:09:20.912196 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:20.912145    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77cdfdb5c9-pmcm8"]
Jul 07 17:09:20.939535 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:20.939481    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:21.008908 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:21.008874    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q7297\" (UniqueName: \"kubernetes.io/projected/10a1886f-cea1-4129-a8e7-737a8a316ec7-kube-api-access-q7297\") pod \"cluster-proxy-proxy-agent-77cdfdb5c9-pmcm8\" (UID: \"10a1886f-cea1-4129-a8e7-737a8a316ec7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77cdfdb5c9-pmcm8"
Jul 07 17:09:21.009072 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:21.008917    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/10a1886f-cea1-4129-a8e7-737a8a316ec7-ca\") pod \"cluster-proxy-proxy-agent-77cdfdb5c9-pmcm8\" (UID: \"10a1886f-cea1-4129-a8e7-737a8a316ec7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77cdfdb5c9-pmcm8"
Jul 07 17:09:21.009072 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:21.008938    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/10a1886f-cea1-4129-a8e7-737a8a316ec7-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-77cdfdb5c9-pmcm8\" (UID: \"10a1886f-cea1-4129-a8e7-737a8a316ec7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77cdfdb5c9-pmcm8"
Jul 07 17:09:21.009072 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:21.008983    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/10a1886f-cea1-4129-a8e7-737a8a316ec7-additional-service-ca\") pod \"cluster-proxy-proxy-agent-77cdfdb5c9-pmcm8\" (UID: \"10a1886f-cea1-4129-a8e7-737a8a316ec7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77cdfdb5c9-pmcm8"
Jul 07 17:09:21.009072 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:21.009008    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/10a1886f-cea1-4129-a8e7-737a8a316ec7-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-77cdfdb5c9-pmcm8\" (UID: \"10a1886f-cea1-4129-a8e7-737a8a316ec7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77cdfdb5c9-pmcm8"
Jul 07 17:09:21.009072 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:21.009060    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/10a1886f-cea1-4129-a8e7-737a8a316ec7-hub\") pod \"cluster-proxy-proxy-agent-77cdfdb5c9-pmcm8\" (UID: \"10a1886f-cea1-4129-a8e7-737a8a316ec7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77cdfdb5c9-pmcm8"
Jul 07 17:09:21.066576 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:21.066542    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:21.109959 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:21.109923    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca\" (UniqueName: \"kubernetes.io/secret/10a1886f-cea1-4129-a8e7-737a8a316ec7-ca\") pod \"cluster-proxy-proxy-agent-77cdfdb5c9-pmcm8\" (UID: \"10a1886f-cea1-4129-a8e7-737a8a316ec7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77cdfdb5c9-pmcm8"
Jul 07 17:09:21.109959 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:21.109962    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/10a1886f-cea1-4129-a8e7-737a8a316ec7-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-77cdfdb5c9-pmcm8\" (UID: \"10a1886f-cea1-4129-a8e7-737a8a316ec7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77cdfdb5c9-pmcm8"
Jul 07 17:09:21.110224 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:21.109979    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/10a1886f-cea1-4129-a8e7-737a8a316ec7-additional-service-ca\") pod \"cluster-proxy-proxy-agent-77cdfdb5c9-pmcm8\" (UID: \"10a1886f-cea1-4129-a8e7-737a8a316ec7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77cdfdb5c9-pmcm8"
Jul 07 17:09:21.110224 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:21.109997    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/10a1886f-cea1-4129-a8e7-737a8a316ec7-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-77cdfdb5c9-pmcm8\" (UID: \"10a1886f-cea1-4129-a8e7-737a8a316ec7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77cdfdb5c9-pmcm8"
Jul 07 17:09:21.110224 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:21.110067    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hub\" (UniqueName: \"kubernetes.io/secret/10a1886f-cea1-4129-a8e7-737a8a316ec7-hub\") pod \"cluster-proxy-proxy-agent-77cdfdb5c9-pmcm8\" (UID: \"10a1886f-cea1-4129-a8e7-737a8a316ec7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77cdfdb5c9-pmcm8"
Jul 07 17:09:21.110224 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:21.110189    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q7297\" (UniqueName: \"kubernetes.io/projected/10a1886f-cea1-4129-a8e7-737a8a316ec7-kube-api-access-q7297\") pod \"cluster-proxy-proxy-agent-77cdfdb5c9-pmcm8\" (UID: \"10a1886f-cea1-4129-a8e7-737a8a316ec7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77cdfdb5c9-pmcm8"
Jul 07 17:09:21.111299 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:21.111271    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"additional-service-ca\" (UniqueName: \"kubernetes.io/configmap/10a1886f-cea1-4129-a8e7-737a8a316ec7-additional-service-ca\") pod \"cluster-proxy-proxy-agent-77cdfdb5c9-pmcm8\" (UID: \"10a1886f-cea1-4129-a8e7-737a8a316ec7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77cdfdb5c9-pmcm8"
Jul 07 17:09:21.112957 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:21.112916    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca\" (UniqueName: \"kubernetes.io/secret/10a1886f-cea1-4129-a8e7-737a8a316ec7-ca\") pod \"cluster-proxy-proxy-agent-77cdfdb5c9-pmcm8\" (UID: \"10a1886f-cea1-4129-a8e7-737a8a316ec7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77cdfdb5c9-pmcm8"
Jul 07 17:09:21.113090 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:21.112980    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub\" (UniqueName: \"kubernetes.io/secret/10a1886f-cea1-4129-a8e7-737a8a316ec7-hub\") pod \"cluster-proxy-proxy-agent-77cdfdb5c9-pmcm8\" (UID: \"10a1886f-cea1-4129-a8e7-737a8a316ec7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77cdfdb5c9-pmcm8"
Jul 07 17:09:21.113090 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:21.113040    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-proxy-server-cert\" (UniqueName: \"kubernetes.io/secret/10a1886f-cea1-4129-a8e7-737a8a316ec7-service-proxy-server-cert\") pod \"cluster-proxy-proxy-agent-77cdfdb5c9-pmcm8\" (UID: \"10a1886f-cea1-4129-a8e7-737a8a316ec7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77cdfdb5c9-pmcm8"
Jul 07 17:09:21.113236 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:21.113194    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hub-kubeconfig\" (UniqueName: \"kubernetes.io/secret/10a1886f-cea1-4129-a8e7-737a8a316ec7-hub-kubeconfig\") pod \"cluster-proxy-proxy-agent-77cdfdb5c9-pmcm8\" (UID: \"10a1886f-cea1-4129-a8e7-737a8a316ec7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77cdfdb5c9-pmcm8"
Jul 07 17:09:21.130909 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:21.130878    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-q7297\" (UniqueName: \"kubernetes.io/projected/10a1886f-cea1-4129-a8e7-737a8a316ec7-kube-api-access-q7297\") pod \"cluster-proxy-proxy-agent-77cdfdb5c9-pmcm8\" (UID: \"10a1886f-cea1-4129-a8e7-737a8a316ec7\") " pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77cdfdb5c9-pmcm8"
Jul 07 17:09:21.180624 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:21.180524    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:21.214598 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:21.214559    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77cdfdb5c9-pmcm8"
Jul 07 17:09:21.347547 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:21.347514    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-675c858bdf-2tgn6"
Jul 07 17:09:21.348882 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:21.348858    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-675c858bdf-2tgn6"
Jul 07 17:09:21.642474 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:21.642445    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77cdfdb5c9-pmcm8"]
Jul 07 17:09:21.645595 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:09:21.645559    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod10a1886f_cea1_4129_a8e7_737a8a316ec7.slice/crio-41d321cd0260b675f8a886c599f6e1f536bc18823e4d1fa71e26442d68b8797b WatchSource:0}: Error finding container 41d321cd0260b675f8a886c599f6e1f536bc18823e4d1fa71e26442d68b8797b: Status 404 returned error can't find the container with id 41d321cd0260b675f8a886c599f6e1f536bc18823e4d1fa71e26442d68b8797b
Jul 07 17:09:21.914968 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:21.914934    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:22.012404 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:22.012369    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:22.095204 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:22.095148    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:22.154554 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:22.154522    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:22.351954 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:22.351856    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-h6qjb" event={"ID":"278dfd1c-402a-4f6f-8772-694c8c9e22b0","Type":"ContainerStarted","Data":"28836b0f89158addc57ca7de7f933cca53e27545a2bdc288a6248ddd29aee6b6"}
Jul 07 17:09:22.352970 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:22.352947    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77cdfdb5c9-pmcm8" event={"ID":"10a1886f-cea1-4129-a8e7-737a8a316ec7","Type":"ContainerStarted","Data":"41d321cd0260b675f8a886c599f6e1f536bc18823e4d1fa71e26442d68b8797b"}
Jul 07 17:09:22.371196 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:22.371128    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-64786d9cbb-h6qjb" podStartSLOduration=33.322539096 podStartE2EDuration="35.371106992s" totalImagesPullingTime="2.048567896s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:08:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:09:22.369640575 +0000 UTC m=+87.092893795" watchObservedRunningTime="2026-07-07 17:09:22.371106992 +0000 UTC m=+87.094360189"
Jul 07 17:09:23.543283 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:23.543248    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:23.632969 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:23.632878    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:27.123733 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:27.123696    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:27.204278 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:27.204234    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:27.317077 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:27.317041    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:29.410747 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:29.410709    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:29.513968 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:29.513931    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:29.615312 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:29.615279    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:29.879760 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:29.879732    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:29.980054 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:29.980021    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:30.916456 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:30.916424    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:31.017977 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:31.017947    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:31.200929 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:31.200840    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:31.302280 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:31.302241    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:31.405142 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:31.405111    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:31.533530 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:31.533445    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:31.582248 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:31.582215    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-mcln4"]
Jul 07 17:09:31.586574 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:31.586551    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mcln4"
Jul 07 17:09:31.588883 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:31.588859    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-vvz5v\""
Jul 07 17:09:31.589011 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:31.588879    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\""
Jul 07 17:09:31.589093 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:31.589079    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\""
Jul 07 17:09:31.589912 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:31.589900    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\""
Jul 07 17:09:31.589976 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:31.589910    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\""
Jul 07 17:09:31.637886 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:31.637844    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:31.689744 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:31.689707    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0f99cba8-fd36-4a97-8177-7212383855fe-node-exporter-tls\") pod \"node-exporter-mcln4\" (UID: \"0f99cba8-fd36-4a97-8177-7212383855fe\") " pod="openshift-monitoring/node-exporter-mcln4"
Jul 07 17:09:31.689744 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:31.689747    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0f99cba8-fd36-4a97-8177-7212383855fe-node-exporter-accelerators-collector-config\") pod \"node-exporter-mcln4\" (UID: \"0f99cba8-fd36-4a97-8177-7212383855fe\") " pod="openshift-monitoring/node-exporter-mcln4"
Jul 07 17:09:31.689938 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:31.689825    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0f99cba8-fd36-4a97-8177-7212383855fe-node-exporter-wtmp\") pod \"node-exporter-mcln4\" (UID: \"0f99cba8-fd36-4a97-8177-7212383855fe\") " pod="openshift-monitoring/node-exporter-mcln4"
Jul 07 17:09:31.689938 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:31.689854    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0f99cba8-fd36-4a97-8177-7212383855fe-metrics-client-ca\") pod \"node-exporter-mcln4\" (UID: \"0f99cba8-fd36-4a97-8177-7212383855fe\") " pod="openshift-monitoring/node-exporter-mcln4"
Jul 07 17:09:31.689938 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:31.689888    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0f99cba8-fd36-4a97-8177-7212383855fe-sys\") pod \"node-exporter-mcln4\" (UID: \"0f99cba8-fd36-4a97-8177-7212383855fe\") " pod="openshift-monitoring/node-exporter-mcln4"
Jul 07 17:09:31.690071 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:31.689956    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0f99cba8-fd36-4a97-8177-7212383855fe-node-exporter-textfile\") pod \"node-exporter-mcln4\" (UID: \"0f99cba8-fd36-4a97-8177-7212383855fe\") " pod="openshift-monitoring/node-exporter-mcln4"
Jul 07 17:09:31.690071 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:31.689975    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pdbf6\" (UniqueName: \"kubernetes.io/projected/0f99cba8-fd36-4a97-8177-7212383855fe-kube-api-access-pdbf6\") pod \"node-exporter-mcln4\" (UID: \"0f99cba8-fd36-4a97-8177-7212383855fe\") " pod="openshift-monitoring/node-exporter-mcln4"
Jul 07 17:09:31.690071 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:31.690001    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0f99cba8-fd36-4a97-8177-7212383855fe-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mcln4\" (UID: \"0f99cba8-fd36-4a97-8177-7212383855fe\") " pod="openshift-monitoring/node-exporter-mcln4"
Jul 07 17:09:31.690071 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:31.690021    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0f99cba8-fd36-4a97-8177-7212383855fe-root\") pod \"node-exporter-mcln4\" (UID: \"0f99cba8-fd36-4a97-8177-7212383855fe\") " pod="openshift-monitoring/node-exporter-mcln4"
Jul 07 17:09:31.732994 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:31.732961    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:31.791196 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:31.791090    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0f99cba8-fd36-4a97-8177-7212383855fe-node-exporter-wtmp\") pod \"node-exporter-mcln4\" (UID: \"0f99cba8-fd36-4a97-8177-7212383855fe\") " pod="openshift-monitoring/node-exporter-mcln4"
Jul 07 17:09:31.791196 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:31.791141    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0f99cba8-fd36-4a97-8177-7212383855fe-metrics-client-ca\") pod \"node-exporter-mcln4\" (UID: \"0f99cba8-fd36-4a97-8177-7212383855fe\") " pod="openshift-monitoring/node-exporter-mcln4"
Jul 07 17:09:31.791417 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:31.791206    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0f99cba8-fd36-4a97-8177-7212383855fe-sys\") pod \"node-exporter-mcln4\" (UID: \"0f99cba8-fd36-4a97-8177-7212383855fe\") " pod="openshift-monitoring/node-exporter-mcln4"
Jul 07 17:09:31.791417 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:31.791264    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0f99cba8-fd36-4a97-8177-7212383855fe-node-exporter-textfile\") pod \"node-exporter-mcln4\" (UID: \"0f99cba8-fd36-4a97-8177-7212383855fe\") " pod="openshift-monitoring/node-exporter-mcln4"
Jul 07 17:09:31.791417 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:31.791292    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pdbf6\" (UniqueName: \"kubernetes.io/projected/0f99cba8-fd36-4a97-8177-7212383855fe-kube-api-access-pdbf6\") pod \"node-exporter-mcln4\" (UID: \"0f99cba8-fd36-4a97-8177-7212383855fe\") " pod="openshift-monitoring/node-exporter-mcln4"
Jul 07 17:09:31.791417 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:31.791304    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/0f99cba8-fd36-4a97-8177-7212383855fe-node-exporter-wtmp\") pod \"node-exporter-mcln4\" (UID: \"0f99cba8-fd36-4a97-8177-7212383855fe\") " pod="openshift-monitoring/node-exporter-mcln4"
Jul 07 17:09:31.791417 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:31.791330    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/0f99cba8-fd36-4a97-8177-7212383855fe-sys\") pod \"node-exporter-mcln4\" (UID: \"0f99cba8-fd36-4a97-8177-7212383855fe\") " pod="openshift-monitoring/node-exporter-mcln4"
Jul 07 17:09:31.791417 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:31.791418    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0f99cba8-fd36-4a97-8177-7212383855fe-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mcln4\" (UID: \"0f99cba8-fd36-4a97-8177-7212383855fe\") " pod="openshift-monitoring/node-exporter-mcln4"
Jul 07 17:09:31.791699 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:31.791451    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0f99cba8-fd36-4a97-8177-7212383855fe-root\") pod \"node-exporter-mcln4\" (UID: \"0f99cba8-fd36-4a97-8177-7212383855fe\") " pod="openshift-monitoring/node-exporter-mcln4"
Jul 07 17:09:31.791699 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:31.791472    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0f99cba8-fd36-4a97-8177-7212383855fe-node-exporter-tls\") pod \"node-exporter-mcln4\" (UID: \"0f99cba8-fd36-4a97-8177-7212383855fe\") " pod="openshift-monitoring/node-exporter-mcln4"
Jul 07 17:09:31.791699 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:31.791495    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0f99cba8-fd36-4a97-8177-7212383855fe-node-exporter-accelerators-collector-config\") pod \"node-exporter-mcln4\" (UID: \"0f99cba8-fd36-4a97-8177-7212383855fe\") " pod="openshift-monitoring/node-exporter-mcln4"
Jul 07 17:09:31.791699 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:31.791521    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/0f99cba8-fd36-4a97-8177-7212383855fe-root\") pod \"node-exporter-mcln4\" (UID: \"0f99cba8-fd36-4a97-8177-7212383855fe\") " pod="openshift-monitoring/node-exporter-mcln4"
Jul 07 17:09:31.791699 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:31.791607    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/0f99cba8-fd36-4a97-8177-7212383855fe-node-exporter-textfile\") pod \"node-exporter-mcln4\" (UID: \"0f99cba8-fd36-4a97-8177-7212383855fe\") " pod="openshift-monitoring/node-exporter-mcln4"
Jul 07 17:09:31.791897 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:31.791846    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/0f99cba8-fd36-4a97-8177-7212383855fe-metrics-client-ca\") pod \"node-exporter-mcln4\" (UID: \"0f99cba8-fd36-4a97-8177-7212383855fe\") " pod="openshift-monitoring/node-exporter-mcln4"
Jul 07 17:09:31.792042 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:31.792017    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/0f99cba8-fd36-4a97-8177-7212383855fe-node-exporter-accelerators-collector-config\") pod \"node-exporter-mcln4\" (UID: \"0f99cba8-fd36-4a97-8177-7212383855fe\") " pod="openshift-monitoring/node-exporter-mcln4"
Jul 07 17:09:31.794172 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:31.794137    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/0f99cba8-fd36-4a97-8177-7212383855fe-node-exporter-tls\") pod \"node-exporter-mcln4\" (UID: \"0f99cba8-fd36-4a97-8177-7212383855fe\") " pod="openshift-monitoring/node-exporter-mcln4"
Jul 07 17:09:31.794320 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:31.794302    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/0f99cba8-fd36-4a97-8177-7212383855fe-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-mcln4\" (UID: \"0f99cba8-fd36-4a97-8177-7212383855fe\") " pod="openshift-monitoring/node-exporter-mcln4"
Jul 07 17:09:31.800857 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:31.800834    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pdbf6\" (UniqueName: \"kubernetes.io/projected/0f99cba8-fd36-4a97-8177-7212383855fe-kube-api-access-pdbf6\") pod \"node-exporter-mcln4\" (UID: \"0f99cba8-fd36-4a97-8177-7212383855fe\") " pod="openshift-monitoring/node-exporter-mcln4"
Jul 07 17:09:31.836337 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:31.836298    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:31.895927 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:31.895896    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-mcln4"
Jul 07 17:09:31.907587 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:09:31.907553    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f99cba8_fd36_4a97_8177_7212383855fe.slice/crio-cea79196f481d01281fe262a39bedc613588043211351042deeea5cc7bd2479e WatchSource:0}: Error finding container cea79196f481d01281fe262a39bedc613588043211351042deeea5cc7bd2479e: Status 404 returned error can't find the container with id cea79196f481d01281fe262a39bedc613588043211351042deeea5cc7bd2479e
Jul 07 17:09:31.929425 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:31.929396    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:32.018780 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:32.018742    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:32.109107 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:32.109003    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:32.389142 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:32.389105    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mcln4" event={"ID":"0f99cba8-fd36-4a97-8177-7212383855fe","Type":"ContainerStarted","Data":"cea79196f481d01281fe262a39bedc613588043211351042deeea5cc7bd2479e"}
Jul 07 17:09:32.543534 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:32.543499    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:32.628269 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:32.628234    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:32.715067 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:32.714965    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:32.865001 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:32.864968    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:32.965471 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:32.965391    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:33.068907 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:33.068876    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:33.165335 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:33.165297    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:33.394735 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:33.394707    2562 generic.go:356] "Generic (PLEG): container finished" podID="0f99cba8-fd36-4a97-8177-7212383855fe" containerID="b7f36a3f073b7c79df4fa80054a7c695d404c49833589930db75f897a7dd7494" exitCode=0
Jul 07 17:09:33.394905 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:33.394787    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mcln4" event={"ID":"0f99cba8-fd36-4a97-8177-7212383855fe","Type":"ContainerDied","Data":"b7f36a3f073b7c79df4fa80054a7c695d404c49833589930db75f897a7dd7494"}
Jul 07 17:09:33.801260 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:33.801182    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:33.900586 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:33.900524    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:34.399942 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:34.399905    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mcln4" event={"ID":"0f99cba8-fd36-4a97-8177-7212383855fe","Type":"ContainerStarted","Data":"74191f29daa1f5f20b2ecfd6ee54931594fc808b5d90f974b51e1cc395b5a3c1"}
Jul 07 17:09:34.400339 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:34.399959    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-mcln4" event={"ID":"0f99cba8-fd36-4a97-8177-7212383855fe","Type":"ContainerStarted","Data":"9ff961f8cdd6fbe41887d17196728d3fccc4cfc18d31e7009b07b4ca18aea89a"}
Jul 07 17:09:34.423320 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:34.423269    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-mcln4" podStartSLOduration=2.247199425 podStartE2EDuration="3.423252693s" totalImagesPullingTime="1.108887797s" totalInitContainerRuntime="67.165471ms" isStatefulPod=true podCreationTimestamp="2026-07-07 17:09:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:09:34.422640673 +0000 UTC m=+99.145893870" watchObservedRunningTime="2026-07-07 17:09:34.423252693 +0000 UTC m=+99.146505881"
Jul 07 17:09:34.575302 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:34.575270    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:34.673083 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:34.672969    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:34.751207 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:34.751169    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:34.850501 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:34.850463    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:36.321257 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:36.321221    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:36.411297 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:36.411260    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:36.548877 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:36.548847    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:37.977496 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:37.977463    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:38.517825 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:38.517797    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:38.604574 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:38.604544    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:39.300816 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:39.300787    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-7kh6b"
Jul 07 17:09:40.721533 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:40.721497    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:40.820380 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:40.820346    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:42.688314 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:42.688281    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:42.788951 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:42.788920    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:43.632406 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:43.632378    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:43.699323 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:43.699285    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:43.801229 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:43.801196    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:43.872820 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:43.872778    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:44.144634 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:44.144606    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-765fbf7b6d-ncx7q"]
Jul 07 17:09:44.160011 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:44.159978    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-765fbf7b6d-ncx7q"]
Jul 07 17:09:44.160175 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:44.160084    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-765fbf7b6d-ncx7q"
Jul 07 17:09:44.162522 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:44.162492    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 07 17:09:44.162522 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:44.162514    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 07 17:09:44.163352 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:44.163337    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 07 17:09:44.163352 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:44.163346    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 07 17:09:44.163491 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:44.163384    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-x89tt\""
Jul 07 17:09:44.163749 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:44.163718    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 07 17:09:44.163821 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:44.163762    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 07 17:09:44.163874 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:44.163824    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 07 17:09:44.168361 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:44.168343    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 07 17:09:44.191909 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:44.191875    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1a8790e5-ef6c-4aa7-8012-78da3d2a0a67-console-config\") pod \"console-765fbf7b6d-ncx7q\" (UID: \"1a8790e5-ef6c-4aa7-8012-78da3d2a0a67\") " pod="openshift-console/console-765fbf7b6d-ncx7q"
Jul 07 17:09:44.191909 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:44.191905    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1a8790e5-ef6c-4aa7-8012-78da3d2a0a67-oauth-serving-cert\") pod \"console-765fbf7b6d-ncx7q\" (UID: \"1a8790e5-ef6c-4aa7-8012-78da3d2a0a67\") " pod="openshift-console/console-765fbf7b6d-ncx7q"
Jul 07 17:09:44.192096 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:44.191928    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1a8790e5-ef6c-4aa7-8012-78da3d2a0a67-console-oauth-config\") pod \"console-765fbf7b6d-ncx7q\" (UID: \"1a8790e5-ef6c-4aa7-8012-78da3d2a0a67\") " pod="openshift-console/console-765fbf7b6d-ncx7q"
Jul 07 17:09:44.192096 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:44.191948    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a8790e5-ef6c-4aa7-8012-78da3d2a0a67-trusted-ca-bundle\") pod \"console-765fbf7b6d-ncx7q\" (UID: \"1a8790e5-ef6c-4aa7-8012-78da3d2a0a67\") " pod="openshift-console/console-765fbf7b6d-ncx7q"
Jul 07 17:09:44.192096 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:44.192014    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1a8790e5-ef6c-4aa7-8012-78da3d2a0a67-console-serving-cert\") pod \"console-765fbf7b6d-ncx7q\" (UID: \"1a8790e5-ef6c-4aa7-8012-78da3d2a0a67\") " pod="openshift-console/console-765fbf7b6d-ncx7q"
Jul 07 17:09:44.192096 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:44.192032    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1a8790e5-ef6c-4aa7-8012-78da3d2a0a67-service-ca\") pod \"console-765fbf7b6d-ncx7q\" (UID: \"1a8790e5-ef6c-4aa7-8012-78da3d2a0a67\") " pod="openshift-console/console-765fbf7b6d-ncx7q"
Jul 07 17:09:44.192096 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:44.192062    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27x8x\" (UniqueName: \"kubernetes.io/projected/1a8790e5-ef6c-4aa7-8012-78da3d2a0a67-kube-api-access-27x8x\") pod \"console-765fbf7b6d-ncx7q\" (UID: \"1a8790e5-ef6c-4aa7-8012-78da3d2a0a67\") " pod="openshift-console/console-765fbf7b6d-ncx7q"
Jul 07 17:09:44.292418 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:44.292377    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1a8790e5-ef6c-4aa7-8012-78da3d2a0a67-console-config\") pod \"console-765fbf7b6d-ncx7q\" (UID: \"1a8790e5-ef6c-4aa7-8012-78da3d2a0a67\") " pod="openshift-console/console-765fbf7b6d-ncx7q"
Jul 07 17:09:44.292418 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:44.292413    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1a8790e5-ef6c-4aa7-8012-78da3d2a0a67-oauth-serving-cert\") pod \"console-765fbf7b6d-ncx7q\" (UID: \"1a8790e5-ef6c-4aa7-8012-78da3d2a0a67\") " pod="openshift-console/console-765fbf7b6d-ncx7q"
Jul 07 17:09:44.292683 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:44.292437    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1a8790e5-ef6c-4aa7-8012-78da3d2a0a67-console-oauth-config\") pod \"console-765fbf7b6d-ncx7q\" (UID: \"1a8790e5-ef6c-4aa7-8012-78da3d2a0a67\") " pod="openshift-console/console-765fbf7b6d-ncx7q"
Jul 07 17:09:44.292683 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:44.292453    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a8790e5-ef6c-4aa7-8012-78da3d2a0a67-trusted-ca-bundle\") pod \"console-765fbf7b6d-ncx7q\" (UID: \"1a8790e5-ef6c-4aa7-8012-78da3d2a0a67\") " pod="openshift-console/console-765fbf7b6d-ncx7q"
Jul 07 17:09:44.292683 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:44.292476    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1a8790e5-ef6c-4aa7-8012-78da3d2a0a67-console-serving-cert\") pod \"console-765fbf7b6d-ncx7q\" (UID: \"1a8790e5-ef6c-4aa7-8012-78da3d2a0a67\") " pod="openshift-console/console-765fbf7b6d-ncx7q"
Jul 07 17:09:44.292683 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:44.292489    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1a8790e5-ef6c-4aa7-8012-78da3d2a0a67-service-ca\") pod \"console-765fbf7b6d-ncx7q\" (UID: \"1a8790e5-ef6c-4aa7-8012-78da3d2a0a67\") " pod="openshift-console/console-765fbf7b6d-ncx7q"
Jul 07 17:09:44.292683 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:44.292521    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27x8x\" (UniqueName: \"kubernetes.io/projected/1a8790e5-ef6c-4aa7-8012-78da3d2a0a67-kube-api-access-27x8x\") pod \"console-765fbf7b6d-ncx7q\" (UID: \"1a8790e5-ef6c-4aa7-8012-78da3d2a0a67\") " pod="openshift-console/console-765fbf7b6d-ncx7q"
Jul 07 17:09:44.293216 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:44.293186    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1a8790e5-ef6c-4aa7-8012-78da3d2a0a67-console-config\") pod \"console-765fbf7b6d-ncx7q\" (UID: \"1a8790e5-ef6c-4aa7-8012-78da3d2a0a67\") " pod="openshift-console/console-765fbf7b6d-ncx7q"
Jul 07 17:09:44.293355 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:44.293318    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1a8790e5-ef6c-4aa7-8012-78da3d2a0a67-service-ca\") pod \"console-765fbf7b6d-ncx7q\" (UID: \"1a8790e5-ef6c-4aa7-8012-78da3d2a0a67\") " pod="openshift-console/console-765fbf7b6d-ncx7q"
Jul 07 17:09:44.293479 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:44.293459    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1a8790e5-ef6c-4aa7-8012-78da3d2a0a67-oauth-serving-cert\") pod \"console-765fbf7b6d-ncx7q\" (UID: \"1a8790e5-ef6c-4aa7-8012-78da3d2a0a67\") " pod="openshift-console/console-765fbf7b6d-ncx7q"
Jul 07 17:09:44.293786 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:44.293760    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a8790e5-ef6c-4aa7-8012-78da3d2a0a67-trusted-ca-bundle\") pod \"console-765fbf7b6d-ncx7q\" (UID: \"1a8790e5-ef6c-4aa7-8012-78da3d2a0a67\") " pod="openshift-console/console-765fbf7b6d-ncx7q"
Jul 07 17:09:44.295067 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:44.295040    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1a8790e5-ef6c-4aa7-8012-78da3d2a0a67-console-serving-cert\") pod \"console-765fbf7b6d-ncx7q\" (UID: \"1a8790e5-ef6c-4aa7-8012-78da3d2a0a67\") " pod="openshift-console/console-765fbf7b6d-ncx7q"
Jul 07 17:09:44.295189 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:44.295067    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1a8790e5-ef6c-4aa7-8012-78da3d2a0a67-console-oauth-config\") pod \"console-765fbf7b6d-ncx7q\" (UID: \"1a8790e5-ef6c-4aa7-8012-78da3d2a0a67\") " pod="openshift-console/console-765fbf7b6d-ncx7q"
Jul 07 17:09:44.304995 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:44.304964    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-27x8x\" (UniqueName: \"kubernetes.io/projected/1a8790e5-ef6c-4aa7-8012-78da3d2a0a67-kube-api-access-27x8x\") pod \"console-765fbf7b6d-ncx7q\" (UID: \"1a8790e5-ef6c-4aa7-8012-78da3d2a0a67\") " pod="openshift-console/console-765fbf7b6d-ncx7q"
Jul 07 17:09:44.470140 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:44.470051    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-765fbf7b6d-ncx7q"
Jul 07 17:09:44.614608 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:44.614576    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-765fbf7b6d-ncx7q"]
Jul 07 17:09:44.617727 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:09:44.617696    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1a8790e5_ef6c_4aa7_8012_78da3d2a0a67.slice/crio-29779e4dd01db6d377714f41590d18c9ffbaa38b7faeb7e81336b00ecd5289ec WatchSource:0}: Error finding container 29779e4dd01db6d377714f41590d18c9ffbaa38b7faeb7e81336b00ecd5289ec: Status 404 returned error can't find the container with id 29779e4dd01db6d377714f41590d18c9ffbaa38b7faeb7e81336b00ecd5289ec
Jul 07 17:09:45.439319 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:45.439276    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-765fbf7b6d-ncx7q" event={"ID":"1a8790e5-ef6c-4aa7-8012-78da3d2a0a67","Type":"ContainerStarted","Data":"29779e4dd01db6d377714f41590d18c9ffbaa38b7faeb7e81336b00ecd5289ec"}
Jul 07 17:09:45.602651 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:45.602621    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:47.894642 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:47.894610    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:47.994569 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:47.994536    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:48.451267 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:48.451231    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-765fbf7b6d-ncx7q" event={"ID":"1a8790e5-ef6c-4aa7-8012-78da3d2a0a67","Type":"ContainerStarted","Data":"70087b7b08c4b48169c6b727b1b65dff459888006a3d47af535f934a6476dbc2"}
Jul 07 17:09:48.472391 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:48.472335    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-765fbf7b6d-ncx7q" podStartSLOduration=1.672053907 podStartE2EDuration="4.472319201s" totalImagesPullingTime="2.800265294s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:09:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:09:48.470793202 +0000 UTC m=+113.194046401" watchObservedRunningTime="2026-07-07 17:09:48.472319201 +0000 UTC m=+113.195572398"
Jul 07 17:09:49.821387 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:49.821351    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:49.889012 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:49.888976    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:51.172356 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:51.172323    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:51.269327 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:51.269299    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:54.031037 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:54.031000    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:54.115731 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:54.115698    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:54.470193 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:54.470146    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-765fbf7b6d-ncx7q"
Jul 07 17:09:54.470390 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:54.470223    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-765fbf7b6d-ncx7q"
Jul 07 17:09:54.475127 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:54.475098    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-765fbf7b6d-ncx7q"
Jul 07 17:09:55.478758 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:55.478727    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-765fbf7b6d-ncx7q"
Jul 07 17:09:56.545109 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:56.545076    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:09:56.612279 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:09:56.612250    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:10:03.764634 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:10:03.764592    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:10:03.867405 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:10:03.867369    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:10:03.975866 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:10:03.975836    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:10:04.604889 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:10:04.604852    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:10:04.666490 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:10:04.666460    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:10:05.544379 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:10:05.544335    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3982c405-1bdb-4b6c-928a-fc6fb9e7b360-metrics-certs\") pod \"network-metrics-daemon-rqsv7\" (UID: \"3982c405-1bdb-4b6c-928a-fc6fb9e7b360\") " pod="openshift-multus/network-metrics-daemon-rqsv7"
Jul 07 17:10:05.546716 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:10:05.546688    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/3982c405-1bdb-4b6c-928a-fc6fb9e7b360-metrics-certs\") pod \"network-metrics-daemon-rqsv7\" (UID: \"3982c405-1bdb-4b6c-928a-fc6fb9e7b360\") " pod="openshift-multus/network-metrics-daemon-rqsv7"
Jul 07 17:10:05.654958 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:10:05.654918    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-chtgz\""
Jul 07 17:10:05.662607 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:10:05.662585    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-rqsv7"
Jul 07 17:10:05.803948 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:10:05.803864    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-rqsv7"]
Jul 07 17:10:05.806907 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:10:05.806877    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3982c405_1bdb_4b6c_928a_fc6fb9e7b360.slice/crio-a77dfb0ee14125ad623cdd5a702fa93fefa55a69c3d64b994a5453989cd82234 WatchSource:0}: Error finding container a77dfb0ee14125ad623cdd5a702fa93fefa55a69c3d64b994a5453989cd82234: Status 404 returned error can't find the container with id a77dfb0ee14125ad623cdd5a702fa93fefa55a69c3d64b994a5453989cd82234
Jul 07 17:10:06.511747 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:10:06.511704    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rqsv7" event={"ID":"3982c405-1bdb-4b6c-928a-fc6fb9e7b360","Type":"ContainerStarted","Data":"a77dfb0ee14125ad623cdd5a702fa93fefa55a69c3d64b994a5453989cd82234"}
Jul 07 17:10:07.517010 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:10:07.516975    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rqsv7" event={"ID":"3982c405-1bdb-4b6c-928a-fc6fb9e7b360","Type":"ContainerStarted","Data":"bfafa0a14d2d5df85907d6d9cf01d2b3d8fc710813efc59f7863a119e0122363"}
Jul 07 17:10:07.517494 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:10:07.517030    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-rqsv7" event={"ID":"3982c405-1bdb-4b6c-928a-fc6fb9e7b360","Type":"ContainerStarted","Data":"3a859bb095793c7bb947bca629ee8eb0646ee95783f8e6966e348c0241626913"}
Jul 07 17:10:07.535059 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:10:07.535004    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-rqsv7" podStartSLOduration=130.526216596 podStartE2EDuration="2m11.534987708s" totalImagesPullingTime="1.008771112s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:07:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:10:07.534249377 +0000 UTC m=+132.257502571" watchObservedRunningTime="2026-07-07 17:10:07.534987708 +0000 UTC m=+132.258240903"
Jul 07 17:10:07.635820 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:10:07.635785    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:10:07.740111 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:10:07.740073    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:10:08.813295 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:10:08.813262    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:10:08.908931 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:10:08.908896    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:10:11.542937 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:10:11.542903    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:10:11.643046 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:10:11.643008    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:10:21.564898 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:10:21.564867    2562 generic.go:356] "Generic (PLEG): container finished" podID="40bee3fc-b922-45bb-ac62-2a9593b07e28" containerID="3456d8a3995d24b739a0788f35093e4590477c04944c5f5e89d3f90cc03431f0" exitCode=0
Jul 07 17:10:21.565296 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:10:21.564903    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-qk5b2" event={"ID":"40bee3fc-b922-45bb-ac62-2a9593b07e28","Type":"ContainerDied","Data":"3456d8a3995d24b739a0788f35093e4590477c04944c5f5e89d3f90cc03431f0"}
Jul 07 17:10:21.565296 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:10:21.565230    2562 scope.go:117] "RemoveContainer" containerID="3456d8a3995d24b739a0788f35093e4590477c04944c5f5e89d3f90cc03431f0"
Jul 07 17:10:22.570570 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:10:22.570535    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5c847dcfc4-qk5b2" event={"ID":"40bee3fc-b922-45bb-ac62-2a9593b07e28","Type":"ContainerStarted","Data":"c8b08149d27454351c55a0bfa9f26f5f6ead6f4e29db4d7240ff28f741f19634"}
Jul 07 17:10:46.654274 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:10:46.654228    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77cdfdb5c9-pmcm8" event={"ID":"10a1886f-cea1-4129-a8e7-737a8a316ec7","Type":"ContainerStarted","Data":"159bdfb057beaf0f686c1f2c36a5ab160edad41471c80b12dd94adef8c5f3869"}
Jul 07 17:10:46.654274 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:10:46.654277    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77cdfdb5c9-pmcm8" event={"ID":"10a1886f-cea1-4129-a8e7-737a8a316ec7","Type":"ContainerStarted","Data":"2d4c80cf6e06e6dda5e7087cfc0ee2d1bd9e57144efbb91ccac6f6983f28b652"}
Jul 07 17:10:46.654837 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:10:46.654294    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77cdfdb5c9-pmcm8" event={"ID":"10a1886f-cea1-4129-a8e7-737a8a316ec7","Type":"ContainerStarted","Data":"20fc3612d84f0ebd5cd95112bfd8662fce0da9ce284dac026b8090bbd47623cd"}
Jul 07 17:10:46.675856 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:10:46.675802    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="open-cluster-management-agent-addon/cluster-proxy-proxy-agent-77cdfdb5c9-pmcm8" podStartSLOduration=2.360603937 podStartE2EDuration="1m26.675786481s" totalImagesPullingTime="1m24.315182544s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:09:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:10:46.674020121 +0000 UTC m=+171.397273319" watchObservedRunningTime="2026-07-07 17:10:46.675786481 +0000 UTC m=+171.399039695"
Jul 07 17:10:47.235622 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:10:47.235581    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:10:47.804368 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:10:47.804335    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:10:47.871356 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:10:47.871317    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:10:53.486643 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:10:53.486592    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:10:53.586364 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:10:53.586318    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:10:59.788422 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:10:59.788385    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:10:59.854763 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:10:59.854725    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:11:03.964832 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:11:03.964799    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-765fbf7b6d-ncx7q"]
Jul 07 17:11:04.075637 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:11:04.075604    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:11:04.177292 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:11:04.177261    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:11:04.242213 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:11:04.242114    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:11:11.543758 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:11:11.543711    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:11:11.700441 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:11:11.700400    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:11:11.772046 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:11:11.772015    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:11:28.987395 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:11:28.987319    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-765fbf7b6d-ncx7q" podUID="1a8790e5-ef6c-4aa7-8012-78da3d2a0a67" containerName="console" containerID="cri-o://70087b7b08c4b48169c6b727b1b65dff459888006a3d47af535f934a6476dbc2" gracePeriod=15
Jul 07 17:11:29.230046 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:11:29.230023    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-765fbf7b6d-ncx7q"
Jul 07 17:11:29.274507 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:11:29.274416    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1a8790e5-ef6c-4aa7-8012-78da3d2a0a67-oauth-serving-cert\") pod \"1a8790e5-ef6c-4aa7-8012-78da3d2a0a67\" (UID: \"1a8790e5-ef6c-4aa7-8012-78da3d2a0a67\") "
Jul 07 17:11:29.274507 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:11:29.274483    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1a8790e5-ef6c-4aa7-8012-78da3d2a0a67-console-serving-cert\") pod \"1a8790e5-ef6c-4aa7-8012-78da3d2a0a67\" (UID: \"1a8790e5-ef6c-4aa7-8012-78da3d2a0a67\") "
Jul 07 17:11:29.274693 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:11:29.274621    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1a8790e5-ef6c-4aa7-8012-78da3d2a0a67-console-oauth-config\") pod \"1a8790e5-ef6c-4aa7-8012-78da3d2a0a67\" (UID: \"1a8790e5-ef6c-4aa7-8012-78da3d2a0a67\") "
Jul 07 17:11:29.274693 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:11:29.274646    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1a8790e5-ef6c-4aa7-8012-78da3d2a0a67-service-ca\") pod \"1a8790e5-ef6c-4aa7-8012-78da3d2a0a67\" (UID: \"1a8790e5-ef6c-4aa7-8012-78da3d2a0a67\") "
Jul 07 17:11:29.274693 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:11:29.274688    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1a8790e5-ef6c-4aa7-8012-78da3d2a0a67-console-config\") pod \"1a8790e5-ef6c-4aa7-8012-78da3d2a0a67\" (UID: \"1a8790e5-ef6c-4aa7-8012-78da3d2a0a67\") "
Jul 07 17:11:29.274806 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:11:29.274734    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a8790e5-ef6c-4aa7-8012-78da3d2a0a67-trusted-ca-bundle\") pod \"1a8790e5-ef6c-4aa7-8012-78da3d2a0a67\" (UID: \"1a8790e5-ef6c-4aa7-8012-78da3d2a0a67\") "
Jul 07 17:11:29.274806 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:11:29.274772    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-27x8x\" (UniqueName: \"kubernetes.io/projected/1a8790e5-ef6c-4aa7-8012-78da3d2a0a67-kube-api-access-27x8x\") pod \"1a8790e5-ef6c-4aa7-8012-78da3d2a0a67\" (UID: \"1a8790e5-ef6c-4aa7-8012-78da3d2a0a67\") "
Jul 07 17:11:29.275025 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:11:29.274918    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a8790e5-ef6c-4aa7-8012-78da3d2a0a67-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1a8790e5-ef6c-4aa7-8012-78da3d2a0a67" (UID: "1a8790e5-ef6c-4aa7-8012-78da3d2a0a67"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:11:29.275132 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:11:29.275094    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a8790e5-ef6c-4aa7-8012-78da3d2a0a67-service-ca" (OuterVolumeSpecName: "service-ca") pod "1a8790e5-ef6c-4aa7-8012-78da3d2a0a67" (UID: "1a8790e5-ef6c-4aa7-8012-78da3d2a0a67"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:11:29.275132 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:11:29.275111    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a8790e5-ef6c-4aa7-8012-78da3d2a0a67-console-config" (OuterVolumeSpecName: "console-config") pod "1a8790e5-ef6c-4aa7-8012-78da3d2a0a67" (UID: "1a8790e5-ef6c-4aa7-8012-78da3d2a0a67"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:11:29.275269 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:11:29.275243    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1a8790e5-ef6c-4aa7-8012-78da3d2a0a67-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1a8790e5-ef6c-4aa7-8012-78da3d2a0a67" (UID: "1a8790e5-ef6c-4aa7-8012-78da3d2a0a67"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:11:29.277020 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:11:29.276997    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1a8790e5-ef6c-4aa7-8012-78da3d2a0a67-kube-api-access-27x8x" (OuterVolumeSpecName: "kube-api-access-27x8x") pod "1a8790e5-ef6c-4aa7-8012-78da3d2a0a67" (UID: "1a8790e5-ef6c-4aa7-8012-78da3d2a0a67"). InnerVolumeSpecName "kube-api-access-27x8x". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:11:29.277188 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:11:29.277149    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a8790e5-ef6c-4aa7-8012-78da3d2a0a67-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1a8790e5-ef6c-4aa7-8012-78da3d2a0a67" (UID: "1a8790e5-ef6c-4aa7-8012-78da3d2a0a67"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:11:29.277234 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:11:29.277187    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1a8790e5-ef6c-4aa7-8012-78da3d2a0a67-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1a8790e5-ef6c-4aa7-8012-78da3d2a0a67" (UID: "1a8790e5-ef6c-4aa7-8012-78da3d2a0a67"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:11:29.375550 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:11:29.375502    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-27x8x\" (UniqueName: \"kubernetes.io/projected/1a8790e5-ef6c-4aa7-8012-78da3d2a0a67-kube-api-access-27x8x\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:11:29.375550 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:11:29.375538    2562 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1a8790e5-ef6c-4aa7-8012-78da3d2a0a67-oauth-serving-cert\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:11:29.375550 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:11:29.375551    2562 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1a8790e5-ef6c-4aa7-8012-78da3d2a0a67-console-serving-cert\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:11:29.375550 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:11:29.375562    2562 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1a8790e5-ef6c-4aa7-8012-78da3d2a0a67-console-oauth-config\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:11:29.375830 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:11:29.375574    2562 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1a8790e5-ef6c-4aa7-8012-78da3d2a0a67-service-ca\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:11:29.375830 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:11:29.375586    2562 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1a8790e5-ef6c-4aa7-8012-78da3d2a0a67-console-config\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:11:29.375830 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:11:29.375600    2562 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1a8790e5-ef6c-4aa7-8012-78da3d2a0a67-trusted-ca-bundle\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:11:29.802821 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:11:29.801956    2562 generic.go:356] "Generic (PLEG): container finished" podID="1a8790e5-ef6c-4aa7-8012-78da3d2a0a67" containerID="70087b7b08c4b48169c6b727b1b65dff459888006a3d47af535f934a6476dbc2" exitCode=0
Jul 07 17:11:29.802821 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:11:29.802020    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-765fbf7b6d-ncx7q" event={"ID":"1a8790e5-ef6c-4aa7-8012-78da3d2a0a67","Type":"ContainerDied","Data":"70087b7b08c4b48169c6b727b1b65dff459888006a3d47af535f934a6476dbc2"}
Jul 07 17:11:29.802821 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:11:29.802114    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-765fbf7b6d-ncx7q" event={"ID":"1a8790e5-ef6c-4aa7-8012-78da3d2a0a67","Type":"ContainerDied","Data":"29779e4dd01db6d377714f41590d18c9ffbaa38b7faeb7e81336b00ecd5289ec"}
Jul 07 17:11:29.802821 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:11:29.802174    2562 scope.go:117] "RemoveContainer" containerID="70087b7b08c4b48169c6b727b1b65dff459888006a3d47af535f934a6476dbc2"
Jul 07 17:11:29.802821 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:11:29.802366    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-765fbf7b6d-ncx7q"
Jul 07 17:11:29.814761 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:11:29.814738    2562 scope.go:117] "RemoveContainer" containerID="70087b7b08c4b48169c6b727b1b65dff459888006a3d47af535f934a6476dbc2"
Jul 07 17:11:29.815089 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:11:29.815066    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"70087b7b08c4b48169c6b727b1b65dff459888006a3d47af535f934a6476dbc2\": container with ID starting with 70087b7b08c4b48169c6b727b1b65dff459888006a3d47af535f934a6476dbc2 not found: ID does not exist" containerID="70087b7b08c4b48169c6b727b1b65dff459888006a3d47af535f934a6476dbc2"
Jul 07 17:11:29.815193 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:11:29.815103    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"70087b7b08c4b48169c6b727b1b65dff459888006a3d47af535f934a6476dbc2"} err="failed to get container status \"70087b7b08c4b48169c6b727b1b65dff459888006a3d47af535f934a6476dbc2\": rpc error: code = NotFound desc = could not find container \"70087b7b08c4b48169c6b727b1b65dff459888006a3d47af535f934a6476dbc2\": container with ID starting with 70087b7b08c4b48169c6b727b1b65dff459888006a3d47af535f934a6476dbc2 not found: ID does not exist"
Jul 07 17:11:29.828337 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:11:29.828303    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-765fbf7b6d-ncx7q"]
Jul 07 17:11:29.833771 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:11:29.833744    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-765fbf7b6d-ncx7q"]
Jul 07 17:11:29.844236 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:11:29.844202    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1a8790e5-ef6c-4aa7-8012-78da3d2a0a67" path="/var/lib/kubelet/pods/1a8790e5-ef6c-4aa7-8012-78da3d2a0a67/volumes"
Jul 07 17:11:55.945935 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:11:55.945847    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:11:56.046933 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:11:56.046880    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:12:27.832412 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:12:27.832326    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:12:28.642727 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:12:28.642698    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:12:31.555857 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:12:31.555822    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:12:31.668275 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:12:31.668246    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:12:32.648200 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:12:32.648146    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:12:32.788168 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:12:32.788131    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:12:33.799039 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:12:33.799005    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:12:33.942909 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:12:33.942873    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:12:36.031348 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:12:36.031314    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:12:36.397033 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:12:36.397001    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:12:44.084122 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:12:44.084087    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:12:45.155773 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:12:45.155739    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-r7xr7"]
Jul 07 17:12:45.156172 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:12:45.155976    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1a8790e5-ef6c-4aa7-8012-78da3d2a0a67" containerName="console"
Jul 07 17:12:45.156172 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:12:45.155987    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="1a8790e5-ef6c-4aa7-8012-78da3d2a0a67" containerName="console"
Jul 07 17:12:45.156172 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:12:45.156053    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="1a8790e5-ef6c-4aa7-8012-78da3d2a0a67" containerName="console"
Jul 07 17:12:45.157744 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:12:45.157728    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-r7xr7"
Jul 07 17:12:45.159944 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:12:45.159921    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-m765c\""
Jul 07 17:12:45.160050 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:12:45.159950    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\""
Jul 07 17:12:45.160602 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:12:45.160585    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\""
Jul 07 17:12:45.172199 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:12:45.172167    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-r7xr7"]
Jul 07 17:12:45.328406 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:12:45.328360    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9c147e38-4d66-4886-bb5f-53875c0a7e6a-bound-sa-token\") pod \"cert-manager-55b4d954d5-r7xr7\" (UID: \"9c147e38-4d66-4886-bb5f-53875c0a7e6a\") " pod="cert-manager/cert-manager-55b4d954d5-r7xr7"
Jul 07 17:12:45.328577 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:12:45.328409    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gvfgc\" (UniqueName: \"kubernetes.io/projected/9c147e38-4d66-4886-bb5f-53875c0a7e6a-kube-api-access-gvfgc\") pod \"cert-manager-55b4d954d5-r7xr7\" (UID: \"9c147e38-4d66-4886-bb5f-53875c0a7e6a\") " pod="cert-manager/cert-manager-55b4d954d5-r7xr7"
Jul 07 17:12:45.359883 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:12:45.359858    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:12:45.429018 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:12:45.428930    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gvfgc\" (UniqueName: \"kubernetes.io/projected/9c147e38-4d66-4886-bb5f-53875c0a7e6a-kube-api-access-gvfgc\") pod \"cert-manager-55b4d954d5-r7xr7\" (UID: \"9c147e38-4d66-4886-bb5f-53875c0a7e6a\") " pod="cert-manager/cert-manager-55b4d954d5-r7xr7"
Jul 07 17:12:45.429120 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:12:45.429038    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9c147e38-4d66-4886-bb5f-53875c0a7e6a-bound-sa-token\") pod \"cert-manager-55b4d954d5-r7xr7\" (UID: \"9c147e38-4d66-4886-bb5f-53875c0a7e6a\") " pod="cert-manager/cert-manager-55b4d954d5-r7xr7"
Jul 07 17:12:45.439842 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:12:45.439810    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gvfgc\" (UniqueName: \"kubernetes.io/projected/9c147e38-4d66-4886-bb5f-53875c0a7e6a-kube-api-access-gvfgc\") pod \"cert-manager-55b4d954d5-r7xr7\" (UID: \"9c147e38-4d66-4886-bb5f-53875c0a7e6a\") " pod="cert-manager/cert-manager-55b4d954d5-r7xr7"
Jul 07 17:12:45.440909 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:12:45.440886    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9c147e38-4d66-4886-bb5f-53875c0a7e6a-bound-sa-token\") pod \"cert-manager-55b4d954d5-r7xr7\" (UID: \"9c147e38-4d66-4886-bb5f-53875c0a7e6a\") " pod="cert-manager/cert-manager-55b4d954d5-r7xr7"
Jul 07 17:12:45.460347 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:12:45.460312    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:12:45.466352 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:12:45.466327    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-r7xr7"
Jul 07 17:12:45.599590 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:12:45.599554    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-r7xr7"]
Jul 07 17:12:45.602674 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:12:45.602640    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9c147e38_4d66_4886_bb5f_53875c0a7e6a.slice/crio-ff5e9084c1b939f978c19235d4efc11c3d90f194f4ddda1dae88b70b3750b411 WatchSource:0}: Error finding container ff5e9084c1b939f978c19235d4efc11c3d90f194f4ddda1dae88b70b3750b411: Status 404 returned error can't find the container with id ff5e9084c1b939f978c19235d4efc11c3d90f194f4ddda1dae88b70b3750b411
Jul 07 17:12:46.054660 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:12:46.054625    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-r7xr7" event={"ID":"9c147e38-4d66-4886-bb5f-53875c0a7e6a","Type":"ContainerStarted","Data":"ff5e9084c1b939f978c19235d4efc11c3d90f194f4ddda1dae88b70b3750b411"}
Jul 07 17:12:46.801522 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:12:46.801468    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:12:46.868393 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:12:46.868355    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x9nsq"]
Jul 07 17:12:46.872451 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:12:46.872425    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x9nsq"
Jul 07 17:12:46.875046 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:12:46.875010    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\""
Jul 07 17:12:46.875216 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:12:46.875176    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-n5lzt\""
Jul 07 17:12:46.877071 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:12:46.876266    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\""
Jul 07 17:12:46.883782 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:12:46.883759    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x9nsq"]
Jul 07 17:12:46.915354 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:12:46.915316    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:12:47.043876 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:12:47.043822    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b49f36f5-c2a4-4904-89f6-09a675461c08-tmp\") pod \"openshift-lws-operator-fd8ccff4c-x9nsq\" (UID: \"b49f36f5-c2a4-4904-89f6-09a675461c08\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x9nsq"
Jul 07 17:12:47.043876 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:12:47.043902    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f2q2n\" (UniqueName: \"kubernetes.io/projected/b49f36f5-c2a4-4904-89f6-09a675461c08-kube-api-access-f2q2n\") pod \"openshift-lws-operator-fd8ccff4c-x9nsq\" (UID: \"b49f36f5-c2a4-4904-89f6-09a675461c08\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x9nsq"
Jul 07 17:12:47.145166 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:12:47.145097    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b49f36f5-c2a4-4904-89f6-09a675461c08-tmp\") pod \"openshift-lws-operator-fd8ccff4c-x9nsq\" (UID: \"b49f36f5-c2a4-4904-89f6-09a675461c08\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x9nsq"
Jul 07 17:12:47.145414 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:12:47.145195    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f2q2n\" (UniqueName: \"kubernetes.io/projected/b49f36f5-c2a4-4904-89f6-09a675461c08-kube-api-access-f2q2n\") pod \"openshift-lws-operator-fd8ccff4c-x9nsq\" (UID: \"b49f36f5-c2a4-4904-89f6-09a675461c08\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x9nsq"
Jul 07 17:12:47.145791 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:12:47.145763    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b49f36f5-c2a4-4904-89f6-09a675461c08-tmp\") pod \"openshift-lws-operator-fd8ccff4c-x9nsq\" (UID: \"b49f36f5-c2a4-4904-89f6-09a675461c08\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x9nsq"
Jul 07 17:12:47.157860 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:12:47.157826    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f2q2n\" (UniqueName: \"kubernetes.io/projected/b49f36f5-c2a4-4904-89f6-09a675461c08-kube-api-access-f2q2n\") pod \"openshift-lws-operator-fd8ccff4c-x9nsq\" (UID: \"b49f36f5-c2a4-4904-89f6-09a675461c08\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x9nsq"
Jul 07 17:12:47.184639 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:12:47.184601    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x9nsq"
Jul 07 17:12:48.440047 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:12:48.440005    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x9nsq"]
Jul 07 17:12:48.443346 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:12:48.443313    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podb49f36f5_c2a4_4904_89f6_09a675461c08.slice/crio-0d0b15974fbd7c8434dc8d5cb02d3241811b2f2345bfb008b3d78c4da1e63b68 WatchSource:0}: Error finding container 0d0b15974fbd7c8434dc8d5cb02d3241811b2f2345bfb008b3d78c4da1e63b68: Status 404 returned error can't find the container with id 0d0b15974fbd7c8434dc8d5cb02d3241811b2f2345bfb008b3d78c4da1e63b68
Jul 07 17:12:49.067959 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:12:49.067925    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-r7xr7" event={"ID":"9c147e38-4d66-4886-bb5f-53875c0a7e6a","Type":"ContainerStarted","Data":"c8650e9bdeb8ed4d14345410a9b02729964679934f3b5c19cc08248a06adc1c0"}
Jul 07 17:12:49.069211 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:12:49.069187    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x9nsq" event={"ID":"b49f36f5-c2a4-4904-89f6-09a675461c08","Type":"ContainerStarted","Data":"0d0b15974fbd7c8434dc8d5cb02d3241811b2f2345bfb008b3d78c4da1e63b68"}
Jul 07 17:12:49.085393 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:12:49.085336    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-r7xr7" podStartSLOduration=1.347552425 podStartE2EDuration="4.085317135s" totalImagesPullingTime="2.73776471s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:12:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:12:49.084542807 +0000 UTC m=+293.807796001" watchObservedRunningTime="2026-07-07 17:12:49.085317135 +0000 UTC m=+293.808570332"
Jul 07 17:12:52.082484 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:12:52.082440    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x9nsq" event={"ID":"b49f36f5-c2a4-4904-89f6-09a675461c08","Type":"ContainerStarted","Data":"440c56ac8c3b1b1abd09476f93bf0b6629b9300c89e8d48c367090069929602d"}
Jul 07 17:12:52.107668 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:12:52.107614    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-x9nsq" podStartSLOduration=3.277832289 podStartE2EDuration="6.107598805s" totalImagesPullingTime="2.829766516s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:12:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:12:52.106617493 +0000 UTC m=+296.829870694" watchObservedRunningTime="2026-07-07 17:12:52.107598805 +0000 UTC m=+296.830852021"
Jul 07 17:12:52.889286 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:12:52.889254    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:12:53.008633 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:12:53.008594    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:12:55.163905 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:12:55.163868    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:12:55.626507 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:12:55.626485    2562 kubelet.go:1648] "Image garbage collection succeeded"
Jul 07 17:13:00.071331 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:00.071295    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:13:09.451933 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:09.451900    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:13:09.560168 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:09.560135    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:13:09.870606 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:09.870510    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:13:10.387420 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:10.387390    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:13:10.508511 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:10.508480    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:13:10.570415 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:10.570375    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-547959ffc4-8x76w"]
Jul 07 17:13:10.572486 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:10.572467    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-547959ffc4-8x76w"
Jul 07 17:13:10.576785 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:10.576761    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\""
Jul 07 17:13:10.576891 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:10.576765    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\""
Jul 07 17:13:10.577393 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:10.577375    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\""
Jul 07 17:13:10.577467 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:10.577391    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\""
Jul 07 17:13:10.577545 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:10.577525    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-kchrk\""
Jul 07 17:13:10.593092 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:10.593062    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-547959ffc4-8x76w"]
Jul 07 17:13:10.613338 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:10.613303    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cae1f224-869f-4558-9b34-38184743d1d8-manifests\") pod \"opendatahub-operator-controller-manager-547959ffc4-8x76w\" (UID: \"cae1f224-869f-4558-9b34-38184743d1d8\") " pod="opendatahub/opendatahub-operator-controller-manager-547959ffc4-8x76w"
Jul 07 17:13:10.613338 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:10.613343    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cae1f224-869f-4558-9b34-38184743d1d8-tmp\") pod \"opendatahub-operator-controller-manager-547959ffc4-8x76w\" (UID: \"cae1f224-869f-4558-9b34-38184743d1d8\") " pod="opendatahub/opendatahub-operator-controller-manager-547959ffc4-8x76w"
Jul 07 17:13:10.613535 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:10.613369    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cae1f224-869f-4558-9b34-38184743d1d8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-547959ffc4-8x76w\" (UID: \"cae1f224-869f-4558-9b34-38184743d1d8\") " pod="opendatahub/opendatahub-operator-controller-manager-547959ffc4-8x76w"
Jul 07 17:13:10.613535 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:10.613394    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cae1f224-869f-4558-9b34-38184743d1d8-webhook-cert\") pod \"opendatahub-operator-controller-manager-547959ffc4-8x76w\" (UID: \"cae1f224-869f-4558-9b34-38184743d1d8\") " pod="opendatahub/opendatahub-operator-controller-manager-547959ffc4-8x76w"
Jul 07 17:13:10.613535 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:10.613426    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g5b4l\" (UniqueName: \"kubernetes.io/projected/cae1f224-869f-4558-9b34-38184743d1d8-kube-api-access-g5b4l\") pod \"opendatahub-operator-controller-manager-547959ffc4-8x76w\" (UID: \"cae1f224-869f-4558-9b34-38184743d1d8\") " pod="opendatahub/opendatahub-operator-controller-manager-547959ffc4-8x76w"
Jul 07 17:13:10.713975 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:10.713881    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cae1f224-869f-4558-9b34-38184743d1d8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-547959ffc4-8x76w\" (UID: \"cae1f224-869f-4558-9b34-38184743d1d8\") " pod="opendatahub/opendatahub-operator-controller-manager-547959ffc4-8x76w"
Jul 07 17:13:10.713975 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:10.713924    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cae1f224-869f-4558-9b34-38184743d1d8-webhook-cert\") pod \"opendatahub-operator-controller-manager-547959ffc4-8x76w\" (UID: \"cae1f224-869f-4558-9b34-38184743d1d8\") " pod="opendatahub/opendatahub-operator-controller-manager-547959ffc4-8x76w"
Jul 07 17:13:10.713975 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:10.713973    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g5b4l\" (UniqueName: \"kubernetes.io/projected/cae1f224-869f-4558-9b34-38184743d1d8-kube-api-access-g5b4l\") pod \"opendatahub-operator-controller-manager-547959ffc4-8x76w\" (UID: \"cae1f224-869f-4558-9b34-38184743d1d8\") " pod="opendatahub/opendatahub-operator-controller-manager-547959ffc4-8x76w"
Jul 07 17:13:10.714312 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:10.714023    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cae1f224-869f-4558-9b34-38184743d1d8-manifests\") pod \"opendatahub-operator-controller-manager-547959ffc4-8x76w\" (UID: \"cae1f224-869f-4558-9b34-38184743d1d8\") " pod="opendatahub/opendatahub-operator-controller-manager-547959ffc4-8x76w"
Jul 07 17:13:10.714312 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:10.714052    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cae1f224-869f-4558-9b34-38184743d1d8-tmp\") pod \"opendatahub-operator-controller-manager-547959ffc4-8x76w\" (UID: \"cae1f224-869f-4558-9b34-38184743d1d8\") " pod="opendatahub/opendatahub-operator-controller-manager-547959ffc4-8x76w"
Jul 07 17:13:10.714584 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:10.714546    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/cae1f224-869f-4558-9b34-38184743d1d8-manifests\") pod \"opendatahub-operator-controller-manager-547959ffc4-8x76w\" (UID: \"cae1f224-869f-4558-9b34-38184743d1d8\") " pod="opendatahub/opendatahub-operator-controller-manager-547959ffc4-8x76w"
Jul 07 17:13:10.716302 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:10.716276    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/cae1f224-869f-4558-9b34-38184743d1d8-tmp\") pod \"opendatahub-operator-controller-manager-547959ffc4-8x76w\" (UID: \"cae1f224-869f-4558-9b34-38184743d1d8\") " pod="opendatahub/opendatahub-operator-controller-manager-547959ffc4-8x76w"
Jul 07 17:13:10.716425 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:10.716368    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/cae1f224-869f-4558-9b34-38184743d1d8-apiservice-cert\") pod \"opendatahub-operator-controller-manager-547959ffc4-8x76w\" (UID: \"cae1f224-869f-4558-9b34-38184743d1d8\") " pod="opendatahub/opendatahub-operator-controller-manager-547959ffc4-8x76w"
Jul 07 17:13:10.716545 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:10.716526    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/cae1f224-869f-4558-9b34-38184743d1d8-webhook-cert\") pod \"opendatahub-operator-controller-manager-547959ffc4-8x76w\" (UID: \"cae1f224-869f-4558-9b34-38184743d1d8\") " pod="opendatahub/opendatahub-operator-controller-manager-547959ffc4-8x76w"
Jul 07 17:13:10.725965 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:10.725939    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g5b4l\" (UniqueName: \"kubernetes.io/projected/cae1f224-869f-4558-9b34-38184743d1d8-kube-api-access-g5b4l\") pod \"opendatahub-operator-controller-manager-547959ffc4-8x76w\" (UID: \"cae1f224-869f-4558-9b34-38184743d1d8\") " pod="opendatahub/opendatahub-operator-controller-manager-547959ffc4-8x76w"
Jul 07 17:13:10.763067 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:10.763033    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:13:10.864565 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:10.864530    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:13:10.881865 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:10.881830    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-547959ffc4-8x76w"
Jul 07 17:13:10.965073 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:10.964993    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:13:11.019630 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:11.019592    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-547959ffc4-8x76w"]
Jul 07 17:13:11.023590 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:13:11.023564    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcae1f224_869f_4558_9b34_38184743d1d8.slice/crio-779c2c7121ad7aa677adc2b714b678aecad46365d521d71e6e3a4713a1979e11 WatchSource:0}: Error finding container 779c2c7121ad7aa677adc2b714b678aecad46365d521d71e6e3a4713a1979e11: Status 404 returned error can't find the container with id 779c2c7121ad7aa677adc2b714b678aecad46365d521d71e6e3a4713a1979e11
Jul 07 17:13:11.025285 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:11.025270    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 17:13:11.044097 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:11.044070    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:13:11.138371 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:11.138332    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:13:11.151364 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:11.151327    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-547959ffc4-8x76w" event={"ID":"cae1f224-869f-4558-9b34-38184743d1d8","Type":"ContainerStarted","Data":"779c2c7121ad7aa677adc2b714b678aecad46365d521d71e6e3a4713a1979e11"}
Jul 07 17:13:11.232969 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:11.232882    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:13:11.333797 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:11.333762    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:13:15.167741 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:15.167707    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-547959ffc4-8x76w" event={"ID":"cae1f224-869f-4558-9b34-38184743d1d8","Type":"ContainerStarted","Data":"0e6e6fed316350e7f139d30aaaf1fdd6d37d0cea1896703dd7eade0eaf9db5c3"}
Jul 07 17:13:16.173001 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:16.172966    2562 generic.go:356] "Generic (PLEG): container finished" podID="cae1f224-869f-4558-9b34-38184743d1d8" containerID="0e6e6fed316350e7f139d30aaaf1fdd6d37d0cea1896703dd7eade0eaf9db5c3" exitCode=0
Jul 07 17:13:16.173398 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:16.173052    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-547959ffc4-8x76w" event={"ID":"cae1f224-869f-4558-9b34-38184743d1d8","Type":"ContainerDied","Data":"0e6e6fed316350e7f139d30aaaf1fdd6d37d0cea1896703dd7eade0eaf9db5c3"}
Jul 07 17:13:17.178627 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:17.178592    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-547959ffc4-8x76w" event={"ID":"cae1f224-869f-4558-9b34-38184743d1d8","Type":"ContainerStarted","Data":"31c1af560c4324076f0898cb0d3177eb24961602d819d7bbee89085f264a7eea"}
Jul 07 17:13:17.179053 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:17.178831    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-547959ffc4-8x76w"
Jul 07 17:13:23.603629 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:23.603591    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:13:25.269540 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:25.269507    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:13:28.184523 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:28.184491    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-547959ffc4-8x76w"
Jul 07 17:13:28.209738 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:28.209683    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-547959ffc4-8x76w" podStartSLOduration=13.14252067 podStartE2EDuration="18.209665877s" totalImagesPullingTime="3.994030224s" totalInitContainerRuntime="1.073114983s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:13:10 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:13:17.22732523 +0000 UTC m=+321.950578427" watchObservedRunningTime="2026-07-07 17:13:28.209665877 +0000 UTC m=+332.932919075"
Jul 07 17:13:30.273228 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:30.273192    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:13:30.425354 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:30.425319    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:13:30.708984 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:30.708945    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:13:31.009468 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:31.009374    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:13:31.821873 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:31.821841    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:13:31.959632 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:31.959601    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:13:32.153697 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:32.153660    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:13:33.045830 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:33.045754    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-nh444"]
Jul 07 17:13:33.052973 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:33.052941    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:13:33.055249 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:33.055229    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-nh444"
Jul 07 17:13:33.058479 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:33.058456    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-g25n2\""
Jul 07 17:13:33.058654 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:33.058643    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\""
Jul 07 17:13:33.060099 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:33.060081    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\""
Jul 07 17:13:33.060286 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:33.060272    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\""
Jul 07 17:13:33.062819 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:33.062804    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\""
Jul 07 17:13:33.077880 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:33.077848    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-nh444"]
Jul 07 17:13:33.194654 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:33.194611    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tf5vh\" (UniqueName: \"kubernetes.io/projected/3db2d9d2-e00f-4bb8-a345-019ae0e308f6-kube-api-access-tf5vh\") pod \"istiod-openshift-gateway-7574459656-nh444\" (UID: \"3db2d9d2-e00f-4bb8-a345-019ae0e308f6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nh444"
Jul 07 17:13:33.194850 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:33.194666    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3db2d9d2-e00f-4bb8-a345-019ae0e308f6-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-nh444\" (UID: \"3db2d9d2-e00f-4bb8-a345-019ae0e308f6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nh444"
Jul 07 17:13:33.194850 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:33.194741    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3db2d9d2-e00f-4bb8-a345-019ae0e308f6-local-certs\") pod \"istiod-openshift-gateway-7574459656-nh444\" (UID: \"3db2d9d2-e00f-4bb8-a345-019ae0e308f6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nh444"
Jul 07 17:13:33.194850 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:33.194805    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3db2d9d2-e00f-4bb8-a345-019ae0e308f6-istio-token\") pod \"istiod-openshift-gateway-7574459656-nh444\" (UID: \"3db2d9d2-e00f-4bb8-a345-019ae0e308f6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nh444"
Jul 07 17:13:33.194850 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:33.194830    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3db2d9d2-e00f-4bb8-a345-019ae0e308f6-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-nh444\" (UID: \"3db2d9d2-e00f-4bb8-a345-019ae0e308f6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nh444"
Jul 07 17:13:33.195007 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:33.194856    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3db2d9d2-e00f-4bb8-a345-019ae0e308f6-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-nh444\" (UID: \"3db2d9d2-e00f-4bb8-a345-019ae0e308f6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nh444"
Jul 07 17:13:33.195007 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:33.194889    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3db2d9d2-e00f-4bb8-a345-019ae0e308f6-cacerts\") pod \"istiod-openshift-gateway-7574459656-nh444\" (UID: \"3db2d9d2-e00f-4bb8-a345-019ae0e308f6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nh444"
Jul 07 17:13:33.295774 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:33.295731    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3db2d9d2-e00f-4bb8-a345-019ae0e308f6-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-nh444\" (UID: \"3db2d9d2-e00f-4bb8-a345-019ae0e308f6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nh444"
Jul 07 17:13:33.296027 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:33.295783    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3db2d9d2-e00f-4bb8-a345-019ae0e308f6-cacerts\") pod \"istiod-openshift-gateway-7574459656-nh444\" (UID: \"3db2d9d2-e00f-4bb8-a345-019ae0e308f6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nh444"
Jul 07 17:13:33.296027 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:33.295820    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tf5vh\" (UniqueName: \"kubernetes.io/projected/3db2d9d2-e00f-4bb8-a345-019ae0e308f6-kube-api-access-tf5vh\") pod \"istiod-openshift-gateway-7574459656-nh444\" (UID: \"3db2d9d2-e00f-4bb8-a345-019ae0e308f6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nh444"
Jul 07 17:13:33.296027 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:33.295867    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3db2d9d2-e00f-4bb8-a345-019ae0e308f6-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-nh444\" (UID: \"3db2d9d2-e00f-4bb8-a345-019ae0e308f6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nh444"
Jul 07 17:13:33.296027 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:33.295902    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3db2d9d2-e00f-4bb8-a345-019ae0e308f6-local-certs\") pod \"istiod-openshift-gateway-7574459656-nh444\" (UID: \"3db2d9d2-e00f-4bb8-a345-019ae0e308f6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nh444"
Jul 07 17:13:33.296027 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:33.295935    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3db2d9d2-e00f-4bb8-a345-019ae0e308f6-istio-token\") pod \"istiod-openshift-gateway-7574459656-nh444\" (UID: \"3db2d9d2-e00f-4bb8-a345-019ae0e308f6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nh444"
Jul 07 17:13:33.296027 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:33.295959    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3db2d9d2-e00f-4bb8-a345-019ae0e308f6-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-nh444\" (UID: \"3db2d9d2-e00f-4bb8-a345-019ae0e308f6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nh444"
Jul 07 17:13:33.296673 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:33.296641    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3db2d9d2-e00f-4bb8-a345-019ae0e308f6-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-nh444\" (UID: \"3db2d9d2-e00f-4bb8-a345-019ae0e308f6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nh444"
Jul 07 17:13:33.298648 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:33.298613    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3db2d9d2-e00f-4bb8-a345-019ae0e308f6-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-nh444\" (UID: \"3db2d9d2-e00f-4bb8-a345-019ae0e308f6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nh444"
Jul 07 17:13:33.298780 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:33.298674    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3db2d9d2-e00f-4bb8-a345-019ae0e308f6-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-nh444\" (UID: \"3db2d9d2-e00f-4bb8-a345-019ae0e308f6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nh444"
Jul 07 17:13:33.298780 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:33.298690    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3db2d9d2-e00f-4bb8-a345-019ae0e308f6-local-certs\") pod \"istiod-openshift-gateway-7574459656-nh444\" (UID: \"3db2d9d2-e00f-4bb8-a345-019ae0e308f6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nh444"
Jul 07 17:13:33.299231 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:33.299206    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3db2d9d2-e00f-4bb8-a345-019ae0e308f6-cacerts\") pod \"istiod-openshift-gateway-7574459656-nh444\" (UID: \"3db2d9d2-e00f-4bb8-a345-019ae0e308f6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nh444"
Jul 07 17:13:33.321631 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:33.321595    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3db2d9d2-e00f-4bb8-a345-019ae0e308f6-istio-token\") pod \"istiod-openshift-gateway-7574459656-nh444\" (UID: \"3db2d9d2-e00f-4bb8-a345-019ae0e308f6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nh444"
Jul 07 17:13:33.321815 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:33.321715    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tf5vh\" (UniqueName: \"kubernetes.io/projected/3db2d9d2-e00f-4bb8-a345-019ae0e308f6-kube-api-access-tf5vh\") pod \"istiod-openshift-gateway-7574459656-nh444\" (UID: \"3db2d9d2-e00f-4bb8-a345-019ae0e308f6\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-nh444"
Jul 07 17:13:33.364680 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:33.364627    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-nh444"
Jul 07 17:13:33.392092 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:33.392056    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:13:33.526524 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:33.526489    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-nh444"]
Jul 07 17:13:33.529991 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:13:33.529954    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3db2d9d2_e00f_4bb8_a345_019ae0e308f6.slice/crio-9d5bb7d0eb94b326888dccb61cd47aea54fe4a64743a8c50e8847568410bad5c WatchSource:0}: Error finding container 9d5bb7d0eb94b326888dccb61cd47aea54fe4a64743a8c50e8847568410bad5c: Status 404 returned error can't find the container with id 9d5bb7d0eb94b326888dccb61cd47aea54fe4a64743a8c50e8847568410bad5c
Jul 07 17:13:33.632746 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:33.632713    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:13:33.787493 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:33.787458    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:13:34.243413 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:34.243374    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-nh444" event={"ID":"3db2d9d2-e00f-4bb8-a345-019ae0e308f6","Type":"ContainerStarted","Data":"9d5bb7d0eb94b326888dccb61cd47aea54fe4a64743a8c50e8847568410bad5c"}
Jul 07 17:13:34.928308 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:34.928207    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:13:36.752686 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:36.752623    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 17:13:36.752979 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:36.752743    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 17:13:37.264479 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:37.264443    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-nh444" event={"ID":"3db2d9d2-e00f-4bb8-a345-019ae0e308f6","Type":"ContainerStarted","Data":"6f6ac4a035a0eef6de15f3a66497c2096525d1d190a624adcdef991da43b66ec"}
Jul 07 17:13:37.264678 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:37.264661    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-nh444"
Jul 07 17:13:37.266334 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:37.266305    2562 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-nh444 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 07 17:13:37.266457 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:37.266356    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-nh444" podUID="3db2d9d2-e00f-4bb8-a345-019ae0e308f6" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 17:13:37.304442 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:37.304393    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-nh444" podStartSLOduration=1.084120174 podStartE2EDuration="4.304375519s" totalImagesPullingTime="3.220255345s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:13:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:13:37.304116339 +0000 UTC m=+342.027369537" watchObservedRunningTime="2026-07-07 17:13:37.304375519 +0000 UTC m=+342.027628716"
Jul 07 17:13:37.360449 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:37.360415    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:13:37.492190 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:37.492125    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:13:38.269623 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:38.269583    2562 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-nh444 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 07 17:13:38.269998 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:38.269632    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-nh444" podUID="3db2d9d2-e00f-4bb8-a345-019ae0e308f6" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 17:13:38.923700 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:38.923661    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:13:39.324994 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:39.324895    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:13:39.478279 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:39.478242    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:13:41.270051 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:41.270015    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-nh444"
Jul 07 17:13:42.730295 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:42.730258    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hp895"]
Jul 07 17:13:42.732472 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:42.732455    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hp895"
Jul 07 17:13:42.880948 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:42.880901    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3d14af82-dbb8-4b37-affd-70fe540dbc72-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-hp895\" (UID: \"3d14af82-dbb8-4b37-affd-70fe540dbc72\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hp895"
Jul 07 17:13:42.880948 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:42.880950    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3d14af82-dbb8-4b37-affd-70fe540dbc72-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-hp895\" (UID: \"3d14af82-dbb8-4b37-affd-70fe540dbc72\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hp895"
Jul 07 17:13:42.881185 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:42.880979    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3d14af82-dbb8-4b37-affd-70fe540dbc72-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-hp895\" (UID: \"3d14af82-dbb8-4b37-affd-70fe540dbc72\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hp895"
Jul 07 17:13:42.881185 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:42.881016    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3d14af82-dbb8-4b37-affd-70fe540dbc72-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-hp895\" (UID: \"3d14af82-dbb8-4b37-affd-70fe540dbc72\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hp895"
Jul 07 17:13:42.881185 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:42.881092    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d14af82-dbb8-4b37-affd-70fe540dbc72-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-hp895\" (UID: \"3d14af82-dbb8-4b37-affd-70fe540dbc72\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hp895"
Jul 07 17:13:42.881185 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:42.881123    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d14af82-dbb8-4b37-affd-70fe540dbc72-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-hp895\" (UID: \"3d14af82-dbb8-4b37-affd-70fe540dbc72\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hp895"
Jul 07 17:13:42.881185 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:42.881143    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z9bww\" (UniqueName: \"kubernetes.io/projected/3d14af82-dbb8-4b37-affd-70fe540dbc72-kube-api-access-z9bww\") pod \"istiod-openshift-gateway-94bb8fbfd-hp895\" (UID: \"3d14af82-dbb8-4b37-affd-70fe540dbc72\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hp895"
Jul 07 17:13:42.969442 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:42.969407    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hp895"]
Jul 07 17:13:42.982501 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:42.982428    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d14af82-dbb8-4b37-affd-70fe540dbc72-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-hp895\" (UID: \"3d14af82-dbb8-4b37-affd-70fe540dbc72\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hp895"
Jul 07 17:13:42.982501 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:42.982459    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d14af82-dbb8-4b37-affd-70fe540dbc72-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-hp895\" (UID: \"3d14af82-dbb8-4b37-affd-70fe540dbc72\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hp895"
Jul 07 17:13:42.982501 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:42.982477    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z9bww\" (UniqueName: \"kubernetes.io/projected/3d14af82-dbb8-4b37-affd-70fe540dbc72-kube-api-access-z9bww\") pod \"istiod-openshift-gateway-94bb8fbfd-hp895\" (UID: \"3d14af82-dbb8-4b37-affd-70fe540dbc72\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hp895"
Jul 07 17:13:42.982742 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:42.982541    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3d14af82-dbb8-4b37-affd-70fe540dbc72-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-hp895\" (UID: \"3d14af82-dbb8-4b37-affd-70fe540dbc72\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hp895"
Jul 07 17:13:42.982742 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:42.982575    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3d14af82-dbb8-4b37-affd-70fe540dbc72-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-hp895\" (UID: \"3d14af82-dbb8-4b37-affd-70fe540dbc72\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hp895"
Jul 07 17:13:42.982742 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:42.982596    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3d14af82-dbb8-4b37-affd-70fe540dbc72-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-hp895\" (UID: \"3d14af82-dbb8-4b37-affd-70fe540dbc72\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hp895"
Jul 07 17:13:42.982742 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:42.982619    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3d14af82-dbb8-4b37-affd-70fe540dbc72-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-hp895\" (UID: \"3d14af82-dbb8-4b37-affd-70fe540dbc72\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hp895"
Jul 07 17:13:42.983559 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:42.983526    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3d14af82-dbb8-4b37-affd-70fe540dbc72-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-hp895\" (UID: \"3d14af82-dbb8-4b37-affd-70fe540dbc72\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hp895"
Jul 07 17:13:42.984892 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:42.984871    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3d14af82-dbb8-4b37-affd-70fe540dbc72-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-hp895\" (UID: \"3d14af82-dbb8-4b37-affd-70fe540dbc72\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hp895"
Jul 07 17:13:42.984980 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:42.984928    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3d14af82-dbb8-4b37-affd-70fe540dbc72-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-hp895\" (UID: \"3d14af82-dbb8-4b37-affd-70fe540dbc72\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hp895"
Jul 07 17:13:42.984980 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:42.984927    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3d14af82-dbb8-4b37-affd-70fe540dbc72-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-hp895\" (UID: \"3d14af82-dbb8-4b37-affd-70fe540dbc72\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hp895"
Jul 07 17:13:42.985068 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:42.985052    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3d14af82-dbb8-4b37-affd-70fe540dbc72-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-hp895\" (UID: \"3d14af82-dbb8-4b37-affd-70fe540dbc72\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hp895"
Jul 07 17:13:43.000875 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:43.000849    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3d14af82-dbb8-4b37-affd-70fe540dbc72-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-hp895\" (UID: \"3d14af82-dbb8-4b37-affd-70fe540dbc72\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hp895"
Jul 07 17:13:43.008053 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:43.008026    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z9bww\" (UniqueName: \"kubernetes.io/projected/3d14af82-dbb8-4b37-affd-70fe540dbc72-kube-api-access-z9bww\") pod \"istiod-openshift-gateway-94bb8fbfd-hp895\" (UID: \"3d14af82-dbb8-4b37-affd-70fe540dbc72\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hp895"
Jul 07 17:13:43.042051 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:43.042011    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hp895"
Jul 07 17:13:43.205003 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:43.204975    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hp895"]
Jul 07 17:13:43.207490 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:13:43.207461    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3d14af82_dbb8_4b37_affd_70fe540dbc72.slice/crio-9d07f075b2e6149916d80125cb9c6b471dd1f8edb26ecf821bd5f0af38176fc8 WatchSource:0}: Error finding container 9d07f075b2e6149916d80125cb9c6b471dd1f8edb26ecf821bd5f0af38176fc8: Status 404 returned error can't find the container with id 9d07f075b2e6149916d80125cb9c6b471dd1f8edb26ecf821bd5f0af38176fc8
Jul 07 17:13:43.210411 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:43.210362    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 17:13:43.210485 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:43.210447    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 17:13:43.290260 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:43.290215    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hp895" event={"ID":"3d14af82-dbb8-4b37-affd-70fe540dbc72","Type":"ContainerStarted","Data":"ad0b5078c0c99d3ff39909f10644f3cef0e239d9e842addd43e453ec74aebe8c"}
Jul 07 17:13:43.290427 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:43.290273    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hp895" event={"ID":"3d14af82-dbb8-4b37-affd-70fe540dbc72","Type":"ContainerStarted","Data":"9d07f075b2e6149916d80125cb9c6b471dd1f8edb26ecf821bd5f0af38176fc8"}
Jul 07 17:13:43.290427 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:43.290374    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hp895"
Jul 07 17:13:43.333582 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:43.333527    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hp895" podStartSLOduration=1.33350729 podStartE2EDuration="1.33350729s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:13:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:13:43.333292005 +0000 UTC m=+348.056545232" watchObservedRunningTime="2026-07-07 17:13:43.33350729 +0000 UTC m=+348.056760487"
Jul 07 17:13:43.627665 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:43.627634    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:13:44.296562 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:44.296531    2562 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-hp895 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 07 17:13:44.297024 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:44.296589    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hp895" podUID="3d14af82-dbb8-4b37-affd-70fe540dbc72" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 17:13:45.919604 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:45.919567    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:13:46.038358 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:46.038321    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:13:46.194169 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:46.194068    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:13:46.366594 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:46.366561    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:13:46.540680 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:46.540591    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:13:47.295819 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:47.295730    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-hp895"
Jul 07 17:13:47.448459 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:47.448425    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:13:47.490009 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:47.489976    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-nh444"]
Jul 07 17:13:47.490223 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:47.490201    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-nh444" podUID="3db2d9d2-e00f-4bb8-a345-019ae0e308f6" containerName="discovery" containerID="cri-o://6f6ac4a035a0eef6de15f3a66497c2096525d1d190a624adcdef991da43b66ec" gracePeriod=30
Jul 07 17:13:47.592951 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:47.592867    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:13:47.732961 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:47.732933    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-nh444"
Jul 07 17:13:47.791460 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:47.791422    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:13:47.823061 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:47.823030    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3db2d9d2-e00f-4bb8-a345-019ae0e308f6-istio-csr-dns-cert\") pod \"3db2d9d2-e00f-4bb8-a345-019ae0e308f6\" (UID: \"3db2d9d2-e00f-4bb8-a345-019ae0e308f6\") "
Jul 07 17:13:47.823292 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:47.823073    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3db2d9d2-e00f-4bb8-a345-019ae0e308f6-istio-kubeconfig\") pod \"3db2d9d2-e00f-4bb8-a345-019ae0e308f6\" (UID: \"3db2d9d2-e00f-4bb8-a345-019ae0e308f6\") "
Jul 07 17:13:47.823292 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:47.823123    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3db2d9d2-e00f-4bb8-a345-019ae0e308f6-istio-token\") pod \"3db2d9d2-e00f-4bb8-a345-019ae0e308f6\" (UID: \"3db2d9d2-e00f-4bb8-a345-019ae0e308f6\") "
Jul 07 17:13:47.823292 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:47.823147    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3db2d9d2-e00f-4bb8-a345-019ae0e308f6-local-certs\") pod \"3db2d9d2-e00f-4bb8-a345-019ae0e308f6\" (UID: \"3db2d9d2-e00f-4bb8-a345-019ae0e308f6\") "
Jul 07 17:13:47.823292 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:47.823248    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tf5vh\" (UniqueName: \"kubernetes.io/projected/3db2d9d2-e00f-4bb8-a345-019ae0e308f6-kube-api-access-tf5vh\") pod \"3db2d9d2-e00f-4bb8-a345-019ae0e308f6\" (UID: \"3db2d9d2-e00f-4bb8-a345-019ae0e308f6\") "
Jul 07 17:13:47.823515 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:47.823314    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3db2d9d2-e00f-4bb8-a345-019ae0e308f6-istio-csr-ca-configmap\") pod \"3db2d9d2-e00f-4bb8-a345-019ae0e308f6\" (UID: \"3db2d9d2-e00f-4bb8-a345-019ae0e308f6\") "
Jul 07 17:13:47.823515 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:47.823353    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3db2d9d2-e00f-4bb8-a345-019ae0e308f6-cacerts\") pod \"3db2d9d2-e00f-4bb8-a345-019ae0e308f6\" (UID: \"3db2d9d2-e00f-4bb8-a345-019ae0e308f6\") "
Jul 07 17:13:47.823795 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:47.823766    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3db2d9d2-e00f-4bb8-a345-019ae0e308f6-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "3db2d9d2-e00f-4bb8-a345-019ae0e308f6" (UID: "3db2d9d2-e00f-4bb8-a345-019ae0e308f6"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:13:47.825710 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:47.825681    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3db2d9d2-e00f-4bb8-a345-019ae0e308f6-kube-api-access-tf5vh" (OuterVolumeSpecName: "kube-api-access-tf5vh") pod "3db2d9d2-e00f-4bb8-a345-019ae0e308f6" (UID: "3db2d9d2-e00f-4bb8-a345-019ae0e308f6"). InnerVolumeSpecName "kube-api-access-tf5vh". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:13:47.825710 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:47.825687    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3db2d9d2-e00f-4bb8-a345-019ae0e308f6-istio-token" (OuterVolumeSpecName: "istio-token") pod "3db2d9d2-e00f-4bb8-a345-019ae0e308f6" (UID: "3db2d9d2-e00f-4bb8-a345-019ae0e308f6"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:13:47.825908 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:47.825803    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3db2d9d2-e00f-4bb8-a345-019ae0e308f6-local-certs" (OuterVolumeSpecName: "local-certs") pod "3db2d9d2-e00f-4bb8-a345-019ae0e308f6" (UID: "3db2d9d2-e00f-4bb8-a345-019ae0e308f6"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:13:47.825908 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:47.825852    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3db2d9d2-e00f-4bb8-a345-019ae0e308f6-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "3db2d9d2-e00f-4bb8-a345-019ae0e308f6" (UID: "3db2d9d2-e00f-4bb8-a345-019ae0e308f6"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:13:47.825908 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:47.825892    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3db2d9d2-e00f-4bb8-a345-019ae0e308f6-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "3db2d9d2-e00f-4bb8-a345-019ae0e308f6" (UID: "3db2d9d2-e00f-4bb8-a345-019ae0e308f6"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:13:47.826021 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:47.825925    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3db2d9d2-e00f-4bb8-a345-019ae0e308f6-cacerts" (OuterVolumeSpecName: "cacerts") pod "3db2d9d2-e00f-4bb8-a345-019ae0e308f6" (UID: "3db2d9d2-e00f-4bb8-a345-019ae0e308f6"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:13:47.924349 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:47.924307    2562 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/3db2d9d2-e00f-4bb8-a345-019ae0e308f6-istio-csr-ca-configmap\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:13:47.924349 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:47.924338    2562 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/3db2d9d2-e00f-4bb8-a345-019ae0e308f6-cacerts\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:13:47.924349 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:47.924348    2562 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/3db2d9d2-e00f-4bb8-a345-019ae0e308f6-istio-csr-dns-cert\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:13:47.924349 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:47.924357    2562 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/3db2d9d2-e00f-4bb8-a345-019ae0e308f6-istio-kubeconfig\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:13:47.924607 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:47.924366    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3db2d9d2-e00f-4bb8-a345-019ae0e308f6-istio-token\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:13:47.924607 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:47.924374    2562 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/3db2d9d2-e00f-4bb8-a345-019ae0e308f6-local-certs\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:13:47.924607 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:47.924381    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tf5vh\" (UniqueName: \"kubernetes.io/projected/3db2d9d2-e00f-4bb8-a345-019ae0e308f6-kube-api-access-tf5vh\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:13:48.313290 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:48.313255    2562 generic.go:356] "Generic (PLEG): container finished" podID="3db2d9d2-e00f-4bb8-a345-019ae0e308f6" containerID="6f6ac4a035a0eef6de15f3a66497c2096525d1d190a624adcdef991da43b66ec" exitCode=0
Jul 07 17:13:48.313813 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:48.313316    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-nh444"
Jul 07 17:13:48.313813 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:48.313335    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-nh444" event={"ID":"3db2d9d2-e00f-4bb8-a345-019ae0e308f6","Type":"ContainerDied","Data":"6f6ac4a035a0eef6de15f3a66497c2096525d1d190a624adcdef991da43b66ec"}
Jul 07 17:13:48.313813 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:48.313393    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-nh444" event={"ID":"3db2d9d2-e00f-4bb8-a345-019ae0e308f6","Type":"ContainerDied","Data":"9d5bb7d0eb94b326888dccb61cd47aea54fe4a64743a8c50e8847568410bad5c"}
Jul 07 17:13:48.313813 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:48.313416    2562 scope.go:117] "RemoveContainer" containerID="6f6ac4a035a0eef6de15f3a66497c2096525d1d190a624adcdef991da43b66ec"
Jul 07 17:13:48.321880 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:48.321862    2562 scope.go:117] "RemoveContainer" containerID="6f6ac4a035a0eef6de15f3a66497c2096525d1d190a624adcdef991da43b66ec"
Jul 07 17:13:48.322280 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:13:48.322259    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6f6ac4a035a0eef6de15f3a66497c2096525d1d190a624adcdef991da43b66ec\": container with ID starting with 6f6ac4a035a0eef6de15f3a66497c2096525d1d190a624adcdef991da43b66ec not found: ID does not exist" containerID="6f6ac4a035a0eef6de15f3a66497c2096525d1d190a624adcdef991da43b66ec"
Jul 07 17:13:48.322337 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:48.322291    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6f6ac4a035a0eef6de15f3a66497c2096525d1d190a624adcdef991da43b66ec"} err="failed to get container status \"6f6ac4a035a0eef6de15f3a66497c2096525d1d190a624adcdef991da43b66ec\": rpc error: code = NotFound desc = could not find container \"6f6ac4a035a0eef6de15f3a66497c2096525d1d190a624adcdef991da43b66ec\": container with ID starting with 6f6ac4a035a0eef6de15f3a66497c2096525d1d190a624adcdef991da43b66ec not found: ID does not exist"
Jul 07 17:13:48.340510 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:48.340475    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-nh444"]
Jul 07 17:13:48.348677 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:48.348649    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-nh444"]
Jul 07 17:13:49.227387 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:49.227349    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:13:49.410509 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:49.410472    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:13:49.845096 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:49.845056    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3db2d9d2-e00f-4bb8-a345-019ae0e308f6" path="/var/lib/kubelet/pods/3db2d9d2-e00f-4bb8-a345-019ae0e308f6/volumes"
Jul 07 17:13:51.634952 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:51.634905    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:13:51.717049 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:13:51.717016    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:14:31.781607 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:31.781574    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:14:31.878311 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:31.878277    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:14:31.901296 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:31.901261    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fhv9s"]
Jul 07 17:14:31.901534 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:31.901522    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3db2d9d2-e00f-4bb8-a345-019ae0e308f6" containerName="discovery"
Jul 07 17:14:31.901585 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:31.901535    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3db2d9d2-e00f-4bb8-a345-019ae0e308f6" containerName="discovery"
Jul 07 17:14:31.901585 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:31.901579    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="3db2d9d2-e00f-4bb8-a345-019ae0e308f6" containerName="discovery"
Jul 07 17:14:31.904258 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:31.904235    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fhv9s"
Jul 07 17:14:31.907522 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:31.907495    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-xwpn6\""
Jul 07 17:14:31.908279 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:31.908261    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\""
Jul 07 17:14:31.908279 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:31.908270    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\""
Jul 07 17:14:31.916385 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:31.916356    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fhv9s"]
Jul 07 17:14:31.952805 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:31.952773    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:14:31.974010 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:31.973968    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c46kj\" (UniqueName: \"kubernetes.io/projected/331076ea-58c9-4f8b-a7e7-aa8246dde140-kube-api-access-c46kj\") pod \"kuadrant-operator-catalog-fhv9s\" (UID: \"331076ea-58c9-4f8b-a7e7-aa8246dde140\") " pod="kuadrant-system/kuadrant-operator-catalog-fhv9s"
Jul 07 17:14:32.075547 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:32.075449    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c46kj\" (UniqueName: \"kubernetes.io/projected/331076ea-58c9-4f8b-a7e7-aa8246dde140-kube-api-access-c46kj\") pod \"kuadrant-operator-catalog-fhv9s\" (UID: \"331076ea-58c9-4f8b-a7e7-aa8246dde140\") " pod="kuadrant-system/kuadrant-operator-catalog-fhv9s"
Jul 07 17:14:32.085424 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:32.085390    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c46kj\" (UniqueName: \"kubernetes.io/projected/331076ea-58c9-4f8b-a7e7-aa8246dde140-kube-api-access-c46kj\") pod \"kuadrant-operator-catalog-fhv9s\" (UID: \"331076ea-58c9-4f8b-a7e7-aa8246dde140\") " pod="kuadrant-system/kuadrant-operator-catalog-fhv9s"
Jul 07 17:14:32.216398 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:32.216360    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fhv9s"
Jul 07 17:14:32.267791 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:32.267759    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fhv9s"]
Jul 07 17:14:32.353874 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:32.353850    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fhv9s"]
Jul 07 17:14:32.355928 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:14:32.355899    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod331076ea_58c9_4f8b_a7e7_aa8246dde140.slice/crio-98fb41f84199e9ea74132f1a438ca9437e07187cb5ece4c2fd856d3dfb0b0512 WatchSource:0}: Error finding container 98fb41f84199e9ea74132f1a438ca9437e07187cb5ece4c2fd856d3dfb0b0512: Status 404 returned error can't find the container with id 98fb41f84199e9ea74132f1a438ca9437e07187cb5ece4c2fd856d3dfb0b0512
Jul 07 17:14:32.481624 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:32.481582    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fhv9s" event={"ID":"331076ea-58c9-4f8b-a7e7-aa8246dde140","Type":"ContainerStarted","Data":"98fb41f84199e9ea74132f1a438ca9437e07187cb5ece4c2fd856d3dfb0b0512"}
Jul 07 17:14:32.486176 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:32.486128    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8bbxd"]
Jul 07 17:14:32.490605 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:32.490586    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8bbxd"
Jul 07 17:14:32.499274 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:32.499244    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8bbxd"]
Jul 07 17:14:32.579711 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:32.579668    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jb8kg\" (UniqueName: \"kubernetes.io/projected/3f6171be-c288-415e-99db-869bde16f7cd-kube-api-access-jb8kg\") pod \"kuadrant-operator-catalog-8bbxd\" (UID: \"3f6171be-c288-415e-99db-869bde16f7cd\") " pod="kuadrant-system/kuadrant-operator-catalog-8bbxd"
Jul 07 17:14:32.680834 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:32.680803    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jb8kg\" (UniqueName: \"kubernetes.io/projected/3f6171be-c288-415e-99db-869bde16f7cd-kube-api-access-jb8kg\") pod \"kuadrant-operator-catalog-8bbxd\" (UID: \"3f6171be-c288-415e-99db-869bde16f7cd\") " pod="kuadrant-system/kuadrant-operator-catalog-8bbxd"
Jul 07 17:14:32.690607 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:32.690570    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jb8kg\" (UniqueName: \"kubernetes.io/projected/3f6171be-c288-415e-99db-869bde16f7cd-kube-api-access-jb8kg\") pod \"kuadrant-operator-catalog-8bbxd\" (UID: \"3f6171be-c288-415e-99db-869bde16f7cd\") " pod="kuadrant-system/kuadrant-operator-catalog-8bbxd"
Jul 07 17:14:32.711905 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:32.711873    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:14:32.800573 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:32.800539    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-8bbxd"
Jul 07 17:14:32.932194 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:32.932030    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:14:32.953920 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:32.953777    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-8bbxd"]
Jul 07 17:14:32.965094 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:14:32.965051    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f6171be_c288_415e_99db_869bde16f7cd.slice/crio-6bc745acfc1e1827a6a64594d63370e61bfd67e2969eb4fbea75aaf9f32c65d4 WatchSource:0}: Error finding container 6bc745acfc1e1827a6a64594d63370e61bfd67e2969eb4fbea75aaf9f32c65d4: Status 404 returned error can't find the container with id 6bc745acfc1e1827a6a64594d63370e61bfd67e2969eb4fbea75aaf9f32c65d4
Jul 07 17:14:33.489473 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:33.489431    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8bbxd" event={"ID":"3f6171be-c288-415e-99db-869bde16f7cd","Type":"ContainerStarted","Data":"6bc745acfc1e1827a6a64594d63370e61bfd67e2969eb4fbea75aaf9f32c65d4"}
Jul 07 17:14:35.498799 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:35.498759    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fhv9s" event={"ID":"331076ea-58c9-4f8b-a7e7-aa8246dde140","Type":"ContainerStarted","Data":"04d37ba535f6d5829d01fef73b9e224d66b76fb66bc0a911735e85e4c211e7ca"}
Jul 07 17:14:35.499356 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:35.498818    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-fhv9s" podUID="331076ea-58c9-4f8b-a7e7-aa8246dde140" containerName="registry-server" containerID="cri-o://04d37ba535f6d5829d01fef73b9e224d66b76fb66bc0a911735e85e4c211e7ca" gracePeriod=2
Jul 07 17:14:35.500316 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:35.500281    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-8bbxd" event={"ID":"3f6171be-c288-415e-99db-869bde16f7cd","Type":"ContainerStarted","Data":"12f07d47098d7313484ed7fab94d558553df85f3fcbaa5f899ba064829aca292"}
Jul 07 17:14:35.521199 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:35.521123    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-fhv9s" podStartSLOduration=2.378871539 podStartE2EDuration="4.521106471s" totalImagesPullingTime="2.142234932s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:14:31 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:14:35.519922718 +0000 UTC m=+400.243175928" watchObservedRunningTime="2026-07-07 17:14:35.521106471 +0000 UTC m=+400.244359666"
Jul 07 17:14:35.547487 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:35.547430    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-8bbxd" podStartSLOduration=2.01148649 podStartE2EDuration="3.547410833s" totalImagesPullingTime="1.535924343s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:14:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:14:35.546408533 +0000 UTC m=+400.269661741" watchObservedRunningTime="2026-07-07 17:14:35.547410833 +0000 UTC m=+400.270664029"
Jul 07 17:14:35.737674 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:35.737642    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fhv9s"
Jul 07 17:14:35.807881 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:35.807784    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c46kj\" (UniqueName: \"kubernetes.io/projected/331076ea-58c9-4f8b-a7e7-aa8246dde140-kube-api-access-c46kj\") pod \"331076ea-58c9-4f8b-a7e7-aa8246dde140\" (UID: \"331076ea-58c9-4f8b-a7e7-aa8246dde140\") "
Jul 07 17:14:35.810013 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:35.809975    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/331076ea-58c9-4f8b-a7e7-aa8246dde140-kube-api-access-c46kj" (OuterVolumeSpecName: "kube-api-access-c46kj") pod "331076ea-58c9-4f8b-a7e7-aa8246dde140" (UID: "331076ea-58c9-4f8b-a7e7-aa8246dde140"). InnerVolumeSpecName "kube-api-access-c46kj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:14:35.908831 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:35.908788    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c46kj\" (UniqueName: \"kubernetes.io/projected/331076ea-58c9-4f8b-a7e7-aa8246dde140-kube-api-access-c46kj\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:14:36.509111 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:36.509071    2562 generic.go:356] "Generic (PLEG): container finished" podID="331076ea-58c9-4f8b-a7e7-aa8246dde140" containerID="04d37ba535f6d5829d01fef73b9e224d66b76fb66bc0a911735e85e4c211e7ca" exitCode=0
Jul 07 17:14:36.509539 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:36.509137    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-fhv9s"
Jul 07 17:14:36.509539 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:36.509169    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fhv9s" event={"ID":"331076ea-58c9-4f8b-a7e7-aa8246dde140","Type":"ContainerDied","Data":"04d37ba535f6d5829d01fef73b9e224d66b76fb66bc0a911735e85e4c211e7ca"}
Jul 07 17:14:36.509539 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:36.509246    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-fhv9s" event={"ID":"331076ea-58c9-4f8b-a7e7-aa8246dde140","Type":"ContainerDied","Data":"98fb41f84199e9ea74132f1a438ca9437e07187cb5ece4c2fd856d3dfb0b0512"}
Jul 07 17:14:36.509539 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:36.509267    2562 scope.go:117] "RemoveContainer" containerID="04d37ba535f6d5829d01fef73b9e224d66b76fb66bc0a911735e85e4c211e7ca"
Jul 07 17:14:36.517642 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:36.517619    2562 scope.go:117] "RemoveContainer" containerID="04d37ba535f6d5829d01fef73b9e224d66b76fb66bc0a911735e85e4c211e7ca"
Jul 07 17:14:36.517954 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:14:36.517933    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04d37ba535f6d5829d01fef73b9e224d66b76fb66bc0a911735e85e4c211e7ca\": container with ID starting with 04d37ba535f6d5829d01fef73b9e224d66b76fb66bc0a911735e85e4c211e7ca not found: ID does not exist" containerID="04d37ba535f6d5829d01fef73b9e224d66b76fb66bc0a911735e85e4c211e7ca"
Jul 07 17:14:36.518021 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:36.517963    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04d37ba535f6d5829d01fef73b9e224d66b76fb66bc0a911735e85e4c211e7ca"} err="failed to get container status \"04d37ba535f6d5829d01fef73b9e224d66b76fb66bc0a911735e85e4c211e7ca\": rpc error: code = NotFound desc = could not find container \"04d37ba535f6d5829d01fef73b9e224d66b76fb66bc0a911735e85e4c211e7ca\": container with ID starting with 04d37ba535f6d5829d01fef73b9e224d66b76fb66bc0a911735e85e4c211e7ca not found: ID does not exist"
Jul 07 17:14:36.529340 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:36.529313    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fhv9s"]
Jul 07 17:14:36.536024 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:36.536000    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-fhv9s"]
Jul 07 17:14:37.845573 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:37.845536    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="331076ea-58c9-4f8b-a7e7-aa8246dde140" path="/var/lib/kubelet/pods/331076ea-58c9-4f8b-a7e7-aa8246dde140/volumes"
Jul 07 17:14:42.801105 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:42.801056    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-8bbxd"
Jul 07 17:14:42.801558 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:42.801220    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-8bbxd"
Jul 07 17:14:42.823610 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:42.823582    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-8bbxd"
Jul 07 17:14:43.560882 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:43.560840    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-8bbxd"
Jul 07 17:14:44.305288 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:44.305252    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5dbfd647dc-cpj52"]
Jul 07 17:14:44.305772 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:44.305638    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="331076ea-58c9-4f8b-a7e7-aa8246dde140" containerName="registry-server"
Jul 07 17:14:44.305772 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:44.305659    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="331076ea-58c9-4f8b-a7e7-aa8246dde140" containerName="registry-server"
Jul 07 17:14:44.305772 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:44.305745    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="331076ea-58c9-4f8b-a7e7-aa8246dde140" containerName="registry-server"
Jul 07 17:14:44.309902 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:44.309878    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dbfd647dc-cpj52"
Jul 07 17:14:44.313941 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:44.313912    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\""
Jul 07 17:14:44.314082 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:44.313965    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\""
Jul 07 17:14:44.314082 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:44.313978    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\""
Jul 07 17:14:44.314082 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:44.313992    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\""
Jul 07 17:14:44.314905 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:44.314882    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\""
Jul 07 17:14:44.315012 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:44.314938    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\""
Jul 07 17:14:44.315356 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:44.315337    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\""
Jul 07 17:14:44.315444 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:44.315396    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-x89tt\""
Jul 07 17:14:44.319536 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:44.319517    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\""
Jul 07 17:14:44.333666 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:44.333632    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5dbfd647dc-cpj52"]
Jul 07 17:14:44.425508 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:44.425477    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:14:44.477384 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:44.477346    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6278r\" (UniqueName: \"kubernetes.io/projected/c3edf7f7-2daa-4174-89c6-fa29480ac438-kube-api-access-6278r\") pod \"console-5dbfd647dc-cpj52\" (UID: \"c3edf7f7-2daa-4174-89c6-fa29480ac438\") " pod="openshift-console/console-5dbfd647dc-cpj52"
Jul 07 17:14:44.477541 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:44.477391    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c3edf7f7-2daa-4174-89c6-fa29480ac438-service-ca\") pod \"console-5dbfd647dc-cpj52\" (UID: \"c3edf7f7-2daa-4174-89c6-fa29480ac438\") " pod="openshift-console/console-5dbfd647dc-cpj52"
Jul 07 17:14:44.477541 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:44.477410    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c3edf7f7-2daa-4174-89c6-fa29480ac438-oauth-serving-cert\") pod \"console-5dbfd647dc-cpj52\" (UID: \"c3edf7f7-2daa-4174-89c6-fa29480ac438\") " pod="openshift-console/console-5dbfd647dc-cpj52"
Jul 07 17:14:44.477541 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:44.477448    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c3edf7f7-2daa-4174-89c6-fa29480ac438-console-oauth-config\") pod \"console-5dbfd647dc-cpj52\" (UID: \"c3edf7f7-2daa-4174-89c6-fa29480ac438\") " pod="openshift-console/console-5dbfd647dc-cpj52"
Jul 07 17:14:44.477541 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:44.477464    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3edf7f7-2daa-4174-89c6-fa29480ac438-trusted-ca-bundle\") pod \"console-5dbfd647dc-cpj52\" (UID: \"c3edf7f7-2daa-4174-89c6-fa29480ac438\") " pod="openshift-console/console-5dbfd647dc-cpj52"
Jul 07 17:14:44.477541 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:44.477482    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c3edf7f7-2daa-4174-89c6-fa29480ac438-console-config\") pod \"console-5dbfd647dc-cpj52\" (UID: \"c3edf7f7-2daa-4174-89c6-fa29480ac438\") " pod="openshift-console/console-5dbfd647dc-cpj52"
Jul 07 17:14:44.477541 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:44.477505    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c3edf7f7-2daa-4174-89c6-fa29480ac438-console-serving-cert\") pod \"console-5dbfd647dc-cpj52\" (UID: \"c3edf7f7-2daa-4174-89c6-fa29480ac438\") " pod="openshift-console/console-5dbfd647dc-cpj52"
Jul 07 17:14:44.550451 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:44.550411    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:14:44.578669 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:44.578600    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6278r\" (UniqueName: \"kubernetes.io/projected/c3edf7f7-2daa-4174-89c6-fa29480ac438-kube-api-access-6278r\") pod \"console-5dbfd647dc-cpj52\" (UID: \"c3edf7f7-2daa-4174-89c6-fa29480ac438\") " pod="openshift-console/console-5dbfd647dc-cpj52"
Jul 07 17:14:44.578669 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:44.578639    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c3edf7f7-2daa-4174-89c6-fa29480ac438-service-ca\") pod \"console-5dbfd647dc-cpj52\" (UID: \"c3edf7f7-2daa-4174-89c6-fa29480ac438\") " pod="openshift-console/console-5dbfd647dc-cpj52"
Jul 07 17:14:44.578669 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:44.578660    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c3edf7f7-2daa-4174-89c6-fa29480ac438-oauth-serving-cert\") pod \"console-5dbfd647dc-cpj52\" (UID: \"c3edf7f7-2daa-4174-89c6-fa29480ac438\") " pod="openshift-console/console-5dbfd647dc-cpj52"
Jul 07 17:14:44.578845 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:44.578780    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c3edf7f7-2daa-4174-89c6-fa29480ac438-console-oauth-config\") pod \"console-5dbfd647dc-cpj52\" (UID: \"c3edf7f7-2daa-4174-89c6-fa29480ac438\") " pod="openshift-console/console-5dbfd647dc-cpj52"
Jul 07 17:14:44.578845 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:44.578818    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3edf7f7-2daa-4174-89c6-fa29480ac438-trusted-ca-bundle\") pod \"console-5dbfd647dc-cpj52\" (UID: \"c3edf7f7-2daa-4174-89c6-fa29480ac438\") " pod="openshift-console/console-5dbfd647dc-cpj52"
Jul 07 17:14:44.578969 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:44.578948    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c3edf7f7-2daa-4174-89c6-fa29480ac438-console-config\") pod \"console-5dbfd647dc-cpj52\" (UID: \"c3edf7f7-2daa-4174-89c6-fa29480ac438\") " pod="openshift-console/console-5dbfd647dc-cpj52"
Jul 07 17:14:44.579018 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:44.579004    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c3edf7f7-2daa-4174-89c6-fa29480ac438-console-serving-cert\") pod \"console-5dbfd647dc-cpj52\" (UID: \"c3edf7f7-2daa-4174-89c6-fa29480ac438\") " pod="openshift-console/console-5dbfd647dc-cpj52"
Jul 07 17:14:44.579452 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:44.579427    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c3edf7f7-2daa-4174-89c6-fa29480ac438-oauth-serving-cert\") pod \"console-5dbfd647dc-cpj52\" (UID: \"c3edf7f7-2daa-4174-89c6-fa29480ac438\") " pod="openshift-console/console-5dbfd647dc-cpj52"
Jul 07 17:14:44.579583 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:44.579535    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c3edf7f7-2daa-4174-89c6-fa29480ac438-service-ca\") pod \"console-5dbfd647dc-cpj52\" (UID: \"c3edf7f7-2daa-4174-89c6-fa29480ac438\") " pod="openshift-console/console-5dbfd647dc-cpj52"
Jul 07 17:14:44.579583 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:44.579573    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c3edf7f7-2daa-4174-89c6-fa29480ac438-console-config\") pod \"console-5dbfd647dc-cpj52\" (UID: \"c3edf7f7-2daa-4174-89c6-fa29480ac438\") " pod="openshift-console/console-5dbfd647dc-cpj52"
Jul 07 17:14:44.579800 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:44.579779    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c3edf7f7-2daa-4174-89c6-fa29480ac438-trusted-ca-bundle\") pod \"console-5dbfd647dc-cpj52\" (UID: \"c3edf7f7-2daa-4174-89c6-fa29480ac438\") " pod="openshift-console/console-5dbfd647dc-cpj52"
Jul 07 17:14:44.581417 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:44.581384    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c3edf7f7-2daa-4174-89c6-fa29480ac438-console-serving-cert\") pod \"console-5dbfd647dc-cpj52\" (UID: \"c3edf7f7-2daa-4174-89c6-fa29480ac438\") " pod="openshift-console/console-5dbfd647dc-cpj52"
Jul 07 17:14:44.581516 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:44.581497    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c3edf7f7-2daa-4174-89c6-fa29480ac438-console-oauth-config\") pod \"console-5dbfd647dc-cpj52\" (UID: \"c3edf7f7-2daa-4174-89c6-fa29480ac438\") " pod="openshift-console/console-5dbfd647dc-cpj52"
Jul 07 17:14:44.588345 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:44.588311    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6278r\" (UniqueName: \"kubernetes.io/projected/c3edf7f7-2daa-4174-89c6-fa29480ac438-kube-api-access-6278r\") pod \"console-5dbfd647dc-cpj52\" (UID: \"c3edf7f7-2daa-4174-89c6-fa29480ac438\") " pod="openshift-console/console-5dbfd647dc-cpj52"
Jul 07 17:14:44.621177 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:44.621127    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dbfd647dc-cpj52"
Jul 07 17:14:44.754577 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:44.754542    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5dbfd647dc-cpj52"]
Jul 07 17:14:44.757421 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:14:44.757394    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc3edf7f7_2daa_4174_89c6_fa29480ac438.slice/crio-9969e76e889b3a11318a3590c227fbad7f8d6896670e8cb72809367c26a301ea WatchSource:0}: Error finding container 9969e76e889b3a11318a3590c227fbad7f8d6896670e8cb72809367c26a301ea: Status 404 returned error can't find the container with id 9969e76e889b3a11318a3590c227fbad7f8d6896670e8cb72809367c26a301ea
Jul 07 17:14:45.549635 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:45.549598    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dbfd647dc-cpj52" event={"ID":"c3edf7f7-2daa-4174-89c6-fa29480ac438","Type":"ContainerStarted","Data":"c9077958773f94dc106ced3f0f07ed442d617eb6da5a1f88de31f5501e33a7e4"}
Jul 07 17:14:45.549635 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:45.549644    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dbfd647dc-cpj52" event={"ID":"c3edf7f7-2daa-4174-89c6-fa29480ac438","Type":"ContainerStarted","Data":"9969e76e889b3a11318a3590c227fbad7f8d6896670e8cb72809367c26a301ea"}
Jul 07 17:14:45.574843 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:45.574788    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5dbfd647dc-cpj52" podStartSLOduration=1.5747710430000001 podStartE2EDuration="1.574771043s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:14:44 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:14:45.572615165 +0000 UTC m=+410.295868364" watchObservedRunningTime="2026-07-07 17:14:45.574771043 +0000 UTC m=+410.298024238"
Jul 07 17:14:54.622263 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:54.622224    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5dbfd647dc-cpj52"
Jul 07 17:14:54.622720 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:54.622289    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5dbfd647dc-cpj52"
Jul 07 17:14:54.627080 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:54.627056    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5dbfd647dc-cpj52"
Jul 07 17:14:55.594109 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:55.594078    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5dbfd647dc-cpj52"
Jul 07 17:14:55.777972 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:55.777908    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:14:55.848227 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:14:55.848121    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:15:00.843077 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:00.843047    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:15:03.491877 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:03.491842    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-xjbxl"]
Jul 07 17:15:03.496137 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:03.496119    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xjbxl"
Jul 07 17:15:03.499441 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:03.499407    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\""
Jul 07 17:15:03.499567 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:03.499491    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-4hvdc\""
Jul 07 17:15:03.514314 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:03.514286    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-xjbxl"]
Jul 07 17:15:03.531808 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:03.531774    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8vxpk\" (UniqueName: \"kubernetes.io/projected/1c8f7d52-5743-4342-b497-b0008d71213d-kube-api-access-8vxpk\") pod \"dns-operator-controller-manager-864dd78c4c-xjbxl\" (UID: \"1c8f7d52-5743-4342-b497-b0008d71213d\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xjbxl"
Jul 07 17:15:03.633190 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:03.633136    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8vxpk\" (UniqueName: \"kubernetes.io/projected/1c8f7d52-5743-4342-b497-b0008d71213d-kube-api-access-8vxpk\") pod \"dns-operator-controller-manager-864dd78c4c-xjbxl\" (UID: \"1c8f7d52-5743-4342-b497-b0008d71213d\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xjbxl"
Jul 07 17:15:03.647187 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:03.647120    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8vxpk\" (UniqueName: \"kubernetes.io/projected/1c8f7d52-5743-4342-b497-b0008d71213d-kube-api-access-8vxpk\") pod \"dns-operator-controller-manager-864dd78c4c-xjbxl\" (UID: \"1c8f7d52-5743-4342-b497-b0008d71213d\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xjbxl"
Jul 07 17:15:03.806109 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:03.806013    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xjbxl"
Jul 07 17:15:03.941552 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:03.941521    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-xjbxl"]
Jul 07 17:15:03.942790 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:15:03.942760    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c8f7d52_5743_4342_b497_b0008d71213d.slice/crio-5e87e4cf800a5c91137375b134e810f4477728b3e51325549fa370ea1e922890 WatchSource:0}: Error finding container 5e87e4cf800a5c91137375b134e810f4477728b3e51325549fa370ea1e922890: Status 404 returned error can't find the container with id 5e87e4cf800a5c91137375b134e810f4477728b3e51325549fa370ea1e922890
Jul 07 17:15:04.235932 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:04.235899    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:15:04.628046 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:04.628011    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xjbxl" event={"ID":"1c8f7d52-5743-4342-b497-b0008d71213d","Type":"ContainerStarted","Data":"5e87e4cf800a5c91137375b134e810f4477728b3e51325549fa370ea1e922890"}
Jul 07 17:15:05.038541 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:05.038438    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:15:06.638272 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:06.638232    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xjbxl" event={"ID":"1c8f7d52-5743-4342-b497-b0008d71213d","Type":"ContainerStarted","Data":"9b7f88b2a6d08b565c68972eb087e81b42e6653ea5507666d225429a7a1f7eaf"}
Jul 07 17:15:06.638726 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:06.638303    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xjbxl"
Jul 07 17:15:06.657197 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:06.657129    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xjbxl" podStartSLOduration=1.179754978 podStartE2EDuration="3.657113958s" totalImagesPullingTime="2.47735898s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:15:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:15:06.656172837 +0000 UTC m=+431.379426029" watchObservedRunningTime="2026-07-07 17:15:06.657113958 +0000 UTC m=+431.380367154"
Jul 07 17:15:07.547380 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:07.547346    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-9cwjl"]
Jul 07 17:15:07.550684 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:07.550660    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9cwjl"
Jul 07 17:15:07.553820 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:07.553792    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-j6bzd\""
Jul 07 17:15:07.560268 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:07.560242    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-9cwjl"]
Jul 07 17:15:07.562259 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:07.562235    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5ndh\" (UniqueName: \"kubernetes.io/projected/a57c5767-30a4-4804-b12a-406fa1899eec-kube-api-access-f5ndh\") pod \"authorino-operator-75cc8d5cb7-9cwjl\" (UID: \"a57c5767-30a4-4804-b12a-406fa1899eec\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-9cwjl"
Jul 07 17:15:07.662912 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:07.662876    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5ndh\" (UniqueName: \"kubernetes.io/projected/a57c5767-30a4-4804-b12a-406fa1899eec-kube-api-access-f5ndh\") pod \"authorino-operator-75cc8d5cb7-9cwjl\" (UID: \"a57c5767-30a4-4804-b12a-406fa1899eec\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-9cwjl"
Jul 07 17:15:07.676509 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:07.676482    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5ndh\" (UniqueName: \"kubernetes.io/projected/a57c5767-30a4-4804-b12a-406fa1899eec-kube-api-access-f5ndh\") pod \"authorino-operator-75cc8d5cb7-9cwjl\" (UID: \"a57c5767-30a4-4804-b12a-406fa1899eec\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-9cwjl"
Jul 07 17:15:07.862281 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:07.862193    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9cwjl"
Jul 07 17:15:07.996108 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:07.996084    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-9cwjl"]
Jul 07 17:15:07.998768 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:15:07.998739    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda57c5767_30a4_4804_b12a_406fa1899eec.slice/crio-5331b3fd29e89ab621fa03b127eb2fbdf40cfbd65283853bf1ec0458939a8fc2 WatchSource:0}: Error finding container 5331b3fd29e89ab621fa03b127eb2fbdf40cfbd65283853bf1ec0458939a8fc2: Status 404 returned error can't find the container with id 5331b3fd29e89ab621fa03b127eb2fbdf40cfbd65283853bf1ec0458939a8fc2
Jul 07 17:15:08.634611 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:08.634579    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:15:08.647325 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:08.647285    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9cwjl" event={"ID":"a57c5767-30a4-4804-b12a-406fa1899eec","Type":"ContainerStarted","Data":"5331b3fd29e89ab621fa03b127eb2fbdf40cfbd65283853bf1ec0458939a8fc2"}
Jul 07 17:15:08.873088 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:08.873051    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:15:09.033647 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:09.033559    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:15:10.658570 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:10.658533    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9cwjl" event={"ID":"a57c5767-30a4-4804-b12a-406fa1899eec","Type":"ContainerStarted","Data":"61b99f144f29dc09072af3a820c607af77d0ddcadaa0e24e069e8a4b3f55835c"}
Jul 07 17:15:10.659035 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:10.658661    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9cwjl"
Jul 07 17:15:10.684636 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:10.684587    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9cwjl" podStartSLOduration=1.439062976 podStartE2EDuration="3.684569354s" totalImagesPullingTime="2.245506378s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:15:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:15:10.682562232 +0000 UTC m=+435.405815427" watchObservedRunningTime="2026-07-07 17:15:10.684569354 +0000 UTC m=+435.407822548"
Jul 07 17:15:10.844331 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:10.844299    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sgzvd"]
Jul 07 17:15:10.847694 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:10.847671    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sgzvd"
Jul 07 17:15:10.850765 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:10.850741    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-k8wdw\""
Jul 07 17:15:10.863539 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:10.863516    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sgzvd"]
Jul 07 17:15:10.878672 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:10.878646    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:15:10.890365 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:10.890338    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2hkp\" (UniqueName: \"kubernetes.io/projected/a94b9992-b23d-4794-ae55-2b90f611f92e-kube-api-access-z2hkp\") pod \"limitador-operator-controller-manager-859d7b78bd-sgzvd\" (UID: \"a94b9992-b23d-4794-ae55-2b90f611f92e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sgzvd"
Jul 07 17:15:10.990814 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:10.990722    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2hkp\" (UniqueName: \"kubernetes.io/projected/a94b9992-b23d-4794-ae55-2b90f611f92e-kube-api-access-z2hkp\") pod \"limitador-operator-controller-manager-859d7b78bd-sgzvd\" (UID: \"a94b9992-b23d-4794-ae55-2b90f611f92e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sgzvd"
Jul 07 17:15:11.000849 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:11.000817    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2hkp\" (UniqueName: \"kubernetes.io/projected/a94b9992-b23d-4794-ae55-2b90f611f92e-kube-api-access-z2hkp\") pod \"limitador-operator-controller-manager-859d7b78bd-sgzvd\" (UID: \"a94b9992-b23d-4794-ae55-2b90f611f92e\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sgzvd"
Jul 07 17:15:11.157859 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:11.157812    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sgzvd"
Jul 07 17:15:11.292226 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:11.292138    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sgzvd"]
Jul 07 17:15:11.294601 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:15:11.294573    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda94b9992_b23d_4794_ae55_2b90f611f92e.slice/crio-415003cd960ad1bb932c514c2371f9c7bdca94f8a5b9e897a60b0aa70fef7872 WatchSource:0}: Error finding container 415003cd960ad1bb932c514c2371f9c7bdca94f8a5b9e897a60b0aa70fef7872: Status 404 returned error can't find the container with id 415003cd960ad1bb932c514c2371f9c7bdca94f8a5b9e897a60b0aa70fef7872
Jul 07 17:15:11.415853 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:11.415825    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:15:11.669987 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:11.669952    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sgzvd" event={"ID":"a94b9992-b23d-4794-ae55-2b90f611f92e","Type":"ContainerStarted","Data":"415003cd960ad1bb932c514c2371f9c7bdca94f8a5b9e897a60b0aa70fef7872"}
Jul 07 17:15:11.894384 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:11.894297    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:15:13.862688 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:13.862652    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:15:14.687255 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:14.687214    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sgzvd" event={"ID":"a94b9992-b23d-4794-ae55-2b90f611f92e","Type":"ContainerStarted","Data":"097f6fb06caea893fc298cb27388239d62e7d9af66e0642d2a526773de9abb94"}
Jul 07 17:15:14.687414 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:14.687388    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sgzvd"
Jul 07 17:15:14.709498 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:14.709443    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sgzvd" podStartSLOduration=1.858706019 podStartE2EDuration="4.709428187s" totalImagesPullingTime="2.850722168s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:15:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:15:14.708704303 +0000 UTC m=+439.431957499" watchObservedRunningTime="2026-07-07 17:15:14.709428187 +0000 UTC m=+439.432681382"
Jul 07 17:15:15.598041 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:15.597999    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgwd8"]
Jul 07 17:15:15.601355 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:15.601332    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgwd8"
Jul 07 17:15:15.604168 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:15.604137    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-bq2nk\""
Jul 07 17:15:15.615435 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:15.615408    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgwd8"]
Jul 07 17:15:15.631181 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:15.631120    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/51dc8934-1f9c-4047-bc0c-dd8901113db2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lgwd8\" (UID: \"51dc8934-1f9c-4047-bc0c-dd8901113db2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgwd8"
Jul 07 17:15:15.631325 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:15.631189    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z5c8m\" (UniqueName: \"kubernetes.io/projected/51dc8934-1f9c-4047-bc0c-dd8901113db2-kube-api-access-z5c8m\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lgwd8\" (UID: \"51dc8934-1f9c-4047-bc0c-dd8901113db2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgwd8"
Jul 07 17:15:15.732143 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:15.732101    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/51dc8934-1f9c-4047-bc0c-dd8901113db2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lgwd8\" (UID: \"51dc8934-1f9c-4047-bc0c-dd8901113db2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgwd8"
Jul 07 17:15:15.732143 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:15.732146    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z5c8m\" (UniqueName: \"kubernetes.io/projected/51dc8934-1f9c-4047-bc0c-dd8901113db2-kube-api-access-z5c8m\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lgwd8\" (UID: \"51dc8934-1f9c-4047-bc0c-dd8901113db2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgwd8"
Jul 07 17:15:15.732608 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:15.732571    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/51dc8934-1f9c-4047-bc0c-dd8901113db2-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lgwd8\" (UID: \"51dc8934-1f9c-4047-bc0c-dd8901113db2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgwd8"
Jul 07 17:15:15.741984 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:15.741965    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-z5c8m\" (UniqueName: \"kubernetes.io/projected/51dc8934-1f9c-4047-bc0c-dd8901113db2-kube-api-access-z5c8m\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lgwd8\" (UID: \"51dc8934-1f9c-4047-bc0c-dd8901113db2\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgwd8"
Jul 07 17:15:15.911571 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:15.911543    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgwd8"
Jul 07 17:15:16.043209 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:16.043184    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgwd8"]
Jul 07 17:15:16.045940 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:15:16.045914    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod51dc8934_1f9c_4047_bc0c_dd8901113db2.slice/crio-39c0fb470b84cc502de9ee85eb509e5a146dc0708a23ad72ed141d66a72ca260 WatchSource:0}: Error finding container 39c0fb470b84cc502de9ee85eb509e5a146dc0708a23ad72ed141d66a72ca260: Status 404 returned error can't find the container with id 39c0fb470b84cc502de9ee85eb509e5a146dc0708a23ad72ed141d66a72ca260
Jul 07 17:15:16.697542 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:16.697504    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgwd8" event={"ID":"51dc8934-1f9c-4047-bc0c-dd8901113db2","Type":"ContainerStarted","Data":"39c0fb470b84cc502de9ee85eb509e5a146dc0708a23ad72ed141d66a72ca260"}
Jul 07 17:15:16.854889 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:16.854847    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:15:16.969784 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:16.969683    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:15:17.645119 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:17.645092    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-xjbxl"
Jul 07 17:15:21.672321 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:21.672289    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-9cwjl"
Jul 07 17:15:22.260182 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:22.260129    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:15:22.363286 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:22.363251    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:15:22.625032 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:22.625003    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:15:22.728684 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:22.728652    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:15:24.735402 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:24.735301    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgwd8" event={"ID":"51dc8934-1f9c-4047-bc0c-dd8901113db2","Type":"ContainerStarted","Data":"d3ca4bb24debee5fc262f38452b4d9c5fdf64373dc21d88eee1604b5fa1ea023"}
Jul 07 17:15:24.735841 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:24.735476    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgwd8"
Jul 07 17:15:24.757165 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:24.757104    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgwd8" podStartSLOduration=1.34736265 podStartE2EDuration="9.757088289s" totalImagesPullingTime="8.409725639s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:15:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:15:24.755080552 +0000 UTC m=+449.478333748" watchObservedRunningTime="2026-07-07 17:15:24.757088289 +0000 UTC m=+449.480341534"
Jul 07 17:15:25.693711 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:25.693680    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sgzvd"
Jul 07 17:15:26.478538 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:26.478509    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:15:26.580340 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:26.580303    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:15:27.282861 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:27.282834    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:15:27.377376 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:27.377339    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:15:28.784296 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:28.784258    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:15:28.885316 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:28.885273    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:15:30.893191 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:30.893163    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:15:30.993126 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:30.993092    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:15:35.494468 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:35.494432    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:15:35.598973 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:35.598944    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:15:35.741918 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:35.741890    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgwd8"
Jul 07 17:15:37.671587 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:37.671556    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-krm56"]
Jul 07 17:15:37.675287 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:37.675264    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-krm56"
Jul 07 17:15:37.689424 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:37.689397    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-krm56"]
Jul 07 17:15:37.774559 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:37.774518    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-krm56"]
Jul 07 17:15:37.774816 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:15:37.774791    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-vxsr2], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-krm56" podUID="0d524351-106b-4ccc-aaf7-3c1399d1674f"
Jul 07 17:15:37.792579 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:37.792542    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-krm56"
Jul 07 17:15:37.799073 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:37.799050    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-krm56"
Jul 07 17:15:37.811458 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:37.811415    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vxsr2\" (UniqueName: \"kubernetes.io/projected/0d524351-106b-4ccc-aaf7-3c1399d1674f-kube-api-access-vxsr2\") pod \"kuadrant-operator-controller-manager-55467d9f7-krm56\" (UID: \"0d524351-106b-4ccc-aaf7-3c1399d1674f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-krm56"
Jul 07 17:15:37.811633 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:37.811539    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0d524351-106b-4ccc-aaf7-3c1399d1674f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-krm56\" (UID: \"0d524351-106b-4ccc-aaf7-3c1399d1674f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-krm56"
Jul 07 17:15:37.813137 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:37.813117    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lttmr"]
Jul 07 17:15:37.816102 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:37.816085    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lttmr"
Jul 07 17:15:37.827872 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:37.827844    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lttmr"]
Jul 07 17:15:37.854662 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:37.854632    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-krm56"]
Jul 07 17:15:37.861345 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:37.861318    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-krm56"]
Jul 07 17:15:37.877593 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:37.877566    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgwd8"]
Jul 07 17:15:37.877769 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:37.877745    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgwd8" podUID="51dc8934-1f9c-4047-bc0c-dd8901113db2" containerName="manager" containerID="cri-o://d3ca4bb24debee5fc262f38452b4d9c5fdf64373dc21d88eee1604b5fa1ea023" gracePeriod=2
Jul 07 17:15:37.881278 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:15:37.881194    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lgwd8\" is forbidden: User \"system:node:ip-10-0-140-36.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-36.ec2.internal' and this object" podUID="51dc8934-1f9c-4047-bc0c-dd8901113db2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgwd8"
Jul 07 17:15:37.881592 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:37.881566    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgwd8"]
Jul 07 17:15:37.892366 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:37.892325    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lttmr"]
Jul 07 17:15:37.892615 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:15:37.892597    2562 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-jlt6v], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lttmr" podUID="37fde57f-4428-454e-b26f-f988b83a89af"
Jul 07 17:15:37.897797 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:37.897752    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lttmr"]
Jul 07 17:15:37.908169 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:37.908130    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kmc5b"]
Jul 07 17:15:37.908498 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:37.908484    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="51dc8934-1f9c-4047-bc0c-dd8901113db2" containerName="manager"
Jul 07 17:15:37.908542 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:37.908500    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="51dc8934-1f9c-4047-bc0c-dd8901113db2" containerName="manager"
Jul 07 17:15:37.908571 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:37.908558    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="51dc8934-1f9c-4047-bc0c-dd8901113db2" containerName="manager"
Jul 07 17:15:37.911547 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:37.911524    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sgzvd"]
Jul 07 17:15:37.911671 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:37.911643    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kmc5b"
Jul 07 17:15:37.912019 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:37.911806    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sgzvd" podUID="a94b9992-b23d-4794-ae55-2b90f611f92e" containerName="manager" containerID="cri-o://097f6fb06caea893fc298cb27388239d62e7d9af66e0642d2a526773de9abb94" gracePeriod=2
Jul 07 17:15:37.912019 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:37.911997    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jlt6v\" (UniqueName: \"kubernetes.io/projected/37fde57f-4428-454e-b26f-f988b83a89af-kube-api-access-jlt6v\") pod \"kuadrant-operator-controller-manager-86878c769f-lttmr\" (UID: \"37fde57f-4428-454e-b26f-f988b83a89af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lttmr"
Jul 07 17:15:37.912232 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:37.912116    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/37fde57f-4428-454e-b26f-f988b83a89af-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-lttmr\" (UID: \"37fde57f-4428-454e-b26f-f988b83a89af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lttmr"
Jul 07 17:15:37.912292 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:37.912227    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vxsr2\" (UniqueName: \"kubernetes.io/projected/0d524351-106b-4ccc-aaf7-3c1399d1674f-kube-api-access-vxsr2\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:15:37.912292 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:37.912262    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0d524351-106b-4ccc-aaf7-3c1399d1674f-extensions-socket-volume\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:15:37.920815 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:37.920779    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sgzvd"]
Jul 07 17:15:37.925765 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:15:37.925673    2562 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"a94b9992-b23d-4794-ae55-2b90f611f92e\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-sgzvd\": pods \"limitador-operator-controller-manager-859d7b78bd-sgzvd\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sgzvd"
Jul 07 17:15:37.926829 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:37.926798    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vc6qq"]
Jul 07 17:15:37.927874 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:37.927832    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a94b9992-b23d-4794-ae55-2b90f611f92e" containerName="manager"
Jul 07 17:15:37.927874 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:37.927855    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="a94b9992-b23d-4794-ae55-2b90f611f92e" containerName="manager"
Jul 07 17:15:37.928041 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:37.927992    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="a94b9992-b23d-4794-ae55-2b90f611f92e" containerName="manager"
Jul 07 17:15:37.928041 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:15:37.928009    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lgwd8\" is forbidden: User \"system:node:ip-10-0-140-36.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-36.ec2.internal' and this object" podUID="51dc8934-1f9c-4047-bc0c-dd8901113db2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgwd8"
Jul 07 17:15:37.931416 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:37.931379    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kmc5b"]
Jul 07 17:15:37.931539 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:37.931512    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vc6qq"
Jul 07 17:15:37.951021 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:37.949849    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9xnxv"]
Jul 07 17:15:37.955223 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:37.955091    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9xnxv"
Jul 07 17:15:37.955386 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:37.955290    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vc6qq"]
Jul 07 17:15:37.955764 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:15:37.955732    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-sgzvd\" is forbidden: User \"system:node:ip-10-0-140-36.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-36.ec2.internal' and this object" podUID="a94b9992-b23d-4794-ae55-2b90f611f92e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sgzvd"
Jul 07 17:15:37.958299 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:15:37.958273    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lgwd8\" is forbidden: User \"system:node:ip-10-0-140-36.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-36.ec2.internal' and this object" podUID="51dc8934-1f9c-4047-bc0c-dd8901113db2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgwd8"
Jul 07 17:15:37.963908 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:37.963879    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9xnxv"]
Jul 07 17:15:37.996930 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:15:37.996760    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-sgzvd\" is forbidden: User \"system:node:ip-10-0-140-36.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-36.ec2.internal' and this object" podUID="a94b9992-b23d-4794-ae55-2b90f611f92e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sgzvd"
Jul 07 17:15:37.998705 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:15:37.998674    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lgwd8\" is forbidden: User \"system:node:ip-10-0-140-36.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-36.ec2.internal' and this object" podUID="51dc8934-1f9c-4047-bc0c-dd8901113db2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgwd8"
Jul 07 17:15:38.012899 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:38.012871    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/89e55097-87b6-4e2c-a8dc-a9549172f8f3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vc6qq\" (UID: \"89e55097-87b6-4e2c-a8dc-a9549172f8f3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vc6qq"
Jul 07 17:15:38.013006 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:38.012906    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pl4nz\" (UniqueName: \"kubernetes.io/projected/89e55097-87b6-4e2c-a8dc-a9549172f8f3-kube-api-access-pl4nz\") pod \"kuadrant-operator-controller-manager-86878c769f-vc6qq\" (UID: \"89e55097-87b6-4e2c-a8dc-a9549172f8f3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vc6qq"
Jul 07 17:15:38.013006 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:38.012931    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f3d7a41a-4d5b-4307-99a1-80dfb045e376-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kmc5b\" (UID: \"f3d7a41a-4d5b-4307-99a1-80dfb045e376\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kmc5b"
Jul 07 17:15:38.013006 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:38.012965    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tjscl\" (UniqueName: \"kubernetes.io/projected/f3d7a41a-4d5b-4307-99a1-80dfb045e376-kube-api-access-tjscl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kmc5b\" (UID: \"f3d7a41a-4d5b-4307-99a1-80dfb045e376\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kmc5b"
Jul 07 17:15:38.013006 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:38.012992    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/37fde57f-4428-454e-b26f-f988b83a89af-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-lttmr\" (UID: \"37fde57f-4428-454e-b26f-f988b83a89af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lttmr"
Jul 07 17:15:38.013245 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:38.013041    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7n2v8\" (UniqueName: \"kubernetes.io/projected/c4526c3c-5ede-4598-8432-69123eed54a8-kube-api-access-7n2v8\") pod \"limitador-operator-controller-manager-859d7b78bd-9xnxv\" (UID: \"c4526c3c-5ede-4598-8432-69123eed54a8\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9xnxv"
Jul 07 17:15:38.013245 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:38.013068    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlt6v\" (UniqueName: \"kubernetes.io/projected/37fde57f-4428-454e-b26f-f988b83a89af-kube-api-access-jlt6v\") pod \"kuadrant-operator-controller-manager-86878c769f-lttmr\" (UID: \"37fde57f-4428-454e-b26f-f988b83a89af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lttmr"
Jul 07 17:15:38.013355 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:38.013297    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/37fde57f-4428-454e-b26f-f988b83a89af-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-lttmr\" (UID: \"37fde57f-4428-454e-b26f-f988b83a89af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lttmr"
Jul 07 17:15:38.018713 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:15:38.018686    2562 projected.go:196] Error preparing data for projected volume kube-api-access-jlt6v for pod kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lttmr: failed to fetch token: pod "kuadrant-operator-controller-manager-86878c769f-lttmr" not found
Jul 07 17:15:38.018827 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:15:38.018771    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/37fde57f-4428-454e-b26f-f988b83a89af-kube-api-access-jlt6v podName:37fde57f-4428-454e-b26f-f988b83a89af nodeName:}" failed. No retries permitted until 2026-07-07 17:15:38.518751036 +0000 UTC m=+463.242004212 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-jlt6v" (UniqueName: "kubernetes.io/projected/37fde57f-4428-454e-b26f-f988b83a89af-kube-api-access-jlt6v") pod "kuadrant-operator-controller-manager-86878c769f-lttmr" (UID: "37fde57f-4428-454e-b26f-f988b83a89af") : failed to fetch token: pod "kuadrant-operator-controller-manager-86878c769f-lttmr" not found
Jul 07 17:15:38.114414 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:38.114381    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/89e55097-87b6-4e2c-a8dc-a9549172f8f3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vc6qq\" (UID: \"89e55097-87b6-4e2c-a8dc-a9549172f8f3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vc6qq"
Jul 07 17:15:38.114414 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:38.114419    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pl4nz\" (UniqueName: \"kubernetes.io/projected/89e55097-87b6-4e2c-a8dc-a9549172f8f3-kube-api-access-pl4nz\") pod \"kuadrant-operator-controller-manager-86878c769f-vc6qq\" (UID: \"89e55097-87b6-4e2c-a8dc-a9549172f8f3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vc6qq"
Jul 07 17:15:38.114674 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:38.114442    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f3d7a41a-4d5b-4307-99a1-80dfb045e376-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kmc5b\" (UID: \"f3d7a41a-4d5b-4307-99a1-80dfb045e376\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kmc5b"
Jul 07 17:15:38.114674 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:38.114457    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tjscl\" (UniqueName: \"kubernetes.io/projected/f3d7a41a-4d5b-4307-99a1-80dfb045e376-kube-api-access-tjscl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kmc5b\" (UID: \"f3d7a41a-4d5b-4307-99a1-80dfb045e376\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kmc5b"
Jul 07 17:15:38.114674 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:38.114627    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7n2v8\" (UniqueName: \"kubernetes.io/projected/c4526c3c-5ede-4598-8432-69123eed54a8-kube-api-access-7n2v8\") pod \"limitador-operator-controller-manager-859d7b78bd-9xnxv\" (UID: \"c4526c3c-5ede-4598-8432-69123eed54a8\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9xnxv"
Jul 07 17:15:38.114842 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:38.114823    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/89e55097-87b6-4e2c-a8dc-a9549172f8f3-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-vc6qq\" (UID: \"89e55097-87b6-4e2c-a8dc-a9549172f8f3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vc6qq"
Jul 07 17:15:38.115253 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:38.115229    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f3d7a41a-4d5b-4307-99a1-80dfb045e376-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kmc5b\" (UID: \"f3d7a41a-4d5b-4307-99a1-80dfb045e376\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kmc5b"
Jul 07 17:15:38.125955 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:38.125925    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tjscl\" (UniqueName: \"kubernetes.io/projected/f3d7a41a-4d5b-4307-99a1-80dfb045e376-kube-api-access-tjscl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-kmc5b\" (UID: \"f3d7a41a-4d5b-4307-99a1-80dfb045e376\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kmc5b"
Jul 07 17:15:38.126326 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:38.126304    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7n2v8\" (UniqueName: \"kubernetes.io/projected/c4526c3c-5ede-4598-8432-69123eed54a8-kube-api-access-7n2v8\") pod \"limitador-operator-controller-manager-859d7b78bd-9xnxv\" (UID: \"c4526c3c-5ede-4598-8432-69123eed54a8\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9xnxv"
Jul 07 17:15:38.126839 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:38.126814    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pl4nz\" (UniqueName: \"kubernetes.io/projected/89e55097-87b6-4e2c-a8dc-a9549172f8f3-kube-api-access-pl4nz\") pod \"kuadrant-operator-controller-manager-86878c769f-vc6qq\" (UID: \"89e55097-87b6-4e2c-a8dc-a9549172f8f3\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vc6qq"
Jul 07 17:15:38.160822 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:38.160793    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgwd8"
Jul 07 17:15:38.162768 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:38.162750    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sgzvd"
Jul 07 17:15:38.162942 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:15:38.162919    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-sgzvd\" is forbidden: User \"system:node:ip-10-0-140-36.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-36.ec2.internal' and this object" podUID="a94b9992-b23d-4794-ae55-2b90f611f92e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sgzvd"
Jul 07 17:15:38.164726 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:15:38.164703    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lgwd8\" is forbidden: User \"system:node:ip-10-0-140-36.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-36.ec2.internal' and this object" podUID="51dc8934-1f9c-4047-bc0c-dd8901113db2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgwd8"
Jul 07 17:15:38.166480 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:15:38.166461    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-sgzvd\" is forbidden: User \"system:node:ip-10-0-140-36.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-36.ec2.internal' and this object" podUID="a94b9992-b23d-4794-ae55-2b90f611f92e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sgzvd"
Jul 07 17:15:38.168185 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:15:38.168168    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lgwd8\" is forbidden: User \"system:node:ip-10-0-140-36.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-36.ec2.internal' and this object" podUID="51dc8934-1f9c-4047-bc0c-dd8901113db2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgwd8"
Jul 07 17:15:38.215529 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:38.215435    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z2hkp\" (UniqueName: \"kubernetes.io/projected/a94b9992-b23d-4794-ae55-2b90f611f92e-kube-api-access-z2hkp\") pod \"a94b9992-b23d-4794-ae55-2b90f611f92e\" (UID: \"a94b9992-b23d-4794-ae55-2b90f611f92e\") "
Jul 07 17:15:38.215529 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:38.215477    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z5c8m\" (UniqueName: \"kubernetes.io/projected/51dc8934-1f9c-4047-bc0c-dd8901113db2-kube-api-access-z5c8m\") pod \"51dc8934-1f9c-4047-bc0c-dd8901113db2\" (UID: \"51dc8934-1f9c-4047-bc0c-dd8901113db2\") "
Jul 07 17:15:38.215529 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:38.215508    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/51dc8934-1f9c-4047-bc0c-dd8901113db2-extensions-socket-volume\") pod \"51dc8934-1f9c-4047-bc0c-dd8901113db2\" (UID: \"51dc8934-1f9c-4047-bc0c-dd8901113db2\") "
Jul 07 17:15:38.216077 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:38.216038    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/51dc8934-1f9c-4047-bc0c-dd8901113db2-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "51dc8934-1f9c-4047-bc0c-dd8901113db2" (UID: "51dc8934-1f9c-4047-bc0c-dd8901113db2"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:15:38.217776 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:38.217751    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a94b9992-b23d-4794-ae55-2b90f611f92e-kube-api-access-z2hkp" (OuterVolumeSpecName: "kube-api-access-z2hkp") pod "a94b9992-b23d-4794-ae55-2b90f611f92e" (UID: "a94b9992-b23d-4794-ae55-2b90f611f92e"). InnerVolumeSpecName "kube-api-access-z2hkp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:15:38.217855 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:38.217772    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/51dc8934-1f9c-4047-bc0c-dd8901113db2-kube-api-access-z5c8m" (OuterVolumeSpecName: "kube-api-access-z5c8m") pod "51dc8934-1f9c-4047-bc0c-dd8901113db2" (UID: "51dc8934-1f9c-4047-bc0c-dd8901113db2"). InnerVolumeSpecName "kube-api-access-z5c8m". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:15:38.306724 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:38.306688    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kmc5b"
Jul 07 17:15:38.313806 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:38.313782    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vc6qq"
Jul 07 17:15:38.316296 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:38.316270    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z2hkp\" (UniqueName: \"kubernetes.io/projected/a94b9992-b23d-4794-ae55-2b90f611f92e-kube-api-access-z2hkp\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:15:38.316296 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:38.316295    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z5c8m\" (UniqueName: \"kubernetes.io/projected/51dc8934-1f9c-4047-bc0c-dd8901113db2-kube-api-access-z5c8m\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:15:38.316485 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:38.316305    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/51dc8934-1f9c-4047-bc0c-dd8901113db2-extensions-socket-volume\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:15:38.319759 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:38.319731    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9xnxv"
Jul 07 17:15:38.490845 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:38.490765    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kmc5b"]
Jul 07 17:15:38.494343 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:15:38.494314    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3d7a41a_4d5b_4307_99a1_80dfb045e376.slice/crio-3718e17414dd8879dbb5825ad944ffbef015eb2233d1f470abff3639c9496005 WatchSource:0}: Error finding container 3718e17414dd8879dbb5825ad944ffbef015eb2233d1f470abff3639c9496005: Status 404 returned error can't find the container with id 3718e17414dd8879dbb5825ad944ffbef015eb2233d1f470abff3639c9496005
Jul 07 17:15:38.619553 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:38.619507    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jlt6v\" (UniqueName: \"kubernetes.io/projected/37fde57f-4428-454e-b26f-f988b83a89af-kube-api-access-jlt6v\") pod \"kuadrant-operator-controller-manager-86878c769f-lttmr\" (UID: \"37fde57f-4428-454e-b26f-f988b83a89af\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lttmr"
Jul 07 17:15:38.622457 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:15:38.622437    2562 projected.go:196] Error preparing data for projected volume kube-api-access-jlt6v for pod kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lttmr: failed to fetch token: pod "kuadrant-operator-controller-manager-86878c769f-lttmr" not found
Jul 07 17:15:38.622576 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:15:38.622500    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/37fde57f-4428-454e-b26f-f988b83a89af-kube-api-access-jlt6v podName:37fde57f-4428-454e-b26f-f988b83a89af nodeName:}" failed. No retries permitted until 2026-07-07 17:15:39.622485473 +0000 UTC m=+464.345738647 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-jlt6v" (UniqueName: "kubernetes.io/projected/37fde57f-4428-454e-b26f-f988b83a89af-kube-api-access-jlt6v") pod "kuadrant-operator-controller-manager-86878c769f-lttmr" (UID: "37fde57f-4428-454e-b26f-f988b83a89af") : failed to fetch token: pod "kuadrant-operator-controller-manager-86878c769f-lttmr" not found
Jul 07 17:15:38.695681 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:38.695459    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9xnxv"]
Jul 07 17:15:38.697841 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:38.697787    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vc6qq"]
Jul 07 17:15:38.698808 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:15:38.698774    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4526c3c_5ede_4598_8432_69123eed54a8.slice/crio-0935ca9738677cb913498bcf39410267104e08a86ab5aa37ef023c94339fefad WatchSource:0}: Error finding container 0935ca9738677cb913498bcf39410267104e08a86ab5aa37ef023c94339fefad: Status 404 returned error can't find the container with id 0935ca9738677cb913498bcf39410267104e08a86ab5aa37ef023c94339fefad
Jul 07 17:15:38.700723 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:15:38.700654    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod89e55097_87b6_4e2c_a8dc_a9549172f8f3.slice/crio-8871a2d35004af0298a1888e044df4e81ea56e237cd9e0b89af78beaacd350ac WatchSource:0}: Error finding container 8871a2d35004af0298a1888e044df4e81ea56e237cd9e0b89af78beaacd350ac: Status 404 returned error can't find the container with id 8871a2d35004af0298a1888e044df4e81ea56e237cd9e0b89af78beaacd350ac
Jul 07 17:15:38.798473 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:38.798443    2562 generic.go:356] "Generic (PLEG): container finished" podID="a94b9992-b23d-4794-ae55-2b90f611f92e" containerID="097f6fb06caea893fc298cb27388239d62e7d9af66e0642d2a526773de9abb94" exitCode=0
Jul 07 17:15:38.798632 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:38.798491    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sgzvd"
Jul 07 17:15:38.798632 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:38.798529    2562 scope.go:117] "RemoveContainer" containerID="097f6fb06caea893fc298cb27388239d62e7d9af66e0642d2a526773de9abb94"
Jul 07 17:15:38.800394 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:38.800370    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kmc5b" event={"ID":"f3d7a41a-4d5b-4307-99a1-80dfb045e376","Type":"ContainerStarted","Data":"35165b31a94828a9ce43e3588fed536406e893bcdaa05114f3fdf590a624fab7"}
Jul 07 17:15:38.800525 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:38.800415    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kmc5b" event={"ID":"f3d7a41a-4d5b-4307-99a1-80dfb045e376","Type":"ContainerStarted","Data":"3718e17414dd8879dbb5825ad944ffbef015eb2233d1f470abff3639c9496005"}
Jul 07 17:15:38.800525 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:38.800460    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kmc5b"
Jul 07 17:15:38.801336 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:15:38.801305    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-sgzvd\" is forbidden: User \"system:node:ip-10-0-140-36.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-36.ec2.internal' and this object" podUID="a94b9992-b23d-4794-ae55-2b90f611f92e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sgzvd"
Jul 07 17:15:38.801837 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:38.801820    2562 generic.go:356] "Generic (PLEG): container finished" podID="51dc8934-1f9c-4047-bc0c-dd8901113db2" containerID="d3ca4bb24debee5fc262f38452b4d9c5fdf64373dc21d88eee1604b5fa1ea023" exitCode=0
Jul 07 17:15:38.801930 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:38.801856    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgwd8"
Jul 07 17:15:38.803255 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:15:38.803222    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lgwd8\" is forbidden: User \"system:node:ip-10-0-140-36.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-36.ec2.internal' and this object" podUID="51dc8934-1f9c-4047-bc0c-dd8901113db2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgwd8"
Jul 07 17:15:38.803846 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:38.803785    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9xnxv" event={"ID":"c4526c3c-5ede-4598-8432-69123eed54a8","Type":"ContainerStarted","Data":"e39bb886354fdd112a668907a2760d5a12fede7126f7969a40a26a4364abde11"}
Jul 07 17:15:38.803846 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:38.803835    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9xnxv"
Jul 07 17:15:38.804006 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:38.803859    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9xnxv" event={"ID":"c4526c3c-5ede-4598-8432-69123eed54a8","Type":"ContainerStarted","Data":"0935ca9738677cb913498bcf39410267104e08a86ab5aa37ef023c94339fefad"}
Jul 07 17:15:38.806473 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:38.806445    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lttmr"
Jul 07 17:15:38.807526 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:38.806997    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vc6qq" event={"ID":"89e55097-87b6-4e2c-a8dc-a9549172f8f3","Type":"ContainerStarted","Data":"361a2850143c1bd730791f6a6f567e10a7b93b9e865528ffebbbf8e7c459292f"}
Jul 07 17:15:38.807526 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:38.807047    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vc6qq" event={"ID":"89e55097-87b6-4e2c-a8dc-a9549172f8f3","Type":"ContainerStarted","Data":"8871a2d35004af0298a1888e044df4e81ea56e237cd9e0b89af78beaacd350ac"}
Jul 07 17:15:38.807526 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:38.807128    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-krm56"
Jul 07 17:15:38.807526 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:38.807276    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vc6qq"
Jul 07 17:15:38.812904 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:38.812699    2562 scope.go:117] "RemoveContainer" containerID="097f6fb06caea893fc298cb27388239d62e7d9af66e0642d2a526773de9abb94"
Jul 07 17:15:38.814515 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:15:38.814466    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"097f6fb06caea893fc298cb27388239d62e7d9af66e0642d2a526773de9abb94\": container with ID starting with 097f6fb06caea893fc298cb27388239d62e7d9af66e0642d2a526773de9abb94 not found: ID does not exist" containerID="097f6fb06caea893fc298cb27388239d62e7d9af66e0642d2a526773de9abb94"
Jul 07 17:15:38.814753 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:38.814674    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"097f6fb06caea893fc298cb27388239d62e7d9af66e0642d2a526773de9abb94"} err="failed to get container status \"097f6fb06caea893fc298cb27388239d62e7d9af66e0642d2a526773de9abb94\": rpc error: code = NotFound desc = could not find container \"097f6fb06caea893fc298cb27388239d62e7d9af66e0642d2a526773de9abb94\": container with ID starting with 097f6fb06caea893fc298cb27388239d62e7d9af66e0642d2a526773de9abb94 not found: ID does not exist"
Jul 07 17:15:38.814753 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:38.814703    2562 scope.go:117] "RemoveContainer" containerID="d3ca4bb24debee5fc262f38452b4d9c5fdf64373dc21d88eee1604b5fa1ea023"
Jul 07 17:15:38.822465 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:38.822443    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lttmr"
Jul 07 17:15:38.827482 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:38.827464    2562 scope.go:117] "RemoveContainer" containerID="d3ca4bb24debee5fc262f38452b4d9c5fdf64373dc21d88eee1604b5fa1ea023"
Jul 07 17:15:38.827777 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:15:38.827758    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d3ca4bb24debee5fc262f38452b4d9c5fdf64373dc21d88eee1604b5fa1ea023\": container with ID starting with d3ca4bb24debee5fc262f38452b4d9c5fdf64373dc21d88eee1604b5fa1ea023 not found: ID does not exist" containerID="d3ca4bb24debee5fc262f38452b4d9c5fdf64373dc21d88eee1604b5fa1ea023"
Jul 07 17:15:38.827832 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:38.827787    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d3ca4bb24debee5fc262f38452b4d9c5fdf64373dc21d88eee1604b5fa1ea023"} err="failed to get container status \"d3ca4bb24debee5fc262f38452b4d9c5fdf64373dc21d88eee1604b5fa1ea023\": rpc error: code = NotFound desc = could not find container \"d3ca4bb24debee5fc262f38452b4d9c5fdf64373dc21d88eee1604b5fa1ea023\": container with ID starting with d3ca4bb24debee5fc262f38452b4d9c5fdf64373dc21d88eee1604b5fa1ea023 not found: ID does not exist"
Jul 07 17:15:38.829631 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:38.829574    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kmc5b" podStartSLOduration=1.829551191 podStartE2EDuration="1.829551191s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:15:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:15:38.828973785 +0000 UTC m=+463.552226986" watchObservedRunningTime="2026-07-07 17:15:38.829551191 +0000 UTC m=+463.552804443"
Jul 07 17:15:38.830985 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:15:38.830962    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-sgzvd\" is forbidden: User \"system:node:ip-10-0-140-36.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-36.ec2.internal' and this object" podUID="a94b9992-b23d-4794-ae55-2b90f611f92e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sgzvd"
Jul 07 17:15:38.834096 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:15:38.834075    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lgwd8\" is forbidden: User \"system:node:ip-10-0-140-36.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-36.ec2.internal' and this object" podUID="51dc8934-1f9c-4047-bc0c-dd8901113db2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgwd8"
Jul 07 17:15:38.836334 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:15:38.836305    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-sgzvd\" is forbidden: User \"system:node:ip-10-0-140-36.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-36.ec2.internal' and this object" podUID="a94b9992-b23d-4794-ae55-2b90f611f92e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sgzvd"
Jul 07 17:15:38.838504 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:15:38.838476    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lgwd8\" is forbidden: User \"system:node:ip-10-0-140-36.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-36.ec2.internal' and this object" podUID="51dc8934-1f9c-4047-bc0c-dd8901113db2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgwd8"
Jul 07 17:15:38.855223 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:38.855133    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9xnxv" podStartSLOduration=1.855111633 podStartE2EDuration="1.855111633s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:15:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:15:38.854650394 +0000 UTC m=+463.577903589" watchObservedRunningTime="2026-07-07 17:15:38.855111633 +0000 UTC m=+463.578364887"
Jul 07 17:15:38.875333 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:38.875273    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vc6qq" podStartSLOduration=1.875255767 podStartE2EDuration="1.875255767s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:15:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:15:38.87347086 +0000 UTC m=+463.596724056" watchObservedRunningTime="2026-07-07 17:15:38.875255767 +0000 UTC m=+463.598508963"
Jul 07 17:15:38.875524 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:15:38.875477    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-krm56\" is forbidden: User \"system:node:ip-10-0-140-36.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-36.ec2.internal' and this object" podUID="0d524351-106b-4ccc-aaf7-3c1399d1674f" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-krm56"
Jul 07 17:15:38.877088 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:15:38.877066    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-lttmr\" is forbidden: User \"system:node:ip-10-0-140-36.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-36.ec2.internal' and this object" podUID="37fde57f-4428-454e-b26f-f988b83a89af" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lttmr"
Jul 07 17:15:38.921640 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:38.921611    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/37fde57f-4428-454e-b26f-f988b83a89af-extensions-socket-volume\") pod \"37fde57f-4428-454e-b26f-f988b83a89af\" (UID: \"37fde57f-4428-454e-b26f-f988b83a89af\") "
Jul 07 17:15:38.921808 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:38.921790    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jlt6v\" (UniqueName: \"kubernetes.io/projected/37fde57f-4428-454e-b26f-f988b83a89af-kube-api-access-jlt6v\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:15:38.922008 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:38.921986    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/37fde57f-4428-454e-b26f-f988b83a89af-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "37fde57f-4428-454e-b26f-f988b83a89af" (UID: "37fde57f-4428-454e-b26f-f988b83a89af"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:15:39.023023 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:39.022943    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/37fde57f-4428-454e-b26f-f988b83a89af-extensions-socket-volume\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:15:39.814030 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:39.813999    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lttmr"
Jul 07 17:15:39.816535 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:15:39.816502    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-sgzvd\" is forbidden: User \"system:node:ip-10-0-140-36.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-36.ec2.internal' and this object" podUID="a94b9992-b23d-4794-ae55-2b90f611f92e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sgzvd"
Jul 07 17:15:39.818567 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:15:39.818544    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lgwd8\" is forbidden: User \"system:node:ip-10-0-140-36.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-36.ec2.internal' and this object" podUID="51dc8934-1f9c-4047-bc0c-dd8901113db2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgwd8"
Jul 07 17:15:39.820571 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:15:39.820549    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-krm56\" is forbidden: User \"system:node:ip-10-0-140-36.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-36.ec2.internal' and this object" podUID="0d524351-106b-4ccc-aaf7-3c1399d1674f" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-krm56"
Jul 07 17:15:39.823270 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:15:39.823240    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-lttmr\" is forbidden: User \"system:node:ip-10-0-140-36.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-36.ec2.internal' and this object" podUID="37fde57f-4428-454e-b26f-f988b83a89af" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lttmr"
Jul 07 17:15:39.825391 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:15:39.825365    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-krm56\" is forbidden: User \"system:node:ip-10-0-140-36.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-36.ec2.internal' and this object" podUID="0d524351-106b-4ccc-aaf7-3c1399d1674f" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-krm56"
Jul 07 17:15:39.827220 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:15:39.827199    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-lttmr\" is forbidden: User \"system:node:ip-10-0-140-36.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-36.ec2.internal' and this object" podUID="37fde57f-4428-454e-b26f-f988b83a89af" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-lttmr"
Jul 07 17:15:39.828987 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:15:39.828965    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-sgzvd\" is forbidden: User \"system:node:ip-10-0-140-36.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-36.ec2.internal' and this object" podUID="a94b9992-b23d-4794-ae55-2b90f611f92e" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-sgzvd"
Jul 07 17:15:39.830708 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:15:39.830688    2562 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lgwd8\" is forbidden: User \"system:node:ip-10-0-140-36.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-140-36.ec2.internal' and this object" podUID="51dc8934-1f9c-4047-bc0c-dd8901113db2" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lgwd8"
Jul 07 17:15:39.846037 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:39.846005    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0d524351-106b-4ccc-aaf7-3c1399d1674f" path="/var/lib/kubelet/pods/0d524351-106b-4ccc-aaf7-3c1399d1674f/volumes"
Jul 07 17:15:39.846221 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:39.846208    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="37fde57f-4428-454e-b26f-f988b83a89af" path="/var/lib/kubelet/pods/37fde57f-4428-454e-b26f-f988b83a89af/volumes"
Jul 07 17:15:39.846432 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:39.846421    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="51dc8934-1f9c-4047-bc0c-dd8901113db2" path="/var/lib/kubelet/pods/51dc8934-1f9c-4047-bc0c-dd8901113db2/volumes"
Jul 07 17:15:39.846699 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:39.846688    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a94b9992-b23d-4794-ae55-2b90f611f92e" path="/var/lib/kubelet/pods/a94b9992-b23d-4794-ae55-2b90f611f92e/volumes"
Jul 07 17:15:40.861202 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:40.861166    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:15:40.960720 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:40.960682    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:15:41.245759 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:41.245724    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:15:41.349268 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:41.349239    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:15:45.039641 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:45.039608    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:15:45.141353 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:45.141322    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:15:47.242939 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:47.242901    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:15:47.336174 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:47.336122    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:15:49.816481 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:49.816446    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-9xnxv"
Jul 07 17:15:49.816881 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:49.816524    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kmc5b"
Jul 07 17:15:50.821237 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:50.821196    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vc6qq"
Jul 07 17:15:50.892413 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:50.892382    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kmc5b"]
Jul 07 17:15:50.892595 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:50.892570    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kmc5b" podUID="f3d7a41a-4d5b-4307-99a1-80dfb045e376" containerName="manager" containerID="cri-o://35165b31a94828a9ce43e3588fed536406e893bcdaa05114f3fdf590a624fab7" gracePeriod=10
Jul 07 17:15:51.152055 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:51.152025    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kmc5b"
Jul 07 17:15:51.229837 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:51.229807    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tjscl\" (UniqueName: \"kubernetes.io/projected/f3d7a41a-4d5b-4307-99a1-80dfb045e376-kube-api-access-tjscl\") pod \"f3d7a41a-4d5b-4307-99a1-80dfb045e376\" (UID: \"f3d7a41a-4d5b-4307-99a1-80dfb045e376\") "
Jul 07 17:15:51.229990 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:51.229846    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f3d7a41a-4d5b-4307-99a1-80dfb045e376-extensions-socket-volume\") pod \"f3d7a41a-4d5b-4307-99a1-80dfb045e376\" (UID: \"f3d7a41a-4d5b-4307-99a1-80dfb045e376\") "
Jul 07 17:15:51.230290 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:51.230268    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3d7a41a-4d5b-4307-99a1-80dfb045e376-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "f3d7a41a-4d5b-4307-99a1-80dfb045e376" (UID: "f3d7a41a-4d5b-4307-99a1-80dfb045e376"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:15:51.231791 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:51.231769    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3d7a41a-4d5b-4307-99a1-80dfb045e376-kube-api-access-tjscl" (OuterVolumeSpecName: "kube-api-access-tjscl") pod "f3d7a41a-4d5b-4307-99a1-80dfb045e376" (UID: "f3d7a41a-4d5b-4307-99a1-80dfb045e376"). InnerVolumeSpecName "kube-api-access-tjscl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:15:51.331002 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:51.330967    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tjscl\" (UniqueName: \"kubernetes.io/projected/f3d7a41a-4d5b-4307-99a1-80dfb045e376-kube-api-access-tjscl\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:15:51.331002 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:51.330996    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/f3d7a41a-4d5b-4307-99a1-80dfb045e376-extensions-socket-volume\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:15:51.868460 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:51.868427    2562 generic.go:356] "Generic (PLEG): container finished" podID="f3d7a41a-4d5b-4307-99a1-80dfb045e376" containerID="35165b31a94828a9ce43e3588fed536406e893bcdaa05114f3fdf590a624fab7" exitCode=0
Jul 07 17:15:51.868804 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:51.868467    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kmc5b"
Jul 07 17:15:51.868804 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:51.868506    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kmc5b" event={"ID":"f3d7a41a-4d5b-4307-99a1-80dfb045e376","Type":"ContainerDied","Data":"35165b31a94828a9ce43e3588fed536406e893bcdaa05114f3fdf590a624fab7"}
Jul 07 17:15:51.868804 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:51.868557    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kmc5b" event={"ID":"f3d7a41a-4d5b-4307-99a1-80dfb045e376","Type":"ContainerDied","Data":"3718e17414dd8879dbb5825ad944ffbef015eb2233d1f470abff3639c9496005"}
Jul 07 17:15:51.868804 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:51.868582    2562 scope.go:117] "RemoveContainer" containerID="35165b31a94828a9ce43e3588fed536406e893bcdaa05114f3fdf590a624fab7"
Jul 07 17:15:51.876969 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:51.876949    2562 scope.go:117] "RemoveContainer" containerID="35165b31a94828a9ce43e3588fed536406e893bcdaa05114f3fdf590a624fab7"
Jul 07 17:15:51.877256 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:15:51.877236    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"35165b31a94828a9ce43e3588fed536406e893bcdaa05114f3fdf590a624fab7\": container with ID starting with 35165b31a94828a9ce43e3588fed536406e893bcdaa05114f3fdf590a624fab7 not found: ID does not exist" containerID="35165b31a94828a9ce43e3588fed536406e893bcdaa05114f3fdf590a624fab7"
Jul 07 17:15:51.877311 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:51.877267    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"35165b31a94828a9ce43e3588fed536406e893bcdaa05114f3fdf590a624fab7"} err="failed to get container status \"35165b31a94828a9ce43e3588fed536406e893bcdaa05114f3fdf590a624fab7\": rpc error: code = NotFound desc = could not find container \"35165b31a94828a9ce43e3588fed536406e893bcdaa05114f3fdf590a624fab7\": container with ID starting with 35165b31a94828a9ce43e3588fed536406e893bcdaa05114f3fdf590a624fab7 not found: ID does not exist"
Jul 07 17:15:51.894278 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:51.894236    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kmc5b"]
Jul 07 17:15:51.896011 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:51.895978    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-kmc5b"]
Jul 07 17:15:53.845814 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:15:53.845772    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3d7a41a-4d5b-4307-99a1-80dfb045e376" path="/var/lib/kubelet/pods/f3d7a41a-4d5b-4307-99a1-80dfb045e376/volumes"
Jul 07 17:16:07.381287 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:07.381244    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r98nz"]
Jul 07 17:16:07.381722 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:07.381575    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3d7a41a-4d5b-4307-99a1-80dfb045e376" containerName="manager"
Jul 07 17:16:07.381722 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:07.381587    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3d7a41a-4d5b-4307-99a1-80dfb045e376" containerName="manager"
Jul 07 17:16:07.381722 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:07.381643    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3d7a41a-4d5b-4307-99a1-80dfb045e376" containerName="manager"
Jul 07 17:16:07.384532 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:07.384509    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r98nz"
Jul 07 17:16:07.391436 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:07.391406    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-zp5gs\""
Jul 07 17:16:07.404622 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:07.404588    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r98nz"]
Jul 07 17:16:07.404788 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:07.404660    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:16:07.473118 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:07.473083    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/485365e1-7cb4-4143-ad07-4c33e2257b7a-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-r98nz\" (UID: \"485365e1-7cb4-4143-ad07-4c33e2257b7a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r98nz"
Jul 07 17:16:07.473118 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:07.473116    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/485365e1-7cb4-4143-ad07-4c33e2257b7a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-r98nz\" (UID: \"485365e1-7cb4-4143-ad07-4c33e2257b7a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r98nz"
Jul 07 17:16:07.473403 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:07.473135    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/485365e1-7cb4-4143-ad07-4c33e2257b7a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-r98nz\" (UID: \"485365e1-7cb4-4143-ad07-4c33e2257b7a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r98nz"
Jul 07 17:16:07.473403 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:07.473188    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/485365e1-7cb4-4143-ad07-4c33e2257b7a-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-r98nz\" (UID: \"485365e1-7cb4-4143-ad07-4c33e2257b7a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r98nz"
Jul 07 17:16:07.473403 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:07.473267    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/485365e1-7cb4-4143-ad07-4c33e2257b7a-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-r98nz\" (UID: \"485365e1-7cb4-4143-ad07-4c33e2257b7a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r98nz"
Jul 07 17:16:07.473403 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:07.473284    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/485365e1-7cb4-4143-ad07-4c33e2257b7a-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-r98nz\" (UID: \"485365e1-7cb4-4143-ad07-4c33e2257b7a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r98nz"
Jul 07 17:16:07.473403 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:07.473314    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b225m\" (UniqueName: \"kubernetes.io/projected/485365e1-7cb4-4143-ad07-4c33e2257b7a-kube-api-access-b225m\") pod \"maas-default-gateway-openshift-default-56654dcf7-r98nz\" (UID: \"485365e1-7cb4-4143-ad07-4c33e2257b7a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r98nz"
Jul 07 17:16:07.473584 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:07.473391    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/485365e1-7cb4-4143-ad07-4c33e2257b7a-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-r98nz\" (UID: \"485365e1-7cb4-4143-ad07-4c33e2257b7a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r98nz"
Jul 07 17:16:07.473584 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:07.473437    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/485365e1-7cb4-4143-ad07-4c33e2257b7a-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-r98nz\" (UID: \"485365e1-7cb4-4143-ad07-4c33e2257b7a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r98nz"
Jul 07 17:16:07.574750 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:07.574710    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/485365e1-7cb4-4143-ad07-4c33e2257b7a-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-r98nz\" (UID: \"485365e1-7cb4-4143-ad07-4c33e2257b7a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r98nz"
Jul 07 17:16:07.574750 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:07.574749    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/485365e1-7cb4-4143-ad07-4c33e2257b7a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-r98nz\" (UID: \"485365e1-7cb4-4143-ad07-4c33e2257b7a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r98nz"
Jul 07 17:16:07.574955 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:07.574770    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/485365e1-7cb4-4143-ad07-4c33e2257b7a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-r98nz\" (UID: \"485365e1-7cb4-4143-ad07-4c33e2257b7a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r98nz"
Jul 07 17:16:07.574955 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:07.574899    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/485365e1-7cb4-4143-ad07-4c33e2257b7a-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-r98nz\" (UID: \"485365e1-7cb4-4143-ad07-4c33e2257b7a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r98nz"
Jul 07 17:16:07.575037 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:07.574964    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/485365e1-7cb4-4143-ad07-4c33e2257b7a-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-r98nz\" (UID: \"485365e1-7cb4-4143-ad07-4c33e2257b7a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r98nz"
Jul 07 17:16:07.575037 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:07.574999    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/485365e1-7cb4-4143-ad07-4c33e2257b7a-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-r98nz\" (UID: \"485365e1-7cb4-4143-ad07-4c33e2257b7a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r98nz"
Jul 07 17:16:07.575143 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:07.575046    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b225m\" (UniqueName: \"kubernetes.io/projected/485365e1-7cb4-4143-ad07-4c33e2257b7a-kube-api-access-b225m\") pod \"maas-default-gateway-openshift-default-56654dcf7-r98nz\" (UID: \"485365e1-7cb4-4143-ad07-4c33e2257b7a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r98nz"
Jul 07 17:16:07.575143 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:07.575110    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/485365e1-7cb4-4143-ad07-4c33e2257b7a-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-r98nz\" (UID: \"485365e1-7cb4-4143-ad07-4c33e2257b7a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r98nz"
Jul 07 17:16:07.575303 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:07.575217    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/485365e1-7cb4-4143-ad07-4c33e2257b7a-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-r98nz\" (UID: \"485365e1-7cb4-4143-ad07-4c33e2257b7a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r98nz"
Jul 07 17:16:07.575381 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:07.575359    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/485365e1-7cb4-4143-ad07-4c33e2257b7a-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-r98nz\" (UID: \"485365e1-7cb4-4143-ad07-4c33e2257b7a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r98nz"
Jul 07 17:16:07.575469 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:07.575446    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/485365e1-7cb4-4143-ad07-4c33e2257b7a-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-r98nz\" (UID: \"485365e1-7cb4-4143-ad07-4c33e2257b7a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r98nz"
Jul 07 17:16:07.575526 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:07.575470    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/485365e1-7cb4-4143-ad07-4c33e2257b7a-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-r98nz\" (UID: \"485365e1-7cb4-4143-ad07-4c33e2257b7a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r98nz"
Jul 07 17:16:07.575755 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:07.575730    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/485365e1-7cb4-4143-ad07-4c33e2257b7a-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-r98nz\" (UID: \"485365e1-7cb4-4143-ad07-4c33e2257b7a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r98nz"
Jul 07 17:16:07.575891 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:07.575734    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/485365e1-7cb4-4143-ad07-4c33e2257b7a-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-r98nz\" (UID: \"485365e1-7cb4-4143-ad07-4c33e2257b7a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r98nz"
Jul 07 17:16:07.577557 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:07.577531    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/485365e1-7cb4-4143-ad07-4c33e2257b7a-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-r98nz\" (UID: \"485365e1-7cb4-4143-ad07-4c33e2257b7a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r98nz"
Jul 07 17:16:07.577662 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:07.577623    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/485365e1-7cb4-4143-ad07-4c33e2257b7a-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-r98nz\" (UID: \"485365e1-7cb4-4143-ad07-4c33e2257b7a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r98nz"
Jul 07 17:16:07.587848 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:07.587811    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b225m\" (UniqueName: \"kubernetes.io/projected/485365e1-7cb4-4143-ad07-4c33e2257b7a-kube-api-access-b225m\") pod \"maas-default-gateway-openshift-default-56654dcf7-r98nz\" (UID: \"485365e1-7cb4-4143-ad07-4c33e2257b7a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r98nz"
Jul 07 17:16:07.598861 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:07.598834    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/485365e1-7cb4-4143-ad07-4c33e2257b7a-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-r98nz\" (UID: \"485365e1-7cb4-4143-ad07-4c33e2257b7a\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r98nz"
Jul 07 17:16:07.694691 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:07.694614    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r98nz"
Jul 07 17:16:07.842724 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:07.842664    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:16:07.845872 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:16:07.845844    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod485365e1_7cb4_4143_ad07_4c33e2257b7a.slice/crio-0cf0c3e0ec717290f5168b126042090479c2626e0faadd064e2e92a28b9d65ca WatchSource:0}: Error finding container 0cf0c3e0ec717290f5168b126042090479c2626e0faadd064e2e92a28b9d65ca: Status 404 returned error can't find the container with id 0cf0c3e0ec717290f5168b126042090479c2626e0faadd064e2e92a28b9d65ca
Jul 07 17:16:07.847088 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:07.847062    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r98nz"]
Jul 07 17:16:07.944330 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:07.944288    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r98nz" event={"ID":"485365e1-7cb4-4143-ad07-4c33e2257b7a","Type":"ContainerStarted","Data":"0cf0c3e0ec717290f5168b126042090479c2626e0faadd064e2e92a28b9d65ca"}
Jul 07 17:16:10.312932 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:10.312892    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 17:16:10.313214 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:10.312988    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 17:16:10.313214 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:10.313028    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 17:16:10.961502 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:10.961460    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r98nz" event={"ID":"485365e1-7cb4-4143-ad07-4c33e2257b7a","Type":"ContainerStarted","Data":"d405f11ae54013a0d809887d179668259151608de87683d6f0f4b505e691ac54"}
Jul 07 17:16:10.987503 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:10.987445    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r98nz" podStartSLOduration=1.5227310200000002 podStartE2EDuration="3.987426897s" totalImagesPullingTime="2.464695877s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:16:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:16:10.986084518 +0000 UTC m=+495.709337725" watchObservedRunningTime="2026-07-07 17:16:10.987426897 +0000 UTC m=+495.710680094"
Jul 07 17:16:11.694995 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:11.694950    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r98nz"
Jul 07 17:16:11.699810 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:11.699785    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r98nz"
Jul 07 17:16:11.966367 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:11.966283    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r98nz"
Jul 07 17:16:11.967304 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:11.967283    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r98nz"
Jul 07 17:16:12.196669 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:12.196632    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gllxl"]
Jul 07 17:16:12.197612 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:12.197590    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:16:12.199084 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:12.199069    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-gllxl"
Jul 07 17:16:12.201408 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:12.201388    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vv4vg\""
Jul 07 17:16:12.201408 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:12.201388    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\""
Jul 07 17:16:12.213190 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:12.213144    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gllxl"]
Jul 07 17:16:12.218496 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:12.218445    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9628365a-735e-4331-8888-3a4f9a8f3a30-config-file\") pod \"limitador-limitador-64c94fd64f-gllxl\" (UID: \"9628365a-735e-4331-8888-3a4f9a8f3a30\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-gllxl"
Jul 07 17:16:12.218578 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:12.218514    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnljp\" (UniqueName: \"kubernetes.io/projected/9628365a-735e-4331-8888-3a4f9a8f3a30-kube-api-access-dnljp\") pod \"limitador-limitador-64c94fd64f-gllxl\" (UID: \"9628365a-735e-4331-8888-3a4f9a8f3a30\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-gllxl"
Jul 07 17:16:12.295429 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:12.295398    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gllxl"]
Jul 07 17:16:12.303929 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:12.303901    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:16:12.319014 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:12.318984    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9628365a-735e-4331-8888-3a4f9a8f3a30-config-file\") pod \"limitador-limitador-64c94fd64f-gllxl\" (UID: \"9628365a-735e-4331-8888-3a4f9a8f3a30\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-gllxl"
Jul 07 17:16:12.319291 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:12.319056    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnljp\" (UniqueName: \"kubernetes.io/projected/9628365a-735e-4331-8888-3a4f9a8f3a30-kube-api-access-dnljp\") pod \"limitador-limitador-64c94fd64f-gllxl\" (UID: \"9628365a-735e-4331-8888-3a4f9a8f3a30\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-gllxl"
Jul 07 17:16:12.319823 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:12.319797    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9628365a-735e-4331-8888-3a4f9a8f3a30-config-file\") pod \"limitador-limitador-64c94fd64f-gllxl\" (UID: \"9628365a-735e-4331-8888-3a4f9a8f3a30\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-gllxl"
Jul 07 17:16:12.332149 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:12.332125    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnljp\" (UniqueName: \"kubernetes.io/projected/9628365a-735e-4331-8888-3a4f9a8f3a30-kube-api-access-dnljp\") pod \"limitador-limitador-64c94fd64f-gllxl\" (UID: \"9628365a-735e-4331-8888-3a4f9a8f3a30\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-gllxl"
Jul 07 17:16:12.405277 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:12.405243    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:16:12.509139 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:12.509046    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-gllxl"
Jul 07 17:16:12.656613 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:12.656588    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gllxl"]
Jul 07 17:16:12.658525 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:16:12.658489    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9628365a_735e_4331_8888_3a4f9a8f3a30.slice/crio-2c7c4fddd1d6f3dd5eaffe6a0eee128ef21bc18b3ac0501c47b2cfd5f1778b10 WatchSource:0}: Error finding container 2c7c4fddd1d6f3dd5eaffe6a0eee128ef21bc18b3ac0501c47b2cfd5f1778b10: Status 404 returned error can't find the container with id 2c7c4fddd1d6f3dd5eaffe6a0eee128ef21bc18b3ac0501c47b2cfd5f1778b10
Jul 07 17:16:12.972388 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:12.972336    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-gllxl" event={"ID":"9628365a-735e-4331-8888-3a4f9a8f3a30","Type":"ContainerStarted","Data":"2c7c4fddd1d6f3dd5eaffe6a0eee128ef21bc18b3ac0501c47b2cfd5f1778b10"}
Jul 07 17:16:13.144770 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:13.144733    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:16:13.242094 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:13.242011    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:16:15.988830 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:15.988788    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-gllxl" event={"ID":"9628365a-735e-4331-8888-3a4f9a8f3a30","Type":"ContainerStarted","Data":"fe1c321d8d876babc2b5ad6f2a95d1084ae2e2d978d3d1b7c7e8992f7beb0a1b"}
Jul 07 17:16:15.989237 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:15.988928    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-gllxl"
Jul 07 17:16:16.017025 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:16.016970    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-gllxl" podStartSLOduration=1.2014826809999999 podStartE2EDuration="4.01695387s" totalImagesPullingTime="2.815471189s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:16:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:16:16.01487085 +0000 UTC m=+500.738124047" watchObservedRunningTime="2026-07-07 17:16:16.01695387 +0000 UTC m=+500.740207064"
Jul 07 17:16:26.994109 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:26.994073    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-gllxl"
Jul 07 17:16:27.399463 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:27.399428    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gllxl"]
Jul 07 17:16:27.399659 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:27.399611    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-gllxl" podUID="9628365a-735e-4331-8888-3a4f9a8f3a30" containerName="limitador" containerID="cri-o://fe1c321d8d876babc2b5ad6f2a95d1084ae2e2d978d3d1b7c7e8992f7beb0a1b" gracePeriod=30
Jul 07 17:16:27.946207 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:27.946173    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-gllxl"
Jul 07 17:16:28.042694 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:28.042600    2562 generic.go:356] "Generic (PLEG): container finished" podID="9628365a-735e-4331-8888-3a4f9a8f3a30" containerID="fe1c321d8d876babc2b5ad6f2a95d1084ae2e2d978d3d1b7c7e8992f7beb0a1b" exitCode=0
Jul 07 17:16:28.042694 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:28.042644    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-gllxl"
Jul 07 17:16:28.042694 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:28.042679    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-gllxl" event={"ID":"9628365a-735e-4331-8888-3a4f9a8f3a30","Type":"ContainerDied","Data":"fe1c321d8d876babc2b5ad6f2a95d1084ae2e2d978d3d1b7c7e8992f7beb0a1b"}
Jul 07 17:16:28.043284 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:28.042732    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-gllxl" event={"ID":"9628365a-735e-4331-8888-3a4f9a8f3a30","Type":"ContainerDied","Data":"2c7c4fddd1d6f3dd5eaffe6a0eee128ef21bc18b3ac0501c47b2cfd5f1778b10"}
Jul 07 17:16:28.043284 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:28.042755    2562 scope.go:117] "RemoveContainer" containerID="fe1c321d8d876babc2b5ad6f2a95d1084ae2e2d978d3d1b7c7e8992f7beb0a1b"
Jul 07 17:16:28.050748 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:28.050730    2562 scope.go:117] "RemoveContainer" containerID="fe1c321d8d876babc2b5ad6f2a95d1084ae2e2d978d3d1b7c7e8992f7beb0a1b"
Jul 07 17:16:28.051005 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:16:28.050987    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fe1c321d8d876babc2b5ad6f2a95d1084ae2e2d978d3d1b7c7e8992f7beb0a1b\": container with ID starting with fe1c321d8d876babc2b5ad6f2a95d1084ae2e2d978d3d1b7c7e8992f7beb0a1b not found: ID does not exist" containerID="fe1c321d8d876babc2b5ad6f2a95d1084ae2e2d978d3d1b7c7e8992f7beb0a1b"
Jul 07 17:16:28.051059 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:28.051017    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fe1c321d8d876babc2b5ad6f2a95d1084ae2e2d978d3d1b7c7e8992f7beb0a1b"} err="failed to get container status \"fe1c321d8d876babc2b5ad6f2a95d1084ae2e2d978d3d1b7c7e8992f7beb0a1b\": rpc error: code = NotFound desc = could not find container \"fe1c321d8d876babc2b5ad6f2a95d1084ae2e2d978d3d1b7c7e8992f7beb0a1b\": container with ID starting with fe1c321d8d876babc2b5ad6f2a95d1084ae2e2d978d3d1b7c7e8992f7beb0a1b not found: ID does not exist"
Jul 07 17:16:28.068412 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:28.068373    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9628365a-735e-4331-8888-3a4f9a8f3a30-config-file\") pod \"9628365a-735e-4331-8888-3a4f9a8f3a30\" (UID: \"9628365a-735e-4331-8888-3a4f9a8f3a30\") "
Jul 07 17:16:28.068524 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:28.068488    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dnljp\" (UniqueName: \"kubernetes.io/projected/9628365a-735e-4331-8888-3a4f9a8f3a30-kube-api-access-dnljp\") pod \"9628365a-735e-4331-8888-3a4f9a8f3a30\" (UID: \"9628365a-735e-4331-8888-3a4f9a8f3a30\") "
Jul 07 17:16:28.068783 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:28.068751    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9628365a-735e-4331-8888-3a4f9a8f3a30-config-file" (OuterVolumeSpecName: "config-file") pod "9628365a-735e-4331-8888-3a4f9a8f3a30" (UID: "9628365a-735e-4331-8888-3a4f9a8f3a30"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:16:28.070407 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:28.070389    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9628365a-735e-4331-8888-3a4f9a8f3a30-kube-api-access-dnljp" (OuterVolumeSpecName: "kube-api-access-dnljp") pod "9628365a-735e-4331-8888-3a4f9a8f3a30" (UID: "9628365a-735e-4331-8888-3a4f9a8f3a30"). InnerVolumeSpecName "kube-api-access-dnljp". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:16:28.169488 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:28.169454    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dnljp\" (UniqueName: \"kubernetes.io/projected/9628365a-735e-4331-8888-3a4f9a8f3a30-kube-api-access-dnljp\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:16:28.169488 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:28.169483    2562 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/9628365a-735e-4331-8888-3a4f9a8f3a30-config-file\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:16:28.366708 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:28.366674    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gllxl"]
Jul 07 17:16:28.370499 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:28.370466    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-gllxl"]
Jul 07 17:16:29.845322 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:29.845291    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9628365a-735e-4331-8888-3a4f9a8f3a30" path="/var/lib/kubelet/pods/9628365a-735e-4331-8888-3a4f9a8f3a30/volumes"
Jul 07 17:16:33.745275 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:33.745238    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/postgres-69fb4594cf-cft47"]
Jul 07 17:16:33.746406 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:33.746379    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9628365a-735e-4331-8888-3a4f9a8f3a30" containerName="limitador"
Jul 07 17:16:33.746548 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:33.746537    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="9628365a-735e-4331-8888-3a4f9a8f3a30" containerName="limitador"
Jul 07 17:16:33.746775 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:33.746763    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="9628365a-735e-4331-8888-3a4f9a8f3a30" containerName="limitador"
Jul 07 17:16:33.750003 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:33.749978    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-cft47"
Jul 07 17:16:33.752813 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:33.752792    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"postgres-creds\""
Jul 07 17:16:33.753073 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:33.753054    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"default-dockercfg-wbn2x\""
Jul 07 17:16:33.759869 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:33.759847    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-cft47"]
Jul 07 17:16:33.790516 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:33.790486    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:16:33.819354 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:33.819317    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rb7kc\" (UniqueName: \"kubernetes.io/projected/0613eb33-16af-40c7-a1f4-07e500ad6297-kube-api-access-rb7kc\") pod \"postgres-69fb4594cf-cft47\" (UID: \"0613eb33-16af-40c7-a1f4-07e500ad6297\") " pod="opendatahub/postgres-69fb4594cf-cft47"
Jul 07 17:16:33.819541 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:33.819367    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/0613eb33-16af-40c7-a1f4-07e500ad6297-data\") pod \"postgres-69fb4594cf-cft47\" (UID: \"0613eb33-16af-40c7-a1f4-07e500ad6297\") " pod="opendatahub/postgres-69fb4594cf-cft47"
Jul 07 17:16:33.920344 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:33.920299    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rb7kc\" (UniqueName: \"kubernetes.io/projected/0613eb33-16af-40c7-a1f4-07e500ad6297-kube-api-access-rb7kc\") pod \"postgres-69fb4594cf-cft47\" (UID: \"0613eb33-16af-40c7-a1f4-07e500ad6297\") " pod="opendatahub/postgres-69fb4594cf-cft47"
Jul 07 17:16:33.920537 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:33.920372    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/0613eb33-16af-40c7-a1f4-07e500ad6297-data\") pod \"postgres-69fb4594cf-cft47\" (UID: \"0613eb33-16af-40c7-a1f4-07e500ad6297\") " pod="opendatahub/postgres-69fb4594cf-cft47"
Jul 07 17:16:33.920775 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:33.920755    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/0613eb33-16af-40c7-a1f4-07e500ad6297-data\") pod \"postgres-69fb4594cf-cft47\" (UID: \"0613eb33-16af-40c7-a1f4-07e500ad6297\") " pod="opendatahub/postgres-69fb4594cf-cft47"
Jul 07 17:16:33.931254 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:33.931218    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-rb7kc\" (UniqueName: \"kubernetes.io/projected/0613eb33-16af-40c7-a1f4-07e500ad6297-kube-api-access-rb7kc\") pod \"postgres-69fb4594cf-cft47\" (UID: \"0613eb33-16af-40c7-a1f4-07e500ad6297\") " pod="opendatahub/postgres-69fb4594cf-cft47"
Jul 07 17:16:34.062033 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:34.061946    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/postgres-69fb4594cf-cft47"
Jul 07 17:16:34.203561 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:34.203478    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/postgres-69fb4594cf-cft47"]
Jul 07 17:16:34.205835 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:16:34.205804    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0613eb33_16af_40c7_a1f4_07e500ad6297.slice/crio-ea0b29be61182e1f3e780a7969347e6c930f43e171f1d0a2f7fbabd129519164 WatchSource:0}: Error finding container ea0b29be61182e1f3e780a7969347e6c930f43e171f1d0a2f7fbabd129519164: Status 404 returned error can't find the container with id ea0b29be61182e1f3e780a7969347e6c930f43e171f1d0a2f7fbabd129519164
Jul 07 17:16:35.080849 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:35.080722    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-cft47" event={"ID":"0613eb33-16af-40c7-a1f4-07e500ad6297","Type":"ContainerStarted","Data":"ea0b29be61182e1f3e780a7969347e6c930f43e171f1d0a2f7fbabd129519164"}
Jul 07 17:16:39.102259 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:39.102165    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/postgres-69fb4594cf-cft47" event={"ID":"0613eb33-16af-40c7-a1f4-07e500ad6297","Type":"ContainerStarted","Data":"f5d10889922c022f3a24d220fccaef711a0689f47f3c4e3c2dbbb23e7def1a8a"}
Jul 07 17:16:39.102630 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:39.102276    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/postgres-69fb4594cf-cft47"
Jul 07 17:16:39.122465 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:39.122410    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/postgres-69fb4594cf-cft47" podStartSLOduration=1.491520919 podStartE2EDuration="6.122394296s" totalImagesPullingTime="4.630873377s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:16:33 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:16:39.121847035 +0000 UTC m=+523.845100232" watchObservedRunningTime="2026-07-07 17:16:39.122394296 +0000 UTC m=+523.845647517"
Jul 07 17:16:45.137643 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:45.137610    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/postgres-69fb4594cf-cft47"
Jul 07 17:16:45.476524 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:45.476434    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:16:45.584912 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:45.584871    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:16:52.251888 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:52.251802    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:16:52.269922 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:52.269882    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5b8d4fb649-jf22s"]
Jul 07 17:16:52.276500 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:52.276472    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b8d4fb649-jf22s"
Jul 07 17:16:52.280586 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:52.280557    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-w7pgh\""
Jul 07 17:16:52.280870 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:52.280853    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 07 17:16:52.280977 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:52.280899    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 07 17:16:52.287382 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:52.287352    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5b8d4fb649-jf22s"]
Jul 07 17:16:52.360135 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:52.360100    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:16:52.384423 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:52.384365    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t2fcl\" (UniqueName: \"kubernetes.io/projected/3da79924-2624-4488-8edf-aacf9c2c3f8b-kube-api-access-t2fcl\") pod \"maas-controller-5b8d4fb649-jf22s\" (UID: \"3da79924-2624-4488-8edf-aacf9c2c3f8b\") " pod="opendatahub/maas-controller-5b8d4fb649-jf22s"
Jul 07 17:16:52.384583 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:52.384441    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3da79924-2624-4488-8edf-aacf9c2c3f8b-webhook-cert\") pod \"maas-controller-5b8d4fb649-jf22s\" (UID: \"3da79924-2624-4488-8edf-aacf9c2c3f8b\") " pod="opendatahub/maas-controller-5b8d4fb649-jf22s"
Jul 07 17:16:52.435566 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:52.435532    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:16:52.485309 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:52.485272    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3da79924-2624-4488-8edf-aacf9c2c3f8b-webhook-cert\") pod \"maas-controller-5b8d4fb649-jf22s\" (UID: \"3da79924-2624-4488-8edf-aacf9c2c3f8b\") " pod="opendatahub/maas-controller-5b8d4fb649-jf22s"
Jul 07 17:16:52.485483 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:52.485348    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t2fcl\" (UniqueName: \"kubernetes.io/projected/3da79924-2624-4488-8edf-aacf9c2c3f8b-kube-api-access-t2fcl\") pod \"maas-controller-5b8d4fb649-jf22s\" (UID: \"3da79924-2624-4488-8edf-aacf9c2c3f8b\") " pod="opendatahub/maas-controller-5b8d4fb649-jf22s"
Jul 07 17:16:52.487752 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:52.487725    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3da79924-2624-4488-8edf-aacf9c2c3f8b-webhook-cert\") pod \"maas-controller-5b8d4fb649-jf22s\" (UID: \"3da79924-2624-4488-8edf-aacf9c2c3f8b\") " pod="opendatahub/maas-controller-5b8d4fb649-jf22s"
Jul 07 17:16:52.505620 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:52.505527    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-dbcbb4f4b-rgwbb"]
Jul 07 17:16:52.507939 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:52.507915    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dbcbb4f4b-rgwbb"
Jul 07 17:16:52.509362 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:52.509342    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t2fcl\" (UniqueName: \"kubernetes.io/projected/3da79924-2624-4488-8edf-aacf9c2c3f8b-kube-api-access-t2fcl\") pod \"maas-controller-5b8d4fb649-jf22s\" (UID: \"3da79924-2624-4488-8edf-aacf9c2c3f8b\") " pod="opendatahub/maas-controller-5b8d4fb649-jf22s"
Jul 07 17:16:52.536018 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:52.535982    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-dbcbb4f4b-rgwbb"]
Jul 07 17:16:52.587323 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:52.587285    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b8d4fb649-jf22s"
Jul 07 17:16:52.686709 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:52.686673    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cchwt\" (UniqueName: \"kubernetes.io/projected/95895b07-fb7e-45e4-95c9-efde3661a898-kube-api-access-cchwt\") pod \"maas-controller-dbcbb4f4b-rgwbb\" (UID: \"95895b07-fb7e-45e4-95c9-efde3661a898\") " pod="opendatahub/maas-controller-dbcbb4f4b-rgwbb"
Jul 07 17:16:52.686860 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:52.686802    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/95895b07-fb7e-45e4-95c9-efde3661a898-webhook-cert\") pod \"maas-controller-dbcbb4f4b-rgwbb\" (UID: \"95895b07-fb7e-45e4-95c9-efde3661a898\") " pod="opendatahub/maas-controller-dbcbb4f4b-rgwbb"
Jul 07 17:16:52.726886 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:52.726828    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5b8d4fb649-jf22s"]
Jul 07 17:16:52.730685 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:16:52.730643    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3da79924_2624_4488_8edf_aacf9c2c3f8b.slice/crio-1cad27b520a904b0ad19aa7f0f786d05dc637871a64a60615ae22351857d4b0e WatchSource:0}: Error finding container 1cad27b520a904b0ad19aa7f0f786d05dc637871a64a60615ae22351857d4b0e: Status 404 returned error can't find the container with id 1cad27b520a904b0ad19aa7f0f786d05dc637871a64a60615ae22351857d4b0e
Jul 07 17:16:52.787681 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:52.787589    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/95895b07-fb7e-45e4-95c9-efde3661a898-webhook-cert\") pod \"maas-controller-dbcbb4f4b-rgwbb\" (UID: \"95895b07-fb7e-45e4-95c9-efde3661a898\") " pod="opendatahub/maas-controller-dbcbb4f4b-rgwbb"
Jul 07 17:16:52.787681 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:52.787651    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cchwt\" (UniqueName: \"kubernetes.io/projected/95895b07-fb7e-45e4-95c9-efde3661a898-kube-api-access-cchwt\") pod \"maas-controller-dbcbb4f4b-rgwbb\" (UID: \"95895b07-fb7e-45e4-95c9-efde3661a898\") " pod="opendatahub/maas-controller-dbcbb4f4b-rgwbb"
Jul 07 17:16:52.790634 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:52.790611    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/95895b07-fb7e-45e4-95c9-efde3661a898-webhook-cert\") pod \"maas-controller-dbcbb4f4b-rgwbb\" (UID: \"95895b07-fb7e-45e4-95c9-efde3661a898\") " pod="opendatahub/maas-controller-dbcbb4f4b-rgwbb"
Jul 07 17:16:52.797510 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:52.797483    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cchwt\" (UniqueName: \"kubernetes.io/projected/95895b07-fb7e-45e4-95c9-efde3661a898-kube-api-access-cchwt\") pod \"maas-controller-dbcbb4f4b-rgwbb\" (UID: \"95895b07-fb7e-45e4-95c9-efde3661a898\") " pod="opendatahub/maas-controller-dbcbb4f4b-rgwbb"
Jul 07 17:16:52.825721 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:52.825686    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dbcbb4f4b-rgwbb"
Jul 07 17:16:52.966734 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:52.966699    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-dbcbb4f4b-rgwbb"]
Jul 07 17:16:52.969763 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:16:52.969734    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95895b07_fb7e_45e4_95c9_efde3661a898.slice/crio-8e8384ac94380a87b1919b3be8758bc87189911e8bb139484f0ed525b237424f WatchSource:0}: Error finding container 8e8384ac94380a87b1919b3be8758bc87189911e8bb139484f0ed525b237424f: Status 404 returned error can't find the container with id 8e8384ac94380a87b1919b3be8758bc87189911e8bb139484f0ed525b237424f
Jul 07 17:16:53.165904 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:53.165861    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dbcbb4f4b-rgwbb" event={"ID":"95895b07-fb7e-45e4-95c9-efde3661a898","Type":"ContainerStarted","Data":"8e8384ac94380a87b1919b3be8758bc87189911e8bb139484f0ed525b237424f"}
Jul 07 17:16:53.167036 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:53.167009    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b8d4fb649-jf22s" event={"ID":"3da79924-2624-4488-8edf-aacf9c2c3f8b","Type":"ContainerStarted","Data":"1cad27b520a904b0ad19aa7f0f786d05dc637871a64a60615ae22351857d4b0e"}
Jul 07 17:16:55.180584 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:55.180539    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dbcbb4f4b-rgwbb" event={"ID":"95895b07-fb7e-45e4-95c9-efde3661a898","Type":"ContainerStarted","Data":"c2b685fa555f9a29f01a0f0ea84e97ae1c0ca2f4f678c95a4f458f7a7cf88f0f"}
Jul 07 17:16:55.181022 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:55.180645    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-dbcbb4f4b-rgwbb"
Jul 07 17:16:55.182088 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:55.182058    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b8d4fb649-jf22s" event={"ID":"3da79924-2624-4488-8edf-aacf9c2c3f8b","Type":"ContainerStarted","Data":"6e9672b16ac8e0b318684cfc1898de151c68558a13c25436683987bdb8ff4597"}
Jul 07 17:16:55.182197 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:55.182121    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5b8d4fb649-jf22s"
Jul 07 17:16:55.205037 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:55.204981    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-dbcbb4f4b-rgwbb" podStartSLOduration=1.120814641 podStartE2EDuration="3.204966078s" totalImagesPullingTime="2.084151437s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:16:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:16:55.203643175 +0000 UTC m=+539.926896374" watchObservedRunningTime="2026-07-07 17:16:55.204966078 +0000 UTC m=+539.928219273"
Jul 07 17:16:55.228877 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:55.228816    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5b8d4fb649-jf22s" podStartSLOduration=0.916152373 podStartE2EDuration="3.228796414s" totalImagesPullingTime="2.312644041s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:16:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:16:55.227134669 +0000 UTC m=+539.950387865" watchObservedRunningTime="2026-07-07 17:16:55.228796414 +0000 UTC m=+539.952049609"
Jul 07 17:16:55.304065 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:55.303967    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:16:55.408820 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:55.408787    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:16:56.133207 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:16:56.133175    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:17:06.193026 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:06.192989    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-dbcbb4f4b-rgwbb"
Jul 07 17:17:06.193432 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:06.193174    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5b8d4fb649-jf22s"
Jul 07 17:17:06.261093 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:06.261053    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5b8d4fb649-jf22s"]
Jul 07 17:17:06.261299 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:06.261258    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-5b8d4fb649-jf22s" podUID="3da79924-2624-4488-8edf-aacf9c2c3f8b" containerName="manager" containerID="cri-o://6e9672b16ac8e0b318684cfc1898de151c68558a13c25436683987bdb8ff4597" gracePeriod=30
Jul 07 17:17:06.501055 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:06.501029    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b8d4fb649-jf22s"
Jul 07 17:17:06.610094 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:06.610056    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3da79924-2624-4488-8edf-aacf9c2c3f8b-webhook-cert\") pod \"3da79924-2624-4488-8edf-aacf9c2c3f8b\" (UID: \"3da79924-2624-4488-8edf-aacf9c2c3f8b\") "
Jul 07 17:17:06.610303 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:06.610121    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-t2fcl\" (UniqueName: \"kubernetes.io/projected/3da79924-2624-4488-8edf-aacf9c2c3f8b-kube-api-access-t2fcl\") pod \"3da79924-2624-4488-8edf-aacf9c2c3f8b\" (UID: \"3da79924-2624-4488-8edf-aacf9c2c3f8b\") "
Jul 07 17:17:06.612390 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:06.612341    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3da79924-2624-4488-8edf-aacf9c2c3f8b-kube-api-access-t2fcl" (OuterVolumeSpecName: "kube-api-access-t2fcl") pod "3da79924-2624-4488-8edf-aacf9c2c3f8b" (UID: "3da79924-2624-4488-8edf-aacf9c2c3f8b"). InnerVolumeSpecName "kube-api-access-t2fcl". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:17:06.612496 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:06.612400    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3da79924-2624-4488-8edf-aacf9c2c3f8b-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "3da79924-2624-4488-8edf-aacf9c2c3f8b" (UID: "3da79924-2624-4488-8edf-aacf9c2c3f8b"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:17:06.711122 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:06.711073    2562 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/3da79924-2624-4488-8edf-aacf9c2c3f8b-webhook-cert\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:17:06.711122 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:06.711117    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-t2fcl\" (UniqueName: \"kubernetes.io/projected/3da79924-2624-4488-8edf-aacf9c2c3f8b-kube-api-access-t2fcl\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:17:07.238285 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:07.238247    2562 generic.go:356] "Generic (PLEG): container finished" podID="3da79924-2624-4488-8edf-aacf9c2c3f8b" containerID="6e9672b16ac8e0b318684cfc1898de151c68558a13c25436683987bdb8ff4597" exitCode=0
Jul 07 17:17:07.238760 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:07.238293    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5b8d4fb649-jf22s"
Jul 07 17:17:07.238760 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:07.238332    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b8d4fb649-jf22s" event={"ID":"3da79924-2624-4488-8edf-aacf9c2c3f8b","Type":"ContainerDied","Data":"6e9672b16ac8e0b318684cfc1898de151c68558a13c25436683987bdb8ff4597"}
Jul 07 17:17:07.238760 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:07.238396    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5b8d4fb649-jf22s" event={"ID":"3da79924-2624-4488-8edf-aacf9c2c3f8b","Type":"ContainerDied","Data":"1cad27b520a904b0ad19aa7f0f786d05dc637871a64a60615ae22351857d4b0e"}
Jul 07 17:17:07.238760 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:07.238430    2562 scope.go:117] "RemoveContainer" containerID="6e9672b16ac8e0b318684cfc1898de151c68558a13c25436683987bdb8ff4597"
Jul 07 17:17:07.248262 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:07.248234    2562 scope.go:117] "RemoveContainer" containerID="6e9672b16ac8e0b318684cfc1898de151c68558a13c25436683987bdb8ff4597"
Jul 07 17:17:07.248640 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:17:07.248619    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e9672b16ac8e0b318684cfc1898de151c68558a13c25436683987bdb8ff4597\": container with ID starting with 6e9672b16ac8e0b318684cfc1898de151c68558a13c25436683987bdb8ff4597 not found: ID does not exist" containerID="6e9672b16ac8e0b318684cfc1898de151c68558a13c25436683987bdb8ff4597"
Jul 07 17:17:07.248679 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:07.248652    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e9672b16ac8e0b318684cfc1898de151c68558a13c25436683987bdb8ff4597"} err="failed to get container status \"6e9672b16ac8e0b318684cfc1898de151c68558a13c25436683987bdb8ff4597\": rpc error: code = NotFound desc = could not find container \"6e9672b16ac8e0b318684cfc1898de151c68558a13c25436683987bdb8ff4597\": container with ID starting with 6e9672b16ac8e0b318684cfc1898de151c68558a13c25436683987bdb8ff4597 not found: ID does not exist"
Jul 07 17:17:07.264344 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:07.264283    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5b8d4fb649-jf22s"]
Jul 07 17:17:07.269410 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:07.269371    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5b8d4fb649-jf22s"]
Jul 07 17:17:07.846170 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:07.846121    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3da79924-2624-4488-8edf-aacf9c2c3f8b" path="/var/lib/kubelet/pods/3da79924-2624-4488-8edf-aacf9c2c3f8b/volumes"
Jul 07 17:17:26.322289 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:26.322249    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:17:26.819258 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:26.819208    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:17:26.858613 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:26.858578    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-5788c58957-9tq9b"]
Jul 07 17:17:26.858890 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:26.858877    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3da79924-2624-4488-8edf-aacf9c2c3f8b" containerName="manager"
Jul 07 17:17:26.858937 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:26.858891    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="3da79924-2624-4488-8edf-aacf9c2c3f8b" containerName="manager"
Jul 07 17:17:26.858970 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:26.858956    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="3da79924-2624-4488-8edf-aacf9c2c3f8b" containerName="manager"
Jul 07 17:17:26.860999 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:26.860984    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5788c58957-9tq9b"
Jul 07 17:17:26.863345 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:26.863324    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-serving-cert\""
Jul 07 17:17:26.863620 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:26.863606    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-dockercfg-wbb9r\""
Jul 07 17:17:26.871911 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:26.871885    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5788c58957-9tq9b"]
Jul 07 17:17:26.987551 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:26.987505    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/44ff424e-d29a-4229-968c-ae86f65cb19e-openshift-service-ca\") pod \"maas-api-5788c58957-9tq9b\" (UID: \"44ff424e-d29a-4229-968c-ae86f65cb19e\") " pod="opendatahub/maas-api-5788c58957-9tq9b"
Jul 07 17:17:26.987825 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:26.987622    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vzmk\" (UniqueName: \"kubernetes.io/projected/44ff424e-d29a-4229-968c-ae86f65cb19e-kube-api-access-4vzmk\") pod \"maas-api-5788c58957-9tq9b\" (UID: \"44ff424e-d29a-4229-968c-ae86f65cb19e\") " pod="opendatahub/maas-api-5788c58957-9tq9b"
Jul 07 17:17:26.987825 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:26.987682    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44ff424e-d29a-4229-968c-ae86f65cb19e-maas-api-tls\") pod \"maas-api-5788c58957-9tq9b\" (UID: \"44ff424e-d29a-4229-968c-ae86f65cb19e\") " pod="opendatahub/maas-api-5788c58957-9tq9b"
Jul 07 17:17:27.088412 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:27.088317    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44ff424e-d29a-4229-968c-ae86f65cb19e-maas-api-tls\") pod \"maas-api-5788c58957-9tq9b\" (UID: \"44ff424e-d29a-4229-968c-ae86f65cb19e\") " pod="opendatahub/maas-api-5788c58957-9tq9b"
Jul 07 17:17:27.088412 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:27.088366    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/44ff424e-d29a-4229-968c-ae86f65cb19e-openshift-service-ca\") pod \"maas-api-5788c58957-9tq9b\" (UID: \"44ff424e-d29a-4229-968c-ae86f65cb19e\") " pod="opendatahub/maas-api-5788c58957-9tq9b"
Jul 07 17:17:27.088656 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:27.088418    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vzmk\" (UniqueName: \"kubernetes.io/projected/44ff424e-d29a-4229-968c-ae86f65cb19e-kube-api-access-4vzmk\") pod \"maas-api-5788c58957-9tq9b\" (UID: \"44ff424e-d29a-4229-968c-ae86f65cb19e\") " pod="opendatahub/maas-api-5788c58957-9tq9b"
Jul 07 17:17:27.088656 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:17:27.088455    2562 secret.go:189] Couldn't get secret opendatahub/maas-api-serving-cert: secret "maas-api-serving-cert" not found
Jul 07 17:17:27.088656 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:17:27.088534    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/44ff424e-d29a-4229-968c-ae86f65cb19e-maas-api-tls podName:44ff424e-d29a-4229-968c-ae86f65cb19e nodeName:}" failed. No retries permitted until 2026-07-07 17:17:27.588512583 +0000 UTC m=+572.311765775 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/44ff424e-d29a-4229-968c-ae86f65cb19e-maas-api-tls") pod "maas-api-5788c58957-9tq9b" (UID: "44ff424e-d29a-4229-968c-ae86f65cb19e") : secret "maas-api-serving-cert" not found
Jul 07 17:17:27.089065 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:27.089041    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/44ff424e-d29a-4229-968c-ae86f65cb19e-openshift-service-ca\") pod \"maas-api-5788c58957-9tq9b\" (UID: \"44ff424e-d29a-4229-968c-ae86f65cb19e\") " pod="opendatahub/maas-api-5788c58957-9tq9b"
Jul 07 17:17:27.103256 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:27.103216    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vzmk\" (UniqueName: \"kubernetes.io/projected/44ff424e-d29a-4229-968c-ae86f65cb19e-kube-api-access-4vzmk\") pod \"maas-api-5788c58957-9tq9b\" (UID: \"44ff424e-d29a-4229-968c-ae86f65cb19e\") " pod="opendatahub/maas-api-5788c58957-9tq9b"
Jul 07 17:17:27.217529 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:27.217488    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:17:27.319522 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:27.319489    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:17:27.443809 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:27.443777    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:17:27.520376 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:27.520321    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-rq7vq"]
Jul 07 17:17:27.522730 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:27.522692    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-rq7vq"
Jul 07 17:17:27.525805 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:27.525774    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\""
Jul 07 17:17:27.525952 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:27.525849    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-cwnf7\""
Jul 07 17:17:27.540909 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:27.540879    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-rq7vq"]
Jul 07 17:17:27.594134 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:27.594101    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44ff424e-d29a-4229-968c-ae86f65cb19e-maas-api-tls\") pod \"maas-api-5788c58957-9tq9b\" (UID: \"44ff424e-d29a-4229-968c-ae86f65cb19e\") " pod="opendatahub/maas-api-5788c58957-9tq9b"
Jul 07 17:17:27.596541 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:27.596519    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/44ff424e-d29a-4229-968c-ae86f65cb19e-maas-api-tls\") pod \"maas-api-5788c58957-9tq9b\" (UID: \"44ff424e-d29a-4229-968c-ae86f65cb19e\") " pod="opendatahub/maas-api-5788c58957-9tq9b"
Jul 07 17:17:27.632112 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:27.632075    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-2d2d5"]
Jul 07 17:17:27.634339 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:27.634315    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-2d2d5"
Jul 07 17:17:27.647999 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:27.647975    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-2d2d5"]
Jul 07 17:17:27.695544 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:27.695461    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c736238-7320-469b-a304-c64f27e464e8-plugins-config-volume\") pod \"payload-pre-processing-7964457696-rq7vq\" (UID: \"5c736238-7320-469b-a304-c64f27e464e8\") " pod="openshift-ingress/payload-pre-processing-7964457696-rq7vq"
Jul 07 17:17:27.695544 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:27.695509    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f485d\" (UniqueName: \"kubernetes.io/projected/5c736238-7320-469b-a304-c64f27e464e8-kube-api-access-f485d\") pod \"payload-pre-processing-7964457696-rq7vq\" (UID: \"5c736238-7320-469b-a304-c64f27e464e8\") " pod="openshift-ingress/payload-pre-processing-7964457696-rq7vq"
Jul 07 17:17:27.771858 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:27.771816    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-5788c58957-9tq9b"
Jul 07 17:17:27.796942 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:27.796897    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/401c9525-9b61-4fbe-9692-8815029a9de2-plugins-config-volume\") pod \"payload-processing-58f86c7798-2d2d5\" (UID: \"401c9525-9b61-4fbe-9692-8815029a9de2\") " pod="openshift-ingress/payload-processing-58f86c7798-2d2d5"
Jul 07 17:17:27.796942 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:27.796941    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f485d\" (UniqueName: \"kubernetes.io/projected/5c736238-7320-469b-a304-c64f27e464e8-kube-api-access-f485d\") pod \"payload-pre-processing-7964457696-rq7vq\" (UID: \"5c736238-7320-469b-a304-c64f27e464e8\") " pod="openshift-ingress/payload-pre-processing-7964457696-rq7vq"
Jul 07 17:17:27.797215 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:27.797068    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r59bk\" (UniqueName: \"kubernetes.io/projected/401c9525-9b61-4fbe-9692-8815029a9de2-kube-api-access-r59bk\") pod \"payload-processing-58f86c7798-2d2d5\" (UID: \"401c9525-9b61-4fbe-9692-8815029a9de2\") " pod="openshift-ingress/payload-processing-58f86c7798-2d2d5"
Jul 07 17:17:27.797215 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:27.797105    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c736238-7320-469b-a304-c64f27e464e8-plugins-config-volume\") pod \"payload-pre-processing-7964457696-rq7vq\" (UID: \"5c736238-7320-469b-a304-c64f27e464e8\") " pod="openshift-ingress/payload-pre-processing-7964457696-rq7vq"
Jul 07 17:17:27.797817 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:27.797785    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/5c736238-7320-469b-a304-c64f27e464e8-plugins-config-volume\") pod \"payload-pre-processing-7964457696-rq7vq\" (UID: \"5c736238-7320-469b-a304-c64f27e464e8\") " pod="openshift-ingress/payload-pre-processing-7964457696-rq7vq"
Jul 07 17:17:27.810000 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:27.809960    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f485d\" (UniqueName: \"kubernetes.io/projected/5c736238-7320-469b-a304-c64f27e464e8-kube-api-access-f485d\") pod \"payload-pre-processing-7964457696-rq7vq\" (UID: \"5c736238-7320-469b-a304-c64f27e464e8\") " pod="openshift-ingress/payload-pre-processing-7964457696-rq7vq"
Jul 07 17:17:27.835726 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:27.835600    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-7964457696-rq7vq"
Jul 07 17:17:27.898510 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:27.898467    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r59bk\" (UniqueName: \"kubernetes.io/projected/401c9525-9b61-4fbe-9692-8815029a9de2-kube-api-access-r59bk\") pod \"payload-processing-58f86c7798-2d2d5\" (UID: \"401c9525-9b61-4fbe-9692-8815029a9de2\") " pod="openshift-ingress/payload-processing-58f86c7798-2d2d5"
Jul 07 17:17:27.898714 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:27.898529    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/401c9525-9b61-4fbe-9692-8815029a9de2-plugins-config-volume\") pod \"payload-processing-58f86c7798-2d2d5\" (UID: \"401c9525-9b61-4fbe-9692-8815029a9de2\") " pod="openshift-ingress/payload-processing-58f86c7798-2d2d5"
Jul 07 17:17:27.899404 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:27.899378    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/401c9525-9b61-4fbe-9692-8815029a9de2-plugins-config-volume\") pod \"payload-processing-58f86c7798-2d2d5\" (UID: \"401c9525-9b61-4fbe-9692-8815029a9de2\") " pod="openshift-ingress/payload-processing-58f86c7798-2d2d5"
Jul 07 17:17:27.909823 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:27.909786    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-r59bk\" (UniqueName: \"kubernetes.io/projected/401c9525-9b61-4fbe-9692-8815029a9de2-kube-api-access-r59bk\") pod \"payload-processing-58f86c7798-2d2d5\" (UID: \"401c9525-9b61-4fbe-9692-8815029a9de2\") " pod="openshift-ingress/payload-processing-58f86c7798-2d2d5"
Jul 07 17:17:27.927534 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:27.927509    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-5788c58957-9tq9b"]
Jul 07 17:17:27.930362 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:17:27.930334    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44ff424e_d29a_4229_968c_ae86f65cb19e.slice/crio-820971498a4b98010d598517587b4c70756ee35455f720fff8aa11e0c9b73c2a WatchSource:0}: Error finding container 820971498a4b98010d598517587b4c70756ee35455f720fff8aa11e0c9b73c2a: Status 404 returned error can't find the container with id 820971498a4b98010d598517587b4c70756ee35455f720fff8aa11e0c9b73c2a
Jul 07 17:17:27.945451 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:27.945411    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-2d2d5"
Jul 07 17:17:28.005680 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:28.005620    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-7964457696-rq7vq"]
Jul 07 17:17:28.011647 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:17:28.010800    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c736238_7320_469b_a304_c64f27e464e8.slice/crio-a648dad380b4f772c620a1a8c27f8597a026deca153345868b2312c81b26ca3a WatchSource:0}: Error finding container a648dad380b4f772c620a1a8c27f8597a026deca153345868b2312c81b26ca3a: Status 404 returned error can't find the container with id a648dad380b4f772c620a1a8c27f8597a026deca153345868b2312c81b26ca3a
Jul 07 17:17:28.121268 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:28.121238    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-2d2d5"]
Jul 07 17:17:28.124198 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:17:28.124149    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod401c9525_9b61_4fbe_9692_8815029a9de2.slice/crio-417ea9d0512258dd132fdf9c618aa3052949631424bf68003acb4463c5e5de33 WatchSource:0}: Error finding container 417ea9d0512258dd132fdf9c618aa3052949631424bf68003acb4463c5e5de33: Status 404 returned error can't find the container with id 417ea9d0512258dd132fdf9c618aa3052949631424bf68003acb4463c5e5de33
Jul 07 17:17:28.335877 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:28.335785    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-2d2d5" event={"ID":"401c9525-9b61-4fbe-9692-8815029a9de2","Type":"ContainerStarted","Data":"417ea9d0512258dd132fdf9c618aa3052949631424bf68003acb4463c5e5de33"}
Jul 07 17:17:28.337147 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:28.337117    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-rq7vq" event={"ID":"5c736238-7320-469b-a304-c64f27e464e8","Type":"ContainerStarted","Data":"a648dad380b4f772c620a1a8c27f8597a026deca153345868b2312c81b26ca3a"}
Jul 07 17:17:28.338517 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:28.338477    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5788c58957-9tq9b" event={"ID":"44ff424e-d29a-4229-968c-ae86f65cb19e","Type":"ContainerStarted","Data":"820971498a4b98010d598517587b4c70756ee35455f720fff8aa11e0c9b73c2a"}
Jul 07 17:17:30.352669 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:30.352628    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-2d2d5" event={"ID":"401c9525-9b61-4fbe-9692-8815029a9de2","Type":"ContainerStarted","Data":"5be52fa7dfe5ca8cf379428b46f91d2fa9c25a7417692c52eddc1af915d2bae1"}
Jul 07 17:17:30.353192 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:30.352825    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-2d2d5"
Jul 07 17:17:30.354253 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:30.354227    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-7964457696-rq7vq" event={"ID":"5c736238-7320-469b-a304-c64f27e464e8","Type":"ContainerStarted","Data":"7d07b73b291d31aa4b0a7af7cec1410126a4469c4b436a15db5904849de65af2"}
Jul 07 17:17:30.354378 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:30.354321    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-7964457696-rq7vq"
Jul 07 17:17:30.356250 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:30.356129    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-5788c58957-9tq9b" event={"ID":"44ff424e-d29a-4229-968c-ae86f65cb19e","Type":"ContainerStarted","Data":"9672784a96ad8cc2a66853ad62ee8ef535355b6c5aa98e94c72f7461491623b9"}
Jul 07 17:17:30.356371 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:30.356328    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-5788c58957-9tq9b"
Jul 07 17:17:30.372511 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:30.372451    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-2d2d5" podStartSLOduration=1.300051619 podStartE2EDuration="3.372427332s" totalImagesPullingTime="2.072375713s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:17:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:17:30.371185367 +0000 UTC m=+575.094438562" watchObservedRunningTime="2026-07-07 17:17:30.372427332 +0000 UTC m=+575.095680528"
Jul 07 17:17:30.392335 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:30.392277    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-5788c58957-9tq9b" podStartSLOduration=2.124989195 podStartE2EDuration="4.392237248s" totalImagesPullingTime="2.267248053s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:17:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:17:30.390929246 +0000 UTC m=+575.114182441" watchObservedRunningTime="2026-07-07 17:17:30.392237248 +0000 UTC m=+575.115490444"
Jul 07 17:17:36.366858 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:36.366826    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-5788c58957-9tq9b"
Jul 07 17:17:36.386370 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:36.386337    2562 generic.go:356] "Generic (PLEG): container finished" podID="485365e1-7cb4-4143-ad07-4c33e2257b7a" containerID="d405f11ae54013a0d809887d179668259151608de87683d6f0f4b505e691ac54" exitCode=0
Jul 07 17:17:36.386544 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:36.386383    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r98nz" event={"ID":"485365e1-7cb4-4143-ad07-4c33e2257b7a","Type":"ContainerDied","Data":"d405f11ae54013a0d809887d179668259151608de87683d6f0f4b505e691ac54"}
Jul 07 17:17:36.386830 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:36.386811    2562 scope.go:117] "RemoveContainer" containerID="d405f11ae54013a0d809887d179668259151608de87683d6f0f4b505e691ac54"
Jul 07 17:17:36.387813 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:36.387780    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 17:17:36.387909 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:36.387864    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 17:17:36.387969 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:36.387912    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 17:17:36.391074 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:36.391024    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-7964457696-rq7vq" podStartSLOduration=7.207398983 podStartE2EDuration="9.391006426s" totalImagesPullingTime="2.183607443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:17:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:17:30.412530517 +0000 UTC m=+575.135783714" watchObservedRunningTime="2026-07-07 17:17:36.391006426 +0000 UTC m=+581.114259623"
Jul 07 17:17:37.392667 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:37.392631    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r98nz" event={"ID":"485365e1-7cb4-4143-ad07-4c33e2257b7a","Type":"ContainerStarted","Data":"1deef6411ad55146b63c18aeb788da44683aefc2beab92e3963cac857c3214dc"}
Jul 07 17:17:37.695426 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:37.695329    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r98nz"
Jul 07 17:17:37.696567 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:37.696544    2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-r98nz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 07 17:17:37.696634 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:37.696593    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r98nz" podUID="485365e1-7cb4-4143-ad07-4c33e2257b7a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 07 17:17:37.874463 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:37.874427    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:17:37.973994 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:37.973912    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:17:38.695840 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:38.695801    2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-r98nz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 07 17:17:38.696300 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:38.695871    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r98nz" podUID="485365e1-7cb4-4143-ad07-4c33e2257b7a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 07 17:17:39.695106 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:39.695058    2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-r98nz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 07 17:17:39.695336 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:39.695132    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r98nz" podUID="485365e1-7cb4-4143-ad07-4c33e2257b7a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 07 17:17:40.112832 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:40.112743    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:17:40.695008 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:40.694965    2562 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-r98nz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused" start-of-body=
Jul 07 17:17:40.695226 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:40.695039    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r98nz" podUID="485365e1-7cb4-4143-ad07-4c33e2257b7a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.32:15021/healthz/ready\": dial tcp 10.133.0.32:15021: connect: connection refused"
Jul 07 17:17:41.363280 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:41.363248    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-2d2d5"
Jul 07 17:17:41.363713 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:41.363323    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-7964457696-rq7vq"
Jul 07 17:17:41.698814 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:41.698780    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r98nz"
Jul 07 17:17:41.699100 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:41.699066    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r98nz"
Jul 07 17:17:41.699907 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:41.699890    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r98nz"
Jul 07 17:17:50.000748 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:50.000712    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:17:51.666341 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:51.666306    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cs99k"]
Jul 07 17:17:51.668750 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:51.668725    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cs99k"
Jul 07 17:17:51.671927 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:51.671898    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\""
Jul 07 17:17:51.672071 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:51.671905    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\""
Jul 07 17:17:51.672071 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:51.671940    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-hltvx\""
Jul 07 17:17:51.672071 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:51.672062    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\""
Jul 07 17:17:51.682448 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:51.682421    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cs99k"]
Jul 07 17:17:51.705842 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:51.705812    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:17:51.730981 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:51.730943    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ecd5589-20a1-49fe-87d7-51cdb0bfcb7f-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cs99k\" (UID: \"9ecd5589-20a1-49fe-87d7-51cdb0bfcb7f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cs99k"
Jul 07 17:17:51.730981 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:51.730980    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ecd5589-20a1-49fe-87d7-51cdb0bfcb7f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cs99k\" (UID: \"9ecd5589-20a1-49fe-87d7-51cdb0bfcb7f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cs99k"
Jul 07 17:17:51.731276 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:51.730997    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ecd5589-20a1-49fe-87d7-51cdb0bfcb7f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cs99k\" (UID: \"9ecd5589-20a1-49fe-87d7-51cdb0bfcb7f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cs99k"
Jul 07 17:17:51.731276 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:51.731019    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dzcvk\" (UniqueName: \"kubernetes.io/projected/9ecd5589-20a1-49fe-87d7-51cdb0bfcb7f-kube-api-access-dzcvk\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cs99k\" (UID: \"9ecd5589-20a1-49fe-87d7-51cdb0bfcb7f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cs99k"
Jul 07 17:17:51.731276 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:51.731135    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ecd5589-20a1-49fe-87d7-51cdb0bfcb7f-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cs99k\" (UID: \"9ecd5589-20a1-49fe-87d7-51cdb0bfcb7f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cs99k"
Jul 07 17:17:51.731276 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:51.731221    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ecd5589-20a1-49fe-87d7-51cdb0bfcb7f-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cs99k\" (UID: \"9ecd5589-20a1-49fe-87d7-51cdb0bfcb7f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cs99k"
Jul 07 17:17:51.831790 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:51.831754    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ecd5589-20a1-49fe-87d7-51cdb0bfcb7f-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cs99k\" (UID: \"9ecd5589-20a1-49fe-87d7-51cdb0bfcb7f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cs99k"
Jul 07 17:17:51.831790 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:51.831788    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ecd5589-20a1-49fe-87d7-51cdb0bfcb7f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cs99k\" (UID: \"9ecd5589-20a1-49fe-87d7-51cdb0bfcb7f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cs99k"
Jul 07 17:17:51.832107 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:51.831811    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ecd5589-20a1-49fe-87d7-51cdb0bfcb7f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cs99k\" (UID: \"9ecd5589-20a1-49fe-87d7-51cdb0bfcb7f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cs99k"
Jul 07 17:17:51.832107 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:51.831954    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dzcvk\" (UniqueName: \"kubernetes.io/projected/9ecd5589-20a1-49fe-87d7-51cdb0bfcb7f-kube-api-access-dzcvk\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cs99k\" (UID: \"9ecd5589-20a1-49fe-87d7-51cdb0bfcb7f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cs99k"
Jul 07 17:17:51.832107 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:51.832032    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ecd5589-20a1-49fe-87d7-51cdb0bfcb7f-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cs99k\" (UID: \"9ecd5589-20a1-49fe-87d7-51cdb0bfcb7f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cs99k"
Jul 07 17:17:51.832107 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:51.832077    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ecd5589-20a1-49fe-87d7-51cdb0bfcb7f-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cs99k\" (UID: \"9ecd5589-20a1-49fe-87d7-51cdb0bfcb7f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cs99k"
Jul 07 17:17:51.832328 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:51.832277    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9ecd5589-20a1-49fe-87d7-51cdb0bfcb7f-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cs99k\" (UID: \"9ecd5589-20a1-49fe-87d7-51cdb0bfcb7f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cs99k"
Jul 07 17:17:51.832328 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:51.832299    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9ecd5589-20a1-49fe-87d7-51cdb0bfcb7f-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cs99k\" (UID: \"9ecd5589-20a1-49fe-87d7-51cdb0bfcb7f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cs99k"
Jul 07 17:17:51.832556 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:51.832526    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9ecd5589-20a1-49fe-87d7-51cdb0bfcb7f-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cs99k\" (UID: \"9ecd5589-20a1-49fe-87d7-51cdb0bfcb7f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cs99k"
Jul 07 17:17:51.834259 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:51.834233    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9ecd5589-20a1-49fe-87d7-51cdb0bfcb7f-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cs99k\" (UID: \"9ecd5589-20a1-49fe-87d7-51cdb0bfcb7f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cs99k"
Jul 07 17:17:51.834367 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:51.834327    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9ecd5589-20a1-49fe-87d7-51cdb0bfcb7f-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cs99k\" (UID: \"9ecd5589-20a1-49fe-87d7-51cdb0bfcb7f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cs99k"
Jul 07 17:17:51.842278 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:51.842250    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-dzcvk\" (UniqueName: \"kubernetes.io/projected/9ecd5589-20a1-49fe-87d7-51cdb0bfcb7f-kube-api-access-dzcvk\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-cs99k\" (UID: \"9ecd5589-20a1-49fe-87d7-51cdb0bfcb7f\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cs99k"
Jul 07 17:17:51.980682 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:51.980588    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cs99k"
Jul 07 17:17:52.122314 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:52.122284    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cs99k"]
Jul 07 17:17:52.123471 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:17:52.123423    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ecd5589_20a1_49fe_87d7_51cdb0bfcb7f.slice/crio-a7f5e4940f606aa861144b2638a763e8ab2ce1b0fc64f582ed68a10f84da85d0 WatchSource:0}: Error finding container a7f5e4940f606aa861144b2638a763e8ab2ce1b0fc64f582ed68a10f84da85d0: Status 404 returned error can't find the container with id a7f5e4940f606aa861144b2638a763e8ab2ce1b0fc64f582ed68a10f84da85d0
Jul 07 17:17:52.496723 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:52.496672    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cs99k" event={"ID":"9ecd5589-20a1-49fe-87d7-51cdb0bfcb7f","Type":"ContainerStarted","Data":"a7f5e4940f606aa861144b2638a763e8ab2ce1b0fc64f582ed68a10f84da85d0"}
Jul 07 17:17:53.503957 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:53.503844    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cs99k" event={"ID":"9ecd5589-20a1-49fe-87d7-51cdb0bfcb7f","Type":"ContainerStarted","Data":"4b7c3210b8fbde616fa0a2f8d617080ade813f6de98beb6add4b67a6d33fc014"}
Jul 07 17:17:53.526896 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:53.526842    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cs99k" podStartSLOduration=1.453985839 podStartE2EDuration="2.526827783s" totalImagesPullingTime="1.072841944s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:17:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:17:53.525120606 +0000 UTC m=+598.248373802" watchObservedRunningTime="2026-07-07 17:17:53.526827783 +0000 UTC m=+598.250080979"
Jul 07 17:17:55.943960 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:17:55.943871    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:18:01.981345 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:01.981296    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cs99k"
Jul 07 17:18:01.981834 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:01.981395    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cs99k"
Jul 07 17:18:01.993873 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:01.993842    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cs99k"
Jul 07 17:18:02.557305 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:02.557273    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-cs99k"
Jul 07 17:18:18.727054 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:18.726982    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:18:20.618019 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:20.617991    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:18:29.790552 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:29.790508    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-77lb5"]
Jul 07 17:18:29.794621 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:29.794592    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-77lb5"
Jul 07 17:18:29.798968 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:29.798942    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\""
Jul 07 17:18:29.811930 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:29.811899    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-77lb5"]
Jul 07 17:18:29.854555 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:29.854524    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:18:29.878993 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:29.878956    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3c55cec-17af-481f-973f-7fb262e0e859-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-77lb5\" (UID: \"b3c55cec-17af-481f-973f-7fb262e0e859\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-77lb5"
Jul 07 17:18:29.878993 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:29.878993    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fgtjs\" (UniqueName: \"kubernetes.io/projected/b3c55cec-17af-481f-973f-7fb262e0e859-kube-api-access-fgtjs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-77lb5\" (UID: \"b3c55cec-17af-481f-973f-7fb262e0e859\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-77lb5"
Jul 07 17:18:29.879331 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:29.879026    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3c55cec-17af-481f-973f-7fb262e0e859-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-77lb5\" (UID: \"b3c55cec-17af-481f-973f-7fb262e0e859\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-77lb5"
Jul 07 17:18:29.879331 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:29.879057    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3c55cec-17af-481f-973f-7fb262e0e859-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-77lb5\" (UID: \"b3c55cec-17af-481f-973f-7fb262e0e859\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-77lb5"
Jul 07 17:18:29.879331 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:29.879080    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3c55cec-17af-481f-973f-7fb262e0e859-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-77lb5\" (UID: \"b3c55cec-17af-481f-973f-7fb262e0e859\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-77lb5"
Jul 07 17:18:29.879331 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:29.879276    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3c55cec-17af-481f-973f-7fb262e0e859-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-77lb5\" (UID: \"b3c55cec-17af-481f-973f-7fb262e0e859\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-77lb5"
Jul 07 17:18:29.980362 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:29.980310    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3c55cec-17af-481f-973f-7fb262e0e859-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-77lb5\" (UID: \"b3c55cec-17af-481f-973f-7fb262e0e859\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-77lb5"
Jul 07 17:18:29.980546 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:29.980386    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3c55cec-17af-481f-973f-7fb262e0e859-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-77lb5\" (UID: \"b3c55cec-17af-481f-973f-7fb262e0e859\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-77lb5"
Jul 07 17:18:29.980546 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:29.980415    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fgtjs\" (UniqueName: \"kubernetes.io/projected/b3c55cec-17af-481f-973f-7fb262e0e859-kube-api-access-fgtjs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-77lb5\" (UID: \"b3c55cec-17af-481f-973f-7fb262e0e859\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-77lb5"
Jul 07 17:18:29.980546 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:29.980448    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3c55cec-17af-481f-973f-7fb262e0e859-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-77lb5\" (UID: \"b3c55cec-17af-481f-973f-7fb262e0e859\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-77lb5"
Jul 07 17:18:29.980546 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:29.980472    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3c55cec-17af-481f-973f-7fb262e0e859-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-77lb5\" (UID: \"b3c55cec-17af-481f-973f-7fb262e0e859\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-77lb5"
Jul 07 17:18:29.980546 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:29.980498    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3c55cec-17af-481f-973f-7fb262e0e859-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-77lb5\" (UID: \"b3c55cec-17af-481f-973f-7fb262e0e859\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-77lb5"
Jul 07 17:18:29.980909 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:29.980882    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b3c55cec-17af-481f-973f-7fb262e0e859-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-77lb5\" (UID: \"b3c55cec-17af-481f-973f-7fb262e0e859\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-77lb5"
Jul 07 17:18:29.980980 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:29.980903    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b3c55cec-17af-481f-973f-7fb262e0e859-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-77lb5\" (UID: \"b3c55cec-17af-481f-973f-7fb262e0e859\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-77lb5"
Jul 07 17:18:29.980980 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:29.980929    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b3c55cec-17af-481f-973f-7fb262e0e859-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-77lb5\" (UID: \"b3c55cec-17af-481f-973f-7fb262e0e859\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-77lb5"
Jul 07 17:18:29.982735 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:29.982708    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b3c55cec-17af-481f-973f-7fb262e0e859-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-77lb5\" (UID: \"b3c55cec-17af-481f-973f-7fb262e0e859\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-77lb5"
Jul 07 17:18:29.982927 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:29.982910    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b3c55cec-17af-481f-973f-7fb262e0e859-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-77lb5\" (UID: \"b3c55cec-17af-481f-973f-7fb262e0e859\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-77lb5"
Jul 07 17:18:29.993497 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:29.993472    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fgtjs\" (UniqueName: \"kubernetes.io/projected/b3c55cec-17af-481f-973f-7fb262e0e859-kube-api-access-fgtjs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-77lb5\" (UID: \"b3c55cec-17af-481f-973f-7fb262e0e859\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-77lb5"
Jul 07 17:18:30.104900 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:30.104800    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-77lb5"
Jul 07 17:18:30.260649 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:30.260619    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-77lb5"]
Jul 07 17:18:30.262957 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:18:30.262934    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb3c55cec_17af_481f_973f_7fb262e0e859.slice/crio-2c5df7d96f246772956933f5fcf73e4ba895664602ef0475bf29b7ef450f0902 WatchSource:0}: Error finding container 2c5df7d96f246772956933f5fcf73e4ba895664602ef0475bf29b7ef450f0902: Status 404 returned error can't find the container with id 2c5df7d96f246772956933f5fcf73e4ba895664602ef0475bf29b7ef450f0902
Jul 07 17:18:30.264341 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:30.264324    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 17:18:30.680104 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:30.680067    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-77lb5" event={"ID":"b3c55cec-17af-481f-973f-7fb262e0e859","Type":"ContainerStarted","Data":"4e2b3f5c3b9e8590e388296036ddc8c895a89c1468754d920420ff545ec843e8"}
Jul 07 17:18:30.680314 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:30.680127    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-77lb5" event={"ID":"b3c55cec-17af-481f-973f-7fb262e0e859","Type":"ContainerStarted","Data":"2c5df7d96f246772956933f5fcf73e4ba895664602ef0475bf29b7ef450f0902"}
Jul 07 17:18:30.709247 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:30.709173    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-77lb5" podStartSLOduration=1.477275861 podStartE2EDuration="1.709138292s" totalImagesPullingTime="231.862431ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:18:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:18:30.707766875 +0000 UTC m=+635.431020071" watchObservedRunningTime="2026-07-07 17:18:30.709138292 +0000 UTC m=+635.432391491"
Jul 07 17:18:38.589214 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:38.589177    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:18:40.105347 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:40.105299    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-77lb5"
Jul 07 17:18:40.105759 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:40.105370    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-77lb5"
Jul 07 17:18:40.118926 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:40.118895    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-77lb5"
Jul 07 17:18:40.739220 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:40.739192    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-77lb5"
Jul 07 17:18:50.580479 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:50.580445    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-jrz46"]
Jul 07 17:18:50.587062 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:50.587030    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jrz46"
Jul 07 17:18:50.589840 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:50.589813    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\""
Jul 07 17:18:50.597479 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:50.597455    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-jrz46"]
Jul 07 17:18:50.633795 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:50.633768    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:18:50.678985 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:50.678939    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f16cb088-5e71-4214-946a-040fd3750cbc-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jrz46\" (UID: \"f16cb088-5e71-4214-946a-040fd3750cbc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jrz46"
Jul 07 17:18:50.678985 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:50.678988    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f16cb088-5e71-4214-946a-040fd3750cbc-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jrz46\" (UID: \"f16cb088-5e71-4214-946a-040fd3750cbc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jrz46"
Jul 07 17:18:50.679405 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:50.679015    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f16cb088-5e71-4214-946a-040fd3750cbc-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jrz46\" (UID: \"f16cb088-5e71-4214-946a-040fd3750cbc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jrz46"
Jul 07 17:18:50.679405 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:50.679126    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f16cb088-5e71-4214-946a-040fd3750cbc-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jrz46\" (UID: \"f16cb088-5e71-4214-946a-040fd3750cbc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jrz46"
Jul 07 17:18:50.679405 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:50.679199    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f16cb088-5e71-4214-946a-040fd3750cbc-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jrz46\" (UID: \"f16cb088-5e71-4214-946a-040fd3750cbc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jrz46"
Jul 07 17:18:50.679405 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:50.679251    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6mqq\" (UniqueName: \"kubernetes.io/projected/f16cb088-5e71-4214-946a-040fd3750cbc-kube-api-access-f6mqq\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jrz46\" (UID: \"f16cb088-5e71-4214-946a-040fd3750cbc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jrz46"
Jul 07 17:18:50.779867 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:50.779830    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f16cb088-5e71-4214-946a-040fd3750cbc-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jrz46\" (UID: \"f16cb088-5e71-4214-946a-040fd3750cbc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jrz46"
Jul 07 17:18:50.779867 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:50.779866    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f16cb088-5e71-4214-946a-040fd3750cbc-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jrz46\" (UID: \"f16cb088-5e71-4214-946a-040fd3750cbc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jrz46"
Jul 07 17:18:50.780175 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:50.779884    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f16cb088-5e71-4214-946a-040fd3750cbc-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jrz46\" (UID: \"f16cb088-5e71-4214-946a-040fd3750cbc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jrz46"
Jul 07 17:18:50.780175 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:50.779930    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f16cb088-5e71-4214-946a-040fd3750cbc-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jrz46\" (UID: \"f16cb088-5e71-4214-946a-040fd3750cbc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jrz46"
Jul 07 17:18:50.780175 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:50.779946    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f16cb088-5e71-4214-946a-040fd3750cbc-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jrz46\" (UID: \"f16cb088-5e71-4214-946a-040fd3750cbc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jrz46"
Jul 07 17:18:50.780175 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:50.779987    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6mqq\" (UniqueName: \"kubernetes.io/projected/f16cb088-5e71-4214-946a-040fd3750cbc-kube-api-access-f6mqq\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jrz46\" (UID: \"f16cb088-5e71-4214-946a-040fd3750cbc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jrz46"
Jul 07 17:18:50.780406 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:50.780377    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f16cb088-5e71-4214-946a-040fd3750cbc-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jrz46\" (UID: \"f16cb088-5e71-4214-946a-040fd3750cbc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jrz46"
Jul 07 17:18:50.780474 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:50.780418    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f16cb088-5e71-4214-946a-040fd3750cbc-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jrz46\" (UID: \"f16cb088-5e71-4214-946a-040fd3750cbc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jrz46"
Jul 07 17:18:50.780539 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:50.780469    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f16cb088-5e71-4214-946a-040fd3750cbc-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jrz46\" (UID: \"f16cb088-5e71-4214-946a-040fd3750cbc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jrz46"
Jul 07 17:18:50.782201 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:50.782173    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f16cb088-5e71-4214-946a-040fd3750cbc-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jrz46\" (UID: \"f16cb088-5e71-4214-946a-040fd3750cbc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jrz46"
Jul 07 17:18:50.782591 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:50.782576    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f16cb088-5e71-4214-946a-040fd3750cbc-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jrz46\" (UID: \"f16cb088-5e71-4214-946a-040fd3750cbc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jrz46"
Jul 07 17:18:50.790291 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:50.790267    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6mqq\" (UniqueName: \"kubernetes.io/projected/f16cb088-5e71-4214-946a-040fd3750cbc-kube-api-access-f6mqq\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-jrz46\" (UID: \"f16cb088-5e71-4214-946a-040fd3750cbc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jrz46"
Jul 07 17:18:50.901237 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:50.901191    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jrz46"
Jul 07 17:18:51.039326 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:51.039298    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-jrz46"]
Jul 07 17:18:51.041097 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:18:51.041069    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf16cb088_5e71_4214_946a_040fd3750cbc.slice/crio-d4ccad31e5b114c41df250c4051069ec916d6ad6c05e7fa6e6f52e4d6b9df75d WatchSource:0}: Error finding container d4ccad31e5b114c41df250c4051069ec916d6ad6c05e7fa6e6f52e4d6b9df75d: Status 404 returned error can't find the container with id d4ccad31e5b114c41df250c4051069ec916d6ad6c05e7fa6e6f52e4d6b9df75d
Jul 07 17:18:51.787765 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:51.787729    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jrz46" event={"ID":"f16cb088-5e71-4214-946a-040fd3750cbc","Type":"ContainerStarted","Data":"b06a6065559b9b93a78c4da0144cd40f7258325e83a2da497804396e69e55b2b"}
Jul 07 17:18:51.788168 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:51.787807    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jrz46" event={"ID":"f16cb088-5e71-4214-946a-040fd3750cbc","Type":"ContainerStarted","Data":"d4ccad31e5b114c41df250c4051069ec916d6ad6c05e7fa6e6f52e4d6b9df75d"}
Jul 07 17:18:51.808727 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:51.808657    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jrz46" podStartSLOduration=1.620897436 podStartE2EDuration="1.808635441s" totalImagesPullingTime="187.738005ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:18:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:18:51.806634576 +0000 UTC m=+656.529887773" watchObservedRunningTime="2026-07-07 17:18:51.808635441 +0000 UTC m=+656.531888637"
Jul 07 17:18:52.140470 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:52.140432    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:18:52.211360 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:52.211317    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:18:55.186096 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:55.186061    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:18:55.288873 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:55.288838    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:18:58.508922 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:18:58.508887    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:19:00.901537 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:19:00.901496    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jrz46"
Jul 07 17:19:00.901926 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:19:00.901555    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jrz46"
Jul 07 17:19:00.913953 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:19:00.913926    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jrz46"
Jul 07 17:19:01.846492 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:19:01.846460    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-jrz46"
Jul 07 17:19:32.351863 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:19:32.351824    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:19:32.416141 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:19:32.416107    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:19:36.999854 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:19:36.999818    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:20:03.474073 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:20:03.474037    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:20:03.573873 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:20:03.573839    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:20:04.642884 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:20:04.642852    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:20:04.736338 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:20:04.736303    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:21:15.615404 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:21:15.615364    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:21:15.720256 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:21:15.720206    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-dbcbb4f4b-rgwbb"]
Jul 07 17:21:15.720514 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:21:15.720487    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-dbcbb4f4b-rgwbb" podUID="95895b07-fb7e-45e4-95c9-efde3661a898" containerName="manager" containerID="cri-o://c2b685fa555f9a29f01a0f0ea84e97ae1c0ca2f4f678c95a4f458f7a7cf88f0f" gracePeriod=30
Jul 07 17:21:15.986382 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:21:15.986351    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dbcbb4f4b-rgwbb"
Jul 07 17:21:16.096461 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:21:16.096422    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cchwt\" (UniqueName: \"kubernetes.io/projected/95895b07-fb7e-45e4-95c9-efde3661a898-kube-api-access-cchwt\") pod \"95895b07-fb7e-45e4-95c9-efde3661a898\" (UID: \"95895b07-fb7e-45e4-95c9-efde3661a898\") "
Jul 07 17:21:16.096650 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:21:16.096536    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/95895b07-fb7e-45e4-95c9-efde3661a898-webhook-cert\") pod \"95895b07-fb7e-45e4-95c9-efde3661a898\" (UID: \"95895b07-fb7e-45e4-95c9-efde3661a898\") "
Jul 07 17:21:16.098601 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:21:16.098561    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95895b07-fb7e-45e4-95c9-efde3661a898-kube-api-access-cchwt" (OuterVolumeSpecName: "kube-api-access-cchwt") pod "95895b07-fb7e-45e4-95c9-efde3661a898" (UID: "95895b07-fb7e-45e4-95c9-efde3661a898"). InnerVolumeSpecName "kube-api-access-cchwt". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:21:16.098721 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:21:16.098649    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/95895b07-fb7e-45e4-95c9-efde3661a898-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "95895b07-fb7e-45e4-95c9-efde3661a898" (UID: "95895b07-fb7e-45e4-95c9-efde3661a898"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:21:16.197371 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:21:16.197280    2562 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/95895b07-fb7e-45e4-95c9-efde3661a898-webhook-cert\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:21:16.197371 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:21:16.197312    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cchwt\" (UniqueName: \"kubernetes.io/projected/95895b07-fb7e-45e4-95c9-efde3661a898-kube-api-access-cchwt\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:21:16.498269 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:21:16.498137    2562 generic.go:356] "Generic (PLEG): container finished" podID="95895b07-fb7e-45e4-95c9-efde3661a898" containerID="c2b685fa555f9a29f01a0f0ea84e97ae1c0ca2f4f678c95a4f458f7a7cf88f0f" exitCode=0
Jul 07 17:21:16.498269 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:21:16.498211    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dbcbb4f4b-rgwbb"
Jul 07 17:21:16.498269 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:21:16.498224    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dbcbb4f4b-rgwbb" event={"ID":"95895b07-fb7e-45e4-95c9-efde3661a898","Type":"ContainerDied","Data":"c2b685fa555f9a29f01a0f0ea84e97ae1c0ca2f4f678c95a4f458f7a7cf88f0f"}
Jul 07 17:21:16.498269 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:21:16.498275    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dbcbb4f4b-rgwbb" event={"ID":"95895b07-fb7e-45e4-95c9-efde3661a898","Type":"ContainerDied","Data":"8e8384ac94380a87b1919b3be8758bc87189911e8bb139484f0ed525b237424f"}
Jul 07 17:21:16.498562 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:21:16.498302    2562 scope.go:117] "RemoveContainer" containerID="c2b685fa555f9a29f01a0f0ea84e97ae1c0ca2f4f678c95a4f458f7a7cf88f0f"
Jul 07 17:21:16.515194 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:21:16.515138    2562 scope.go:117] "RemoveContainer" containerID="c2b685fa555f9a29f01a0f0ea84e97ae1c0ca2f4f678c95a4f458f7a7cf88f0f"
Jul 07 17:21:16.515515 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:21:16.515494    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2b685fa555f9a29f01a0f0ea84e97ae1c0ca2f4f678c95a4f458f7a7cf88f0f\": container with ID starting with c2b685fa555f9a29f01a0f0ea84e97ae1c0ca2f4f678c95a4f458f7a7cf88f0f not found: ID does not exist" containerID="c2b685fa555f9a29f01a0f0ea84e97ae1c0ca2f4f678c95a4f458f7a7cf88f0f"
Jul 07 17:21:16.515627 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:21:16.515527    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2b685fa555f9a29f01a0f0ea84e97ae1c0ca2f4f678c95a4f458f7a7cf88f0f"} err="failed to get container status \"c2b685fa555f9a29f01a0f0ea84e97ae1c0ca2f4f678c95a4f458f7a7cf88f0f\": rpc error: code = NotFound desc = could not find container \"c2b685fa555f9a29f01a0f0ea84e97ae1c0ca2f4f678c95a4f458f7a7cf88f0f\": container with ID starting with c2b685fa555f9a29f01a0f0ea84e97ae1c0ca2f4f678c95a4f458f7a7cf88f0f not found: ID does not exist"
Jul 07 17:21:16.535721 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:21:16.535676    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-dbcbb4f4b-rgwbb"]
Jul 07 17:21:16.540850 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:21:16.540815    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-dbcbb4f4b-rgwbb"]
Jul 07 17:21:17.306033 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:21:17.305954    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:21:17.425924 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:21:17.425886    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-dbcbb4f4b-xz2qg"]
Jul 07 17:21:17.426270 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:21:17.426257    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95895b07-fb7e-45e4-95c9-efde3661a898" containerName="manager"
Jul 07 17:21:17.426319 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:21:17.426271    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="95895b07-fb7e-45e4-95c9-efde3661a898" containerName="manager"
Jul 07 17:21:17.426353 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:21:17.426323    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="95895b07-fb7e-45e4-95c9-efde3661a898" containerName="manager"
Jul 07 17:21:17.430793 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:21:17.430768    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dbcbb4f4b-xz2qg"
Jul 07 17:21:17.433933 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:21:17.433900    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-w7pgh\""
Jul 07 17:21:17.434081 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:21:17.433963    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\""
Jul 07 17:21:17.434081 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:21:17.433965    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\""
Jul 07 17:21:17.439353 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:21:17.439325    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-dbcbb4f4b-xz2qg"]
Jul 07 17:21:17.511228 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:21:17.511142    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6bab73cc-c48d-4359-809e-977f5c417d85-webhook-cert\") pod \"maas-controller-dbcbb4f4b-xz2qg\" (UID: \"6bab73cc-c48d-4359-809e-977f5c417d85\") " pod="opendatahub/maas-controller-dbcbb4f4b-xz2qg"
Jul 07 17:21:17.511404 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:21:17.511252    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nwf96\" (UniqueName: \"kubernetes.io/projected/6bab73cc-c48d-4359-809e-977f5c417d85-kube-api-access-nwf96\") pod \"maas-controller-dbcbb4f4b-xz2qg\" (UID: \"6bab73cc-c48d-4359-809e-977f5c417d85\") " pod="opendatahub/maas-controller-dbcbb4f4b-xz2qg"
Jul 07 17:21:17.612703 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:21:17.612595    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nwf96\" (UniqueName: \"kubernetes.io/projected/6bab73cc-c48d-4359-809e-977f5c417d85-kube-api-access-nwf96\") pod \"maas-controller-dbcbb4f4b-xz2qg\" (UID: \"6bab73cc-c48d-4359-809e-977f5c417d85\") " pod="opendatahub/maas-controller-dbcbb4f4b-xz2qg"
Jul 07 17:21:17.612888 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:21:17.612723    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6bab73cc-c48d-4359-809e-977f5c417d85-webhook-cert\") pod \"maas-controller-dbcbb4f4b-xz2qg\" (UID: \"6bab73cc-c48d-4359-809e-977f5c417d85\") " pod="opendatahub/maas-controller-dbcbb4f4b-xz2qg"
Jul 07 17:21:17.615140 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:21:17.615106    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6bab73cc-c48d-4359-809e-977f5c417d85-webhook-cert\") pod \"maas-controller-dbcbb4f4b-xz2qg\" (UID: \"6bab73cc-c48d-4359-809e-977f5c417d85\") " pod="opendatahub/maas-controller-dbcbb4f4b-xz2qg"
Jul 07 17:21:17.623275 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:21:17.623253    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nwf96\" (UniqueName: \"kubernetes.io/projected/6bab73cc-c48d-4359-809e-977f5c417d85-kube-api-access-nwf96\") pod \"maas-controller-dbcbb4f4b-xz2qg\" (UID: \"6bab73cc-c48d-4359-809e-977f5c417d85\") " pod="opendatahub/maas-controller-dbcbb4f4b-xz2qg"
Jul 07 17:21:17.741631 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:21:17.741592    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-dbcbb4f4b-xz2qg"
Jul 07 17:21:17.848662 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:21:17.848628    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95895b07-fb7e-45e4-95c9-efde3661a898" path="/var/lib/kubelet/pods/95895b07-fb7e-45e4-95c9-efde3661a898/volumes"
Jul 07 17:21:17.905795 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:21:17.905760    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-dbcbb4f4b-xz2qg"]
Jul 07 17:21:17.909863 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:21:17.909826    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bab73cc_c48d_4359_809e_977f5c417d85.slice/crio-3e133c5c35da8844e14748421665986fc86d12397fd8da56ea5fbc0c3c2028d5 WatchSource:0}: Error finding container 3e133c5c35da8844e14748421665986fc86d12397fd8da56ea5fbc0c3c2028d5: Status 404 returned error can't find the container with id 3e133c5c35da8844e14748421665986fc86d12397fd8da56ea5fbc0c3c2028d5
Jul 07 17:21:18.510897 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:21:18.510860    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dbcbb4f4b-xz2qg" event={"ID":"6bab73cc-c48d-4359-809e-977f5c417d85","Type":"ContainerStarted","Data":"6aaba8e089fdc3e6261d00e72eeefe0681db2c13a4f930887aab691818d83aa3"}
Jul 07 17:21:18.511425 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:21:18.510921    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-dbcbb4f4b-xz2qg" event={"ID":"6bab73cc-c48d-4359-809e-977f5c417d85","Type":"ContainerStarted","Data":"3e133c5c35da8844e14748421665986fc86d12397fd8da56ea5fbc0c3c2028d5"}
Jul 07 17:21:18.511425 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:21:18.510949    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-dbcbb4f4b-xz2qg"
Jul 07 17:21:18.538033 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:21:18.537975    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-dbcbb4f4b-xz2qg" podStartSLOduration=1.093193764 podStartE2EDuration="1.537959165s" totalImagesPullingTime="444.765401ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:21:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:21:18.535024077 +0000 UTC m=+803.258277264" watchObservedRunningTime="2026-07-07 17:21:18.537959165 +0000 UTC m=+803.261212370"
Jul 07 17:21:29.523380 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:21:29.523342    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-dbcbb4f4b-xz2qg"
Jul 07 17:21:49.854167 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:21:49.854127    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:21:49.957075 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:21:49.957037    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:21:50.084586 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:21:50.084554    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:21:56.581789 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:21:56.581757    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:21:56.656937 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:21:56.656905    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:21:56.742478 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:21:56.742439    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:21:56.946517 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:21:56.946477    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:22:03.364731 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:22:03.364664    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:22:03.435305 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:22:03.435276    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:25:55.924496 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:25:55.924399    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vc6qq"]
Jul 07 17:25:55.925082 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:25:55.924634    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vc6qq" podUID="89e55097-87b6-4e2c-a8dc-a9549172f8f3" containerName="manager" containerID="cri-o://361a2850143c1bd730791f6a6f567e10a7b93b9e865528ffebbbf8e7c459292f" gracePeriod=10
Jul 07 17:25:59.581504 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:25:59.581474    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vc6qq"
Jul 07 17:25:59.732891 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:25:59.732794    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/89e55097-87b6-4e2c-a8dc-a9549172f8f3-extensions-socket-volume\") pod \"89e55097-87b6-4e2c-a8dc-a9549172f8f3\" (UID: \"89e55097-87b6-4e2c-a8dc-a9549172f8f3\") "
Jul 07 17:25:59.732891 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:25:59.732842    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pl4nz\" (UniqueName: \"kubernetes.io/projected/89e55097-87b6-4e2c-a8dc-a9549172f8f3-kube-api-access-pl4nz\") pod \"89e55097-87b6-4e2c-a8dc-a9549172f8f3\" (UID: \"89e55097-87b6-4e2c-a8dc-a9549172f8f3\") "
Jul 07 17:25:59.733303 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:25:59.733280    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/89e55097-87b6-4e2c-a8dc-a9549172f8f3-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "89e55097-87b6-4e2c-a8dc-a9549172f8f3" (UID: "89e55097-87b6-4e2c-a8dc-a9549172f8f3"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:25:59.735209 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:25:59.735135    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/89e55097-87b6-4e2c-a8dc-a9549172f8f3-kube-api-access-pl4nz" (OuterVolumeSpecName: "kube-api-access-pl4nz") pod "89e55097-87b6-4e2c-a8dc-a9549172f8f3" (UID: "89e55097-87b6-4e2c-a8dc-a9549172f8f3"). InnerVolumeSpecName "kube-api-access-pl4nz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:25:59.834072 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:25:59.834024    2562 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/89e55097-87b6-4e2c-a8dc-a9549172f8f3-extensions-socket-volume\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:25:59.834072 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:25:59.834061    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pl4nz\" (UniqueName: \"kubernetes.io/projected/89e55097-87b6-4e2c-a8dc-a9549172f8f3-kube-api-access-pl4nz\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:25:59.879544 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:25:59.879514    2562 generic.go:356] "Generic (PLEG): container finished" podID="89e55097-87b6-4e2c-a8dc-a9549172f8f3" containerID="361a2850143c1bd730791f6a6f567e10a7b93b9e865528ffebbbf8e7c459292f" exitCode=0
Jul 07 17:25:59.879750 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:25:59.879559    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vc6qq"
Jul 07 17:25:59.879750 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:25:59.879578    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vc6qq" event={"ID":"89e55097-87b6-4e2c-a8dc-a9549172f8f3","Type":"ContainerDied","Data":"361a2850143c1bd730791f6a6f567e10a7b93b9e865528ffebbbf8e7c459292f"}
Jul 07 17:25:59.879750 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:25:59.879625    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vc6qq" event={"ID":"89e55097-87b6-4e2c-a8dc-a9549172f8f3","Type":"ContainerDied","Data":"8871a2d35004af0298a1888e044df4e81ea56e237cd9e0b89af78beaacd350ac"}
Jul 07 17:25:59.879750 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:25:59.879647    2562 scope.go:117] "RemoveContainer" containerID="361a2850143c1bd730791f6a6f567e10a7b93b9e865528ffebbbf8e7c459292f"
Jul 07 17:25:59.891804 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:25:59.891780    2562 scope.go:117] "RemoveContainer" containerID="361a2850143c1bd730791f6a6f567e10a7b93b9e865528ffebbbf8e7c459292f"
Jul 07 17:25:59.892213 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:25:59.892180    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"361a2850143c1bd730791f6a6f567e10a7b93b9e865528ffebbbf8e7c459292f\": container with ID starting with 361a2850143c1bd730791f6a6f567e10a7b93b9e865528ffebbbf8e7c459292f not found: ID does not exist" containerID="361a2850143c1bd730791f6a6f567e10a7b93b9e865528ffebbbf8e7c459292f"
Jul 07 17:25:59.892341 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:25:59.892221    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"361a2850143c1bd730791f6a6f567e10a7b93b9e865528ffebbbf8e7c459292f"} err="failed to get container status \"361a2850143c1bd730791f6a6f567e10a7b93b9e865528ffebbbf8e7c459292f\": rpc error: code = NotFound desc = could not find container \"361a2850143c1bd730791f6a6f567e10a7b93b9e865528ffebbbf8e7c459292f\": container with ID starting with 361a2850143c1bd730791f6a6f567e10a7b93b9e865528ffebbbf8e7c459292f not found: ID does not exist"
Jul 07 17:25:59.905481 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:25:59.905448    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vc6qq"]
Jul 07 17:25:59.912435 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:25:59.912400    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-vc6qq"]
Jul 07 17:26:01.846028 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:26:01.845989    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="89e55097-87b6-4e2c-a8dc-a9549172f8f3" path="/var/lib/kubelet/pods/89e55097-87b6-4e2c-a8dc-a9549172f8f3/volumes"
Jul 07 17:26:57.095396 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:26:57.095361    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r82t6"]
Jul 07 17:26:57.095810 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:26:57.095736    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="89e55097-87b6-4e2c-a8dc-a9549172f8f3" containerName="manager"
Jul 07 17:26:57.095810 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:26:57.095748    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="89e55097-87b6-4e2c-a8dc-a9549172f8f3" containerName="manager"
Jul 07 17:26:57.095881 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:26:57.095821    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="89e55097-87b6-4e2c-a8dc-a9549172f8f3" containerName="manager"
Jul 07 17:26:57.101174 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:26:57.101115    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r82t6"
Jul 07 17:26:57.104086 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:26:57.104058    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-bq2nk\""
Jul 07 17:26:57.113749 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:26:57.113715    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r82t6"]
Jul 07 17:26:57.168730 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:26:57.168688    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/97c9de77-1237-4d8e-8744-511366b65e34-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-r82t6\" (UID: \"97c9de77-1237-4d8e-8744-511366b65e34\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r82t6"
Jul 07 17:26:57.168730 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:26:57.168729    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bl6xf\" (UniqueName: \"kubernetes.io/projected/97c9de77-1237-4d8e-8744-511366b65e34-kube-api-access-bl6xf\") pod \"kuadrant-operator-controller-manager-86878c769f-r82t6\" (UID: \"97c9de77-1237-4d8e-8744-511366b65e34\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r82t6"
Jul 07 17:26:57.269518 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:26:57.269475    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/97c9de77-1237-4d8e-8744-511366b65e34-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-r82t6\" (UID: \"97c9de77-1237-4d8e-8744-511366b65e34\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r82t6"
Jul 07 17:26:57.269518 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:26:57.269520    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bl6xf\" (UniqueName: \"kubernetes.io/projected/97c9de77-1237-4d8e-8744-511366b65e34-kube-api-access-bl6xf\") pod \"kuadrant-operator-controller-manager-86878c769f-r82t6\" (UID: \"97c9de77-1237-4d8e-8744-511366b65e34\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r82t6"
Jul 07 17:26:57.269875 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:26:57.269856    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/97c9de77-1237-4d8e-8744-511366b65e34-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-r82t6\" (UID: \"97c9de77-1237-4d8e-8744-511366b65e34\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r82t6"
Jul 07 17:26:57.278790 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:26:57.278755    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bl6xf\" (UniqueName: \"kubernetes.io/projected/97c9de77-1237-4d8e-8744-511366b65e34-kube-api-access-bl6xf\") pod \"kuadrant-operator-controller-manager-86878c769f-r82t6\" (UID: \"97c9de77-1237-4d8e-8744-511366b65e34\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r82t6"
Jul 07 17:26:57.413142 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:26:57.413109    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r82t6"
Jul 07 17:26:57.557259 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:26:57.557232    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r82t6"]
Jul 07 17:26:57.559549 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:26:57.559526    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97c9de77_1237_4d8e_8744_511366b65e34.slice/crio-bcb0a232e68e5a2c2a42ff38f3eb0034a2752493d49e68c119154084e3831e3d WatchSource:0}: Error finding container bcb0a232e68e5a2c2a42ff38f3eb0034a2752493d49e68c119154084e3831e3d: Status 404 returned error can't find the container with id bcb0a232e68e5a2c2a42ff38f3eb0034a2752493d49e68c119154084e3831e3d
Jul 07 17:26:58.146865 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:26:58.146828    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r82t6" event={"ID":"97c9de77-1237-4d8e-8744-511366b65e34","Type":"ContainerStarted","Data":"b0d22ba1bce136d6be4f97ba97feef40b79febeab90abcf9dc51161abc42e76a"}
Jul 07 17:26:58.147358 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:26:58.146883    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r82t6" event={"ID":"97c9de77-1237-4d8e-8744-511366b65e34","Type":"ContainerStarted","Data":"bcb0a232e68e5a2c2a42ff38f3eb0034a2752493d49e68c119154084e3831e3d"}
Jul 07 17:26:58.147358 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:26:58.146905    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r82t6"
Jul 07 17:26:58.173370 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:26:58.173312    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r82t6" podStartSLOduration=1.17329351 podStartE2EDuration="1.17329351s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:26:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:26:58.171187475 +0000 UTC m=+1142.894440671" watchObservedRunningTime="2026-07-07 17:26:58.17329351 +0000 UTC m=+1142.896546705"
Jul 07 17:27:09.154463 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:27:09.154427    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-r82t6"
Jul 07 17:27:38.497356 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:27:38.497260    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:28:16.445458 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:28:16.445407    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:28:17.915836 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:28:17.915797    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:28:35.170886 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:28:35.170845    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:28:35.261989 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:28:35.261957    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:30:00.166549 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:30:00.166516    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-key-cleanup-29724090-cqv6v"]
Jul 07 17:30:00.169953 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:30:00.169934    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724090-cqv6v"
Jul 07 17:30:00.240869 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:30:00.240834    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29724090-cqv6v"]
Jul 07 17:30:00.318225 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:30:00.318185    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnl67\" (UniqueName: \"kubernetes.io/projected/2cf4e327-d785-4810-bd94-fff3ae50f434-kube-api-access-bnl67\") pod \"maas-api-key-cleanup-29724090-cqv6v\" (UID: \"2cf4e327-d785-4810-bd94-fff3ae50f434\") " pod="opendatahub/maas-api-key-cleanup-29724090-cqv6v"
Jul 07 17:30:00.419672 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:30:00.419570    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnl67\" (UniqueName: \"kubernetes.io/projected/2cf4e327-d785-4810-bd94-fff3ae50f434-kube-api-access-bnl67\") pod \"maas-api-key-cleanup-29724090-cqv6v\" (UID: \"2cf4e327-d785-4810-bd94-fff3ae50f434\") " pod="opendatahub/maas-api-key-cleanup-29724090-cqv6v"
Jul 07 17:30:00.434492 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:30:00.434452    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnl67\" (UniqueName: \"kubernetes.io/projected/2cf4e327-d785-4810-bd94-fff3ae50f434-kube-api-access-bnl67\") pod \"maas-api-key-cleanup-29724090-cqv6v\" (UID: \"2cf4e327-d785-4810-bd94-fff3ae50f434\") " pod="opendatahub/maas-api-key-cleanup-29724090-cqv6v"
Jul 07 17:30:00.480124 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:30:00.480087    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724090-cqv6v"
Jul 07 17:30:00.630487 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:30:00.630452    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-key-cleanup-29724090-cqv6v"]
Jul 07 17:30:00.632223 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:30:00.632190    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2cf4e327_d785_4810_bd94_fff3ae50f434.slice/crio-5c399bf03d0aebdc437171895da0638dacc35c2354e71e296c716247f5ba030f WatchSource:0}: Error finding container 5c399bf03d0aebdc437171895da0638dacc35c2354e71e296c716247f5ba030f: Status 404 returned error can't find the container with id 5c399bf03d0aebdc437171895da0638dacc35c2354e71e296c716247f5ba030f
Jul 07 17:30:00.634384 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:30:00.634362    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 17:30:01.058002 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:30:01.057961    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724090-cqv6v" event={"ID":"2cf4e327-d785-4810-bd94-fff3ae50f434","Type":"ContainerStarted","Data":"5c399bf03d0aebdc437171895da0638dacc35c2354e71e296c716247f5ba030f"}
Jul 07 17:30:05.079826 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:30:05.079783    2562 generic.go:356] "Generic (PLEG): container finished" podID="2cf4e327-d785-4810-bd94-fff3ae50f434" containerID="91e1f1120887db479e3c19a0260a33ae392ced815c0d159c7e6336e3061ecdf4" exitCode=0
Jul 07 17:30:05.080278 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:30:05.079850    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724090-cqv6v" event={"ID":"2cf4e327-d785-4810-bd94-fff3ae50f434","Type":"ContainerDied","Data":"91e1f1120887db479e3c19a0260a33ae392ced815c0d159c7e6336e3061ecdf4"}
Jul 07 17:30:06.224317 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:30:06.224284    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724090-cqv6v"
Jul 07 17:30:06.379863 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:30:06.379830    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bnl67\" (UniqueName: \"kubernetes.io/projected/2cf4e327-d785-4810-bd94-fff3ae50f434-kube-api-access-bnl67\") pod \"2cf4e327-d785-4810-bd94-fff3ae50f434\" (UID: \"2cf4e327-d785-4810-bd94-fff3ae50f434\") "
Jul 07 17:30:06.381968 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:30:06.381934    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2cf4e327-d785-4810-bd94-fff3ae50f434-kube-api-access-bnl67" (OuterVolumeSpecName: "kube-api-access-bnl67") pod "2cf4e327-d785-4810-bd94-fff3ae50f434" (UID: "2cf4e327-d785-4810-bd94-fff3ae50f434"). InnerVolumeSpecName "kube-api-access-bnl67". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:30:06.480786 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:30:06.480748    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bnl67\" (UniqueName: \"kubernetes.io/projected/2cf4e327-d785-4810-bd94-fff3ae50f434-kube-api-access-bnl67\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:30:07.090852 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:30:07.090814    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-key-cleanup-29724090-cqv6v"
Jul 07 17:30:07.091028 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:30:07.090854    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-key-cleanup-29724090-cqv6v" event={"ID":"2cf4e327-d785-4810-bd94-fff3ae50f434","Type":"ContainerDied","Data":"5c399bf03d0aebdc437171895da0638dacc35c2354e71e296c716247f5ba030f"}
Jul 07 17:30:07.091028 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:30:07.090903    2562 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="5c399bf03d0aebdc437171895da0638dacc35c2354e71e296c716247f5ba030f"
Jul 07 17:31:41.060850 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:31:41.060811    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:31:41.217985 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:31:41.217953    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:32:31.097539 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:32:31.097503    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:32:42.291685 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:32:42.291651    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:32:57.692001 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:32:57.691964    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:33:12.836067 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:12.836033    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:33:20.215560 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:20.215476    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:33:25.396834 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:25.396800    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:33:28.454300 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:28.454265    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:33:28.573433 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:28.573392    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:33:29.026556 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:29.026526    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:33:35.448754 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:35.448716    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:33:35.612675 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:35.612634    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:33:35.739475 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:35.739377    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:33:35.838553 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:35.838519    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:33:36.948893 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:36.948857    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:33:37.088373 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:37.088338    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-9d5662de-576c8f6c5f-xd7gr"]
Jul 07 17:33:37.088730 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:37.088717    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2cf4e327-d785-4810-bd94-fff3ae50f434" containerName="cleanup"
Jul 07 17:33:37.088785 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:37.088732    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="2cf4e327-d785-4810-bd94-fff3ae50f434" containerName="cleanup"
Jul 07 17:33:37.088819 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:37.088796    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="2cf4e327-d785-4810-bd94-fff3ae50f434" containerName="cleanup"
Jul 07 17:33:37.092081 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:37.092047    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:33:37.092909 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:37.092885    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-9d5662de-576c8f6c5f-xd7gr"
Jul 07 17:33:37.097394 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:37.097354    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-9d5662de-serving-cert\""
Jul 07 17:33:37.108581 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:37.108550    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-9d5662de-576c8f6c5f-xd7gr"]
Jul 07 17:33:37.187420 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:37.187382    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:33:37.201645 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:37.201553    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff38c199-406c-4e24-8be4-9f058d0cb8e5-maas-api-tls\") pod \"maas-api-e2e-ait-9d5662de-576c8f6c5f-xd7gr\" (UID: \"ff38c199-406c-4e24-8be4-9f058d0cb8e5\") " pod="opendatahub/maas-api-e2e-ait-9d5662de-576c8f6c5f-xd7gr"
Jul 07 17:33:37.201645 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:37.201596    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9mrql\" (UniqueName: \"kubernetes.io/projected/ff38c199-406c-4e24-8be4-9f058d0cb8e5-kube-api-access-9mrql\") pod \"maas-api-e2e-ait-9d5662de-576c8f6c5f-xd7gr\" (UID: \"ff38c199-406c-4e24-8be4-9f058d0cb8e5\") " pod="opendatahub/maas-api-e2e-ait-9d5662de-576c8f6c5f-xd7gr"
Jul 07 17:33:37.201853 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:37.201721    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff38c199-406c-4e24-8be4-9f058d0cb8e5-openshift-service-ca\") pod \"maas-api-e2e-ait-9d5662de-576c8f6c5f-xd7gr\" (UID: \"ff38c199-406c-4e24-8be4-9f058d0cb8e5\") " pod="opendatahub/maas-api-e2e-ait-9d5662de-576c8f6c5f-xd7gr"
Jul 07 17:33:37.303119 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:37.303081    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff38c199-406c-4e24-8be4-9f058d0cb8e5-openshift-service-ca\") pod \"maas-api-e2e-ait-9d5662de-576c8f6c5f-xd7gr\" (UID: \"ff38c199-406c-4e24-8be4-9f058d0cb8e5\") " pod="opendatahub/maas-api-e2e-ait-9d5662de-576c8f6c5f-xd7gr"
Jul 07 17:33:37.303331 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:37.303182    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff38c199-406c-4e24-8be4-9f058d0cb8e5-maas-api-tls\") pod \"maas-api-e2e-ait-9d5662de-576c8f6c5f-xd7gr\" (UID: \"ff38c199-406c-4e24-8be4-9f058d0cb8e5\") " pod="opendatahub/maas-api-e2e-ait-9d5662de-576c8f6c5f-xd7gr"
Jul 07 17:33:37.303383 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:37.303363    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9mrql\" (UniqueName: \"kubernetes.io/projected/ff38c199-406c-4e24-8be4-9f058d0cb8e5-kube-api-access-9mrql\") pod \"maas-api-e2e-ait-9d5662de-576c8f6c5f-xd7gr\" (UID: \"ff38c199-406c-4e24-8be4-9f058d0cb8e5\") " pod="opendatahub/maas-api-e2e-ait-9d5662de-576c8f6c5f-xd7gr"
Jul 07 17:33:37.303952 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:37.303932    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff38c199-406c-4e24-8be4-9f058d0cb8e5-openshift-service-ca\") pod \"maas-api-e2e-ait-9d5662de-576c8f6c5f-xd7gr\" (UID: \"ff38c199-406c-4e24-8be4-9f058d0cb8e5\") " pod="opendatahub/maas-api-e2e-ait-9d5662de-576c8f6c5f-xd7gr"
Jul 07 17:33:37.305713 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:37.305692    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff38c199-406c-4e24-8be4-9f058d0cb8e5-maas-api-tls\") pod \"maas-api-e2e-ait-9d5662de-576c8f6c5f-xd7gr\" (UID: \"ff38c199-406c-4e24-8be4-9f058d0cb8e5\") " pod="opendatahub/maas-api-e2e-ait-9d5662de-576c8f6c5f-xd7gr"
Jul 07 17:33:37.336881 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:37.336847    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9mrql\" (UniqueName: \"kubernetes.io/projected/ff38c199-406c-4e24-8be4-9f058d0cb8e5-kube-api-access-9mrql\") pod \"maas-api-e2e-ait-9d5662de-576c8f6c5f-xd7gr\" (UID: \"ff38c199-406c-4e24-8be4-9f058d0cb8e5\") " pod="opendatahub/maas-api-e2e-ait-9d5662de-576c8f6c5f-xd7gr"
Jul 07 17:33:37.364011 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:37.363974    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:33:37.405266 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:37.405223    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-9d5662de-576c8f6c5f-xd7gr"
Jul 07 17:33:37.562984 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:37.562954    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-9d5662de-576c8f6c5f-xd7gr"]
Jul 07 17:33:37.566026 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:33:37.565999    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff38c199_406c_4e24_8be4_9f058d0cb8e5.slice/crio-8c429c6e2c00314fd8d3a52cd89d4c93a319c86ef2a2a2f13ec7b393f2af3436 WatchSource:0}: Error finding container 8c429c6e2c00314fd8d3a52cd89d4c93a319c86ef2a2a2f13ec7b393f2af3436: Status 404 returned error can't find the container with id 8c429c6e2c00314fd8d3a52cd89d4c93a319c86ef2a2a2f13ec7b393f2af3436
Jul 07 17:33:38.008267 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:38.008232    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:33:38.131507 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:38.131475    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:33:38.159436 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:38.159407    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-9d5662de-576c8f6c5f-xd7gr" event={"ID":"ff38c199-406c-4e24-8be4-9f058d0cb8e5","Type":"ContainerStarted","Data":"8c429c6e2c00314fd8d3a52cd89d4c93a319c86ef2a2a2f13ec7b393f2af3436"}
Jul 07 17:33:39.166287 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:39.166252    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-9d5662de-576c8f6c5f-xd7gr" event={"ID":"ff38c199-406c-4e24-8be4-9f058d0cb8e5","Type":"ContainerStarted","Data":"4dcc6a592c87c9a5510ca8bcce31664638ef286bd1f5364153353cda2a890c85"}
Jul 07 17:33:39.166689 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:39.166318    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-9d5662de-576c8f6c5f-xd7gr"
Jul 07 17:33:39.211681 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:39.211625    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-9d5662de-576c8f6c5f-xd7gr" podStartSLOduration=1.6269790880000001 podStartE2EDuration="2.211605917s" totalImagesPullingTime="584.626829ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:33:37 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:33:39.209690026 +0000 UTC m=+1543.932943223" watchObservedRunningTime="2026-07-07 17:33:39.211605917 +0000 UTC m=+1543.934859114"
Jul 07 17:33:39.701094 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:39.701065    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:33:42.062824 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:42.062787    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:33:42.248507 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:42.248427    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:33:42.366866 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:42.366785    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:33:42.711956 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:42.711914    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-9d5662de-576c8f6c5f-xd7gr"]
Jul 07 17:33:42.712252 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:42.712225    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-9d5662de-576c8f6c5f-xd7gr" podUID="ff38c199-406c-4e24-8be4-9f058d0cb8e5" containerName="maas-api" containerID="cri-o://4dcc6a592c87c9a5510ca8bcce31664638ef286bd1f5364153353cda2a890c85" gracePeriod=30
Jul 07 17:33:42.884134 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:42.884107    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:33:42.957451 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:42.957419    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-9d5662de-576c8f6c5f-xd7gr"
Jul 07 17:33:43.059516 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:43.059416    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9mrql\" (UniqueName: \"kubernetes.io/projected/ff38c199-406c-4e24-8be4-9f058d0cb8e5-kube-api-access-9mrql\") pod \"ff38c199-406c-4e24-8be4-9f058d0cb8e5\" (UID: \"ff38c199-406c-4e24-8be4-9f058d0cb8e5\") "
Jul 07 17:33:43.059516 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:43.059477    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff38c199-406c-4e24-8be4-9f058d0cb8e5-openshift-service-ca\") pod \"ff38c199-406c-4e24-8be4-9f058d0cb8e5\" (UID: \"ff38c199-406c-4e24-8be4-9f058d0cb8e5\") "
Jul 07 17:33:43.059516 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:43.059508    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff38c199-406c-4e24-8be4-9f058d0cb8e5-maas-api-tls\") pod \"ff38c199-406c-4e24-8be4-9f058d0cb8e5\" (UID: \"ff38c199-406c-4e24-8be4-9f058d0cb8e5\") "
Jul 07 17:33:43.059902 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:43.059879    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ff38c199-406c-4e24-8be4-9f058d0cb8e5-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "ff38c199-406c-4e24-8be4-9f058d0cb8e5" (UID: "ff38c199-406c-4e24-8be4-9f058d0cb8e5"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:33:43.061643 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:43.061612    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ff38c199-406c-4e24-8be4-9f058d0cb8e5-kube-api-access-9mrql" (OuterVolumeSpecName: "kube-api-access-9mrql") pod "ff38c199-406c-4e24-8be4-9f058d0cb8e5" (UID: "ff38c199-406c-4e24-8be4-9f058d0cb8e5"). InnerVolumeSpecName "kube-api-access-9mrql". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:33:43.061643 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:43.061632    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ff38c199-406c-4e24-8be4-9f058d0cb8e5-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "ff38c199-406c-4e24-8be4-9f058d0cb8e5" (UID: "ff38c199-406c-4e24-8be4-9f058d0cb8e5"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:33:43.160709 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:43.160675    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9mrql\" (UniqueName: \"kubernetes.io/projected/ff38c199-406c-4e24-8be4-9f058d0cb8e5-kube-api-access-9mrql\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:33:43.160709 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:43.160703    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/ff38c199-406c-4e24-8be4-9f058d0cb8e5-openshift-service-ca\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:33:43.160709 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:43.160714    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/ff38c199-406c-4e24-8be4-9f058d0cb8e5-maas-api-tls\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:33:43.185973 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:43.185933    2562 generic.go:356] "Generic (PLEG): container finished" podID="ff38c199-406c-4e24-8be4-9f058d0cb8e5" containerID="4dcc6a592c87c9a5510ca8bcce31664638ef286bd1f5364153353cda2a890c85" exitCode=0
Jul 07 17:33:43.186178 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:43.185987    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-9d5662de-576c8f6c5f-xd7gr"
Jul 07 17:33:43.186178 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:43.186026    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-9d5662de-576c8f6c5f-xd7gr" event={"ID":"ff38c199-406c-4e24-8be4-9f058d0cb8e5","Type":"ContainerDied","Data":"4dcc6a592c87c9a5510ca8bcce31664638ef286bd1f5364153353cda2a890c85"}
Jul 07 17:33:43.186178 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:43.186084    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-9d5662de-576c8f6c5f-xd7gr" event={"ID":"ff38c199-406c-4e24-8be4-9f058d0cb8e5","Type":"ContainerDied","Data":"8c429c6e2c00314fd8d3a52cd89d4c93a319c86ef2a2a2f13ec7b393f2af3436"}
Jul 07 17:33:43.186178 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:43.186108    2562 scope.go:117] "RemoveContainer" containerID="4dcc6a592c87c9a5510ca8bcce31664638ef286bd1f5364153353cda2a890c85"
Jul 07 17:33:43.195242 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:43.195222    2562 scope.go:117] "RemoveContainer" containerID="4dcc6a592c87c9a5510ca8bcce31664638ef286bd1f5364153353cda2a890c85"
Jul 07 17:33:43.195519 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:33:43.195502    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4dcc6a592c87c9a5510ca8bcce31664638ef286bd1f5364153353cda2a890c85\": container with ID starting with 4dcc6a592c87c9a5510ca8bcce31664638ef286bd1f5364153353cda2a890c85 not found: ID does not exist" containerID="4dcc6a592c87c9a5510ca8bcce31664638ef286bd1f5364153353cda2a890c85"
Jul 07 17:33:43.195566 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:43.195528    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4dcc6a592c87c9a5510ca8bcce31664638ef286bd1f5364153353cda2a890c85"} err="failed to get container status \"4dcc6a592c87c9a5510ca8bcce31664638ef286bd1f5364153353cda2a890c85\": rpc error: code = NotFound desc = could not find container \"4dcc6a592c87c9a5510ca8bcce31664638ef286bd1f5364153353cda2a890c85\": container with ID starting with 4dcc6a592c87c9a5510ca8bcce31664638ef286bd1f5364153353cda2a890c85 not found: ID does not exist"
Jul 07 17:33:43.209336 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:43.209308    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-9d5662de-576c8f6c5f-xd7gr"]
Jul 07 17:33:43.215005 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:43.214983    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-9d5662de-576c8f6c5f-xd7gr"]
Jul 07 17:33:43.550712 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:43.550684    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:33:43.846369 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:43.846291    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ff38c199-406c-4e24-8be4-9f058d0cb8e5" path="/var/lib/kubelet/pods/ff38c199-406c-4e24-8be4-9f058d0cb8e5/volumes"
Jul 07 17:33:49.929934 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:49.929898    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:33:50.029092 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:50.029060    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:33:50.161235 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:50.161195    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb"]
Jul 07 17:33:50.161609 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:50.161594    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ff38c199-406c-4e24-8be4-9f058d0cb8e5" containerName="maas-api"
Jul 07 17:33:50.161662 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:50.161610    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="ff38c199-406c-4e24-8be4-9f058d0cb8e5" containerName="maas-api"
Jul 07 17:33:50.161699 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:50.161685    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="ff38c199-406c-4e24-8be4-9f058d0cb8e5" containerName="maas-api"
Jul 07 17:33:50.165905 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:50.165886    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb"
Jul 07 17:33:50.170971 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:50.170950    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-c7d7d193-openshift-default-dockercfg-qxtzp\""
Jul 07 17:33:50.189032 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:50.188959    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb"]
Jul 07 17:33:50.221671 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:50.221642    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:33:50.308613 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:50.308571    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:33:50.328837 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:50.328805    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2860e16-7181-41e8-a7ef-1cb3b78f06e9-istio-envoy\") pod \"e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb\" (UID: \"b2860e16-7181-41e8-a7ef-1cb3b78f06e9\") " pod="openshift-ingress/e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb"
Jul 07 17:33:50.328837 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:50.328835    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2860e16-7181-41e8-a7ef-1cb3b78f06e9-istio-podinfo\") pod \"e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb\" (UID: \"b2860e16-7181-41e8-a7ef-1cb3b78f06e9\") " pod="openshift-ingress/e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb"
Jul 07 17:33:50.329093 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:50.328868    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2860e16-7181-41e8-a7ef-1cb3b78f06e9-istio-data\") pod \"e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb\" (UID: \"b2860e16-7181-41e8-a7ef-1cb3b78f06e9\") " pod="openshift-ingress/e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb"
Jul 07 17:33:50.329093 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:50.328943    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bg7h2\" (UniqueName: \"kubernetes.io/projected/b2860e16-7181-41e8-a7ef-1cb3b78f06e9-kube-api-access-bg7h2\") pod \"e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb\" (UID: \"b2860e16-7181-41e8-a7ef-1cb3b78f06e9\") " pod="openshift-ingress/e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb"
Jul 07 17:33:50.329093 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:50.328994    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2860e16-7181-41e8-a7ef-1cb3b78f06e9-istiod-ca-cert\") pod \"e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb\" (UID: \"b2860e16-7181-41e8-a7ef-1cb3b78f06e9\") " pod="openshift-ingress/e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb"
Jul 07 17:33:50.329093 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:50.329033    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2860e16-7181-41e8-a7ef-1cb3b78f06e9-istio-token\") pod \"e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb\" (UID: \"b2860e16-7181-41e8-a7ef-1cb3b78f06e9\") " pod="openshift-ingress/e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb"
Jul 07 17:33:50.329093 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:50.329070    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2860e16-7181-41e8-a7ef-1cb3b78f06e9-workload-socket\") pod \"e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb\" (UID: \"b2860e16-7181-41e8-a7ef-1cb3b78f06e9\") " pod="openshift-ingress/e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb"
Jul 07 17:33:50.329348 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:50.329101    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2860e16-7181-41e8-a7ef-1cb3b78f06e9-workload-certs\") pod \"e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb\" (UID: \"b2860e16-7181-41e8-a7ef-1cb3b78f06e9\") " pod="openshift-ingress/e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb"
Jul 07 17:33:50.329348 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:50.329136    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2860e16-7181-41e8-a7ef-1cb3b78f06e9-credential-socket\") pod \"e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb\" (UID: \"b2860e16-7181-41e8-a7ef-1cb3b78f06e9\") " pod="openshift-ingress/e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb"
Jul 07 17:33:50.430532 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:50.430493    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2860e16-7181-41e8-a7ef-1cb3b78f06e9-istio-envoy\") pod \"e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb\" (UID: \"b2860e16-7181-41e8-a7ef-1cb3b78f06e9\") " pod="openshift-ingress/e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb"
Jul 07 17:33:50.430532 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:50.430532    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2860e16-7181-41e8-a7ef-1cb3b78f06e9-istio-podinfo\") pod \"e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb\" (UID: \"b2860e16-7181-41e8-a7ef-1cb3b78f06e9\") " pod="openshift-ingress/e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb"
Jul 07 17:33:50.430779 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:50.430554    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2860e16-7181-41e8-a7ef-1cb3b78f06e9-istio-data\") pod \"e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb\" (UID: \"b2860e16-7181-41e8-a7ef-1cb3b78f06e9\") " pod="openshift-ingress/e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb"
Jul 07 17:33:50.430779 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:50.430582    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bg7h2\" (UniqueName: \"kubernetes.io/projected/b2860e16-7181-41e8-a7ef-1cb3b78f06e9-kube-api-access-bg7h2\") pod \"e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb\" (UID: \"b2860e16-7181-41e8-a7ef-1cb3b78f06e9\") " pod="openshift-ingress/e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb"
Jul 07 17:33:50.430779 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:50.430604    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2860e16-7181-41e8-a7ef-1cb3b78f06e9-istiod-ca-cert\") pod \"e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb\" (UID: \"b2860e16-7181-41e8-a7ef-1cb3b78f06e9\") " pod="openshift-ingress/e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb"
Jul 07 17:33:50.430779 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:50.430629    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2860e16-7181-41e8-a7ef-1cb3b78f06e9-istio-token\") pod \"e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb\" (UID: \"b2860e16-7181-41e8-a7ef-1cb3b78f06e9\") " pod="openshift-ingress/e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb"
Jul 07 17:33:50.430779 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:50.430653    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2860e16-7181-41e8-a7ef-1cb3b78f06e9-workload-socket\") pod \"e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb\" (UID: \"b2860e16-7181-41e8-a7ef-1cb3b78f06e9\") " pod="openshift-ingress/e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb"
Jul 07 17:33:50.430779 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:50.430668    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2860e16-7181-41e8-a7ef-1cb3b78f06e9-workload-certs\") pod \"e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb\" (UID: \"b2860e16-7181-41e8-a7ef-1cb3b78f06e9\") " pod="openshift-ingress/e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb"
Jul 07 17:33:50.430779 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:50.430695    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2860e16-7181-41e8-a7ef-1cb3b78f06e9-credential-socket\") pod \"e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb\" (UID: \"b2860e16-7181-41e8-a7ef-1cb3b78f06e9\") " pod="openshift-ingress/e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb"
Jul 07 17:33:50.431129 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:50.431073    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2860e16-7181-41e8-a7ef-1cb3b78f06e9-istio-data\") pod \"e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb\" (UID: \"b2860e16-7181-41e8-a7ef-1cb3b78f06e9\") " pod="openshift-ingress/e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb"
Jul 07 17:33:50.431278 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:50.431253    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2860e16-7181-41e8-a7ef-1cb3b78f06e9-workload-socket\") pod \"e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb\" (UID: \"b2860e16-7181-41e8-a7ef-1cb3b78f06e9\") " pod="openshift-ingress/e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb"
Jul 07 17:33:50.431344 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:50.431283    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2860e16-7181-41e8-a7ef-1cb3b78f06e9-workload-certs\") pod \"e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb\" (UID: \"b2860e16-7181-41e8-a7ef-1cb3b78f06e9\") " pod="openshift-ingress/e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb"
Jul 07 17:33:50.431552 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:50.431530    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2860e16-7181-41e8-a7ef-1cb3b78f06e9-credential-socket\") pod \"e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb\" (UID: \"b2860e16-7181-41e8-a7ef-1cb3b78f06e9\") " pod="openshift-ingress/e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb"
Jul 07 17:33:50.431647 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:50.431567    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2860e16-7181-41e8-a7ef-1cb3b78f06e9-istiod-ca-cert\") pod \"e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb\" (UID: \"b2860e16-7181-41e8-a7ef-1cb3b78f06e9\") " pod="openshift-ingress/e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb"
Jul 07 17:33:50.432886 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:50.432868    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2860e16-7181-41e8-a7ef-1cb3b78f06e9-istio-envoy\") pod \"e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb\" (UID: \"b2860e16-7181-41e8-a7ef-1cb3b78f06e9\") " pod="openshift-ingress/e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb"
Jul 07 17:33:50.433225 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:50.433208    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2860e16-7181-41e8-a7ef-1cb3b78f06e9-istio-podinfo\") pod \"e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb\" (UID: \"b2860e16-7181-41e8-a7ef-1cb3b78f06e9\") " pod="openshift-ingress/e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb"
Jul 07 17:33:50.440921 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:50.440861    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bg7h2\" (UniqueName: \"kubernetes.io/projected/b2860e16-7181-41e8-a7ef-1cb3b78f06e9-kube-api-access-bg7h2\") pod \"e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb\" (UID: \"b2860e16-7181-41e8-a7ef-1cb3b78f06e9\") " pod="openshift-ingress/e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb"
Jul 07 17:33:50.443684 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:50.443661    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2860e16-7181-41e8-a7ef-1cb3b78f06e9-istio-token\") pod \"e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb\" (UID: \"b2860e16-7181-41e8-a7ef-1cb3b78f06e9\") " pod="openshift-ingress/e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb"
Jul 07 17:33:50.475805 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:50.475777    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb"
Jul 07 17:33:50.623104 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:50.623079    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb"]
Jul 07 17:33:50.625066 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:33:50.625039    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb2860e16_7181_41e8_a7ef_1cb3b78f06e9.slice/crio-472acb94b25b52994b72a649782b08144e1e4ff2d3099e021a4e5d985e81a5da WatchSource:0}: Error finding container 472acb94b25b52994b72a649782b08144e1e4ff2d3099e021a4e5d985e81a5da: Status 404 returned error can't find the container with id 472acb94b25b52994b72a649782b08144e1e4ff2d3099e021a4e5d985e81a5da
Jul 07 17:33:50.627548 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:50.627513    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 17:33:50.627660 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:50.627578    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 17:33:50.627660 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:50.627623    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 17:33:51.230789 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:51.230749    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb" event={"ID":"b2860e16-7181-41e8-a7ef-1cb3b78f06e9","Type":"ContainerStarted","Data":"a9894e10eac333db4b0e0b5e299f14b91ff2908ca966d4468163b25aac030d91"}
Jul 07 17:33:51.231193 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:51.230811    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb" event={"ID":"b2860e16-7181-41e8-a7ef-1cb3b78f06e9","Type":"ContainerStarted","Data":"472acb94b25b52994b72a649782b08144e1e4ff2d3099e021a4e5d985e81a5da"}
Jul 07 17:33:51.274713 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:51.274656    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb" podStartSLOduration=1.27463742 podStartE2EDuration="1.27463742s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:33:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:33:51.273709818 +0000 UTC m=+1555.996963016" watchObservedRunningTime="2026-07-07 17:33:51.27463742 +0000 UTC m=+1555.997890616"
Jul 07 17:33:51.423177 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:51.423121    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:33:51.476929 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:51.476893    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb"
Jul 07 17:33:51.478657 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:51.478621    2562 patch_prober.go:28] interesting pod/e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused" start-of-body=
Jul 07 17:33:51.478801 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:51.478685    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb" podUID="b2860e16-7181-41e8-a7ef-1cb3b78f06e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.47:15021/healthz/ready\": dial tcp 10.133.0.47:15021: connect: connection refused"
Jul 07 17:33:51.517006 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:51.516926    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:33:51.588789 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:51.588753    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-ait-c7d7d193-6c988bbb68-grz9x"]
Jul 07 17:33:51.592256 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:51.592235    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-c7d7d193-6c988bbb68-grz9x"
Jul 07 17:33:51.596545 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:51.596525    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-ait-c7d7d193-serving-cert\""
Jul 07 17:33:51.605475 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:51.605449    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-c7d7d193-6c988bbb68-grz9x"]
Jul 07 17:33:51.641308 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:51.641278    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:33:51.744251 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:51.744216    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8433a2a6-c2e3-4c5c-b6c0-2fef89bf1483-maas-api-tls\") pod \"maas-api-e2e-ait-c7d7d193-6c988bbb68-grz9x\" (UID: \"8433a2a6-c2e3-4c5c-b6c0-2fef89bf1483\") " pod="opendatahub/maas-api-e2e-ait-c7d7d193-6c988bbb68-grz9x"
Jul 07 17:33:51.744431 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:51.744280    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4w9wj\" (UniqueName: \"kubernetes.io/projected/8433a2a6-c2e3-4c5c-b6c0-2fef89bf1483-kube-api-access-4w9wj\") pod \"maas-api-e2e-ait-c7d7d193-6c988bbb68-grz9x\" (UID: \"8433a2a6-c2e3-4c5c-b6c0-2fef89bf1483\") " pod="opendatahub/maas-api-e2e-ait-c7d7d193-6c988bbb68-grz9x"
Jul 07 17:33:51.744431 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:51.744303    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8433a2a6-c2e3-4c5c-b6c0-2fef89bf1483-openshift-service-ca\") pod \"maas-api-e2e-ait-c7d7d193-6c988bbb68-grz9x\" (UID: \"8433a2a6-c2e3-4c5c-b6c0-2fef89bf1483\") " pod="opendatahub/maas-api-e2e-ait-c7d7d193-6c988bbb68-grz9x"
Jul 07 17:33:51.845788 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:51.845675    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8433a2a6-c2e3-4c5c-b6c0-2fef89bf1483-maas-api-tls\") pod \"maas-api-e2e-ait-c7d7d193-6c988bbb68-grz9x\" (UID: \"8433a2a6-c2e3-4c5c-b6c0-2fef89bf1483\") " pod="opendatahub/maas-api-e2e-ait-c7d7d193-6c988bbb68-grz9x"
Jul 07 17:33:51.845788 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:51.845738    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4w9wj\" (UniqueName: \"kubernetes.io/projected/8433a2a6-c2e3-4c5c-b6c0-2fef89bf1483-kube-api-access-4w9wj\") pod \"maas-api-e2e-ait-c7d7d193-6c988bbb68-grz9x\" (UID: \"8433a2a6-c2e3-4c5c-b6c0-2fef89bf1483\") " pod="opendatahub/maas-api-e2e-ait-c7d7d193-6c988bbb68-grz9x"
Jul 07 17:33:51.845788 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:51.845780    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8433a2a6-c2e3-4c5c-b6c0-2fef89bf1483-openshift-service-ca\") pod \"maas-api-e2e-ait-c7d7d193-6c988bbb68-grz9x\" (UID: \"8433a2a6-c2e3-4c5c-b6c0-2fef89bf1483\") " pod="opendatahub/maas-api-e2e-ait-c7d7d193-6c988bbb68-grz9x"
Jul 07 17:33:51.846621 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:51.846595    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8433a2a6-c2e3-4c5c-b6c0-2fef89bf1483-openshift-service-ca\") pod \"maas-api-e2e-ait-c7d7d193-6c988bbb68-grz9x\" (UID: \"8433a2a6-c2e3-4c5c-b6c0-2fef89bf1483\") " pod="opendatahub/maas-api-e2e-ait-c7d7d193-6c988bbb68-grz9x"
Jul 07 17:33:51.849074 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:51.849041    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8433a2a6-c2e3-4c5c-b6c0-2fef89bf1483-maas-api-tls\") pod \"maas-api-e2e-ait-c7d7d193-6c988bbb68-grz9x\" (UID: \"8433a2a6-c2e3-4c5c-b6c0-2fef89bf1483\") " pod="opendatahub/maas-api-e2e-ait-c7d7d193-6c988bbb68-grz9x"
Jul 07 17:33:51.858590 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:51.858560    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4w9wj\" (UniqueName: \"kubernetes.io/projected/8433a2a6-c2e3-4c5c-b6c0-2fef89bf1483-kube-api-access-4w9wj\") pod \"maas-api-e2e-ait-c7d7d193-6c988bbb68-grz9x\" (UID: \"8433a2a6-c2e3-4c5c-b6c0-2fef89bf1483\") " pod="opendatahub/maas-api-e2e-ait-c7d7d193-6c988bbb68-grz9x"
Jul 07 17:33:51.867680 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:51.867662    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:33:51.903450 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:51.903417    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-c7d7d193-6c988bbb68-grz9x"
Jul 07 17:33:52.061704 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:52.061677    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-ait-c7d7d193-6c988bbb68-grz9x"]
Jul 07 17:33:52.063476 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:33:52.063445    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8433a2a6_c2e3_4c5c_b6c0_2fef89bf1483.slice/crio-9607c8176e17838d934b396e3857ba679a362920b58c42612b2225708838db88 WatchSource:0}: Error finding container 9607c8176e17838d934b396e3857ba679a362920b58c42612b2225708838db88: Status 404 returned error can't find the container with id 9607c8176e17838d934b396e3857ba679a362920b58c42612b2225708838db88
Jul 07 17:33:52.237223 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:52.237186    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-c7d7d193-6c988bbb68-grz9x" event={"ID":"8433a2a6-c2e3-4c5c-b6c0-2fef89bf1483","Type":"ContainerStarted","Data":"9607c8176e17838d934b396e3857ba679a362920b58c42612b2225708838db88"}
Jul 07 17:33:52.422488 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:52.422451    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:33:52.481363 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:52.481332    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb"
Jul 07 17:33:52.532584 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:52.532498    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:33:53.244413 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:53.244368    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-c7d7d193-6c988bbb68-grz9x" event={"ID":"8433a2a6-c2e3-4c5c-b6c0-2fef89bf1483","Type":"ContainerStarted","Data":"bc05a93bb142b6793b9ceeaa099646c3a7c8748b0303b7c8f84d579741ff921d"}
Jul 07 17:33:53.244843 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:53.244709    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb"
Jul 07 17:33:53.244843 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:53.244765    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-ait-c7d7d193-6c988bbb68-grz9x"
Jul 07 17:33:53.245644 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:53.245617    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb"
Jul 07 17:33:53.271856 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:53.271802    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-ait-c7d7d193-6c988bbb68-grz9x" podStartSLOduration=1.709601536 podStartE2EDuration="2.271785358s" totalImagesPullingTime="562.183822ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:33:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:33:53.270784469 +0000 UTC m=+1557.994037676" watchObservedRunningTime="2026-07-07 17:33:53.271785358 +0000 UTC m=+1557.995038554"
Jul 07 17:33:53.756004 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:53.755957    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:33:56.523192 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:56.522227    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:33:57.021917 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:57.021876    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-c7d7d193-6c988bbb68-grz9x"]
Jul 07 17:33:57.028884 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:57.022508    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-ait-c7d7d193-6c988bbb68-grz9x" podUID="8433a2a6-c2e3-4c5c-b6c0-2fef89bf1483" containerName="maas-api" containerID="cri-o://bc05a93bb142b6793b9ceeaa099646c3a7c8748b0303b7c8f84d579741ff921d" gracePeriod=30
Jul 07 17:33:57.040475 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:57.040427    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-ait-c7d7d193-6c988bbb68-grz9x"
Jul 07 17:33:57.048602 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:57.048572    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:33:57.266263 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:57.266232    2562 generic.go:356] "Generic (PLEG): container finished" podID="8433a2a6-c2e3-4c5c-b6c0-2fef89bf1483" containerID="bc05a93bb142b6793b9ceeaa099646c3a7c8748b0303b7c8f84d579741ff921d" exitCode=0
Jul 07 17:33:57.266431 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:57.266287    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-c7d7d193-6c988bbb68-grz9x" event={"ID":"8433a2a6-c2e3-4c5c-b6c0-2fef89bf1483","Type":"ContainerDied","Data":"bc05a93bb142b6793b9ceeaa099646c3a7c8748b0303b7c8f84d579741ff921d"}
Jul 07 17:33:57.295677 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:57.295647    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-c7d7d193-6c988bbb68-grz9x"
Jul 07 17:33:57.399350 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:57.399314    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8433a2a6-c2e3-4c5c-b6c0-2fef89bf1483-maas-api-tls\") pod \"8433a2a6-c2e3-4c5c-b6c0-2fef89bf1483\" (UID: \"8433a2a6-c2e3-4c5c-b6c0-2fef89bf1483\") "
Jul 07 17:33:57.399557 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:57.399375    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8433a2a6-c2e3-4c5c-b6c0-2fef89bf1483-openshift-service-ca\") pod \"8433a2a6-c2e3-4c5c-b6c0-2fef89bf1483\" (UID: \"8433a2a6-c2e3-4c5c-b6c0-2fef89bf1483\") "
Jul 07 17:33:57.399557 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:57.399406    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4w9wj\" (UniqueName: \"kubernetes.io/projected/8433a2a6-c2e3-4c5c-b6c0-2fef89bf1483-kube-api-access-4w9wj\") pod \"8433a2a6-c2e3-4c5c-b6c0-2fef89bf1483\" (UID: \"8433a2a6-c2e3-4c5c-b6c0-2fef89bf1483\") "
Jul 07 17:33:57.399736 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:57.399709    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8433a2a6-c2e3-4c5c-b6c0-2fef89bf1483-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8433a2a6-c2e3-4c5c-b6c0-2fef89bf1483" (UID: "8433a2a6-c2e3-4c5c-b6c0-2fef89bf1483"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:33:57.401525 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:57.401496    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8433a2a6-c2e3-4c5c-b6c0-2fef89bf1483-kube-api-access-4w9wj" (OuterVolumeSpecName: "kube-api-access-4w9wj") pod "8433a2a6-c2e3-4c5c-b6c0-2fef89bf1483" (UID: "8433a2a6-c2e3-4c5c-b6c0-2fef89bf1483"). InnerVolumeSpecName "kube-api-access-4w9wj". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:33:57.401525 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:57.401499    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8433a2a6-c2e3-4c5c-b6c0-2fef89bf1483-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8433a2a6-c2e3-4c5c-b6c0-2fef89bf1483" (UID: "8433a2a6-c2e3-4c5c-b6c0-2fef89bf1483"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:33:57.500815 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:57.500779    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8433a2a6-c2e3-4c5c-b6c0-2fef89bf1483-maas-api-tls\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:33:57.500815 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:57.500808    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8433a2a6-c2e3-4c5c-b6c0-2fef89bf1483-openshift-service-ca\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:33:57.500815 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:57.500818    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4w9wj\" (UniqueName: \"kubernetes.io/projected/8433a2a6-c2e3-4c5c-b6c0-2fef89bf1483-kube-api-access-4w9wj\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:33:58.272772 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:58.272743    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-ait-c7d7d193-6c988bbb68-grz9x"
Jul 07 17:33:58.273326 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:58.272790    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-ait-c7d7d193-6c988bbb68-grz9x" event={"ID":"8433a2a6-c2e3-4c5c-b6c0-2fef89bf1483","Type":"ContainerDied","Data":"9607c8176e17838d934b396e3857ba679a362920b58c42612b2225708838db88"}
Jul 07 17:33:58.273326 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:58.272860    2562 scope.go:117] "RemoveContainer" containerID="bc05a93bb142b6793b9ceeaa099646c3a7c8748b0303b7c8f84d579741ff921d"
Jul 07 17:33:58.293972 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:58.293936    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-ait-c7d7d193-6c988bbb68-grz9x"]
Jul 07 17:33:58.303823 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:58.303785    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-ait-c7d7d193-6c988bbb68-grz9x"]
Jul 07 17:33:59.849303 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:33:59.849268    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8433a2a6-c2e3-4c5c-b6c0-2fef89bf1483" path="/var/lib/kubelet/pods/8433a2a6-c2e3-4c5c-b6c0-2fef89bf1483/volumes"
Jul 07 17:34:02.679583 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:02.679551    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb"]
Jul 07 17:34:02.679957 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:02.679749    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb" podUID="b2860e16-7181-41e8-a7ef-1cb3b78f06e9" containerName="istio-proxy" containerID="cri-o://a9894e10eac333db4b0e0b5e299f14b91ff2908ca966d4468163b25aac030d91" gracePeriod=30
Jul 07 17:34:02.739124 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:02.739090    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:34:02.831432 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:02.831408    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb"
Jul 07 17:34:02.886670 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:02.886635    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:34:02.955782 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:02.955748    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2860e16-7181-41e8-a7ef-1cb3b78f06e9-istio-envoy\") pod \"b2860e16-7181-41e8-a7ef-1cb3b78f06e9\" (UID: \"b2860e16-7181-41e8-a7ef-1cb3b78f06e9\") "
Jul 07 17:34:02.955942 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:02.955796    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bg7h2\" (UniqueName: \"kubernetes.io/projected/b2860e16-7181-41e8-a7ef-1cb3b78f06e9-kube-api-access-bg7h2\") pod \"b2860e16-7181-41e8-a7ef-1cb3b78f06e9\" (UID: \"b2860e16-7181-41e8-a7ef-1cb3b78f06e9\") "
Jul 07 17:34:02.955942 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:02.955840    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2860e16-7181-41e8-a7ef-1cb3b78f06e9-workload-certs\") pod \"b2860e16-7181-41e8-a7ef-1cb3b78f06e9\" (UID: \"b2860e16-7181-41e8-a7ef-1cb3b78f06e9\") "
Jul 07 17:34:02.955942 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:02.955866    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2860e16-7181-41e8-a7ef-1cb3b78f06e9-istiod-ca-cert\") pod \"b2860e16-7181-41e8-a7ef-1cb3b78f06e9\" (UID: \"b2860e16-7181-41e8-a7ef-1cb3b78f06e9\") "
Jul 07 17:34:02.955942 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:02.955896    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2860e16-7181-41e8-a7ef-1cb3b78f06e9-istio-data\") pod \"b2860e16-7181-41e8-a7ef-1cb3b78f06e9\" (UID: \"b2860e16-7181-41e8-a7ef-1cb3b78f06e9\") "
Jul 07 17:34:02.955942 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:02.955937    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2860e16-7181-41e8-a7ef-1cb3b78f06e9-credential-socket\") pod \"b2860e16-7181-41e8-a7ef-1cb3b78f06e9\" (UID: \"b2860e16-7181-41e8-a7ef-1cb3b78f06e9\") "
Jul 07 17:34:02.956217 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:02.955973    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2860e16-7181-41e8-a7ef-1cb3b78f06e9-istio-podinfo\") pod \"b2860e16-7181-41e8-a7ef-1cb3b78f06e9\" (UID: \"b2860e16-7181-41e8-a7ef-1cb3b78f06e9\") "
Jul 07 17:34:02.956217 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:02.956012    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2860e16-7181-41e8-a7ef-1cb3b78f06e9-istio-token\") pod \"b2860e16-7181-41e8-a7ef-1cb3b78f06e9\" (UID: \"b2860e16-7181-41e8-a7ef-1cb3b78f06e9\") "
Jul 07 17:34:02.956217 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:02.956038    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2860e16-7181-41e8-a7ef-1cb3b78f06e9-workload-socket\") pod \"b2860e16-7181-41e8-a7ef-1cb3b78f06e9\" (UID: \"b2860e16-7181-41e8-a7ef-1cb3b78f06e9\") "
Jul 07 17:34:02.956217 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:02.956108    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2860e16-7181-41e8-a7ef-1cb3b78f06e9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b2860e16-7181-41e8-a7ef-1cb3b78f06e9" (UID: "b2860e16-7181-41e8-a7ef-1cb3b78f06e9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:34:02.956407 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:02.956328    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2860e16-7181-41e8-a7ef-1cb3b78f06e9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b2860e16-7181-41e8-a7ef-1cb3b78f06e9" (UID: "b2860e16-7181-41e8-a7ef-1cb3b78f06e9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:34:02.956407 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:02.956379    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b2860e16-7181-41e8-a7ef-1cb3b78f06e9-workload-certs\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:34:02.956633 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:02.956588    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2860e16-7181-41e8-a7ef-1cb3b78f06e9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b2860e16-7181-41e8-a7ef-1cb3b78f06e9" (UID: "b2860e16-7181-41e8-a7ef-1cb3b78f06e9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:34:02.956766 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:02.956634    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2860e16-7181-41e8-a7ef-1cb3b78f06e9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b2860e16-7181-41e8-a7ef-1cb3b78f06e9" (UID: "b2860e16-7181-41e8-a7ef-1cb3b78f06e9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:34:02.956838 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:02.956804    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2860e16-7181-41e8-a7ef-1cb3b78f06e9-istio-data" (OuterVolumeSpecName: "istio-data") pod "b2860e16-7181-41e8-a7ef-1cb3b78f06e9" (UID: "b2860e16-7181-41e8-a7ef-1cb3b78f06e9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:34:02.958141 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:02.958112    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2860e16-7181-41e8-a7ef-1cb3b78f06e9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b2860e16-7181-41e8-a7ef-1cb3b78f06e9" (UID: "b2860e16-7181-41e8-a7ef-1cb3b78f06e9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:34:02.958141 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:02.958120    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2860e16-7181-41e8-a7ef-1cb3b78f06e9-istio-token" (OuterVolumeSpecName: "istio-token") pod "b2860e16-7181-41e8-a7ef-1cb3b78f06e9" (UID: "b2860e16-7181-41e8-a7ef-1cb3b78f06e9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:34:02.958141 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:02.958121    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2860e16-7181-41e8-a7ef-1cb3b78f06e9-kube-api-access-bg7h2" (OuterVolumeSpecName: "kube-api-access-bg7h2") pod "b2860e16-7181-41e8-a7ef-1cb3b78f06e9" (UID: "b2860e16-7181-41e8-a7ef-1cb3b78f06e9"). InnerVolumeSpecName "kube-api-access-bg7h2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:34:02.958317 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:02.958138    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b2860e16-7181-41e8-a7ef-1cb3b78f06e9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b2860e16-7181-41e8-a7ef-1cb3b78f06e9" (UID: "b2860e16-7181-41e8-a7ef-1cb3b78f06e9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 17:34:03.057736 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:03.057689    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2860e16-7181-41e8-a7ef-1cb3b78f06e9-credential-socket\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:34:03.057736 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:03.057731    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b2860e16-7181-41e8-a7ef-1cb3b78f06e9-istio-podinfo\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:34:03.057736 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:03.057741    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b2860e16-7181-41e8-a7ef-1cb3b78f06e9-istio-token\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:34:03.057736 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:03.057750    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b2860e16-7181-41e8-a7ef-1cb3b78f06e9-workload-socket\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:34:03.058034 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:03.057759    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b2860e16-7181-41e8-a7ef-1cb3b78f06e9-istio-envoy\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:34:03.058034 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:03.057769    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bg7h2\" (UniqueName: \"kubernetes.io/projected/b2860e16-7181-41e8-a7ef-1cb3b78f06e9-kube-api-access-bg7h2\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:34:03.058034 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:03.057777    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b2860e16-7181-41e8-a7ef-1cb3b78f06e9-istiod-ca-cert\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:34:03.058034 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:03.057787    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b2860e16-7181-41e8-a7ef-1cb3b78f06e9-istio-data\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:34:03.300551 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:03.300468    2562 generic.go:356] "Generic (PLEG): container finished" podID="b2860e16-7181-41e8-a7ef-1cb3b78f06e9" containerID="a9894e10eac333db4b0e0b5e299f14b91ff2908ca966d4468163b25aac030d91" exitCode=0
Jul 07 17:34:03.300551 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:03.300510    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb"
Jul 07 17:34:03.300551 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:03.300532    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb" event={"ID":"b2860e16-7181-41e8-a7ef-1cb3b78f06e9","Type":"ContainerDied","Data":"a9894e10eac333db4b0e0b5e299f14b91ff2908ca966d4468163b25aac030d91"}
Jul 07 17:34:03.300779 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:03.300574    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb" event={"ID":"b2860e16-7181-41e8-a7ef-1cb3b78f06e9","Type":"ContainerDied","Data":"472acb94b25b52994b72a649782b08144e1e4ff2d3099e021a4e5d985e81a5da"}
Jul 07 17:34:03.300779 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:03.300595    2562 scope.go:117] "RemoveContainer" containerID="a9894e10eac333db4b0e0b5e299f14b91ff2908ca966d4468163b25aac030d91"
Jul 07 17:34:03.309958 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:03.309936    2562 scope.go:117] "RemoveContainer" containerID="a9894e10eac333db4b0e0b5e299f14b91ff2908ca966d4468163b25aac030d91"
Jul 07 17:34:03.310250 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:34:03.310223    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9894e10eac333db4b0e0b5e299f14b91ff2908ca966d4468163b25aac030d91\": container with ID starting with a9894e10eac333db4b0e0b5e299f14b91ff2908ca966d4468163b25aac030d91 not found: ID does not exist" containerID="a9894e10eac333db4b0e0b5e299f14b91ff2908ca966d4468163b25aac030d91"
Jul 07 17:34:03.310311 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:03.310264    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9894e10eac333db4b0e0b5e299f14b91ff2908ca966d4468163b25aac030d91"} err="failed to get container status \"a9894e10eac333db4b0e0b5e299f14b91ff2908ca966d4468163b25aac030d91\": rpc error: code = NotFound desc = could not find container \"a9894e10eac333db4b0e0b5e299f14b91ff2908ca966d4468163b25aac030d91\": container with ID starting with a9894e10eac333db4b0e0b5e299f14b91ff2908ca966d4468163b25aac030d91 not found: ID does not exist"
Jul 07 17:34:03.327639 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:03.327611    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb"]
Jul 07 17:34:03.336968 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:03.336946    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-c7d7d193-openshift-default-55f8979487-jwkfb"]
Jul 07 17:34:03.845738 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:03.845696    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2860e16-7181-41e8-a7ef-1cb3b78f06e9" path="/var/lib/kubelet/pods/b2860e16-7181-41e8-a7ef-1cb3b78f06e9/volumes"
Jul 07 17:34:10.365377 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:10.365342    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:34:10.498556 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:10.498510    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:34:10.597180 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:10.597061    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:34:10.729385 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:10.729335    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:34:10.877778 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:10.877741    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd"]
Jul 07 17:34:10.878249 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:10.878223    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2860e16-7181-41e8-a7ef-1cb3b78f06e9" containerName="istio-proxy"
Jul 07 17:34:10.878249 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:10.878245    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2860e16-7181-41e8-a7ef-1cb3b78f06e9" containerName="istio-proxy"
Jul 07 17:34:10.878418 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:10.878259    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8433a2a6-c2e3-4c5c-b6c0-2fef89bf1483" containerName="maas-api"
Jul 07 17:34:10.878418 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:10.878267    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8433a2a6-c2e3-4c5c-b6c0-2fef89bf1483" containerName="maas-api"
Jul 07 17:34:10.878418 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:10.878351    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8433a2a6-c2e3-4c5c-b6c0-2fef89bf1483" containerName="maas-api"
Jul 07 17:34:10.878418 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:10.878366    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2860e16-7181-41e8-a7ef-1cb3b78f06e9" containerName="istio-proxy"
Jul 07 17:34:10.881279 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:10.881256    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd"
Jul 07 17:34:10.888657 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:10.888637    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-6781f0c8-openshift-default-dockercfg-vfgph\""
Jul 07 17:34:10.931070 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:10.931029    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4b2bb88-0a18-4259-8fb1-737fa94644f8-istio-podinfo\") pod \"e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd\" (UID: \"d4b2bb88-0a18-4259-8fb1-737fa94644f8\") " pod="openshift-ingress/e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd"
Jul 07 17:34:10.931314 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:10.931081    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cm4dx\" (UniqueName: \"kubernetes.io/projected/d4b2bb88-0a18-4259-8fb1-737fa94644f8-kube-api-access-cm4dx\") pod \"e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd\" (UID: \"d4b2bb88-0a18-4259-8fb1-737fa94644f8\") " pod="openshift-ingress/e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd"
Jul 07 17:34:10.931314 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:10.931111    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4b2bb88-0a18-4259-8fb1-737fa94644f8-istiod-ca-cert\") pod \"e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd\" (UID: \"d4b2bb88-0a18-4259-8fb1-737fa94644f8\") " pod="openshift-ingress/e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd"
Jul 07 17:34:10.931314 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:10.931171    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4b2bb88-0a18-4259-8fb1-737fa94644f8-workload-certs\") pod \"e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd\" (UID: \"d4b2bb88-0a18-4259-8fb1-737fa94644f8\") " pod="openshift-ingress/e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd"
Jul 07 17:34:10.931314 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:10.931252    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4b2bb88-0a18-4259-8fb1-737fa94644f8-credential-socket\") pod \"e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd\" (UID: \"d4b2bb88-0a18-4259-8fb1-737fa94644f8\") " pod="openshift-ingress/e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd"
Jul 07 17:34:10.931314 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:10.931276    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4b2bb88-0a18-4259-8fb1-737fa94644f8-istio-data\") pod \"e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd\" (UID: \"d4b2bb88-0a18-4259-8fb1-737fa94644f8\") " pod="openshift-ingress/e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd"
Jul 07 17:34:10.931659 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:10.931326    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4b2bb88-0a18-4259-8fb1-737fa94644f8-workload-socket\") pod \"e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd\" (UID: \"d4b2bb88-0a18-4259-8fb1-737fa94644f8\") " pod="openshift-ingress/e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd"
Jul 07 17:34:10.931659 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:10.931379    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4b2bb88-0a18-4259-8fb1-737fa94644f8-istio-token\") pod \"e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd\" (UID: \"d4b2bb88-0a18-4259-8fb1-737fa94644f8\") " pod="openshift-ingress/e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd"
Jul 07 17:34:10.931659 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:10.931490    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4b2bb88-0a18-4259-8fb1-737fa94644f8-istio-envoy\") pod \"e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd\" (UID: \"d4b2bb88-0a18-4259-8fb1-737fa94644f8\") " pod="openshift-ingress/e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd"
Jul 07 17:34:10.991242 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:10.991205    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd"]
Jul 07 17:34:11.011761 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:11.011723    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:34:11.032178 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:11.032121    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4b2bb88-0a18-4259-8fb1-737fa94644f8-workload-certs\") pod \"e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd\" (UID: \"d4b2bb88-0a18-4259-8fb1-737fa94644f8\") " pod="openshift-ingress/e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd"
Jul 07 17:34:11.032370 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:11.032208    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4b2bb88-0a18-4259-8fb1-737fa94644f8-credential-socket\") pod \"e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd\" (UID: \"d4b2bb88-0a18-4259-8fb1-737fa94644f8\") " pod="openshift-ingress/e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd"
Jul 07 17:34:11.032370 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:11.032229    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4b2bb88-0a18-4259-8fb1-737fa94644f8-istio-data\") pod \"e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd\" (UID: \"d4b2bb88-0a18-4259-8fb1-737fa94644f8\") " pod="openshift-ingress/e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd"
Jul 07 17:34:11.032370 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:11.032246    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4b2bb88-0a18-4259-8fb1-737fa94644f8-workload-socket\") pod \"e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd\" (UID: \"d4b2bb88-0a18-4259-8fb1-737fa94644f8\") " pod="openshift-ingress/e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd"
Jul 07 17:34:11.032370 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:11.032267    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4b2bb88-0a18-4259-8fb1-737fa94644f8-istio-token\") pod \"e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd\" (UID: \"d4b2bb88-0a18-4259-8fb1-737fa94644f8\") " pod="openshift-ingress/e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd"
Jul 07 17:34:11.032599 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:11.032425    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4b2bb88-0a18-4259-8fb1-737fa94644f8-istio-envoy\") pod \"e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd\" (UID: \"d4b2bb88-0a18-4259-8fb1-737fa94644f8\") " pod="openshift-ingress/e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd"
Jul 07 17:34:11.032599 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:11.032486    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4b2bb88-0a18-4259-8fb1-737fa94644f8-istio-podinfo\") pod \"e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd\" (UID: \"d4b2bb88-0a18-4259-8fb1-737fa94644f8\") " pod="openshift-ingress/e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd"
Jul 07 17:34:11.032599 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:11.032530    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cm4dx\" (UniqueName: \"kubernetes.io/projected/d4b2bb88-0a18-4259-8fb1-737fa94644f8-kube-api-access-cm4dx\") pod \"e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd\" (UID: \"d4b2bb88-0a18-4259-8fb1-737fa94644f8\") " pod="openshift-ingress/e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd"
Jul 07 17:34:11.032599 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:11.032573    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4b2bb88-0a18-4259-8fb1-737fa94644f8-istiod-ca-cert\") pod \"e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd\" (UID: \"d4b2bb88-0a18-4259-8fb1-737fa94644f8\") " pod="openshift-ingress/e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd"
Jul 07 17:34:11.032816 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:11.032594    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4b2bb88-0a18-4259-8fb1-737fa94644f8-workload-certs\") pod \"e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd\" (UID: \"d4b2bb88-0a18-4259-8fb1-737fa94644f8\") " pod="openshift-ingress/e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd"
Jul 07 17:34:11.032816 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:11.032622    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4b2bb88-0a18-4259-8fb1-737fa94644f8-istio-data\") pod \"e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd\" (UID: \"d4b2bb88-0a18-4259-8fb1-737fa94644f8\") " pod="openshift-ingress/e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd"
Jul 07 17:34:11.032816 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:11.032781    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4b2bb88-0a18-4259-8fb1-737fa94644f8-credential-socket\") pod \"e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd\" (UID: \"d4b2bb88-0a18-4259-8fb1-737fa94644f8\") " pod="openshift-ingress/e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd"
Jul 07 17:34:11.033034 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:11.033015    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4b2bb88-0a18-4259-8fb1-737fa94644f8-workload-socket\") pod \"e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd\" (UID: \"d4b2bb88-0a18-4259-8fb1-737fa94644f8\") " pod="openshift-ingress/e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd"
Jul 07 17:34:11.033273 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:11.033256    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4b2bb88-0a18-4259-8fb1-737fa94644f8-istiod-ca-cert\") pod \"e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd\" (UID: \"d4b2bb88-0a18-4259-8fb1-737fa94644f8\") " pod="openshift-ingress/e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd"
Jul 07 17:34:11.034721 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:11.034691    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4b2bb88-0a18-4259-8fb1-737fa94644f8-istio-envoy\") pod \"e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd\" (UID: \"d4b2bb88-0a18-4259-8fb1-737fa94644f8\") " pod="openshift-ingress/e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd"
Jul 07 17:34:11.034986 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:11.034963    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4b2bb88-0a18-4259-8fb1-737fa94644f8-istio-podinfo\") pod \"e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd\" (UID: \"d4b2bb88-0a18-4259-8fb1-737fa94644f8\") " pod="openshift-ingress/e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd"
Jul 07 17:34:11.047665 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:11.047642    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-cm4dx\" (UniqueName: \"kubernetes.io/projected/d4b2bb88-0a18-4259-8fb1-737fa94644f8-kube-api-access-cm4dx\") pod \"e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd\" (UID: \"d4b2bb88-0a18-4259-8fb1-737fa94644f8\") " pod="openshift-ingress/e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd"
Jul 07 17:34:11.047777 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:11.047685    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4b2bb88-0a18-4259-8fb1-737fa94644f8-istio-token\") pod \"e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd\" (UID: \"d4b2bb88-0a18-4259-8fb1-737fa94644f8\") " pod="openshift-ingress/e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd"
Jul 07 17:34:11.127018 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:11.126974    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:34:11.192036 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:11.192001    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd"
Jul 07 17:34:11.340020 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:11.339995    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd"]
Jul 07 17:34:11.342673 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:34:11.342647    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd4b2bb88_0a18_4259_8fb1_737fa94644f8.slice/crio-2e10be80f8c5ad6cd777ce75eeefc1a4f53282e421e5dcef542719593d11f6ac WatchSource:0}: Error finding container 2e10be80f8c5ad6cd777ce75eeefc1a4f53282e421e5dcef542719593d11f6ac: Status 404 returned error can't find the container with id 2e10be80f8c5ad6cd777ce75eeefc1a4f53282e421e5dcef542719593d11f6ac
Jul 07 17:34:11.351374 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:11.351336    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 17:34:11.351473 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:11.351408    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 17:34:11.351473 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:11.351437    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 17:34:12.090658 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:12.090588    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:34:12.170203 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:12.170173    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-derive-6781f0c8-84dc57f4d4-bxpd7"]
Jul 07 17:34:12.172716 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:12.172691    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-6781f0c8-84dc57f4d4-bxpd7"
Jul 07 17:34:12.176548 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:12.176522    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-derive-6781f0c8-serving-cert\""
Jul 07 17:34:12.189639 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:12.189613    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:34:12.194761 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:12.194733    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-6781f0c8-84dc57f4d4-bxpd7"]
Jul 07 17:34:12.244030 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:12.243993    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7367ac3-5678-46a7-bb82-08131a0a23b3-maas-api-tls\") pod \"maas-api-e2e-derive-6781f0c8-84dc57f4d4-bxpd7\" (UID: \"e7367ac3-5678-46a7-bb82-08131a0a23b3\") " pod="opendatahub/maas-api-e2e-derive-6781f0c8-84dc57f4d4-bxpd7"
Jul 07 17:34:12.244030 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:12.244036    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzb67\" (UniqueName: \"kubernetes.io/projected/e7367ac3-5678-46a7-bb82-08131a0a23b3-kube-api-access-zzb67\") pod \"maas-api-e2e-derive-6781f0c8-84dc57f4d4-bxpd7\" (UID: \"e7367ac3-5678-46a7-bb82-08131a0a23b3\") " pod="opendatahub/maas-api-e2e-derive-6781f0c8-84dc57f4d4-bxpd7"
Jul 07 17:34:12.244295 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:12.244068    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7367ac3-5678-46a7-bb82-08131a0a23b3-openshift-service-ca\") pod \"maas-api-e2e-derive-6781f0c8-84dc57f4d4-bxpd7\" (UID: \"e7367ac3-5678-46a7-bb82-08131a0a23b3\") " pod="opendatahub/maas-api-e2e-derive-6781f0c8-84dc57f4d4-bxpd7"
Jul 07 17:34:12.345538 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:12.345447    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7367ac3-5678-46a7-bb82-08131a0a23b3-maas-api-tls\") pod \"maas-api-e2e-derive-6781f0c8-84dc57f4d4-bxpd7\" (UID: \"e7367ac3-5678-46a7-bb82-08131a0a23b3\") " pod="opendatahub/maas-api-e2e-derive-6781f0c8-84dc57f4d4-bxpd7"
Jul 07 17:34:12.345538 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:12.345486    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzb67\" (UniqueName: \"kubernetes.io/projected/e7367ac3-5678-46a7-bb82-08131a0a23b3-kube-api-access-zzb67\") pod \"maas-api-e2e-derive-6781f0c8-84dc57f4d4-bxpd7\" (UID: \"e7367ac3-5678-46a7-bb82-08131a0a23b3\") " pod="opendatahub/maas-api-e2e-derive-6781f0c8-84dc57f4d4-bxpd7"
Jul 07 17:34:12.345538 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:12.345516    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7367ac3-5678-46a7-bb82-08131a0a23b3-openshift-service-ca\") pod \"maas-api-e2e-derive-6781f0c8-84dc57f4d4-bxpd7\" (UID: \"e7367ac3-5678-46a7-bb82-08131a0a23b3\") " pod="opendatahub/maas-api-e2e-derive-6781f0c8-84dc57f4d4-bxpd7"
Jul 07 17:34:12.345827 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:34:12.345603    2562 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-derive-6781f0c8-serving-cert: secret "maas-api-e2e-derive-6781f0c8-serving-cert" not found
Jul 07 17:34:12.345827 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:34:12.345687    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e7367ac3-5678-46a7-bb82-08131a0a23b3-maas-api-tls podName:e7367ac3-5678-46a7-bb82-08131a0a23b3 nodeName:}" failed. No retries permitted until 2026-07-07 17:34:12.845665143 +0000 UTC m=+1577.568918337 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e7367ac3-5678-46a7-bb82-08131a0a23b3-maas-api-tls") pod "maas-api-e2e-derive-6781f0c8-84dc57f4d4-bxpd7" (UID: "e7367ac3-5678-46a7-bb82-08131a0a23b3") : secret "maas-api-e2e-derive-6781f0c8-serving-cert" not found
Jul 07 17:34:12.346271 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:12.346252    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7367ac3-5678-46a7-bb82-08131a0a23b3-openshift-service-ca\") pod \"maas-api-e2e-derive-6781f0c8-84dc57f4d4-bxpd7\" (UID: \"e7367ac3-5678-46a7-bb82-08131a0a23b3\") " pod="opendatahub/maas-api-e2e-derive-6781f0c8-84dc57f4d4-bxpd7"
Jul 07 17:34:12.351139 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:12.351111    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd" event={"ID":"d4b2bb88-0a18-4259-8fb1-737fa94644f8","Type":"ContainerStarted","Data":"0ba02d0863e35bea3c6b3da7c260b25f731a369aaf4045fe692619f580d0ccb6"}
Jul 07 17:34:12.351291 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:12.351266    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd" event={"ID":"d4b2bb88-0a18-4259-8fb1-737fa94644f8","Type":"ContainerStarted","Data":"2e10be80f8c5ad6cd777ce75eeefc1a4f53282e421e5dcef542719593d11f6ac"}
Jul 07 17:34:12.356929 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:12.356908    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzb67\" (UniqueName: \"kubernetes.io/projected/e7367ac3-5678-46a7-bb82-08131a0a23b3-kube-api-access-zzb67\") pod \"maas-api-e2e-derive-6781f0c8-84dc57f4d4-bxpd7\" (UID: \"e7367ac3-5678-46a7-bb82-08131a0a23b3\") " pod="opendatahub/maas-api-e2e-derive-6781f0c8-84dc57f4d4-bxpd7"
Jul 07 17:34:12.384736 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:12.384591    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd" podStartSLOduration=2.384567959 podStartE2EDuration="2.384567959s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:34:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:34:12.381183611 +0000 UTC m=+1577.104436805" watchObservedRunningTime="2026-07-07 17:34:12.384567959 +0000 UTC m=+1577.107821171"
Jul 07 17:34:12.582814 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:12.582775    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:34:12.697947 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:12.697914    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:34:12.849402 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:12.849361    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7367ac3-5678-46a7-bb82-08131a0a23b3-maas-api-tls\") pod \"maas-api-e2e-derive-6781f0c8-84dc57f4d4-bxpd7\" (UID: \"e7367ac3-5678-46a7-bb82-08131a0a23b3\") " pod="opendatahub/maas-api-e2e-derive-6781f0c8-84dc57f4d4-bxpd7"
Jul 07 17:34:12.851813 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:12.851787    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7367ac3-5678-46a7-bb82-08131a0a23b3-maas-api-tls\") pod \"maas-api-e2e-derive-6781f0c8-84dc57f4d4-bxpd7\" (UID: \"e7367ac3-5678-46a7-bb82-08131a0a23b3\") " pod="opendatahub/maas-api-e2e-derive-6781f0c8-84dc57f4d4-bxpd7"
Jul 07 17:34:13.084878 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:13.084749    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-6781f0c8-84dc57f4d4-bxpd7"
Jul 07 17:34:13.138395 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:13.138352    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:34:13.192993 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:13.192952    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd"
Jul 07 17:34:13.199426 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:13.199391    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd"
Jul 07 17:34:13.242467 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:13.242429    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:34:13.284003 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:13.283956    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-derive-6781f0c8-84dc57f4d4-bxpd7"]
Jul 07 17:34:13.287018 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:34:13.286991    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7367ac3_5678_46a7_bb82_08131a0a23b3.slice/crio-af15ca1b40056bed65053f3d633c803d2f32e693925b7405fe78fab91c4adfe9 WatchSource:0}: Error finding container af15ca1b40056bed65053f3d633c803d2f32e693925b7405fe78fab91c4adfe9: Status 404 returned error can't find the container with id af15ca1b40056bed65053f3d633c803d2f32e693925b7405fe78fab91c4adfe9
Jul 07 17:34:13.358102 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:13.358013    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-6781f0c8-84dc57f4d4-bxpd7" event={"ID":"e7367ac3-5678-46a7-bb82-08131a0a23b3","Type":"ContainerStarted","Data":"af15ca1b40056bed65053f3d633c803d2f32e693925b7405fe78fab91c4adfe9"}
Jul 07 17:34:13.358289 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:13.358226    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd"
Jul 07 17:34:13.359062 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:13.359047    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd"
Jul 07 17:34:14.098369 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:14.098335    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:34:14.364100 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:14.364005    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-6781f0c8-84dc57f4d4-bxpd7" event={"ID":"e7367ac3-5678-46a7-bb82-08131a0a23b3","Type":"ContainerStarted","Data":"5c6d1fc8660f823e8ce8aa170ad0aa9de91c956b4a0072acf844879471871fe7"}
Jul 07 17:34:14.388525 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:14.388475    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-derive-6781f0c8-84dc57f4d4-bxpd7" podStartSLOduration=2.038918072 podStartE2EDuration="2.388458817s" totalImagesPullingTime="349.540745ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:34:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:34:14.385701205 +0000 UTC m=+1579.108954402" watchObservedRunningTime="2026-07-07 17:34:14.388458817 +0000 UTC m=+1579.111712017"
Jul 07 17:34:15.370512 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:15.370473    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-derive-6781f0c8-84dc57f4d4-bxpd7"
Jul 07 17:34:16.521178 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:16.521026    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:34:16.694477 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:16.694443    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd"]
Jul 07 17:34:16.694717 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:16.694689    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd" podUID="d4b2bb88-0a18-4259-8fb1-737fa94644f8" containerName="istio-proxy" containerID="cri-o://0ba02d0863e35bea3c6b3da7c260b25f731a369aaf4045fe692619f580d0ccb6" gracePeriod=30
Jul 07 17:34:16.729032 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:16.728990    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:34:16.826039 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:16.825922    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:34:17.065655 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:17.065621    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-6781f0c8-84dc57f4d4-bxpd7"]
Jul 07 17:34:17.129181 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:17.126957    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:34:17.379863 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:17.379744    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-derive-6781f0c8-84dc57f4d4-bxpd7" podUID="e7367ac3-5678-46a7-bb82-08131a0a23b3" containerName="maas-api" containerID="cri-o://5c6d1fc8660f823e8ce8aa170ad0aa9de91c956b4a0072acf844879471871fe7" gracePeriod=30
Jul 07 17:34:17.686635 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:17.686609    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-6781f0c8-84dc57f4d4-bxpd7"
Jul 07 17:34:17.800546 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:17.800508    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7367ac3-5678-46a7-bb82-08131a0a23b3-openshift-service-ca\") pod \"e7367ac3-5678-46a7-bb82-08131a0a23b3\" (UID: \"e7367ac3-5678-46a7-bb82-08131a0a23b3\") "
Jul 07 17:34:17.800759 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:17.800607    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7367ac3-5678-46a7-bb82-08131a0a23b3-maas-api-tls\") pod \"e7367ac3-5678-46a7-bb82-08131a0a23b3\" (UID: \"e7367ac3-5678-46a7-bb82-08131a0a23b3\") "
Jul 07 17:34:17.800759 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:17.800632    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-zzb67\" (UniqueName: \"kubernetes.io/projected/e7367ac3-5678-46a7-bb82-08131a0a23b3-kube-api-access-zzb67\") pod \"e7367ac3-5678-46a7-bb82-08131a0a23b3\" (UID: \"e7367ac3-5678-46a7-bb82-08131a0a23b3\") "
Jul 07 17:34:17.800977 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:17.800945    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e7367ac3-5678-46a7-bb82-08131a0a23b3-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e7367ac3-5678-46a7-bb82-08131a0a23b3" (UID: "e7367ac3-5678-46a7-bb82-08131a0a23b3"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:34:17.803136 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:17.803106    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e7367ac3-5678-46a7-bb82-08131a0a23b3-kube-api-access-zzb67" (OuterVolumeSpecName: "kube-api-access-zzb67") pod "e7367ac3-5678-46a7-bb82-08131a0a23b3" (UID: "e7367ac3-5678-46a7-bb82-08131a0a23b3"). InnerVolumeSpecName "kube-api-access-zzb67". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:34:17.813431 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:17.813298    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e7367ac3-5678-46a7-bb82-08131a0a23b3-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e7367ac3-5678-46a7-bb82-08131a0a23b3" (UID: "e7367ac3-5678-46a7-bb82-08131a0a23b3"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:34:17.902400 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:17.902362    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e7367ac3-5678-46a7-bb82-08131a0a23b3-maas-api-tls\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:34:17.902400 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:17.902399    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-zzb67\" (UniqueName: \"kubernetes.io/projected/e7367ac3-5678-46a7-bb82-08131a0a23b3-kube-api-access-zzb67\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:34:17.902645 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:17.902415    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e7367ac3-5678-46a7-bb82-08131a0a23b3-openshift-service-ca\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:34:17.962831 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:17.962800    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:34:18.386234 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:18.386201    2562 generic.go:356] "Generic (PLEG): container finished" podID="e7367ac3-5678-46a7-bb82-08131a0a23b3" containerID="5c6d1fc8660f823e8ce8aa170ad0aa9de91c956b4a0072acf844879471871fe7" exitCode=0
Jul 07 17:34:18.386412 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:18.386243    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-derive-6781f0c8-84dc57f4d4-bxpd7"
Jul 07 17:34:18.386412 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:18.386275    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-6781f0c8-84dc57f4d4-bxpd7" event={"ID":"e7367ac3-5678-46a7-bb82-08131a0a23b3","Type":"ContainerDied","Data":"5c6d1fc8660f823e8ce8aa170ad0aa9de91c956b4a0072acf844879471871fe7"}
Jul 07 17:34:18.386412 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:18.386322    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-derive-6781f0c8-84dc57f4d4-bxpd7" event={"ID":"e7367ac3-5678-46a7-bb82-08131a0a23b3","Type":"ContainerDied","Data":"af15ca1b40056bed65053f3d633c803d2f32e693925b7405fe78fab91c4adfe9"}
Jul 07 17:34:18.386412 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:18.386343    2562 scope.go:117] "RemoveContainer" containerID="5c6d1fc8660f823e8ce8aa170ad0aa9de91c956b4a0072acf844879471871fe7"
Jul 07 17:34:18.395120 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:18.395099    2562 scope.go:117] "RemoveContainer" containerID="5c6d1fc8660f823e8ce8aa170ad0aa9de91c956b4a0072acf844879471871fe7"
Jul 07 17:34:18.395454 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:34:18.395433    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c6d1fc8660f823e8ce8aa170ad0aa9de91c956b4a0072acf844879471871fe7\": container with ID starting with 5c6d1fc8660f823e8ce8aa170ad0aa9de91c956b4a0072acf844879471871fe7 not found: ID does not exist" containerID="5c6d1fc8660f823e8ce8aa170ad0aa9de91c956b4a0072acf844879471871fe7"
Jul 07 17:34:18.395532 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:18.395462    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c6d1fc8660f823e8ce8aa170ad0aa9de91c956b4a0072acf844879471871fe7"} err="failed to get container status \"5c6d1fc8660f823e8ce8aa170ad0aa9de91c956b4a0072acf844879471871fe7\": rpc error: code = NotFound desc = could not find container \"5c6d1fc8660f823e8ce8aa170ad0aa9de91c956b4a0072acf844879471871fe7\": container with ID starting with 5c6d1fc8660f823e8ce8aa170ad0aa9de91c956b4a0072acf844879471871fe7 not found: ID does not exist"
Jul 07 17:34:18.410957 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:18.410888    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-derive-6781f0c8-84dc57f4d4-bxpd7"]
Jul 07 17:34:18.413736 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:18.413704    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-derive-6781f0c8-84dc57f4d4-bxpd7"]
Jul 07 17:34:19.847142 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:19.847107    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e7367ac3-5678-46a7-bb82-08131a0a23b3" path="/var/lib/kubelet/pods/e7367ac3-5678-46a7-bb82-08131a0a23b3/volumes"
Jul 07 17:34:22.862442 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:22.862417    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd"
Jul 07 17:34:22.960899 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:22.960804    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4b2bb88-0a18-4259-8fb1-737fa94644f8-istio-data\") pod \"d4b2bb88-0a18-4259-8fb1-737fa94644f8\" (UID: \"d4b2bb88-0a18-4259-8fb1-737fa94644f8\") "
Jul 07 17:34:22.960899 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:22.960846    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cm4dx\" (UniqueName: \"kubernetes.io/projected/d4b2bb88-0a18-4259-8fb1-737fa94644f8-kube-api-access-cm4dx\") pod \"d4b2bb88-0a18-4259-8fb1-737fa94644f8\" (UID: \"d4b2bb88-0a18-4259-8fb1-737fa94644f8\") "
Jul 07 17:34:22.960899 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:22.960883    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4b2bb88-0a18-4259-8fb1-737fa94644f8-workload-socket\") pod \"d4b2bb88-0a18-4259-8fb1-737fa94644f8\" (UID: \"d4b2bb88-0a18-4259-8fb1-737fa94644f8\") "
Jul 07 17:34:22.961217 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:22.960922    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4b2bb88-0a18-4259-8fb1-737fa94644f8-workload-certs\") pod \"d4b2bb88-0a18-4259-8fb1-737fa94644f8\" (UID: \"d4b2bb88-0a18-4259-8fb1-737fa94644f8\") "
Jul 07 17:34:22.961217 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:22.960950    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4b2bb88-0a18-4259-8fb1-737fa94644f8-istio-podinfo\") pod \"d4b2bb88-0a18-4259-8fb1-737fa94644f8\" (UID: \"d4b2bb88-0a18-4259-8fb1-737fa94644f8\") "
Jul 07 17:34:22.961217 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:22.961041    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4b2bb88-0a18-4259-8fb1-737fa94644f8-istiod-ca-cert\") pod \"d4b2bb88-0a18-4259-8fb1-737fa94644f8\" (UID: \"d4b2bb88-0a18-4259-8fb1-737fa94644f8\") "
Jul 07 17:34:22.961217 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:22.961063    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4b2bb88-0a18-4259-8fb1-737fa94644f8-istio-envoy\") pod \"d4b2bb88-0a18-4259-8fb1-737fa94644f8\" (UID: \"d4b2bb88-0a18-4259-8fb1-737fa94644f8\") "
Jul 07 17:34:22.961217 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:22.961096    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4b2bb88-0a18-4259-8fb1-737fa94644f8-istio-token\") pod \"d4b2bb88-0a18-4259-8fb1-737fa94644f8\" (UID: \"d4b2bb88-0a18-4259-8fb1-737fa94644f8\") "
Jul 07 17:34:22.961217 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:22.961124    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4b2bb88-0a18-4259-8fb1-737fa94644f8-credential-socket\") pod \"d4b2bb88-0a18-4259-8fb1-737fa94644f8\" (UID: \"d4b2bb88-0a18-4259-8fb1-737fa94644f8\") "
Jul 07 17:34:22.961528 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:22.961283    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4b2bb88-0a18-4259-8fb1-737fa94644f8-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d4b2bb88-0a18-4259-8fb1-737fa94644f8" (UID: "d4b2bb88-0a18-4259-8fb1-737fa94644f8"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:34:22.961528 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:22.961495    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4b2bb88-0a18-4259-8fb1-737fa94644f8-workload-socket\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:34:22.961528 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:22.961508    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4b2bb88-0a18-4259-8fb1-737fa94644f8-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d4b2bb88-0a18-4259-8fb1-737fa94644f8" (UID: "d4b2bb88-0a18-4259-8fb1-737fa94644f8"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:34:22.961681 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:22.961538    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d4b2bb88-0a18-4259-8fb1-737fa94644f8-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d4b2bb88-0a18-4259-8fb1-737fa94644f8" (UID: "d4b2bb88-0a18-4259-8fb1-737fa94644f8"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:34:22.961681 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:22.961579    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4b2bb88-0a18-4259-8fb1-737fa94644f8-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d4b2bb88-0a18-4259-8fb1-737fa94644f8" (UID: "d4b2bb88-0a18-4259-8fb1-737fa94644f8"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:34:22.961777 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:22.961715    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4b2bb88-0a18-4259-8fb1-737fa94644f8-istio-data" (OuterVolumeSpecName: "istio-data") pod "d4b2bb88-0a18-4259-8fb1-737fa94644f8" (UID: "d4b2bb88-0a18-4259-8fb1-737fa94644f8"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:34:22.963238 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:22.963198    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d4b2bb88-0a18-4259-8fb1-737fa94644f8-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d4b2bb88-0a18-4259-8fb1-737fa94644f8" (UID: "d4b2bb88-0a18-4259-8fb1-737fa94644f8"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 17:34:22.963451 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:22.963429    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4b2bb88-0a18-4259-8fb1-737fa94644f8-istio-token" (OuterVolumeSpecName: "istio-token") pod "d4b2bb88-0a18-4259-8fb1-737fa94644f8" (UID: "d4b2bb88-0a18-4259-8fb1-737fa94644f8"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:34:22.963558 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:22.963534    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d4b2bb88-0a18-4259-8fb1-737fa94644f8-kube-api-access-cm4dx" (OuterVolumeSpecName: "kube-api-access-cm4dx") pod "d4b2bb88-0a18-4259-8fb1-737fa94644f8" (UID: "d4b2bb88-0a18-4259-8fb1-737fa94644f8"). InnerVolumeSpecName "kube-api-access-cm4dx". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:34:22.963609 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:22.963580    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d4b2bb88-0a18-4259-8fb1-737fa94644f8-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d4b2bb88-0a18-4259-8fb1-737fa94644f8" (UID: "d4b2bb88-0a18-4259-8fb1-737fa94644f8"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:34:23.062471 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:23.062432    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d4b2bb88-0a18-4259-8fb1-737fa94644f8-istiod-ca-cert\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:34:23.062471 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:23.062467    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d4b2bb88-0a18-4259-8fb1-737fa94644f8-istio-envoy\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:34:23.062471 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:23.062476    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d4b2bb88-0a18-4259-8fb1-737fa94644f8-istio-token\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:34:23.062732 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:23.062488    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d4b2bb88-0a18-4259-8fb1-737fa94644f8-credential-socket\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:34:23.062732 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:23.062498    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d4b2bb88-0a18-4259-8fb1-737fa94644f8-istio-data\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:34:23.062732 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:23.062506    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cm4dx\" (UniqueName: \"kubernetes.io/projected/d4b2bb88-0a18-4259-8fb1-737fa94644f8-kube-api-access-cm4dx\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:34:23.062732 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:23.062519    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d4b2bb88-0a18-4259-8fb1-737fa94644f8-workload-certs\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:34:23.062732 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:23.062531    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d4b2bb88-0a18-4259-8fb1-737fa94644f8-istio-podinfo\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:34:23.138538 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:23.138505    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:34:23.238380 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:23.238285    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:34:23.417863 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:23.417826    2562 generic.go:356] "Generic (PLEG): container finished" podID="d4b2bb88-0a18-4259-8fb1-737fa94644f8" containerID="0ba02d0863e35bea3c6b3da7c260b25f731a369aaf4045fe692619f580d0ccb6" exitCode=0
Jul 07 17:34:23.418070 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:23.417882    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd"
Jul 07 17:34:23.418070 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:23.417913    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd" event={"ID":"d4b2bb88-0a18-4259-8fb1-737fa94644f8","Type":"ContainerDied","Data":"0ba02d0863e35bea3c6b3da7c260b25f731a369aaf4045fe692619f580d0ccb6"}
Jul 07 17:34:23.418070 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:23.417968    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd" event={"ID":"d4b2bb88-0a18-4259-8fb1-737fa94644f8","Type":"ContainerDied","Data":"2e10be80f8c5ad6cd777ce75eeefc1a4f53282e421e5dcef542719593d11f6ac"}
Jul 07 17:34:23.418070 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:23.417997    2562 scope.go:117] "RemoveContainer" containerID="0ba02d0863e35bea3c6b3da7c260b25f731a369aaf4045fe692619f580d0ccb6"
Jul 07 17:34:23.428003 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:23.427986    2562 scope.go:117] "RemoveContainer" containerID="0ba02d0863e35bea3c6b3da7c260b25f731a369aaf4045fe692619f580d0ccb6"
Jul 07 17:34:23.428287 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:34:23.428269    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0ba02d0863e35bea3c6b3da7c260b25f731a369aaf4045fe692619f580d0ccb6\": container with ID starting with 0ba02d0863e35bea3c6b3da7c260b25f731a369aaf4045fe692619f580d0ccb6 not found: ID does not exist" containerID="0ba02d0863e35bea3c6b3da7c260b25f731a369aaf4045fe692619f580d0ccb6"
Jul 07 17:34:23.428341 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:23.428297    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0ba02d0863e35bea3c6b3da7c260b25f731a369aaf4045fe692619f580d0ccb6"} err="failed to get container status \"0ba02d0863e35bea3c6b3da7c260b25f731a369aaf4045fe692619f580d0ccb6\": rpc error: code = NotFound desc = could not find container \"0ba02d0863e35bea3c6b3da7c260b25f731a369aaf4045fe692619f580d0ccb6\": container with ID starting with 0ba02d0863e35bea3c6b3da7c260b25f731a369aaf4045fe692619f580d0ccb6 not found: ID does not exist"
Jul 07 17:34:23.451977 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:23.451943    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd"]
Jul 07 17:34:23.474446 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:23.474416    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-6781f0c8-openshift-default-77f7644847-2xktd"]
Jul 07 17:34:23.684316 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:23.684282    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:34:23.796721 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:23.796676    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:34:23.846083 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:23.846050    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d4b2bb88-0a18-4259-8fb1-737fa94644f8" path="/var/lib/kubelet/pods/d4b2bb88-0a18-4259-8fb1-737fa94644f8/volumes"
Jul 07 17:34:23.912363 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:23.912327    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:34:25.484682 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:25.484652    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:34:32.077593 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:32.077545    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:34:32.196905 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:32.196856    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:34:32.364311 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:32.364209    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:34:32.470890 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:32.470845    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:34:32.957083 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:32.957047    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:34:59.021324 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:34:59.021290    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:35:06.181667 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:35:06.181615    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:35:06.308039 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:35:06.308007    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:35:06.416444 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:35:06.416406    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:35:22.541917 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:35:22.541883    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:35:28.729662 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:35:28.729627    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:35:28.794514 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:35:28.794480    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:35:28.890692 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:35:28.890656    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:35:28.990472 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:35:28.990386    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:35:39.522520 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:35:39.522481    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:35:40.358929 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:35:40.358893    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:35:46.671812 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:35:46.671778    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:35:46.770366 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:35:46.770327    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:35:46.866842 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:35:46.866812    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:35:46.967371 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:35:46.967277    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:35:47.814070 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:35:47.814036    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:35:47.903268 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:35:47.903235    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:35:48.002174 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:35:48.002123    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:35:49.782400 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:35:49.782361    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:35:56.100119 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:35:56.100088    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:35:56.165698 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:35:56.165663    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:35:56.830436 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:35:56.830403    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:36:03.112092 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:03.112048    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:36:03.173757 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:03.173720    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:36:03.375510 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:03.375483    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:36:03.754182 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:03.754082    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:36:04.012365 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:04.012283    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:36:06.957371 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:06.957336    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:36:07.057542 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:07.057505    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:36:07.185195 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:07.185146    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-88352601-59f9c896bd-xnrts"]
Jul 07 17:36:07.185592 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:07.185569    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e7367ac3-5678-46a7-bb82-08131a0a23b3" containerName="maas-api"
Jul 07 17:36:07.185592 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:07.185589    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e7367ac3-5678-46a7-bb82-08131a0a23b3" containerName="maas-api"
Jul 07 17:36:07.185739 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:07.185612    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d4b2bb88-0a18-4259-8fb1-737fa94644f8" containerName="istio-proxy"
Jul 07 17:36:07.185739 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:07.185620    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="d4b2bb88-0a18-4259-8fb1-737fa94644f8" containerName="istio-proxy"
Jul 07 17:36:07.185739 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:07.185724    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="d4b2bb88-0a18-4259-8fb1-737fa94644f8" containerName="istio-proxy"
Jul 07 17:36:07.185886 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:07.185741    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e7367ac3-5678-46a7-bb82-08131a0a23b3" containerName="maas-api"
Jul 07 17:36:07.187901 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:07.187881    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-88352601-59f9c896bd-xnrts"
Jul 07 17:36:07.190894 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:07.190867    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-88352601-serving-cert\""
Jul 07 17:36:07.203981 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:07.203945    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-88352601-59f9c896bd-xnrts"]
Jul 07 17:36:07.223990 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:07.223915    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:36:07.290144 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:07.290108    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db2025dc-0c16-4be8-a653-a928d197a5a6-maas-api-tls\") pod \"maas-api-e2e-mt-88352601-59f9c896bd-xnrts\" (UID: \"db2025dc-0c16-4be8-a653-a928d197a5a6\") " pod="opendatahub/maas-api-e2e-mt-88352601-59f9c896bd-xnrts"
Jul 07 17:36:07.290144 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:07.290145    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db2025dc-0c16-4be8-a653-a928d197a5a6-openshift-service-ca\") pod \"maas-api-e2e-mt-88352601-59f9c896bd-xnrts\" (UID: \"db2025dc-0c16-4be8-a653-a928d197a5a6\") " pod="opendatahub/maas-api-e2e-mt-88352601-59f9c896bd-xnrts"
Jul 07 17:36:07.290392 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:07.290249    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jnljz\" (UniqueName: \"kubernetes.io/projected/db2025dc-0c16-4be8-a653-a928d197a5a6-kube-api-access-jnljz\") pod \"maas-api-e2e-mt-88352601-59f9c896bd-xnrts\" (UID: \"db2025dc-0c16-4be8-a653-a928d197a5a6\") " pod="opendatahub/maas-api-e2e-mt-88352601-59f9c896bd-xnrts"
Jul 07 17:36:07.391738 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:07.391695    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db2025dc-0c16-4be8-a653-a928d197a5a6-maas-api-tls\") pod \"maas-api-e2e-mt-88352601-59f9c896bd-xnrts\" (UID: \"db2025dc-0c16-4be8-a653-a928d197a5a6\") " pod="opendatahub/maas-api-e2e-mt-88352601-59f9c896bd-xnrts"
Jul 07 17:36:07.391738 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:07.391736    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db2025dc-0c16-4be8-a653-a928d197a5a6-openshift-service-ca\") pod \"maas-api-e2e-mt-88352601-59f9c896bd-xnrts\" (UID: \"db2025dc-0c16-4be8-a653-a928d197a5a6\") " pod="opendatahub/maas-api-e2e-mt-88352601-59f9c896bd-xnrts"
Jul 07 17:36:07.391952 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:07.391780    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jnljz\" (UniqueName: \"kubernetes.io/projected/db2025dc-0c16-4be8-a653-a928d197a5a6-kube-api-access-jnljz\") pod \"maas-api-e2e-mt-88352601-59f9c896bd-xnrts\" (UID: \"db2025dc-0c16-4be8-a653-a928d197a5a6\") " pod="opendatahub/maas-api-e2e-mt-88352601-59f9c896bd-xnrts"
Jul 07 17:36:07.391952 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:36:07.391863    2562 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-mt-88352601-serving-cert: secret "maas-api-e2e-mt-88352601-serving-cert" not found
Jul 07 17:36:07.392024 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:36:07.391952    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/db2025dc-0c16-4be8-a653-a928d197a5a6-maas-api-tls podName:db2025dc-0c16-4be8-a653-a928d197a5a6 nodeName:}" failed. No retries permitted until 2026-07-07 17:36:07.891931971 +0000 UTC m=+1692.615185169 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/db2025dc-0c16-4be8-a653-a928d197a5a6-maas-api-tls") pod "maas-api-e2e-mt-88352601-59f9c896bd-xnrts" (UID: "db2025dc-0c16-4be8-a653-a928d197a5a6") : secret "maas-api-e2e-mt-88352601-serving-cert" not found
Jul 07 17:36:07.392507 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:07.392489    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db2025dc-0c16-4be8-a653-a928d197a5a6-openshift-service-ca\") pod \"maas-api-e2e-mt-88352601-59f9c896bd-xnrts\" (UID: \"db2025dc-0c16-4be8-a653-a928d197a5a6\") " pod="opendatahub/maas-api-e2e-mt-88352601-59f9c896bd-xnrts"
Jul 07 17:36:07.403109 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:07.403080    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jnljz\" (UniqueName: \"kubernetes.io/projected/db2025dc-0c16-4be8-a653-a928d197a5a6-kube-api-access-jnljz\") pod \"maas-api-e2e-mt-88352601-59f9c896bd-xnrts\" (UID: \"db2025dc-0c16-4be8-a653-a928d197a5a6\") " pod="opendatahub/maas-api-e2e-mt-88352601-59f9c896bd-xnrts"
Jul 07 17:36:07.494575 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:07.494489    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:36:07.715887 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:07.715850    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:36:07.814102 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:07.814012    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:36:07.898094 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:07.898051    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db2025dc-0c16-4be8-a653-a928d197a5a6-maas-api-tls\") pod \"maas-api-e2e-mt-88352601-59f9c896bd-xnrts\" (UID: \"db2025dc-0c16-4be8-a653-a928d197a5a6\") " pod="opendatahub/maas-api-e2e-mt-88352601-59f9c896bd-xnrts"
Jul 07 17:36:07.900545 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:07.900520    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db2025dc-0c16-4be8-a653-a928d197a5a6-maas-api-tls\") pod \"maas-api-e2e-mt-88352601-59f9c896bd-xnrts\" (UID: \"db2025dc-0c16-4be8-a653-a928d197a5a6\") " pod="opendatahub/maas-api-e2e-mt-88352601-59f9c896bd-xnrts"
Jul 07 17:36:08.099054 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:08.098953    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-88352601-59f9c896bd-xnrts"
Jul 07 17:36:08.236606 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:08.236575    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-88352601-59f9c896bd-xnrts"]
Jul 07 17:36:08.238588 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:36:08.238556    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb2025dc_0c16_4be8_a653_a928d197a5a6.slice/crio-da4f4003000e70638a3d8d3033b89a9e5e55c67003930f8e3f759b2d3fc71879 WatchSource:0}: Error finding container da4f4003000e70638a3d8d3033b89a9e5e55c67003930f8e3f759b2d3fc71879: Status 404 returned error can't find the container with id da4f4003000e70638a3d8d3033b89a9e5e55c67003930f8e3f759b2d3fc71879
Jul 07 17:36:08.239846 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:08.239826    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 17:36:08.930669 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:08.930571    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-88352601-59f9c896bd-xnrts" event={"ID":"db2025dc-0c16-4be8-a653-a928d197a5a6","Type":"ContainerStarted","Data":"7fe07fc99f97a4e95eba6f207d5744d727394e7177491f0ea929619a158acf36"}
Jul 07 17:36:08.930669 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:08.930620    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-88352601-59f9c896bd-xnrts" event={"ID":"db2025dc-0c16-4be8-a653-a928d197a5a6","Type":"ContainerStarted","Data":"da4f4003000e70638a3d8d3033b89a9e5e55c67003930f8e3f759b2d3fc71879"}
Jul 07 17:36:08.930906 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:08.930675    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-88352601-59f9c896bd-xnrts"
Jul 07 17:36:08.949729 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:08.949675    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-88352601-59f9c896bd-xnrts" podStartSLOduration=1.557611949 podStartE2EDuration="1.949655461s" totalImagesPullingTime="392.043512ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:36:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:36:08.948546907 +0000 UTC m=+1693.671800105" watchObservedRunningTime="2026-07-07 17:36:08.949655461 +0000 UTC m=+1693.672908658"
Jul 07 17:36:11.520821 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:11.520793    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:36:12.221832 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:12.221790    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:36:12.322468 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:12.322413    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:36:12.706100 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:12.706058    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:36:14.941670 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:14.941642    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-88352601-59f9c896bd-xnrts"
Jul 07 17:36:19.173984 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:19.173895    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:36:19.250206 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:19.250173    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:36:19.623449 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:19.623353    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:36:19.961016 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:19.960834    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-88352601-59f9c896bd-xnrts"]
Jul 07 17:36:19.961274 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:19.961231    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-88352601-59f9c896bd-xnrts" podUID="db2025dc-0c16-4be8-a653-a928d197a5a6" containerName="maas-api" containerID="cri-o://7fe07fc99f97a4e95eba6f207d5744d727394e7177491f0ea929619a158acf36" gracePeriod=30
Jul 07 17:36:19.974690 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:19.974664    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:36:20.065795 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:20.065743    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:36:20.225541 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:20.225466    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-88352601-59f9c896bd-xnrts"
Jul 07 17:36:20.315138 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:20.315099    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jnljz\" (UniqueName: \"kubernetes.io/projected/db2025dc-0c16-4be8-a653-a928d197a5a6-kube-api-access-jnljz\") pod \"db2025dc-0c16-4be8-a653-a928d197a5a6\" (UID: \"db2025dc-0c16-4be8-a653-a928d197a5a6\") "
Jul 07 17:36:20.315350 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:20.315257    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db2025dc-0c16-4be8-a653-a928d197a5a6-openshift-service-ca\") pod \"db2025dc-0c16-4be8-a653-a928d197a5a6\" (UID: \"db2025dc-0c16-4be8-a653-a928d197a5a6\") "
Jul 07 17:36:20.315350 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:20.315313    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db2025dc-0c16-4be8-a653-a928d197a5a6-maas-api-tls\") pod \"db2025dc-0c16-4be8-a653-a928d197a5a6\" (UID: \"db2025dc-0c16-4be8-a653-a928d197a5a6\") "
Jul 07 17:36:20.315648 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:20.315620    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/db2025dc-0c16-4be8-a653-a928d197a5a6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "db2025dc-0c16-4be8-a653-a928d197a5a6" (UID: "db2025dc-0c16-4be8-a653-a928d197a5a6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:36:20.317322 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:20.317277    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/db2025dc-0c16-4be8-a653-a928d197a5a6-kube-api-access-jnljz" (OuterVolumeSpecName: "kube-api-access-jnljz") pod "db2025dc-0c16-4be8-a653-a928d197a5a6" (UID: "db2025dc-0c16-4be8-a653-a928d197a5a6"). InnerVolumeSpecName "kube-api-access-jnljz". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:36:20.317418 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:20.317371    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/db2025dc-0c16-4be8-a653-a928d197a5a6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "db2025dc-0c16-4be8-a653-a928d197a5a6" (UID: "db2025dc-0c16-4be8-a653-a928d197a5a6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:36:20.417045 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:20.417005    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/db2025dc-0c16-4be8-a653-a928d197a5a6-openshift-service-ca\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:36:20.417045 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:20.417043    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/db2025dc-0c16-4be8-a653-a928d197a5a6-maas-api-tls\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:36:20.417045 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:20.417055    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jnljz\" (UniqueName: \"kubernetes.io/projected/db2025dc-0c16-4be8-a653-a928d197a5a6-kube-api-access-jnljz\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:36:20.994278 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:20.994242    2562 generic.go:356] "Generic (PLEG): container finished" podID="db2025dc-0c16-4be8-a653-a928d197a5a6" containerID="7fe07fc99f97a4e95eba6f207d5744d727394e7177491f0ea929619a158acf36" exitCode=0
Jul 07 17:36:20.994457 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:20.994293    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-88352601-59f9c896bd-xnrts"
Jul 07 17:36:20.994457 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:20.994330    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-88352601-59f9c896bd-xnrts" event={"ID":"db2025dc-0c16-4be8-a653-a928d197a5a6","Type":"ContainerDied","Data":"7fe07fc99f97a4e95eba6f207d5744d727394e7177491f0ea929619a158acf36"}
Jul 07 17:36:20.994457 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:20.994385    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-88352601-59f9c896bd-xnrts" event={"ID":"db2025dc-0c16-4be8-a653-a928d197a5a6","Type":"ContainerDied","Data":"da4f4003000e70638a3d8d3033b89a9e5e55c67003930f8e3f759b2d3fc71879"}
Jul 07 17:36:20.994457 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:20.994414    2562 scope.go:117] "RemoveContainer" containerID="7fe07fc99f97a4e95eba6f207d5744d727394e7177491f0ea929619a158acf36"
Jul 07 17:36:21.003417 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:21.003399    2562 scope.go:117] "RemoveContainer" containerID="7fe07fc99f97a4e95eba6f207d5744d727394e7177491f0ea929619a158acf36"
Jul 07 17:36:21.003699 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:36:21.003679    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7fe07fc99f97a4e95eba6f207d5744d727394e7177491f0ea929619a158acf36\": container with ID starting with 7fe07fc99f97a4e95eba6f207d5744d727394e7177491f0ea929619a158acf36 not found: ID does not exist" containerID="7fe07fc99f97a4e95eba6f207d5744d727394e7177491f0ea929619a158acf36"
Jul 07 17:36:21.003745 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:21.003711    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7fe07fc99f97a4e95eba6f207d5744d727394e7177491f0ea929619a158acf36"} err="failed to get container status \"7fe07fc99f97a4e95eba6f207d5744d727394e7177491f0ea929619a158acf36\": rpc error: code = NotFound desc = could not find container \"7fe07fc99f97a4e95eba6f207d5744d727394e7177491f0ea929619a158acf36\": container with ID starting with 7fe07fc99f97a4e95eba6f207d5744d727394e7177491f0ea929619a158acf36 not found: ID does not exist"
Jul 07 17:36:21.016912 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:21.016888    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-88352601-59f9c896bd-xnrts"]
Jul 07 17:36:21.021509 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:21.021488    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-88352601-59f9c896bd-xnrts"]
Jul 07 17:36:21.846691 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:21.846658    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="db2025dc-0c16-4be8-a653-a928d197a5a6" path="/var/lib/kubelet/pods/db2025dc-0c16-4be8-a653-a928d197a5a6/volumes"
Jul 07 17:36:26.617027 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:26.616983    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:36:26.724842 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:26.724798    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:36:26.924264 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:26.924236    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:36:27.176425 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:27.176341    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:36:27.306378 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:27.306342    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:36:27.406141 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:27.406106    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:36:27.552088 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:27.551976    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:36:33.313311 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:33.313279    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:36:33.382431 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:33.382385    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:36:33.873203 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:33.873172    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:36:34.038806 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:34.038774    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:36:34.137497 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:34.137419    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:36:34.267760 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:34.267727    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:36:40.548262 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:40.548226    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:36:40.648952 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:40.648920    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:36:41.217909 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:41.217869    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:36:41.317697 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:41.317653    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:36:48.005787 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:48.005753    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:36:48.431695 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:48.431659    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:36:49.041245 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:49.041212    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:36:51.392819 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:51.392785    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:36:51.468365 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:51.468325    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-mt-7bdc63cf-6c65878c99-kfsfn"]
Jul 07 17:36:51.468698 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:51.468685    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="db2025dc-0c16-4be8-a653-a928d197a5a6" containerName="maas-api"
Jul 07 17:36:51.468767 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:51.468699    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="db2025dc-0c16-4be8-a653-a928d197a5a6" containerName="maas-api"
Jul 07 17:36:51.468824 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:51.468768    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="db2025dc-0c16-4be8-a653-a928d197a5a6" containerName="maas-api"
Jul 07 17:36:51.470564 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:51.470538    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-7bdc63cf-6c65878c99-kfsfn"
Jul 07 17:36:51.472641 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:51.472617    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-mt-7bdc63cf-serving-cert\""
Jul 07 17:36:51.474721 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:51.474698    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:36:51.489670 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:51.489635    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-7bdc63cf-6c65878c99-kfsfn"]
Jul 07 17:36:51.546826 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:51.546795    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:36:51.597364 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:51.597329    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/968c613e-88de-4252-a8d7-3fdd45ed88df-maas-api-tls\") pod \"maas-api-e2e-mt-7bdc63cf-6c65878c99-kfsfn\" (UID: \"968c613e-88de-4252-a8d7-3fdd45ed88df\") " pod="opendatahub/maas-api-e2e-mt-7bdc63cf-6c65878c99-kfsfn"
Jul 07 17:36:51.597364 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:51.597375    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/968c613e-88de-4252-a8d7-3fdd45ed88df-openshift-service-ca\") pod \"maas-api-e2e-mt-7bdc63cf-6c65878c99-kfsfn\" (UID: \"968c613e-88de-4252-a8d7-3fdd45ed88df\") " pod="opendatahub/maas-api-e2e-mt-7bdc63cf-6c65878c99-kfsfn"
Jul 07 17:36:51.597607 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:51.597405    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqjl2\" (UniqueName: \"kubernetes.io/projected/968c613e-88de-4252-a8d7-3fdd45ed88df-kube-api-access-gqjl2\") pod \"maas-api-e2e-mt-7bdc63cf-6c65878c99-kfsfn\" (UID: \"968c613e-88de-4252-a8d7-3fdd45ed88df\") " pod="opendatahub/maas-api-e2e-mt-7bdc63cf-6c65878c99-kfsfn"
Jul 07 17:36:51.647245 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:51.647128    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:36:51.698527 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:51.698489    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/968c613e-88de-4252-a8d7-3fdd45ed88df-maas-api-tls\") pod \"maas-api-e2e-mt-7bdc63cf-6c65878c99-kfsfn\" (UID: \"968c613e-88de-4252-a8d7-3fdd45ed88df\") " pod="opendatahub/maas-api-e2e-mt-7bdc63cf-6c65878c99-kfsfn"
Jul 07 17:36:51.698719 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:51.698537    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/968c613e-88de-4252-a8d7-3fdd45ed88df-openshift-service-ca\") pod \"maas-api-e2e-mt-7bdc63cf-6c65878c99-kfsfn\" (UID: \"968c613e-88de-4252-a8d7-3fdd45ed88df\") " pod="opendatahub/maas-api-e2e-mt-7bdc63cf-6c65878c99-kfsfn"
Jul 07 17:36:51.698719 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:51.698563    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqjl2\" (UniqueName: \"kubernetes.io/projected/968c613e-88de-4252-a8d7-3fdd45ed88df-kube-api-access-gqjl2\") pod \"maas-api-e2e-mt-7bdc63cf-6c65878c99-kfsfn\" (UID: \"968c613e-88de-4252-a8d7-3fdd45ed88df\") " pod="opendatahub/maas-api-e2e-mt-7bdc63cf-6c65878c99-kfsfn"
Jul 07 17:36:51.699455 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:51.699403    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/968c613e-88de-4252-a8d7-3fdd45ed88df-openshift-service-ca\") pod \"maas-api-e2e-mt-7bdc63cf-6c65878c99-kfsfn\" (UID: \"968c613e-88de-4252-a8d7-3fdd45ed88df\") " pod="opendatahub/maas-api-e2e-mt-7bdc63cf-6c65878c99-kfsfn"
Jul 07 17:36:51.701230 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:51.701210    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/968c613e-88de-4252-a8d7-3fdd45ed88df-maas-api-tls\") pod \"maas-api-e2e-mt-7bdc63cf-6c65878c99-kfsfn\" (UID: \"968c613e-88de-4252-a8d7-3fdd45ed88df\") " pod="opendatahub/maas-api-e2e-mt-7bdc63cf-6c65878c99-kfsfn"
Jul 07 17:36:51.711069 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:51.711040    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqjl2\" (UniqueName: \"kubernetes.io/projected/968c613e-88de-4252-a8d7-3fdd45ed88df-kube-api-access-gqjl2\") pod \"maas-api-e2e-mt-7bdc63cf-6c65878c99-kfsfn\" (UID: \"968c613e-88de-4252-a8d7-3fdd45ed88df\") " pod="opendatahub/maas-api-e2e-mt-7bdc63cf-6c65878c99-kfsfn"
Jul 07 17:36:51.786048 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:51.786006    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-7bdc63cf-6c65878c99-kfsfn"
Jul 07 17:36:51.931354 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:51.931321    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-mt-7bdc63cf-6c65878c99-kfsfn"]
Jul 07 17:36:51.934026 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:36:51.933981    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod968c613e_88de_4252_a8d7_3fdd45ed88df.slice/crio-10391cd22634308e334516283ee84288989d66bac48d1ae9170e4374a2f1c6e8 WatchSource:0}: Error finding container 10391cd22634308e334516283ee84288989d66bac48d1ae9170e4374a2f1c6e8: Status 404 returned error can't find the container with id 10391cd22634308e334516283ee84288989d66bac48d1ae9170e4374a2f1c6e8
Jul 07 17:36:51.980485 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:51.980447    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:36:52.080955 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:52.080922    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:36:52.152872 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:52.152836    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-7bdc63cf-6c65878c99-kfsfn" event={"ID":"968c613e-88de-4252-a8d7-3fdd45ed88df","Type":"ContainerStarted","Data":"10391cd22634308e334516283ee84288989d66bac48d1ae9170e4374a2f1c6e8"}
Jul 07 17:36:53.159627 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:53.159586    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-7bdc63cf-6c65878c99-kfsfn" event={"ID":"968c613e-88de-4252-a8d7-3fdd45ed88df","Type":"ContainerStarted","Data":"0bd994be3e348cd15afa85ca99facc60867197cf6646bc3a2170543fa66ac806"}
Jul 07 17:36:53.160064 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:53.159782    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-mt-7bdc63cf-6c65878c99-kfsfn"
Jul 07 17:36:53.178115 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:53.178065    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-mt-7bdc63cf-6c65878c99-kfsfn" podStartSLOduration=1.759842206 podStartE2EDuration="2.178049293s" totalImagesPullingTime="418.207087ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:36:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:36:53.177322323 +0000 UTC m=+1737.900575519" watchObservedRunningTime="2026-07-07 17:36:53.178049293 +0000 UTC m=+1737.901302489"
Jul 07 17:36:55.903925 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:55.903892    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:36:59.169882 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:36:59.169848    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-mt-7bdc63cf-6c65878c99-kfsfn"
Jul 07 17:37:07.872603 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:37:07.872574    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:28.661399 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:37:28.661367    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:29.013577 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:37:29.013487    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-7bdc63cf-6c65878c99-kfsfn"]
Jul 07 17:37:29.013790 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:37:29.013764    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-mt-7bdc63cf-6c65878c99-kfsfn" podUID="968c613e-88de-4252-a8d7-3fdd45ed88df" containerName="maas-api" containerID="cri-o://0bd994be3e348cd15afa85ca99facc60867197cf6646bc3a2170543fa66ac806" gracePeriod=30
Jul 07 17:37:29.025107 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:37:29.025077    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:29.165429 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:37:29.165390    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="opendatahub/maas-api-e2e-mt-7bdc63cf-6c65878c99-kfsfn" podUID="968c613e-88de-4252-a8d7-3fdd45ed88df" containerName="maas-api" probeResult="failure" output="Get \"https://10.133.0.52:8443/health\": dial tcp 10.133.0.52:8443: connect: connection refused"
Jul 07 17:37:29.266552 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:37:29.266484    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-7bdc63cf-6c65878c99-kfsfn"
Jul 07 17:37:29.338033 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:37:29.338000    2562 generic.go:356] "Generic (PLEG): container finished" podID="968c613e-88de-4252-a8d7-3fdd45ed88df" containerID="0bd994be3e348cd15afa85ca99facc60867197cf6646bc3a2170543fa66ac806" exitCode=0
Jul 07 17:37:29.338236 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:37:29.338046    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-mt-7bdc63cf-6c65878c99-kfsfn"
Jul 07 17:37:29.338236 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:37:29.338096    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-7bdc63cf-6c65878c99-kfsfn" event={"ID":"968c613e-88de-4252-a8d7-3fdd45ed88df","Type":"ContainerDied","Data":"0bd994be3e348cd15afa85ca99facc60867197cf6646bc3a2170543fa66ac806"}
Jul 07 17:37:29.338236 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:37:29.338148    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-mt-7bdc63cf-6c65878c99-kfsfn" event={"ID":"968c613e-88de-4252-a8d7-3fdd45ed88df","Type":"ContainerDied","Data":"10391cd22634308e334516283ee84288989d66bac48d1ae9170e4374a2f1c6e8"}
Jul 07 17:37:29.338236 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:37:29.338183    2562 scope.go:117] "RemoveContainer" containerID="0bd994be3e348cd15afa85ca99facc60867197cf6646bc3a2170543fa66ac806"
Jul 07 17:37:29.339023 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:37:29.339005    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/968c613e-88de-4252-a8d7-3fdd45ed88df-openshift-service-ca\") pod \"968c613e-88de-4252-a8d7-3fdd45ed88df\" (UID: \"968c613e-88de-4252-a8d7-3fdd45ed88df\") "
Jul 07 17:37:29.339201 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:37:29.339082    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gqjl2\" (UniqueName: \"kubernetes.io/projected/968c613e-88de-4252-a8d7-3fdd45ed88df-kube-api-access-gqjl2\") pod \"968c613e-88de-4252-a8d7-3fdd45ed88df\" (UID: \"968c613e-88de-4252-a8d7-3fdd45ed88df\") "
Jul 07 17:37:29.339201 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:37:29.339105    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/968c613e-88de-4252-a8d7-3fdd45ed88df-maas-api-tls\") pod \"968c613e-88de-4252-a8d7-3fdd45ed88df\" (UID: \"968c613e-88de-4252-a8d7-3fdd45ed88df\") "
Jul 07 17:37:29.339440 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:37:29.339413    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/968c613e-88de-4252-a8d7-3fdd45ed88df-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "968c613e-88de-4252-a8d7-3fdd45ed88df" (UID: "968c613e-88de-4252-a8d7-3fdd45ed88df"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:37:29.341386 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:37:29.341355    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/968c613e-88de-4252-a8d7-3fdd45ed88df-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "968c613e-88de-4252-a8d7-3fdd45ed88df" (UID: "968c613e-88de-4252-a8d7-3fdd45ed88df"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:37:29.341495 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:37:29.341423    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/968c613e-88de-4252-a8d7-3fdd45ed88df-kube-api-access-gqjl2" (OuterVolumeSpecName: "kube-api-access-gqjl2") pod "968c613e-88de-4252-a8d7-3fdd45ed88df" (UID: "968c613e-88de-4252-a8d7-3fdd45ed88df"). InnerVolumeSpecName "kube-api-access-gqjl2". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:37:29.358294 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:37:29.358269    2562 scope.go:117] "RemoveContainer" containerID="0bd994be3e348cd15afa85ca99facc60867197cf6646bc3a2170543fa66ac806"
Jul 07 17:37:29.358663 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:37:29.358639    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0bd994be3e348cd15afa85ca99facc60867197cf6646bc3a2170543fa66ac806\": container with ID starting with 0bd994be3e348cd15afa85ca99facc60867197cf6646bc3a2170543fa66ac806 not found: ID does not exist" containerID="0bd994be3e348cd15afa85ca99facc60867197cf6646bc3a2170543fa66ac806"
Jul 07 17:37:29.358730 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:37:29.358672    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0bd994be3e348cd15afa85ca99facc60867197cf6646bc3a2170543fa66ac806"} err="failed to get container status \"0bd994be3e348cd15afa85ca99facc60867197cf6646bc3a2170543fa66ac806\": rpc error: code = NotFound desc = could not find container \"0bd994be3e348cd15afa85ca99facc60867197cf6646bc3a2170543fa66ac806\": container with ID starting with 0bd994be3e348cd15afa85ca99facc60867197cf6646bc3a2170543fa66ac806 not found: ID does not exist"
Jul 07 17:37:29.440366 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:37:29.440326    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/968c613e-88de-4252-a8d7-3fdd45ed88df-openshift-service-ca\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:37:29.440366 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:37:29.440358    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gqjl2\" (UniqueName: \"kubernetes.io/projected/968c613e-88de-4252-a8d7-3fdd45ed88df-kube-api-access-gqjl2\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:37:29.440366 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:37:29.440369    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/968c613e-88de-4252-a8d7-3fdd45ed88df-maas-api-tls\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:37:29.664900 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:37:29.664862    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-mt-7bdc63cf-6c65878c99-kfsfn"]
Jul 07 17:37:29.667216 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:37:29.667191    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-mt-7bdc63cf-6c65878c99-kfsfn"]
Jul 07 17:37:29.846544 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:37:29.846511    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="968c613e-88de-4252-a8d7-3fdd45ed88df" path="/var/lib/kubelet/pods/968c613e-88de-4252-a8d7-3fdd45ed88df/volumes"
Jul 07 17:37:34.781639 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:37:34.781602    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:37:39.815732 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:37:39.815689    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:16.911683 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:38:16.911644    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:18.116204 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:38:18.116145    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:23.723142 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:38:23.723096    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:23.788245 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:38:23.788219    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:24.035005 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:38:24.034917    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:24.268540 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:38:24.268504    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:25.386171 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:38:25.386118    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:25.483692 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:38:25.483658    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:25.588380 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:38:25.588348    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:26.342340 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:38:26.342311    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:26.444914 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:38:26.444881    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:26.542435 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:38:26.542400    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:27.933626 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:38:27.933582    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:34.612776 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:38:34.612740    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:34.694522 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:38:34.694478    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:35.320141 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:38:35.320107    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:41.731196 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:38:41.731139    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:41.802397 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:38:41.802363    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:41.894534 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:38:41.894503    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:41.999736 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:38:41.999650    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:52.478100 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:38:52.478064    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:38:52.855514 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:38:52.855428    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:39:13.294616 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:13.294579    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:39:13.850322 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:13.850291    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:39:20.443836 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:20.443745    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:39:20.509812 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:20.509777    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:39:20.787364 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:20.787270    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:39:21.086924 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:21.086846    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78"]
Jul 07 17:39:21.087243 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:21.087219    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="968c613e-88de-4252-a8d7-3fdd45ed88df" containerName="maas-api"
Jul 07 17:39:21.087243 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:21.087234    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="968c613e-88de-4252-a8d7-3fdd45ed88df" containerName="maas-api"
Jul 07 17:39:21.087344 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:21.087319    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="968c613e-88de-4252-a8d7-3fdd45ed88df" containerName="maas-api"
Jul 07 17:39:21.090639 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:21.090615    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78"
Jul 07 17:39:21.093213 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:21.093187    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-457985-openshift-default-dockercfg-c699p\""
Jul 07 17:39:21.104773 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:21.104745    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78"]
Jul 07 17:39:21.111349 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:21.111319    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:39:21.187274 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:21.187237    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1067678c-fd8d-40e5-a2ce-ea20f39dca7f-istio-token\") pod \"e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78\" (UID: \"1067678c-fd8d-40e5-a2ce-ea20f39dca7f\") " pod="openshift-ingress/e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78"
Jul 07 17:39:21.187274 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:21.187277    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fbr6z\" (UniqueName: \"kubernetes.io/projected/1067678c-fd8d-40e5-a2ce-ea20f39dca7f-kube-api-access-fbr6z\") pod \"e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78\" (UID: \"1067678c-fd8d-40e5-a2ce-ea20f39dca7f\") " pod="openshift-ingress/e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78"
Jul 07 17:39:21.187501 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:21.187467    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1067678c-fd8d-40e5-a2ce-ea20f39dca7f-istio-data\") pod \"e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78\" (UID: \"1067678c-fd8d-40e5-a2ce-ea20f39dca7f\") " pod="openshift-ingress/e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78"
Jul 07 17:39:21.187541 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:21.187522    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1067678c-fd8d-40e5-a2ce-ea20f39dca7f-workload-socket\") pod \"e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78\" (UID: \"1067678c-fd8d-40e5-a2ce-ea20f39dca7f\") " pod="openshift-ingress/e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78"
Jul 07 17:39:21.187576 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:21.187563    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1067678c-fd8d-40e5-a2ce-ea20f39dca7f-credential-socket\") pod \"e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78\" (UID: \"1067678c-fd8d-40e5-a2ce-ea20f39dca7f\") " pod="openshift-ingress/e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78"
Jul 07 17:39:21.187610 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:21.187589    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1067678c-fd8d-40e5-a2ce-ea20f39dca7f-workload-certs\") pod \"e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78\" (UID: \"1067678c-fd8d-40e5-a2ce-ea20f39dca7f\") " pod="openshift-ingress/e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78"
Jul 07 17:39:21.187644 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:21.187612    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1067678c-fd8d-40e5-a2ce-ea20f39dca7f-istio-envoy\") pod \"e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78\" (UID: \"1067678c-fd8d-40e5-a2ce-ea20f39dca7f\") " pod="openshift-ingress/e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78"
Jul 07 17:39:21.187644 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:21.187636    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1067678c-fd8d-40e5-a2ce-ea20f39dca7f-istiod-ca-cert\") pod \"e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78\" (UID: \"1067678c-fd8d-40e5-a2ce-ea20f39dca7f\") " pod="openshift-ingress/e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78"
Jul 07 17:39:21.187730 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:21.187713    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1067678c-fd8d-40e5-a2ce-ea20f39dca7f-istio-podinfo\") pod \"e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78\" (UID: \"1067678c-fd8d-40e5-a2ce-ea20f39dca7f\") " pod="openshift-ingress/e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78"
Jul 07 17:39:21.288195 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:21.288138    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1067678c-fd8d-40e5-a2ce-ea20f39dca7f-istio-podinfo\") pod \"e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78\" (UID: \"1067678c-fd8d-40e5-a2ce-ea20f39dca7f\") " pod="openshift-ingress/e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78"
Jul 07 17:39:21.288393 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:21.288212    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1067678c-fd8d-40e5-a2ce-ea20f39dca7f-istio-token\") pod \"e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78\" (UID: \"1067678c-fd8d-40e5-a2ce-ea20f39dca7f\") " pod="openshift-ingress/e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78"
Jul 07 17:39:21.288393 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:21.288240    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fbr6z\" (UniqueName: \"kubernetes.io/projected/1067678c-fd8d-40e5-a2ce-ea20f39dca7f-kube-api-access-fbr6z\") pod \"e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78\" (UID: \"1067678c-fd8d-40e5-a2ce-ea20f39dca7f\") " pod="openshift-ingress/e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78"
Jul 07 17:39:21.288393 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:21.288319    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1067678c-fd8d-40e5-a2ce-ea20f39dca7f-istio-data\") pod \"e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78\" (UID: \"1067678c-fd8d-40e5-a2ce-ea20f39dca7f\") " pod="openshift-ingress/e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78"
Jul 07 17:39:21.288393 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:21.288360    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1067678c-fd8d-40e5-a2ce-ea20f39dca7f-workload-socket\") pod \"e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78\" (UID: \"1067678c-fd8d-40e5-a2ce-ea20f39dca7f\") " pod="openshift-ingress/e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78"
Jul 07 17:39:21.288620 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:21.288540    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1067678c-fd8d-40e5-a2ce-ea20f39dca7f-credential-socket\") pod \"e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78\" (UID: \"1067678c-fd8d-40e5-a2ce-ea20f39dca7f\") " pod="openshift-ingress/e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78"
Jul 07 17:39:21.288620 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:21.288573    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1067678c-fd8d-40e5-a2ce-ea20f39dca7f-workload-certs\") pod \"e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78\" (UID: \"1067678c-fd8d-40e5-a2ce-ea20f39dca7f\") " pod="openshift-ingress/e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78"
Jul 07 17:39:21.288620 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:21.288599    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1067678c-fd8d-40e5-a2ce-ea20f39dca7f-istio-envoy\") pod \"e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78\" (UID: \"1067678c-fd8d-40e5-a2ce-ea20f39dca7f\") " pod="openshift-ingress/e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78"
Jul 07 17:39:21.288772 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:21.288626    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1067678c-fd8d-40e5-a2ce-ea20f39dca7f-istiod-ca-cert\") pod \"e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78\" (UID: \"1067678c-fd8d-40e5-a2ce-ea20f39dca7f\") " pod="openshift-ingress/e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78"
Jul 07 17:39:21.288916 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:21.288891    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1067678c-fd8d-40e5-a2ce-ea20f39dca7f-workload-socket\") pod \"e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78\" (UID: \"1067678c-fd8d-40e5-a2ce-ea20f39dca7f\") " pod="openshift-ingress/e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78"
Jul 07 17:39:21.288999 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:21.288980    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1067678c-fd8d-40e5-a2ce-ea20f39dca7f-istio-data\") pod \"e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78\" (UID: \"1067678c-fd8d-40e5-a2ce-ea20f39dca7f\") " pod="openshift-ingress/e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78"
Jul 07 17:39:21.289060 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:21.288999    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1067678c-fd8d-40e5-a2ce-ea20f39dca7f-credential-socket\") pod \"e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78\" (UID: \"1067678c-fd8d-40e5-a2ce-ea20f39dca7f\") " pod="openshift-ingress/e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78"
Jul 07 17:39:21.289120 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:21.289085    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1067678c-fd8d-40e5-a2ce-ea20f39dca7f-workload-certs\") pod \"e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78\" (UID: \"1067678c-fd8d-40e5-a2ce-ea20f39dca7f\") " pod="openshift-ingress/e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78"
Jul 07 17:39:21.289379 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:21.289361    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1067678c-fd8d-40e5-a2ce-ea20f39dca7f-istiod-ca-cert\") pod \"e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78\" (UID: \"1067678c-fd8d-40e5-a2ce-ea20f39dca7f\") " pod="openshift-ingress/e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78"
Jul 07 17:39:21.290760 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:21.290740    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1067678c-fd8d-40e5-a2ce-ea20f39dca7f-istio-podinfo\") pod \"e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78\" (UID: \"1067678c-fd8d-40e5-a2ce-ea20f39dca7f\") " pod="openshift-ingress/e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78"
Jul 07 17:39:21.290843 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:21.290774    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1067678c-fd8d-40e5-a2ce-ea20f39dca7f-istio-envoy\") pod \"e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78\" (UID: \"1067678c-fd8d-40e5-a2ce-ea20f39dca7f\") " pod="openshift-ingress/e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78"
Jul 07 17:39:21.298799 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:21.298770    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1067678c-fd8d-40e5-a2ce-ea20f39dca7f-istio-token\") pod \"e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78\" (UID: \"1067678c-fd8d-40e5-a2ce-ea20f39dca7f\") " pod="openshift-ingress/e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78"
Jul 07 17:39:21.299048 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:21.299025    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-fbr6z\" (UniqueName: \"kubernetes.io/projected/1067678c-fd8d-40e5-a2ce-ea20f39dca7f-kube-api-access-fbr6z\") pod \"e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78\" (UID: \"1067678c-fd8d-40e5-a2ce-ea20f39dca7f\") " pod="openshift-ingress/e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78"
Jul 07 17:39:21.401094 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:21.401045    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78"
Jul 07 17:39:21.544091 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:21.544063    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78"]
Jul 07 17:39:21.546491 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:39:21.546462    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1067678c_fd8d_40e5_a2ce_ea20f39dca7f.slice/crio-4c2d12ceb0905a26ed6f947278a7e4bf83690b89a66c92594c7f594d49a504c9 WatchSource:0}: Error finding container 4c2d12ceb0905a26ed6f947278a7e4bf83690b89a66c92594c7f594d49a504c9: Status 404 returned error can't find the container with id 4c2d12ceb0905a26ed6f947278a7e4bf83690b89a66c92594c7f594d49a504c9
Jul 07 17:39:21.548892 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:21.548861    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 17:39:21.548973 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:21.548923    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 17:39:21.548973 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:21.548955    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 17:39:21.636554 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:21.636523    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:39:21.902057 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:21.902022    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78" event={"ID":"1067678c-fd8d-40e5-a2ce-ea20f39dca7f","Type":"ContainerStarted","Data":"a23aadfe4f8d6539b088e0da600509933b6aa82dbd4676c16a50388cb88dc537"}
Jul 07 17:39:21.902247 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:21.902073    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78" event={"ID":"1067678c-fd8d-40e5-a2ce-ea20f39dca7f","Type":"ContainerStarted","Data":"4c2d12ceb0905a26ed6f947278a7e4bf83690b89a66c92594c7f594d49a504c9"}
Jul 07 17:39:21.923779 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:21.923715    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78" podStartSLOduration=0.92369421 podStartE2EDuration="923.69421ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:39:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:39:21.922853163 +0000 UTC m=+1886.646106373" watchObservedRunningTime="2026-07-07 17:39:21.92369421 +0000 UTC m=+1886.646947408"
Jul 07 17:39:22.401746 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:22.401704    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78"
Jul 07 17:39:22.407331 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:22.407304    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78"
Jul 07 17:39:22.907327 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:22.907291    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78"
Jul 07 17:39:22.909580 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:22.908470    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78"
Jul 07 17:39:23.945210 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:23.945148    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:39:24.043549 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:24.043516    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:39:24.187765 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:24.187727    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-a-457985-786ff77787-gzh2g"]
Jul 07 17:39:24.191698 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:24.191673    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-457985-786ff77787-gzh2g"
Jul 07 17:39:24.194997 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:24.194972    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-a-457985-serving-cert\""
Jul 07 17:39:24.202371 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:24.202338    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-457985-786ff77787-gzh2g"]
Jul 07 17:39:24.230302 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:24.230273    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:39:24.318481 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:24.318434    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qml2v\" (UniqueName: \"kubernetes.io/projected/c2042e73-09a0-4c88-9f89-4b870bd7dd5d-kube-api-access-qml2v\") pod \"maas-api-e2e-inf-a-457985-786ff77787-gzh2g\" (UID: \"c2042e73-09a0-4c88-9f89-4b870bd7dd5d\") " pod="opendatahub/maas-api-e2e-inf-a-457985-786ff77787-gzh2g"
Jul 07 17:39:24.318661 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:24.318504    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c2042e73-09a0-4c88-9f89-4b870bd7dd5d-openshift-service-ca\") pod \"maas-api-e2e-inf-a-457985-786ff77787-gzh2g\" (UID: \"c2042e73-09a0-4c88-9f89-4b870bd7dd5d\") " pod="opendatahub/maas-api-e2e-inf-a-457985-786ff77787-gzh2g"
Jul 07 17:39:24.318661 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:24.318549    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c2042e73-09a0-4c88-9f89-4b870bd7dd5d-maas-api-tls\") pod \"maas-api-e2e-inf-a-457985-786ff77787-gzh2g\" (UID: \"c2042e73-09a0-4c88-9f89-4b870bd7dd5d\") " pod="opendatahub/maas-api-e2e-inf-a-457985-786ff77787-gzh2g"
Jul 07 17:39:24.323409 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:24.323381    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:39:24.419703 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:24.419663    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qml2v\" (UniqueName: \"kubernetes.io/projected/c2042e73-09a0-4c88-9f89-4b870bd7dd5d-kube-api-access-qml2v\") pod \"maas-api-e2e-inf-a-457985-786ff77787-gzh2g\" (UID: \"c2042e73-09a0-4c88-9f89-4b870bd7dd5d\") " pod="opendatahub/maas-api-e2e-inf-a-457985-786ff77787-gzh2g"
Jul 07 17:39:24.419894 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:24.419722    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c2042e73-09a0-4c88-9f89-4b870bd7dd5d-openshift-service-ca\") pod \"maas-api-e2e-inf-a-457985-786ff77787-gzh2g\" (UID: \"c2042e73-09a0-4c88-9f89-4b870bd7dd5d\") " pod="opendatahub/maas-api-e2e-inf-a-457985-786ff77787-gzh2g"
Jul 07 17:39:24.419894 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:24.419755    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c2042e73-09a0-4c88-9f89-4b870bd7dd5d-maas-api-tls\") pod \"maas-api-e2e-inf-a-457985-786ff77787-gzh2g\" (UID: \"c2042e73-09a0-4c88-9f89-4b870bd7dd5d\") " pod="opendatahub/maas-api-e2e-inf-a-457985-786ff77787-gzh2g"
Jul 07 17:39:24.420559 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:24.420539    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c2042e73-09a0-4c88-9f89-4b870bd7dd5d-openshift-service-ca\") pod \"maas-api-e2e-inf-a-457985-786ff77787-gzh2g\" (UID: \"c2042e73-09a0-4c88-9f89-4b870bd7dd5d\") " pod="opendatahub/maas-api-e2e-inf-a-457985-786ff77787-gzh2g"
Jul 07 17:39:24.422417 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:24.422396    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c2042e73-09a0-4c88-9f89-4b870bd7dd5d-maas-api-tls\") pod \"maas-api-e2e-inf-a-457985-786ff77787-gzh2g\" (UID: \"c2042e73-09a0-4c88-9f89-4b870bd7dd5d\") " pod="opendatahub/maas-api-e2e-inf-a-457985-786ff77787-gzh2g"
Jul 07 17:39:24.429601 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:24.429572    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qml2v\" (UniqueName: \"kubernetes.io/projected/c2042e73-09a0-4c88-9f89-4b870bd7dd5d-kube-api-access-qml2v\") pod \"maas-api-e2e-inf-a-457985-786ff77787-gzh2g\" (UID: \"c2042e73-09a0-4c88-9f89-4b870bd7dd5d\") " pod="opendatahub/maas-api-e2e-inf-a-457985-786ff77787-gzh2g"
Jul 07 17:39:24.503633 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:24.503533    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-457985-786ff77787-gzh2g"
Jul 07 17:39:24.650432 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:24.650405    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-457985-786ff77787-gzh2g"]
Jul 07 17:39:24.652365 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:39:24.652334    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc2042e73_09a0_4c88_9f89_4b870bd7dd5d.slice/crio-f76ffcb656ec98182ecc531c8f021f1d6bca75125b75bc3d2880ee06911391e7 WatchSource:0}: Error finding container f76ffcb656ec98182ecc531c8f021f1d6bca75125b75bc3d2880ee06911391e7: Status 404 returned error can't find the container with id f76ffcb656ec98182ecc531c8f021f1d6bca75125b75bc3d2880ee06911391e7
Jul 07 17:39:24.722545 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:24.722493    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:39:24.823080 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:24.822987    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:39:24.923374 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:24.923335    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-457985-786ff77787-gzh2g" event={"ID":"c2042e73-09a0-4c88-9f89-4b870bd7dd5d","Type":"ContainerStarted","Data":"f76ffcb656ec98182ecc531c8f021f1d6bca75125b75bc3d2880ee06911391e7"}
Jul 07 17:39:25.929885 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:25.929850    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-457985-786ff77787-gzh2g" event={"ID":"c2042e73-09a0-4c88-9f89-4b870bd7dd5d","Type":"ContainerStarted","Data":"24c1263e453feaa72467954c8b541786938c16227663c2477802fc768094e217"}
Jul 07 17:39:25.930313 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:25.929951    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-a-457985-786ff77787-gzh2g"
Jul 07 17:39:25.949559 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:25.949509    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-a-457985-786ff77787-gzh2g" podStartSLOduration=1.525677432 podStartE2EDuration="1.949492458s" totalImagesPullingTime="423.815026ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:39:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:39:25.947343082 +0000 UTC m=+1890.670596280" watchObservedRunningTime="2026-07-07 17:39:25.949492458 +0000 UTC m=+1890.672745654"
Jul 07 17:39:28.467827 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:28.467792    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:39:28.862512 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:28.862407    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:39:29.277339 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:29.277295    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:39:29.645300 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:29.645262    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:39:31.940745 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:31.940717    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-a-457985-786ff77787-gzh2g"
Jul 07 17:39:32.004453 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:32.004415    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:39:32.101081 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:32.100996    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:39:32.133673 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:32.133632    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-inf-b-567860-55cbcdc444-ps9zb"]
Jul 07 17:39:32.137340 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:32.137308    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-567860-55cbcdc444-ps9zb"
Jul 07 17:39:32.139658 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:32.139636    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-inf-b-567860-serving-cert\""
Jul 07 17:39:32.152298 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:32.152266    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-567860-55cbcdc444-ps9zb"]
Jul 07 17:39:32.210381 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:32.210263    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:39:32.298773 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:32.298739    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5ac670fc-1eef-4204-9f02-17ff1e30d2d8-maas-api-tls\") pod \"maas-api-e2e-inf-b-567860-55cbcdc444-ps9zb\" (UID: \"5ac670fc-1eef-4204-9f02-17ff1e30d2d8\") " pod="opendatahub/maas-api-e2e-inf-b-567860-55cbcdc444-ps9zb"
Jul 07 17:39:32.298943 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:32.298781    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8br72\" (UniqueName: \"kubernetes.io/projected/5ac670fc-1eef-4204-9f02-17ff1e30d2d8-kube-api-access-8br72\") pod \"maas-api-e2e-inf-b-567860-55cbcdc444-ps9zb\" (UID: \"5ac670fc-1eef-4204-9f02-17ff1e30d2d8\") " pod="opendatahub/maas-api-e2e-inf-b-567860-55cbcdc444-ps9zb"
Jul 07 17:39:32.298943 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:32.298823    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ac670fc-1eef-4204-9f02-17ff1e30d2d8-openshift-service-ca\") pod \"maas-api-e2e-inf-b-567860-55cbcdc444-ps9zb\" (UID: \"5ac670fc-1eef-4204-9f02-17ff1e30d2d8\") " pod="opendatahub/maas-api-e2e-inf-b-567860-55cbcdc444-ps9zb"
Jul 07 17:39:32.399545 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:32.399502    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5ac670fc-1eef-4204-9f02-17ff1e30d2d8-maas-api-tls\") pod \"maas-api-e2e-inf-b-567860-55cbcdc444-ps9zb\" (UID: \"5ac670fc-1eef-4204-9f02-17ff1e30d2d8\") " pod="opendatahub/maas-api-e2e-inf-b-567860-55cbcdc444-ps9zb"
Jul 07 17:39:32.399745 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:32.399560    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8br72\" (UniqueName: \"kubernetes.io/projected/5ac670fc-1eef-4204-9f02-17ff1e30d2d8-kube-api-access-8br72\") pod \"maas-api-e2e-inf-b-567860-55cbcdc444-ps9zb\" (UID: \"5ac670fc-1eef-4204-9f02-17ff1e30d2d8\") " pod="opendatahub/maas-api-e2e-inf-b-567860-55cbcdc444-ps9zb"
Jul 07 17:39:32.399745 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:32.399602    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ac670fc-1eef-4204-9f02-17ff1e30d2d8-openshift-service-ca\") pod \"maas-api-e2e-inf-b-567860-55cbcdc444-ps9zb\" (UID: \"5ac670fc-1eef-4204-9f02-17ff1e30d2d8\") " pod="opendatahub/maas-api-e2e-inf-b-567860-55cbcdc444-ps9zb"
Jul 07 17:39:32.400416 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:32.400386    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:39:32.400579 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:32.400425    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ac670fc-1eef-4204-9f02-17ff1e30d2d8-openshift-service-ca\") pod \"maas-api-e2e-inf-b-567860-55cbcdc444-ps9zb\" (UID: \"5ac670fc-1eef-4204-9f02-17ff1e30d2d8\") " pod="opendatahub/maas-api-e2e-inf-b-567860-55cbcdc444-ps9zb"
Jul 07 17:39:32.402053 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:32.402028    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5ac670fc-1eef-4204-9f02-17ff1e30d2d8-maas-api-tls\") pod \"maas-api-e2e-inf-b-567860-55cbcdc444-ps9zb\" (UID: \"5ac670fc-1eef-4204-9f02-17ff1e30d2d8\") " pod="opendatahub/maas-api-e2e-inf-b-567860-55cbcdc444-ps9zb"
Jul 07 17:39:32.412219 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:32.412136    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8br72\" (UniqueName: \"kubernetes.io/projected/5ac670fc-1eef-4204-9f02-17ff1e30d2d8-kube-api-access-8br72\") pod \"maas-api-e2e-inf-b-567860-55cbcdc444-ps9zb\" (UID: \"5ac670fc-1eef-4204-9f02-17ff1e30d2d8\") " pod="opendatahub/maas-api-e2e-inf-b-567860-55cbcdc444-ps9zb"
Jul 07 17:39:32.450225 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:32.450179    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-567860-55cbcdc444-ps9zb"
Jul 07 17:39:32.630187 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:32.629430    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-567860-55cbcdc444-ps9zb"]
Jul 07 17:39:32.640027 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:39:32.639996    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ac670fc_1eef_4204_9f02_17ff1e30d2d8.slice/crio-695bb207c450b165ed1759bb8e64fc31d8f5436b024364e32a12abccc0ae8a14 WatchSource:0}: Error finding container 695bb207c450b165ed1759bb8e64fc31d8f5436b024364e32a12abccc0ae8a14: Status 404 returned error can't find the container with id 695bb207c450b165ed1759bb8e64fc31d8f5436b024364e32a12abccc0ae8a14
Jul 07 17:39:32.865886 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:32.865787    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:39:32.963128 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:32.963092    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:39:32.965417 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:32.965393    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-567860-55cbcdc444-ps9zb" event={"ID":"5ac670fc-1eef-4204-9f02-17ff1e30d2d8","Type":"ContainerStarted","Data":"695bb207c450b165ed1759bb8e64fc31d8f5436b024364e32a12abccc0ae8a14"}
Jul 07 17:39:33.972071 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:33.972037    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-567860-55cbcdc444-ps9zb" event={"ID":"5ac670fc-1eef-4204-9f02-17ff1e30d2d8","Type":"ContainerStarted","Data":"0d1b3c77258602b02136f1770426eb48ba449998bb25c525cb9ac02899681fc3"}
Jul 07 17:39:33.972468 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:33.972101    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-inf-b-567860-55cbcdc444-ps9zb"
Jul 07 17:39:33.997750 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:33.997689    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-inf-b-567860-55cbcdc444-ps9zb" podStartSLOduration=1.621404412 podStartE2EDuration="1.997670024s" totalImagesPullingTime="376.265612ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:39:32 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:39:33.994657883 +0000 UTC m=+1898.717911094" watchObservedRunningTime="2026-07-07 17:39:33.997670024 +0000 UTC m=+1898.720923220"
Jul 07 17:39:36.605917 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:36.605823    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:39:38.948373 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:38.948323    2562 patch_prober.go:28] interesting pod/e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 07 17:39:38.948792 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:38.948417    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78" podUID="1067678c-fd8d-40e5-a2ce-ea20f39dca7f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 07 17:39:39.982655 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:39.982624    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-inf-b-567860-55cbcdc444-ps9zb"
Jul 07 17:39:40.001066 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:40.001030    2562 generic.go:356] "Generic (PLEG): container finished" podID="1067678c-fd8d-40e5-a2ce-ea20f39dca7f" containerID="a23aadfe4f8d6539b088e0da600509933b6aa82dbd4676c16a50388cb88dc537" exitCode=0
Jul 07 17:39:40.001259 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:40.001080    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78" event={"ID":"1067678c-fd8d-40e5-a2ce-ea20f39dca7f","Type":"ContainerDied","Data":"a23aadfe4f8d6539b088e0da600509933b6aa82dbd4676c16a50388cb88dc537"}
Jul 07 17:39:40.001511 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:40.001497    2562 scope.go:117] "RemoveContainer" containerID="a23aadfe4f8d6539b088e0da600509933b6aa82dbd4676c16a50388cb88dc537"
Jul 07 17:39:40.002503 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:40.002472    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 17:39:40.002565 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:40.002542    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 17:39:40.002601 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:40.002574    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 17:39:41.011706 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:41.011664    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78" event={"ID":"1067678c-fd8d-40e5-a2ce-ea20f39dca7f","Type":"ContainerStarted","Data":"2cfd88a7bca57d8d37e20ff982a0adb09225167ac6097d1944d9ebf2b30ebb92"}
Jul 07 17:39:41.401897 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:41.401859    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78"
Jul 07 17:39:41.402089 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:41.402033    2562 patch_prober.go:28] interesting pod/e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 07 17:39:41.402137 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:41.402080    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78" podUID="1067678c-fd8d-40e5-a2ce-ea20f39dca7f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 07 17:39:42.401582 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:42.401548    2562 patch_prober.go:28] interesting pod/e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 07 17:39:42.401972 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:42.401605    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78" podUID="1067678c-fd8d-40e5-a2ce-ea20f39dca7f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 07 17:39:43.401792 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:43.401749    2562 patch_prober.go:28] interesting pod/e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 07 17:39:43.402254 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:43.401808    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78" podUID="1067678c-fd8d-40e5-a2ce-ea20f39dca7f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 07 17:39:44.401460 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:44.401421    2562 patch_prober.go:28] interesting pod/e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused" start-of-body=
Jul 07 17:39:44.401739 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:44.401495    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78" podUID="1067678c-fd8d-40e5-a2ce-ea20f39dca7f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.53:15021/healthz/ready\": dial tcp 10.133.0.53:15021: connect: connection refused"
Jul 07 17:39:45.405799 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:45.405760    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78"
Jul 07 17:39:45.406350 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:45.406140    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78"
Jul 07 17:39:45.407003 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:45.406981    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78"
Jul 07 17:39:46.430667 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:46.430628    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:39:46.526766 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:46.526735    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:39:53.372317 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:53.372284    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:39:53.686559 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:53.686522    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:39:53.768462 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:39:53.768427    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:40:11.213181 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:40:11.213121    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:40:30.362807 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:40:30.362765    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:40:31.235445 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:40:31.235411    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:40:31.485396 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:40:31.485352    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:40:31.927344 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:40:31.927306    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:40:32.061099 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:40:32.061069    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:40:32.160346 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:40:32.160306    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:40:32.348417 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:40:32.348322    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-457985-786ff77787-gzh2g"]
Jul 07 17:40:32.348584 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:40:32.348552    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-a-457985-786ff77787-gzh2g" podUID="c2042e73-09a0-4c88-9f89-4b870bd7dd5d" containerName="maas-api" containerID="cri-o://24c1263e453feaa72467954c8b541786938c16227663c2477802fc768094e217" gracePeriod=30
Jul 07 17:40:32.369451 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:40:32.369422    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:40:32.615944 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:40:32.615918    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-457985-786ff77787-gzh2g"
Jul 07 17:40:32.670641 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:40:32.670609    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c2042e73-09a0-4c88-9f89-4b870bd7dd5d-maas-api-tls\") pod \"c2042e73-09a0-4c88-9f89-4b870bd7dd5d\" (UID: \"c2042e73-09a0-4c88-9f89-4b870bd7dd5d\") "
Jul 07 17:40:32.670811 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:40:32.670683    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qml2v\" (UniqueName: \"kubernetes.io/projected/c2042e73-09a0-4c88-9f89-4b870bd7dd5d-kube-api-access-qml2v\") pod \"c2042e73-09a0-4c88-9f89-4b870bd7dd5d\" (UID: \"c2042e73-09a0-4c88-9f89-4b870bd7dd5d\") "
Jul 07 17:40:32.670811 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:40:32.670785    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c2042e73-09a0-4c88-9f89-4b870bd7dd5d-openshift-service-ca\") pod \"c2042e73-09a0-4c88-9f89-4b870bd7dd5d\" (UID: \"c2042e73-09a0-4c88-9f89-4b870bd7dd5d\") "
Jul 07 17:40:32.671199 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:40:32.671140    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c2042e73-09a0-4c88-9f89-4b870bd7dd5d-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "c2042e73-09a0-4c88-9f89-4b870bd7dd5d" (UID: "c2042e73-09a0-4c88-9f89-4b870bd7dd5d"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:40:32.672837 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:40:32.672803    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c2042e73-09a0-4c88-9f89-4b870bd7dd5d-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "c2042e73-09a0-4c88-9f89-4b870bd7dd5d" (UID: "c2042e73-09a0-4c88-9f89-4b870bd7dd5d"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:40:32.672937 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:40:32.672904    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c2042e73-09a0-4c88-9f89-4b870bd7dd5d-kube-api-access-qml2v" (OuterVolumeSpecName: "kube-api-access-qml2v") pod "c2042e73-09a0-4c88-9f89-4b870bd7dd5d" (UID: "c2042e73-09a0-4c88-9f89-4b870bd7dd5d"). InnerVolumeSpecName "kube-api-access-qml2v". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:40:32.771680 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:40:32.771641    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qml2v\" (UniqueName: \"kubernetes.io/projected/c2042e73-09a0-4c88-9f89-4b870bd7dd5d-kube-api-access-qml2v\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:40:32.771680 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:40:32.771675    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/c2042e73-09a0-4c88-9f89-4b870bd7dd5d-openshift-service-ca\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:40:32.771680 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:40:32.771685    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/c2042e73-09a0-4c88-9f89-4b870bd7dd5d-maas-api-tls\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:40:33.284702 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:40:33.284665    2562 generic.go:356] "Generic (PLEG): container finished" podID="c2042e73-09a0-4c88-9f89-4b870bd7dd5d" containerID="24c1263e453feaa72467954c8b541786938c16227663c2477802fc768094e217" exitCode=0
Jul 07 17:40:33.284910 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:40:33.284712    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-457985-786ff77787-gzh2g" event={"ID":"c2042e73-09a0-4c88-9f89-4b870bd7dd5d","Type":"ContainerDied","Data":"24c1263e453feaa72467954c8b541786938c16227663c2477802fc768094e217"}
Jul 07 17:40:33.284910 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:40:33.284751    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-a-457985-786ff77787-gzh2g" event={"ID":"c2042e73-09a0-4c88-9f89-4b870bd7dd5d","Type":"ContainerDied","Data":"f76ffcb656ec98182ecc531c8f021f1d6bca75125b75bc3d2880ee06911391e7"}
Jul 07 17:40:33.284910 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:40:33.284773    2562 scope.go:117] "RemoveContainer" containerID="24c1263e453feaa72467954c8b541786938c16227663c2477802fc768094e217"
Jul 07 17:40:33.284910 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:40:33.284713    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-a-457985-786ff77787-gzh2g"
Jul 07 17:40:33.293789 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:40:33.293771    2562 scope.go:117] "RemoveContainer" containerID="24c1263e453feaa72467954c8b541786938c16227663c2477802fc768094e217"
Jul 07 17:40:33.294035 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:40:33.294017    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24c1263e453feaa72467954c8b541786938c16227663c2477802fc768094e217\": container with ID starting with 24c1263e453feaa72467954c8b541786938c16227663c2477802fc768094e217 not found: ID does not exist" containerID="24c1263e453feaa72467954c8b541786938c16227663c2477802fc768094e217"
Jul 07 17:40:33.294088 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:40:33.294043    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24c1263e453feaa72467954c8b541786938c16227663c2477802fc768094e217"} err="failed to get container status \"24c1263e453feaa72467954c8b541786938c16227663c2477802fc768094e217\": rpc error: code = NotFound desc = could not find container \"24c1263e453feaa72467954c8b541786938c16227663c2477802fc768094e217\": container with ID starting with 24c1263e453feaa72467954c8b541786938c16227663c2477802fc768094e217 not found: ID does not exist"
Jul 07 17:40:33.309482 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:40:33.309443    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-457985-786ff77787-gzh2g"]
Jul 07 17:40:33.312378 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:40:33.312353    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-a-457985-786ff77787-gzh2g"]
Jul 07 17:40:33.846367 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:40:33.846330    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c2042e73-09a0-4c88-9f89-4b870bd7dd5d" path="/var/lib/kubelet/pods/c2042e73-09a0-4c88-9f89-4b870bd7dd5d/volumes"
Jul 07 17:40:37.000582 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:40:37.000546    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:14.350867 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:14.350825    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:14.605925 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:14.605822    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78"]
Jul 07 17:41:14.606106 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:14.606068    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78" podUID="1067678c-fd8d-40e5-a2ce-ea20f39dca7f" containerName="istio-proxy" containerID="cri-o://2cfd88a7bca57d8d37e20ff982a0adb09225167ac6097d1944d9ebf2b30ebb92" gracePeriod=30
Jul 07 17:41:14.628577 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:14.628541    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:14.872771 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:14.872662    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:15.031794 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:15.031745    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:15.408948 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:15.408914    2562 patch_prober.go:28] interesting pod/e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body=
Jul 07 17:41:15.409341 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:15.408974    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78" podUID="1067678c-fd8d-40e5-a2ce-ea20f39dca7f" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503"
Jul 07 17:41:15.462435 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:15.462385    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:15.560172 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:15.560091    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:15.658016 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:15.657976    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:15.759860 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:15.759705    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-567860-55cbcdc444-ps9zb"]
Jul 07 17:41:15.760104 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:15.760045    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-inf-b-567860-55cbcdc444-ps9zb" podUID="5ac670fc-1eef-4204-9f02-17ff1e30d2d8" containerName="maas-api" containerID="cri-o://0d1b3c77258602b02136f1770426eb48ba449998bb25c525cb9ac02899681fc3" gracePeriod=30
Jul 07 17:41:15.784877 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:15.784840    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:16.015112 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:16.015036    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-567860-55cbcdc444-ps9zb"
Jul 07 17:41:16.084399 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:16.084367    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5ac670fc-1eef-4204-9f02-17ff1e30d2d8-maas-api-tls\") pod \"5ac670fc-1eef-4204-9f02-17ff1e30d2d8\" (UID: \"5ac670fc-1eef-4204-9f02-17ff1e30d2d8\") "
Jul 07 17:41:16.084399 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:16.084406    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8br72\" (UniqueName: \"kubernetes.io/projected/5ac670fc-1eef-4204-9f02-17ff1e30d2d8-kube-api-access-8br72\") pod \"5ac670fc-1eef-4204-9f02-17ff1e30d2d8\" (UID: \"5ac670fc-1eef-4204-9f02-17ff1e30d2d8\") "
Jul 07 17:41:16.084617 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:16.084429    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ac670fc-1eef-4204-9f02-17ff1e30d2d8-openshift-service-ca\") pod \"5ac670fc-1eef-4204-9f02-17ff1e30d2d8\" (UID: \"5ac670fc-1eef-4204-9f02-17ff1e30d2d8\") "
Jul 07 17:41:16.084870 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:16.084841    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5ac670fc-1eef-4204-9f02-17ff1e30d2d8-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "5ac670fc-1eef-4204-9f02-17ff1e30d2d8" (UID: "5ac670fc-1eef-4204-9f02-17ff1e30d2d8"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:41:16.086530 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:16.086499    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5ac670fc-1eef-4204-9f02-17ff1e30d2d8-kube-api-access-8br72" (OuterVolumeSpecName: "kube-api-access-8br72") pod "5ac670fc-1eef-4204-9f02-17ff1e30d2d8" (UID: "5ac670fc-1eef-4204-9f02-17ff1e30d2d8"). InnerVolumeSpecName "kube-api-access-8br72". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:41:16.086625 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:16.086576    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/5ac670fc-1eef-4204-9f02-17ff1e30d2d8-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "5ac670fc-1eef-4204-9f02-17ff1e30d2d8" (UID: "5ac670fc-1eef-4204-9f02-17ff1e30d2d8"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:41:16.185672 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:16.185629    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/5ac670fc-1eef-4204-9f02-17ff1e30d2d8-maas-api-tls\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:41:16.185672 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:16.185666    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8br72\" (UniqueName: \"kubernetes.io/projected/5ac670fc-1eef-4204-9f02-17ff1e30d2d8-kube-api-access-8br72\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:41:16.185672 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:16.185676    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/5ac670fc-1eef-4204-9f02-17ff1e30d2d8-openshift-service-ca\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:41:16.497723 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:16.497681    2562 generic.go:356] "Generic (PLEG): container finished" podID="5ac670fc-1eef-4204-9f02-17ff1e30d2d8" containerID="0d1b3c77258602b02136f1770426eb48ba449998bb25c525cb9ac02899681fc3" exitCode=0
Jul 07 17:41:16.497723 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:16.497728    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-inf-b-567860-55cbcdc444-ps9zb"
Jul 07 17:41:16.498184 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:16.497765    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-567860-55cbcdc444-ps9zb" event={"ID":"5ac670fc-1eef-4204-9f02-17ff1e30d2d8","Type":"ContainerDied","Data":"0d1b3c77258602b02136f1770426eb48ba449998bb25c525cb9ac02899681fc3"}
Jul 07 17:41:16.498184 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:16.497824    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-inf-b-567860-55cbcdc444-ps9zb" event={"ID":"5ac670fc-1eef-4204-9f02-17ff1e30d2d8","Type":"ContainerDied","Data":"695bb207c450b165ed1759bb8e64fc31d8f5436b024364e32a12abccc0ae8a14"}
Jul 07 17:41:16.498184 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:16.497848    2562 scope.go:117] "RemoveContainer" containerID="0d1b3c77258602b02136f1770426eb48ba449998bb25c525cb9ac02899681fc3"
Jul 07 17:41:16.506792 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:16.506770    2562 scope.go:117] "RemoveContainer" containerID="0d1b3c77258602b02136f1770426eb48ba449998bb25c525cb9ac02899681fc3"
Jul 07 17:41:16.507065 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:41:16.507046    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d1b3c77258602b02136f1770426eb48ba449998bb25c525cb9ac02899681fc3\": container with ID starting with 0d1b3c77258602b02136f1770426eb48ba449998bb25c525cb9ac02899681fc3 not found: ID does not exist" containerID="0d1b3c77258602b02136f1770426eb48ba449998bb25c525cb9ac02899681fc3"
Jul 07 17:41:16.507136 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:16.507079    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d1b3c77258602b02136f1770426eb48ba449998bb25c525cb9ac02899681fc3"} err="failed to get container status \"0d1b3c77258602b02136f1770426eb48ba449998bb25c525cb9ac02899681fc3\": rpc error: code = NotFound desc = could not find container \"0d1b3c77258602b02136f1770426eb48ba449998bb25c525cb9ac02899681fc3\": container with ID starting with 0d1b3c77258602b02136f1770426eb48ba449998bb25c525cb9ac02899681fc3 not found: ID does not exist"
Jul 07 17:41:16.537623 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:16.537583    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-567860-55cbcdc444-ps9zb"]
Jul 07 17:41:16.543855 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:16.543822    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-inf-b-567860-55cbcdc444-ps9zb"]
Jul 07 17:41:17.846321 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:17.846290    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5ac670fc-1eef-4204-9f02-17ff1e30d2d8" path="/var/lib/kubelet/pods/5ac670fc-1eef-4204-9f02-17ff1e30d2d8/volumes"
Jul 07 17:41:19.871278 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:19.871130    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78"
Jul 07 17:41:19.928099 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:19.928062    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fbr6z\" (UniqueName: \"kubernetes.io/projected/1067678c-fd8d-40e5-a2ce-ea20f39dca7f-kube-api-access-fbr6z\") pod \"1067678c-fd8d-40e5-a2ce-ea20f39dca7f\" (UID: \"1067678c-fd8d-40e5-a2ce-ea20f39dca7f\") "
Jul 07 17:41:19.928293 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:19.928118    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1067678c-fd8d-40e5-a2ce-ea20f39dca7f-credential-socket\") pod \"1067678c-fd8d-40e5-a2ce-ea20f39dca7f\" (UID: \"1067678c-fd8d-40e5-a2ce-ea20f39dca7f\") "
Jul 07 17:41:19.928293 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:19.928180    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1067678c-fd8d-40e5-a2ce-ea20f39dca7f-istio-data\") pod \"1067678c-fd8d-40e5-a2ce-ea20f39dca7f\" (UID: \"1067678c-fd8d-40e5-a2ce-ea20f39dca7f\") "
Jul 07 17:41:19.928293 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:19.928214    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1067678c-fd8d-40e5-a2ce-ea20f39dca7f-workload-socket\") pod \"1067678c-fd8d-40e5-a2ce-ea20f39dca7f\" (UID: \"1067678c-fd8d-40e5-a2ce-ea20f39dca7f\") "
Jul 07 17:41:19.928293 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:19.928241    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1067678c-fd8d-40e5-a2ce-ea20f39dca7f-istio-podinfo\") pod \"1067678c-fd8d-40e5-a2ce-ea20f39dca7f\" (UID: \"1067678c-fd8d-40e5-a2ce-ea20f39dca7f\") "
Jul 07 17:41:19.928560 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:19.928296    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1067678c-fd8d-40e5-a2ce-ea20f39dca7f-istio-envoy\") pod \"1067678c-fd8d-40e5-a2ce-ea20f39dca7f\" (UID: \"1067678c-fd8d-40e5-a2ce-ea20f39dca7f\") "
Jul 07 17:41:19.928560 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:19.928340    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1067678c-fd8d-40e5-a2ce-ea20f39dca7f-istiod-ca-cert\") pod \"1067678c-fd8d-40e5-a2ce-ea20f39dca7f\" (UID: \"1067678c-fd8d-40e5-a2ce-ea20f39dca7f\") "
Jul 07 17:41:19.928560 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:19.928373    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1067678c-fd8d-40e5-a2ce-ea20f39dca7f-workload-certs\") pod \"1067678c-fd8d-40e5-a2ce-ea20f39dca7f\" (UID: \"1067678c-fd8d-40e5-a2ce-ea20f39dca7f\") "
Jul 07 17:41:19.928560 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:19.928406    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1067678c-fd8d-40e5-a2ce-ea20f39dca7f-istio-token\") pod \"1067678c-fd8d-40e5-a2ce-ea20f39dca7f\" (UID: \"1067678c-fd8d-40e5-a2ce-ea20f39dca7f\") "
Jul 07 17:41:19.928560 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:19.928480    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1067678c-fd8d-40e5-a2ce-ea20f39dca7f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1067678c-fd8d-40e5-a2ce-ea20f39dca7f" (UID: "1067678c-fd8d-40e5-a2ce-ea20f39dca7f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:41:19.928810 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:19.928620    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1067678c-fd8d-40e5-a2ce-ea20f39dca7f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1067678c-fd8d-40e5-a2ce-ea20f39dca7f" (UID: "1067678c-fd8d-40e5-a2ce-ea20f39dca7f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:41:19.928810 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:19.928779    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1067678c-fd8d-40e5-a2ce-ea20f39dca7f-credential-socket\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:41:19.928810 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:19.928803    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1067678c-fd8d-40e5-a2ce-ea20f39dca7f-workload-socket\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:41:19.928971 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:19.928809    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1067678c-fd8d-40e5-a2ce-ea20f39dca7f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1067678c-fd8d-40e5-a2ce-ea20f39dca7f" (UID: "1067678c-fd8d-40e5-a2ce-ea20f39dca7f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:41:19.928971 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:19.928901    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1067678c-fd8d-40e5-a2ce-ea20f39dca7f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1067678c-fd8d-40e5-a2ce-ea20f39dca7f" (UID: "1067678c-fd8d-40e5-a2ce-ea20f39dca7f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:41:19.929628 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:19.929596    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1067678c-fd8d-40e5-a2ce-ea20f39dca7f-istio-data" (OuterVolumeSpecName: "istio-data") pod "1067678c-fd8d-40e5-a2ce-ea20f39dca7f" (UID: "1067678c-fd8d-40e5-a2ce-ea20f39dca7f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:41:19.931084 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:19.930991    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1067678c-fd8d-40e5-a2ce-ea20f39dca7f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1067678c-fd8d-40e5-a2ce-ea20f39dca7f" (UID: "1067678c-fd8d-40e5-a2ce-ea20f39dca7f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:41:19.931084 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:19.931017    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1067678c-fd8d-40e5-a2ce-ea20f39dca7f-kube-api-access-fbr6z" (OuterVolumeSpecName: "kube-api-access-fbr6z") pod "1067678c-fd8d-40e5-a2ce-ea20f39dca7f" (UID: "1067678c-fd8d-40e5-a2ce-ea20f39dca7f"). InnerVolumeSpecName "kube-api-access-fbr6z". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:41:19.931306 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:19.931214    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1067678c-fd8d-40e5-a2ce-ea20f39dca7f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1067678c-fd8d-40e5-a2ce-ea20f39dca7f" (UID: "1067678c-fd8d-40e5-a2ce-ea20f39dca7f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 17:41:19.931372 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:19.931325    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1067678c-fd8d-40e5-a2ce-ea20f39dca7f-istio-token" (OuterVolumeSpecName: "istio-token") pod "1067678c-fd8d-40e5-a2ce-ea20f39dca7f" (UID: "1067678c-fd8d-40e5-a2ce-ea20f39dca7f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:41:20.029283 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:20.029245    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1067678c-fd8d-40e5-a2ce-ea20f39dca7f-istio-envoy\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:41:20.029283 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:20.029274    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1067678c-fd8d-40e5-a2ce-ea20f39dca7f-istiod-ca-cert\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:41:20.029283 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:20.029284    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1067678c-fd8d-40e5-a2ce-ea20f39dca7f-workload-certs\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:41:20.029283 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:20.029291    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1067678c-fd8d-40e5-a2ce-ea20f39dca7f-istio-token\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:41:20.029557 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:20.029300    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fbr6z\" (UniqueName: \"kubernetes.io/projected/1067678c-fd8d-40e5-a2ce-ea20f39dca7f-kube-api-access-fbr6z\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:41:20.029557 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:20.029310    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1067678c-fd8d-40e5-a2ce-ea20f39dca7f-istio-data\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:41:20.029557 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:20.029318    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1067678c-fd8d-40e5-a2ce-ea20f39dca7f-istio-podinfo\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:41:20.523333 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:20.523296    2562 generic.go:356] "Generic (PLEG): container finished" podID="1067678c-fd8d-40e5-a2ce-ea20f39dca7f" containerID="2cfd88a7bca57d8d37e20ff982a0adb09225167ac6097d1944d9ebf2b30ebb92" exitCode=0
Jul 07 17:41:20.523517 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:20.523350    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78"
Jul 07 17:41:20.523517 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:20.523376    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78" event={"ID":"1067678c-fd8d-40e5-a2ce-ea20f39dca7f","Type":"ContainerDied","Data":"2cfd88a7bca57d8d37e20ff982a0adb09225167ac6097d1944d9ebf2b30ebb92"}
Jul 07 17:41:20.523517 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:20.523438    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78" event={"ID":"1067678c-fd8d-40e5-a2ce-ea20f39dca7f","Type":"ContainerDied","Data":"4c2d12ceb0905a26ed6f947278a7e4bf83690b89a66c92594c7f594d49a504c9"}
Jul 07 17:41:20.523517 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:20.523463    2562 scope.go:117] "RemoveContainer" containerID="2cfd88a7bca57d8d37e20ff982a0adb09225167ac6097d1944d9ebf2b30ebb92"
Jul 07 17:41:20.533128 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:20.533107    2562 scope.go:117] "RemoveContainer" containerID="a23aadfe4f8d6539b088e0da600509933b6aa82dbd4676c16a50388cb88dc537"
Jul 07 17:41:20.541788 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:20.541765    2562 scope.go:117] "RemoveContainer" containerID="2cfd88a7bca57d8d37e20ff982a0adb09225167ac6097d1944d9ebf2b30ebb92"
Jul 07 17:41:20.542080 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:41:20.542058    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2cfd88a7bca57d8d37e20ff982a0adb09225167ac6097d1944d9ebf2b30ebb92\": container with ID starting with 2cfd88a7bca57d8d37e20ff982a0adb09225167ac6097d1944d9ebf2b30ebb92 not found: ID does not exist" containerID="2cfd88a7bca57d8d37e20ff982a0adb09225167ac6097d1944d9ebf2b30ebb92"
Jul 07 17:41:20.542125 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:20.542092    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2cfd88a7bca57d8d37e20ff982a0adb09225167ac6097d1944d9ebf2b30ebb92"} err="failed to get container status \"2cfd88a7bca57d8d37e20ff982a0adb09225167ac6097d1944d9ebf2b30ebb92\": rpc error: code = NotFound desc = could not find container \"2cfd88a7bca57d8d37e20ff982a0adb09225167ac6097d1944d9ebf2b30ebb92\": container with ID starting with 2cfd88a7bca57d8d37e20ff982a0adb09225167ac6097d1944d9ebf2b30ebb92 not found: ID does not exist"
Jul 07 17:41:20.542125 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:20.542111    2562 scope.go:117] "RemoveContainer" containerID="a23aadfe4f8d6539b088e0da600509933b6aa82dbd4676c16a50388cb88dc537"
Jul 07 17:41:20.542385 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:41:20.542371    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a23aadfe4f8d6539b088e0da600509933b6aa82dbd4676c16a50388cb88dc537\": container with ID starting with a23aadfe4f8d6539b088e0da600509933b6aa82dbd4676c16a50388cb88dc537 not found: ID does not exist" containerID="a23aadfe4f8d6539b088e0da600509933b6aa82dbd4676c16a50388cb88dc537"
Jul 07 17:41:20.542436 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:20.542388    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a23aadfe4f8d6539b088e0da600509933b6aa82dbd4676c16a50388cb88dc537"} err="failed to get container status \"a23aadfe4f8d6539b088e0da600509933b6aa82dbd4676c16a50388cb88dc537\": rpc error: code = NotFound desc = could not find container \"a23aadfe4f8d6539b088e0da600509933b6aa82dbd4676c16a50388cb88dc537\": container with ID starting with a23aadfe4f8d6539b088e0da600509933b6aa82dbd4676c16a50388cb88dc537 not found: ID does not exist"
Jul 07 17:41:20.547095 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:20.547066    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78"]
Jul 07 17:41:20.551695 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:20.551671    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-457985-openshift-default-6bdd6dff89-rsb78"]
Jul 07 17:41:21.846228 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:21.846191    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1067678c-fd8d-40e5-a2ce-ea20f39dca7f" path="/var/lib/kubelet/pods/1067678c-fd8d-40e5-a2ce-ea20f39dca7f/volumes"
Jul 07 17:41:22.161717 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:22.161664    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:22.242343 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:22.242305    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:22.432381 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:22.432294    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:22.657369 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:22.657335    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:23.020878 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:23.020850    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:23.361290 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:23.361212    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl"]
Jul 07 17:41:23.361593 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:23.361580    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1067678c-fd8d-40e5-a2ce-ea20f39dca7f" containerName="istio-proxy"
Jul 07 17:41:23.361635 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:23.361596    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="1067678c-fd8d-40e5-a2ce-ea20f39dca7f" containerName="istio-proxy"
Jul 07 17:41:23.361635 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:23.361604    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1067678c-fd8d-40e5-a2ce-ea20f39dca7f" containerName="istio-proxy"
Jul 07 17:41:23.361635 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:23.361609    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="1067678c-fd8d-40e5-a2ce-ea20f39dca7f" containerName="istio-proxy"
Jul 07 17:41:23.361635 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:23.361624    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c2042e73-09a0-4c88-9f89-4b870bd7dd5d" containerName="maas-api"
Jul 07 17:41:23.361635 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:23.361630    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="c2042e73-09a0-4c88-9f89-4b870bd7dd5d" containerName="maas-api"
Jul 07 17:41:23.361635 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:23.361635    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5ac670fc-1eef-4204-9f02-17ff1e30d2d8" containerName="maas-api"
Jul 07 17:41:23.361815 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:23.361641    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="5ac670fc-1eef-4204-9f02-17ff1e30d2d8" containerName="maas-api"
Jul 07 17:41:23.361815 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:23.361697    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="1067678c-fd8d-40e5-a2ce-ea20f39dca7f" containerName="istio-proxy"
Jul 07 17:41:23.361815 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:23.361704    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="c2042e73-09a0-4c88-9f89-4b870bd7dd5d" containerName="maas-api"
Jul 07 17:41:23.361815 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:23.361711    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="5ac670fc-1eef-4204-9f02-17ff1e30d2d8" containerName="maas-api"
Jul 07 17:41:23.366329 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:23.366310    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl"
Jul 07 17:41:23.368969 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:23.368935    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-9ecff9-openshift-default-dockercfg-4szjd\""
Jul 07 17:41:23.380774 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:23.380738    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl"]
Jul 07 17:41:23.386514 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:23.386488    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:23.460465 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:23.460406    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ffdf9f3-6df7-4adc-8469-37e8db307927-istio-data\") pod \"e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl\" (UID: \"1ffdf9f3-6df7-4adc-8469-37e8db307927\") " pod="openshift-ingress/e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl"
Jul 07 17:41:23.460696 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:23.460477    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ffdf9f3-6df7-4adc-8469-37e8db307927-istiod-ca-cert\") pod \"e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl\" (UID: \"1ffdf9f3-6df7-4adc-8469-37e8db307927\") " pod="openshift-ingress/e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl"
Jul 07 17:41:23.460696 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:23.460527    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ffdf9f3-6df7-4adc-8469-37e8db307927-credential-socket\") pod \"e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl\" (UID: \"1ffdf9f3-6df7-4adc-8469-37e8db307927\") " pod="openshift-ingress/e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl"
Jul 07 17:41:23.460696 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:23.460572    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ffdf9f3-6df7-4adc-8469-37e8db307927-istio-podinfo\") pod \"e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl\" (UID: \"1ffdf9f3-6df7-4adc-8469-37e8db307927\") " pod="openshift-ingress/e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl"
Jul 07 17:41:23.460696 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:23.460609    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ffdf9f3-6df7-4adc-8469-37e8db307927-workload-socket\") pod \"e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl\" (UID: \"1ffdf9f3-6df7-4adc-8469-37e8db307927\") " pod="openshift-ingress/e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl"
Jul 07 17:41:23.460696 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:23.460670    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ffdf9f3-6df7-4adc-8469-37e8db307927-istio-envoy\") pod \"e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl\" (UID: \"1ffdf9f3-6df7-4adc-8469-37e8db307927\") " pod="openshift-ingress/e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl"
Jul 07 17:41:23.460971 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:23.460709    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ffdf9f3-6df7-4adc-8469-37e8db307927-istio-token\") pod \"e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl\" (UID: \"1ffdf9f3-6df7-4adc-8469-37e8db307927\") " pod="openshift-ingress/e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl"
Jul 07 17:41:23.460971 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:23.460781    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ffdf9f3-6df7-4adc-8469-37e8db307927-workload-certs\") pod \"e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl\" (UID: \"1ffdf9f3-6df7-4adc-8469-37e8db307927\") " pod="openshift-ingress/e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl"
Jul 07 17:41:23.460971 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:23.460862    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lg2fg\" (UniqueName: \"kubernetes.io/projected/1ffdf9f3-6df7-4adc-8469-37e8db307927-kube-api-access-lg2fg\") pod \"e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl\" (UID: \"1ffdf9f3-6df7-4adc-8469-37e8db307927\") " pod="openshift-ingress/e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl"
Jul 07 17:41:23.561404 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:23.561370    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ffdf9f3-6df7-4adc-8469-37e8db307927-credential-socket\") pod \"e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl\" (UID: \"1ffdf9f3-6df7-4adc-8469-37e8db307927\") " pod="openshift-ingress/e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl"
Jul 07 17:41:23.561577 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:23.561420    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ffdf9f3-6df7-4adc-8469-37e8db307927-istio-podinfo\") pod \"e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl\" (UID: \"1ffdf9f3-6df7-4adc-8469-37e8db307927\") " pod="openshift-ingress/e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl"
Jul 07 17:41:23.561577 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:23.561451    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ffdf9f3-6df7-4adc-8469-37e8db307927-workload-socket\") pod \"e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl\" (UID: \"1ffdf9f3-6df7-4adc-8469-37e8db307927\") " pod="openshift-ingress/e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl"
Jul 07 17:41:23.561577 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:23.561500    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ffdf9f3-6df7-4adc-8469-37e8db307927-istio-envoy\") pod \"e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl\" (UID: \"1ffdf9f3-6df7-4adc-8469-37e8db307927\") " pod="openshift-ingress/e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl"
Jul 07 17:41:23.561577 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:23.561522    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ffdf9f3-6df7-4adc-8469-37e8db307927-istio-token\") pod \"e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl\" (UID: \"1ffdf9f3-6df7-4adc-8469-37e8db307927\") " pod="openshift-ingress/e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl"
Jul 07 17:41:23.561577 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:23.561546    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ffdf9f3-6df7-4adc-8469-37e8db307927-workload-certs\") pod \"e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl\" (UID: \"1ffdf9f3-6df7-4adc-8469-37e8db307927\") " pod="openshift-ingress/e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl"
Jul 07 17:41:23.561856 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:23.561639    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lg2fg\" (UniqueName: \"kubernetes.io/projected/1ffdf9f3-6df7-4adc-8469-37e8db307927-kube-api-access-lg2fg\") pod \"e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl\" (UID: \"1ffdf9f3-6df7-4adc-8469-37e8db307927\") " pod="openshift-ingress/e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl"
Jul 07 17:41:23.561856 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:23.561693    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ffdf9f3-6df7-4adc-8469-37e8db307927-istio-data\") pod \"e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl\" (UID: \"1ffdf9f3-6df7-4adc-8469-37e8db307927\") " pod="openshift-ingress/e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl"
Jul 07 17:41:23.561856 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:23.561732    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ffdf9f3-6df7-4adc-8469-37e8db307927-istiod-ca-cert\") pod \"e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl\" (UID: \"1ffdf9f3-6df7-4adc-8469-37e8db307927\") " pod="openshift-ingress/e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl"
Jul 07 17:41:23.561856 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:23.561814    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ffdf9f3-6df7-4adc-8469-37e8db307927-credential-socket\") pod \"e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl\" (UID: \"1ffdf9f3-6df7-4adc-8469-37e8db307927\") " pod="openshift-ingress/e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl"
Jul 07 17:41:23.561856 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:23.561824    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ffdf9f3-6df7-4adc-8469-37e8db307927-workload-socket\") pod \"e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl\" (UID: \"1ffdf9f3-6df7-4adc-8469-37e8db307927\") " pod="openshift-ingress/e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl"
Jul 07 17:41:23.562131 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:23.562109    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ffdf9f3-6df7-4adc-8469-37e8db307927-workload-certs\") pod \"e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl\" (UID: \"1ffdf9f3-6df7-4adc-8469-37e8db307927\") " pod="openshift-ingress/e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl"
Jul 07 17:41:23.562299 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:23.562211    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ffdf9f3-6df7-4adc-8469-37e8db307927-istio-data\") pod \"e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl\" (UID: \"1ffdf9f3-6df7-4adc-8469-37e8db307927\") " pod="openshift-ingress/e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl"
Jul 07 17:41:23.562572 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:23.562551    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ffdf9f3-6df7-4adc-8469-37e8db307927-istiod-ca-cert\") pod \"e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl\" (UID: \"1ffdf9f3-6df7-4adc-8469-37e8db307927\") " pod="openshift-ingress/e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl"
Jul 07 17:41:23.563900 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:23.563880    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ffdf9f3-6df7-4adc-8469-37e8db307927-istio-envoy\") pod \"e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl\" (UID: \"1ffdf9f3-6df7-4adc-8469-37e8db307927\") " pod="openshift-ingress/e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl"
Jul 07 17:41:23.564004 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:23.563985    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ffdf9f3-6df7-4adc-8469-37e8db307927-istio-podinfo\") pod \"e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl\" (UID: \"1ffdf9f3-6df7-4adc-8469-37e8db307927\") " pod="openshift-ingress/e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl"
Jul 07 17:41:23.573232 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:23.573203    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ffdf9f3-6df7-4adc-8469-37e8db307927-istio-token\") pod \"e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl\" (UID: \"1ffdf9f3-6df7-4adc-8469-37e8db307927\") " pod="openshift-ingress/e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl"
Jul 07 17:41:23.573410 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:23.573392    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lg2fg\" (UniqueName: \"kubernetes.io/projected/1ffdf9f3-6df7-4adc-8469-37e8db307927-kube-api-access-lg2fg\") pod \"e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl\" (UID: \"1ffdf9f3-6df7-4adc-8469-37e8db307927\") " pod="openshift-ingress/e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl"
Jul 07 17:41:23.623450 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:23.623340    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:23.681670 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:23.681633    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl"
Jul 07 17:41:23.828064 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:23.828036    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl"]
Jul 07 17:41:23.830235 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:41:23.830212    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1ffdf9f3_6df7_4adc_8469_37e8db307927.slice/crio-4b96223fb1029679f2c54728b3286e61db1db978bca4e152cd4adbfb2f00377b WatchSource:0}: Error finding container 4b96223fb1029679f2c54728b3286e61db1db978bca4e152cd4adbfb2f00377b: Status 404 returned error can't find the container with id 4b96223fb1029679f2c54728b3286e61db1db978bca4e152cd4adbfb2f00377b
Jul 07 17:41:23.832421 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:23.832386    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 17:41:23.832546 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:23.832450    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 17:41:23.832546 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:23.832482    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 17:41:24.546426 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:24.546388    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl" event={"ID":"1ffdf9f3-6df7-4adc-8469-37e8db307927","Type":"ContainerStarted","Data":"6aa8b97c1a90e914734679e2a45654d188c9503e7c509864b270983d2f4bb879"}
Jul 07 17:41:24.546824 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:24.546450    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl" event={"ID":"1ffdf9f3-6df7-4adc-8469-37e8db307927","Type":"ContainerStarted","Data":"4b96223fb1029679f2c54728b3286e61db1db978bca4e152cd4adbfb2f00377b"}
Jul 07 17:41:24.571399 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:24.571336    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl" podStartSLOduration=1.571312497 podStartE2EDuration="1.571312497s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:41:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:41:24.57036205 +0000 UTC m=+2009.293615248" watchObservedRunningTime="2026-07-07 17:41:24.571312497 +0000 UTC m=+2009.294565691"
Jul 07 17:41:24.682424 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:24.682391    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl"
Jul 07 17:41:24.688835 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:24.688803    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl"
Jul 07 17:41:25.551979 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:25.551949    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl"
Jul 07 17:41:25.552930 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:25.552907    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl"
Jul 07 17:41:26.532169 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:26.532109    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:26.633650 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:26.633613    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:26.674175 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:26.674121    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-a-9ecff9-84499885d-9mk6l"]
Jul 07 17:41:26.674653 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:26.674635    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="1067678c-fd8d-40e5-a2ce-ea20f39dca7f" containerName="istio-proxy"
Jul 07 17:41:26.677759 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:26.677739    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-9ecff9-84499885d-9mk6l"
Jul 07 17:41:26.680013 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:26.679993    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-a-9ecff9-serving-cert\""
Jul 07 17:41:26.695269 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:26.695239    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-9ecff9-84499885d-9mk6l"]
Jul 07 17:41:26.737094 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:26.737053    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:26.795692 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:26.795602    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3de3036-5fca-435a-bce9-538eeb1e6f02-maas-api-tls\") pod \"maas-api-e2e-api-a-9ecff9-84499885d-9mk6l\" (UID: \"f3de3036-5fca-435a-bce9-538eeb1e6f02\") " pod="opendatahub/maas-api-e2e-api-a-9ecff9-84499885d-9mk6l"
Jul 07 17:41:26.795692 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:26.795669    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c45tb\" (UniqueName: \"kubernetes.io/projected/f3de3036-5fca-435a-bce9-538eeb1e6f02-kube-api-access-c45tb\") pod \"maas-api-e2e-api-a-9ecff9-84499885d-9mk6l\" (UID: \"f3de3036-5fca-435a-bce9-538eeb1e6f02\") " pod="opendatahub/maas-api-e2e-api-a-9ecff9-84499885d-9mk6l"
Jul 07 17:41:26.795884 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:26.795723    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3de3036-5fca-435a-bce9-538eeb1e6f02-openshift-service-ca\") pod \"maas-api-e2e-api-a-9ecff9-84499885d-9mk6l\" (UID: \"f3de3036-5fca-435a-bce9-538eeb1e6f02\") " pod="opendatahub/maas-api-e2e-api-a-9ecff9-84499885d-9mk6l"
Jul 07 17:41:26.868493 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:26.868458    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:26.896725 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:26.896690    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3de3036-5fca-435a-bce9-538eeb1e6f02-maas-api-tls\") pod \"maas-api-e2e-api-a-9ecff9-84499885d-9mk6l\" (UID: \"f3de3036-5fca-435a-bce9-538eeb1e6f02\") " pod="opendatahub/maas-api-e2e-api-a-9ecff9-84499885d-9mk6l"
Jul 07 17:41:26.896839 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:26.896779    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c45tb\" (UniqueName: \"kubernetes.io/projected/f3de3036-5fca-435a-bce9-538eeb1e6f02-kube-api-access-c45tb\") pod \"maas-api-e2e-api-a-9ecff9-84499885d-9mk6l\" (UID: \"f3de3036-5fca-435a-bce9-538eeb1e6f02\") " pod="opendatahub/maas-api-e2e-api-a-9ecff9-84499885d-9mk6l"
Jul 07 17:41:26.896839 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:26.896800    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3de3036-5fca-435a-bce9-538eeb1e6f02-openshift-service-ca\") pod \"maas-api-e2e-api-a-9ecff9-84499885d-9mk6l\" (UID: \"f3de3036-5fca-435a-bce9-538eeb1e6f02\") " pod="opendatahub/maas-api-e2e-api-a-9ecff9-84499885d-9mk6l"
Jul 07 17:41:26.897572 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:26.897545    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3de3036-5fca-435a-bce9-538eeb1e6f02-openshift-service-ca\") pod \"maas-api-e2e-api-a-9ecff9-84499885d-9mk6l\" (UID: \"f3de3036-5fca-435a-bce9-538eeb1e6f02\") " pod="opendatahub/maas-api-e2e-api-a-9ecff9-84499885d-9mk6l"
Jul 07 17:41:26.899322 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:26.899296    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3de3036-5fca-435a-bce9-538eeb1e6f02-maas-api-tls\") pod \"maas-api-e2e-api-a-9ecff9-84499885d-9mk6l\" (UID: \"f3de3036-5fca-435a-bce9-538eeb1e6f02\") " pod="opendatahub/maas-api-e2e-api-a-9ecff9-84499885d-9mk6l"
Jul 07 17:41:26.906957 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:26.906927    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c45tb\" (UniqueName: \"kubernetes.io/projected/f3de3036-5fca-435a-bce9-538eeb1e6f02-kube-api-access-c45tb\") pod \"maas-api-e2e-api-a-9ecff9-84499885d-9mk6l\" (UID: \"f3de3036-5fca-435a-bce9-538eeb1e6f02\") " pod="opendatahub/maas-api-e2e-api-a-9ecff9-84499885d-9mk6l"
Jul 07 17:41:26.989788 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:26.989741    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-9ecff9-84499885d-9mk6l"
Jul 07 17:41:27.148086 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:27.148051    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-a-9ecff9-84499885d-9mk6l"]
Jul 07 17:41:27.150674 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:41:27.150643    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3de3036_5fca_435a_bce9_538eeb1e6f02.slice/crio-7915c63ed12b143182c7f1e7f92f12d285d617c19cbb2897456efc0488bf6e80 WatchSource:0}: Error finding container 7915c63ed12b143182c7f1e7f92f12d285d617c19cbb2897456efc0488bf6e80: Status 404 returned error can't find the container with id 7915c63ed12b143182c7f1e7f92f12d285d617c19cbb2897456efc0488bf6e80
Jul 07 17:41:27.152166 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:27.152137    2562 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider
Jul 07 17:41:27.308337 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:27.308175    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:27.410313 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:27.410267    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:27.562603 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:27.562574    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-9ecff9-84499885d-9mk6l" event={"ID":"f3de3036-5fca-435a-bce9-538eeb1e6f02","Type":"ContainerStarted","Data":"7915c63ed12b143182c7f1e7f92f12d285d617c19cbb2897456efc0488bf6e80"}
Jul 07 17:41:28.568867 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:28.568829    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-9ecff9-84499885d-9mk6l" event={"ID":"f3de3036-5fca-435a-bce9-538eeb1e6f02","Type":"ContainerStarted","Data":"02d4fea49b1102f8571f99bd4b7d04a1f97ce73eff3a05bad540fb17f75e37fb"}
Jul 07 17:41:28.569277 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:28.568917    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-a-9ecff9-84499885d-9mk6l"
Jul 07 17:41:28.589456 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:28.589407    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-a-9ecff9-84499885d-9mk6l" podStartSLOduration=2.185893974 podStartE2EDuration="2.589390379s" totalImagesPullingTime="403.496405ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:41:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:41:28.587871984 +0000 UTC m=+2013.311125182" watchObservedRunningTime="2026-07-07 17:41:28.589390379 +0000 UTC m=+2013.312643575"
Jul 07 17:41:31.042310 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:31.042277    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:31.512117 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:31.512084    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:31.854028 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:31.853919    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:32.025381 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:32.025348    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:34.540725 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:34.540693    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:34.580016 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:34.579988    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-a-9ecff9-84499885d-9mk6l"
Jul 07 17:41:34.622719 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:34.622686    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-api-b-4c45e1-c8f758965-wqflp"]
Jul 07 17:41:34.627102 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:34.627075    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-4c45e1-c8f758965-wqflp"
Jul 07 17:41:34.629340 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:34.629312    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:34.629754 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:34.629732    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-api-b-4c45e1-serving-cert\""
Jul 07 17:41:34.635373 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:34.635346    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-4c45e1-c8f758965-wqflp"]
Jul 07 17:41:34.711497 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:34.711459    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:34.777028 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:34.776975    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e97194d-6a53-4e76-ace3-770dbca3fe5b-openshift-service-ca\") pod \"maas-api-e2e-api-b-4c45e1-c8f758965-wqflp\" (UID: \"8e97194d-6a53-4e76-ace3-770dbca3fe5b\") " pod="opendatahub/maas-api-e2e-api-b-4c45e1-c8f758965-wqflp"
Jul 07 17:41:34.777218 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:34.777183    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-48mjr\" (UniqueName: \"kubernetes.io/projected/8e97194d-6a53-4e76-ace3-770dbca3fe5b-kube-api-access-48mjr\") pod \"maas-api-e2e-api-b-4c45e1-c8f758965-wqflp\" (UID: \"8e97194d-6a53-4e76-ace3-770dbca3fe5b\") " pod="opendatahub/maas-api-e2e-api-b-4c45e1-c8f758965-wqflp"
Jul 07 17:41:34.777273 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:34.777227    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e97194d-6a53-4e76-ace3-770dbca3fe5b-maas-api-tls\") pod \"maas-api-e2e-api-b-4c45e1-c8f758965-wqflp\" (UID: \"8e97194d-6a53-4e76-ace3-770dbca3fe5b\") " pod="opendatahub/maas-api-e2e-api-b-4c45e1-c8f758965-wqflp"
Jul 07 17:41:34.818275 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:34.818190    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:34.878227 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:34.878182    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e97194d-6a53-4e76-ace3-770dbca3fe5b-maas-api-tls\") pod \"maas-api-e2e-api-b-4c45e1-c8f758965-wqflp\" (UID: \"8e97194d-6a53-4e76-ace3-770dbca3fe5b\") " pod="opendatahub/maas-api-e2e-api-b-4c45e1-c8f758965-wqflp"
Jul 07 17:41:34.878227 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:34.878231    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e97194d-6a53-4e76-ace3-770dbca3fe5b-openshift-service-ca\") pod \"maas-api-e2e-api-b-4c45e1-c8f758965-wqflp\" (UID: \"8e97194d-6a53-4e76-ace3-770dbca3fe5b\") " pod="opendatahub/maas-api-e2e-api-b-4c45e1-c8f758965-wqflp"
Jul 07 17:41:34.878493 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:34.878326    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-48mjr\" (UniqueName: \"kubernetes.io/projected/8e97194d-6a53-4e76-ace3-770dbca3fe5b-kube-api-access-48mjr\") pod \"maas-api-e2e-api-b-4c45e1-c8f758965-wqflp\" (UID: \"8e97194d-6a53-4e76-ace3-770dbca3fe5b\") " pod="opendatahub/maas-api-e2e-api-b-4c45e1-c8f758965-wqflp"
Jul 07 17:41:34.878893 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:34.878861    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e97194d-6a53-4e76-ace3-770dbca3fe5b-openshift-service-ca\") pod \"maas-api-e2e-api-b-4c45e1-c8f758965-wqflp\" (UID: \"8e97194d-6a53-4e76-ace3-770dbca3fe5b\") " pod="opendatahub/maas-api-e2e-api-b-4c45e1-c8f758965-wqflp"
Jul 07 17:41:34.880669 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:34.880649    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e97194d-6a53-4e76-ace3-770dbca3fe5b-maas-api-tls\") pod \"maas-api-e2e-api-b-4c45e1-c8f758965-wqflp\" (UID: \"8e97194d-6a53-4e76-ace3-770dbca3fe5b\") " pod="opendatahub/maas-api-e2e-api-b-4c45e1-c8f758965-wqflp"
Jul 07 17:41:34.898211 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:34.898168    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-48mjr\" (UniqueName: \"kubernetes.io/projected/8e97194d-6a53-4e76-ace3-770dbca3fe5b-kube-api-access-48mjr\") pod \"maas-api-e2e-api-b-4c45e1-c8f758965-wqflp\" (UID: \"8e97194d-6a53-4e76-ace3-770dbca3fe5b\") " pod="opendatahub/maas-api-e2e-api-b-4c45e1-c8f758965-wqflp"
Jul 07 17:41:34.940588 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:34.940548    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-4c45e1-c8f758965-wqflp"
Jul 07 17:41:35.128933 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:35.128750    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-api-b-4c45e1-c8f758965-wqflp"]
Jul 07 17:41:35.131536 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:41:35.131506    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e97194d_6a53_4e76_ace3_770dbca3fe5b.slice/crio-9d6f0203ae38e8a594c919caf7b76f15a1b460720d65aaf11950a316f8a2db01 WatchSource:0}: Error finding container 9d6f0203ae38e8a594c919caf7b76f15a1b460720d65aaf11950a316f8a2db01: Status 404 returned error can't find the container with id 9d6f0203ae38e8a594c919caf7b76f15a1b460720d65aaf11950a316f8a2db01
Jul 07 17:41:35.392383 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:35.392276    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:35.494271 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:35.494218    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:35.611549 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:35.611506    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-4c45e1-c8f758965-wqflp" event={"ID":"8e97194d-6a53-4e76-ace3-770dbca3fe5b","Type":"ContainerStarted","Data":"9d6f0203ae38e8a594c919caf7b76f15a1b460720d65aaf11950a316f8a2db01"}
Jul 07 17:41:36.622233 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:36.622193    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-4c45e1-c8f758965-wqflp" event={"ID":"8e97194d-6a53-4e76-ace3-770dbca3fe5b","Type":"ContainerStarted","Data":"1abd95c004d7534a0bad6116c0e0de4f59764c73cb53045e48fa2fef10c16611"}
Jul 07 17:41:36.622803 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:36.622782    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-api-b-4c45e1-c8f758965-wqflp"
Jul 07 17:41:36.647851 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:36.647792    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-api-b-4c45e1-c8f758965-wqflp" podStartSLOduration=2.117746491 podStartE2EDuration="2.647772613s" totalImagesPullingTime="530.026122ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:41:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:41:36.646036508 +0000 UTC m=+2021.369289706" watchObservedRunningTime="2026-07-07 17:41:36.647772613 +0000 UTC m=+2021.371025860"
Jul 07 17:41:39.115318 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:39.115281    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:41.593406 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:41.593356    2562 patch_prober.go:28] interesting pod/e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body=
Jul 07 17:41:41.593810 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:41.593434    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl" podUID="1ffdf9f3-6df7-4adc-8469-37e8db307927" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)"
Jul 07 17:41:42.201612 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:42.201569    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:42.339931 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:42.339877    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:43.234648 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:43.234562    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:43.337024 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:43.336932    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:43.641328 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:43.641299    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-api-b-4c45e1-c8f758965-wqflp"
Jul 07 17:41:43.665457 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:43.665423    2562 generic.go:356] "Generic (PLEG): container finished" podID="1ffdf9f3-6df7-4adc-8469-37e8db307927" containerID="6aa8b97c1a90e914734679e2a45654d188c9503e7c509864b270983d2f4bb879" exitCode=0
Jul 07 17:41:43.665628 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:43.665470    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl" event={"ID":"1ffdf9f3-6df7-4adc-8469-37e8db307927","Type":"ContainerDied","Data":"6aa8b97c1a90e914734679e2a45654d188c9503e7c509864b270983d2f4bb879"}
Jul 07 17:41:43.665865 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:43.665850    2562 scope.go:117] "RemoveContainer" containerID="6aa8b97c1a90e914734679e2a45654d188c9503e7c509864b270983d2f4bb879"
Jul 07 17:41:43.666834 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:43.666804    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 17:41:43.666895 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:43.666877    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 17:41:43.666951 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:43.666913    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 17:41:44.672607 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:44.672572    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl" event={"ID":"1ffdf9f3-6df7-4adc-8469-37e8db307927","Type":"ContainerStarted","Data":"24b39257d3998d5743ef8ad079664bf97a7ea331ca12304bb398f7428c23404f"}
Jul 07 17:41:44.682479 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:44.682450    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl"
Jul 07 17:41:44.682652 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:44.682630    2562 patch_prober.go:28] interesting pod/e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 07 17:41:44.682696 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:44.682677    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl" podUID="1ffdf9f3-6df7-4adc-8469-37e8db307927" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 07 17:41:45.682658 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:45.682627    2562 patch_prober.go:28] interesting pod/e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 07 17:41:45.683088 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:45.682678    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl" podUID="1ffdf9f3-6df7-4adc-8469-37e8db307927" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 07 17:41:46.682078 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:46.682041    2562 patch_prober.go:28] interesting pod/e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 07 17:41:46.682284 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:46.682098    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl" podUID="1ffdf9f3-6df7-4adc-8469-37e8db307927" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 07 17:41:47.456422 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:47.456389    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:47.683040 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:47.683002    2562 patch_prober.go:28] interesting pod/e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused" start-of-body=
Jul 07 17:41:47.683273 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:47.683054    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl" podUID="1ffdf9f3-6df7-4adc-8469-37e8db307927" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.56:15021/healthz/ready\": dial tcp 10.133.0.56:15021: connect: connection refused"
Jul 07 17:41:47.873134 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:47.873040    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:48.046810 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:48.046772    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:48.147289 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:48.147254    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:48.313270 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:48.313237    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-9ecff9-84499885d-9mk6l"]
Jul 07 17:41:48.318520 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:48.318481    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-a-9ecff9-84499885d-9mk6l" podUID="f3de3036-5fca-435a-bce9-538eeb1e6f02" containerName="maas-api" containerID="cri-o://02d4fea49b1102f8571f99bd4b7d04a1f97ce73eff3a05bad540fb17f75e37fb" gracePeriod=30
Jul 07 17:41:48.347981 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:48.347943    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:48.595314 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:48.595281    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-9ecff9-84499885d-9mk6l"
Jul 07 17:41:48.638143 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:48.638115    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c45tb\" (UniqueName: \"kubernetes.io/projected/f3de3036-5fca-435a-bce9-538eeb1e6f02-kube-api-access-c45tb\") pod \"f3de3036-5fca-435a-bce9-538eeb1e6f02\" (UID: \"f3de3036-5fca-435a-bce9-538eeb1e6f02\") "
Jul 07 17:41:48.638377 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:48.638208    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3de3036-5fca-435a-bce9-538eeb1e6f02-openshift-service-ca\") pod \"f3de3036-5fca-435a-bce9-538eeb1e6f02\" (UID: \"f3de3036-5fca-435a-bce9-538eeb1e6f02\") "
Jul 07 17:41:48.638377 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:48.638259    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3de3036-5fca-435a-bce9-538eeb1e6f02-maas-api-tls\") pod \"f3de3036-5fca-435a-bce9-538eeb1e6f02\" (UID: \"f3de3036-5fca-435a-bce9-538eeb1e6f02\") "
Jul 07 17:41:48.638605 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:48.638577    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/f3de3036-5fca-435a-bce9-538eeb1e6f02-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "f3de3036-5fca-435a-bce9-538eeb1e6f02" (UID: "f3de3036-5fca-435a-bce9-538eeb1e6f02"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:41:48.641031 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:48.640950    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3de3036-5fca-435a-bce9-538eeb1e6f02-kube-api-access-c45tb" (OuterVolumeSpecName: "kube-api-access-c45tb") pod "f3de3036-5fca-435a-bce9-538eeb1e6f02" (UID: "f3de3036-5fca-435a-bce9-538eeb1e6f02"). InnerVolumeSpecName "kube-api-access-c45tb". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:41:48.641507 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:48.641475    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/f3de3036-5fca-435a-bce9-538eeb1e6f02-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "f3de3036-5fca-435a-bce9-538eeb1e6f02" (UID: "f3de3036-5fca-435a-bce9-538eeb1e6f02"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:41:48.685688 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:48.685657    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl"
Jul 07 17:41:48.686079 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:48.686059    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl"
Jul 07 17:41:48.686869 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:48.686852    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl"
Jul 07 17:41:48.693883 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:48.693857    2562 generic.go:356] "Generic (PLEG): container finished" podID="f3de3036-5fca-435a-bce9-538eeb1e6f02" containerID="02d4fea49b1102f8571f99bd4b7d04a1f97ce73eff3a05bad540fb17f75e37fb" exitCode=0
Jul 07 17:41:48.694046 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:48.693895    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-a-9ecff9-84499885d-9mk6l"
Jul 07 17:41:48.694046 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:48.693939    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-9ecff9-84499885d-9mk6l" event={"ID":"f3de3036-5fca-435a-bce9-538eeb1e6f02","Type":"ContainerDied","Data":"02d4fea49b1102f8571f99bd4b7d04a1f97ce73eff3a05bad540fb17f75e37fb"}
Jul 07 17:41:48.694046 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:48.693988    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-a-9ecff9-84499885d-9mk6l" event={"ID":"f3de3036-5fca-435a-bce9-538eeb1e6f02","Type":"ContainerDied","Data":"7915c63ed12b143182c7f1e7f92f12d285d617c19cbb2897456efc0488bf6e80"}
Jul 07 17:41:48.694046 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:48.694010    2562 scope.go:117] "RemoveContainer" containerID="02d4fea49b1102f8571f99bd4b7d04a1f97ce73eff3a05bad540fb17f75e37fb"
Jul 07 17:41:48.706896 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:48.706870    2562 scope.go:117] "RemoveContainer" containerID="02d4fea49b1102f8571f99bd4b7d04a1f97ce73eff3a05bad540fb17f75e37fb"
Jul 07 17:41:48.707247 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:41:48.707226    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"02d4fea49b1102f8571f99bd4b7d04a1f97ce73eff3a05bad540fb17f75e37fb\": container with ID starting with 02d4fea49b1102f8571f99bd4b7d04a1f97ce73eff3a05bad540fb17f75e37fb not found: ID does not exist" containerID="02d4fea49b1102f8571f99bd4b7d04a1f97ce73eff3a05bad540fb17f75e37fb"
Jul 07 17:41:48.707334 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:48.707256    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"02d4fea49b1102f8571f99bd4b7d04a1f97ce73eff3a05bad540fb17f75e37fb"} err="failed to get container status \"02d4fea49b1102f8571f99bd4b7d04a1f97ce73eff3a05bad540fb17f75e37fb\": rpc error: code = NotFound desc = could not find container \"02d4fea49b1102f8571f99bd4b7d04a1f97ce73eff3a05bad540fb17f75e37fb\": container with ID starting with 02d4fea49b1102f8571f99bd4b7d04a1f97ce73eff3a05bad540fb17f75e37fb not found: ID does not exist"
Jul 07 17:41:48.739146 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:48.739059    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c45tb\" (UniqueName: \"kubernetes.io/projected/f3de3036-5fca-435a-bce9-538eeb1e6f02-kube-api-access-c45tb\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:41:48.739146 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:48.739092    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/f3de3036-5fca-435a-bce9-538eeb1e6f02-openshift-service-ca\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:41:48.739146 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:48.739118    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/f3de3036-5fca-435a-bce9-538eeb1e6f02-maas-api-tls\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:41:48.747320 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:48.747285    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-a-9ecff9-84499885d-9mk6l"]
Jul 07 17:41:48.752281 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:48.752121    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-a-9ecff9-84499885d-9mk6l"]
Jul 07 17:41:49.849019 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:49.848980    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="f3de3036-5fca-435a-bce9-538eeb1e6f02" path="/var/lib/kubelet/pods/f3de3036-5fca-435a-bce9-538eeb1e6f02/volumes"
Jul 07 17:41:55.137027 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:55.136997    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:55.270400 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:55.270362    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:55.415703 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:55.415614    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl"]
Jul 07 17:41:55.415868 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:55.415820    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl" podUID="1ffdf9f3-6df7-4adc-8469-37e8db307927" containerName="istio-proxy" containerID="cri-o://24b39257d3998d5743ef8ad079664bf97a7ea331ca12304bb398f7428c23404f" gracePeriod=30
Jul 07 17:41:55.445205 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:55.445174    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:55.678624 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:55.678526    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:55.856550 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:55.856505    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:56.275894 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:56.275811    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:56.376695 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:56.376662    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:56.477595 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:56.477559    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:56.615626 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:56.615542    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-4c45e1-c8f758965-wqflp"]
Jul 07 17:41:56.615833 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:56.615806    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-api-b-4c45e1-c8f758965-wqflp" podUID="8e97194d-6a53-4e76-ace3-770dbca3fe5b" containerName="maas-api" containerID="cri-o://1abd95c004d7534a0bad6116c0e0de4f59764c73cb53045e48fa2fef10c16611" gracePeriod=30
Jul 07 17:41:56.665851 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:56.665802    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:41:56.740931 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:56.740851    2562 generic.go:356] "Generic (PLEG): container finished" podID="8e97194d-6a53-4e76-ace3-770dbca3fe5b" containerID="1abd95c004d7534a0bad6116c0e0de4f59764c73cb53045e48fa2fef10c16611" exitCode=0
Jul 07 17:41:56.740931 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:56.740917    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-4c45e1-c8f758965-wqflp" event={"ID":"8e97194d-6a53-4e76-ace3-770dbca3fe5b","Type":"ContainerDied","Data":"1abd95c004d7534a0bad6116c0e0de4f59764c73cb53045e48fa2fef10c16611"}
Jul 07 17:41:56.872513 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:56.872449    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-4c45e1-c8f758965-wqflp"
Jul 07 17:41:56.925322 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:56.925289    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-48mjr\" (UniqueName: \"kubernetes.io/projected/8e97194d-6a53-4e76-ace3-770dbca3fe5b-kube-api-access-48mjr\") pod \"8e97194d-6a53-4e76-ace3-770dbca3fe5b\" (UID: \"8e97194d-6a53-4e76-ace3-770dbca3fe5b\") "
Jul 07 17:41:56.925520 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:56.925343    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e97194d-6a53-4e76-ace3-770dbca3fe5b-openshift-service-ca\") pod \"8e97194d-6a53-4e76-ace3-770dbca3fe5b\" (UID: \"8e97194d-6a53-4e76-ace3-770dbca3fe5b\") "
Jul 07 17:41:56.925520 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:56.925391    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e97194d-6a53-4e76-ace3-770dbca3fe5b-maas-api-tls\") pod \"8e97194d-6a53-4e76-ace3-770dbca3fe5b\" (UID: \"8e97194d-6a53-4e76-ace3-770dbca3fe5b\") "
Jul 07 17:41:56.925746 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:56.925719    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8e97194d-6a53-4e76-ace3-770dbca3fe5b-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "8e97194d-6a53-4e76-ace3-770dbca3fe5b" (UID: "8e97194d-6a53-4e76-ace3-770dbca3fe5b"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:41:56.927542 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:56.927516    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8e97194d-6a53-4e76-ace3-770dbca3fe5b-kube-api-access-48mjr" (OuterVolumeSpecName: "kube-api-access-48mjr") pod "8e97194d-6a53-4e76-ace3-770dbca3fe5b" (UID: "8e97194d-6a53-4e76-ace3-770dbca3fe5b"). InnerVolumeSpecName "kube-api-access-48mjr". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:41:56.927628 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:56.927604    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8e97194d-6a53-4e76-ace3-770dbca3fe5b-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "8e97194d-6a53-4e76-ace3-770dbca3fe5b" (UID: "8e97194d-6a53-4e76-ace3-770dbca3fe5b"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:41:57.026392 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:57.026352    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/8e97194d-6a53-4e76-ace3-770dbca3fe5b-maas-api-tls\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:41:57.026392 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:57.026386    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-48mjr\" (UniqueName: \"kubernetes.io/projected/8e97194d-6a53-4e76-ace3-770dbca3fe5b-kube-api-access-48mjr\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:41:57.026392 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:57.026395    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/8e97194d-6a53-4e76-ace3-770dbca3fe5b-openshift-service-ca\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:41:57.747418 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:57.747380    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-api-b-4c45e1-c8f758965-wqflp" event={"ID":"8e97194d-6a53-4e76-ace3-770dbca3fe5b","Type":"ContainerDied","Data":"9d6f0203ae38e8a594c919caf7b76f15a1b460720d65aaf11950a316f8a2db01"}
Jul 07 17:41:57.747418 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:57.747405    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-api-b-4c45e1-c8f758965-wqflp"
Jul 07 17:41:57.747947 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:57.747456    2562 scope.go:117] "RemoveContainer" containerID="1abd95c004d7534a0bad6116c0e0de4f59764c73cb53045e48fa2fef10c16611"
Jul 07 17:41:57.780239 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:57.780205    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-api-b-4c45e1-c8f758965-wqflp"]
Jul 07 17:41:57.783990 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:57.783964    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-api-b-4c45e1-c8f758965-wqflp"]
Jul 07 17:41:57.846490 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:41:57.846455    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8e97194d-6a53-4e76-ace3-770dbca3fe5b" path="/var/lib/kubelet/pods/8e97194d-6a53-4e76-ace3-770dbca3fe5b/volumes"
Jul 07 17:42:00.675390 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:00.675320    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl"
Jul 07 17:42:00.761636 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:00.761602    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ffdf9f3-6df7-4adc-8469-37e8db307927-istiod-ca-cert\") pod \"1ffdf9f3-6df7-4adc-8469-37e8db307927\" (UID: \"1ffdf9f3-6df7-4adc-8469-37e8db307927\") "
Jul 07 17:42:00.761636 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:00.761639    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ffdf9f3-6df7-4adc-8469-37e8db307927-istio-token\") pod \"1ffdf9f3-6df7-4adc-8469-37e8db307927\" (UID: \"1ffdf9f3-6df7-4adc-8469-37e8db307927\") "
Jul 07 17:42:00.761897 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:00.761677    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ffdf9f3-6df7-4adc-8469-37e8db307927-istio-data\") pod \"1ffdf9f3-6df7-4adc-8469-37e8db307927\" (UID: \"1ffdf9f3-6df7-4adc-8469-37e8db307927\") "
Jul 07 17:42:00.761897 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:00.761703    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ffdf9f3-6df7-4adc-8469-37e8db307927-credential-socket\") pod \"1ffdf9f3-6df7-4adc-8469-37e8db307927\" (UID: \"1ffdf9f3-6df7-4adc-8469-37e8db307927\") "
Jul 07 17:42:00.761897 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:00.761727    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ffdf9f3-6df7-4adc-8469-37e8db307927-workload-socket\") pod \"1ffdf9f3-6df7-4adc-8469-37e8db307927\" (UID: \"1ffdf9f3-6df7-4adc-8469-37e8db307927\") "
Jul 07 17:42:00.761897 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:00.761802    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ffdf9f3-6df7-4adc-8469-37e8db307927-workload-certs\") pod \"1ffdf9f3-6df7-4adc-8469-37e8db307927\" (UID: \"1ffdf9f3-6df7-4adc-8469-37e8db307927\") "
Jul 07 17:42:00.761897 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:00.761853    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-lg2fg\" (UniqueName: \"kubernetes.io/projected/1ffdf9f3-6df7-4adc-8469-37e8db307927-kube-api-access-lg2fg\") pod \"1ffdf9f3-6df7-4adc-8469-37e8db307927\" (UID: \"1ffdf9f3-6df7-4adc-8469-37e8db307927\") "
Jul 07 17:42:00.762148 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:00.761899    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ffdf9f3-6df7-4adc-8469-37e8db307927-istio-podinfo\") pod \"1ffdf9f3-6df7-4adc-8469-37e8db307927\" (UID: \"1ffdf9f3-6df7-4adc-8469-37e8db307927\") "
Jul 07 17:42:00.762148 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:00.761969    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ffdf9f3-6df7-4adc-8469-37e8db307927-istio-envoy\") pod \"1ffdf9f3-6df7-4adc-8469-37e8db307927\" (UID: \"1ffdf9f3-6df7-4adc-8469-37e8db307927\") "
Jul 07 17:42:00.762278 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:00.762139    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ffdf9f3-6df7-4adc-8469-37e8db307927-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "1ffdf9f3-6df7-4adc-8469-37e8db307927" (UID: "1ffdf9f3-6df7-4adc-8469-37e8db307927"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:42:00.762278 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:00.762177    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ffdf9f3-6df7-4adc-8469-37e8db307927-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "1ffdf9f3-6df7-4adc-8469-37e8db307927" (UID: "1ffdf9f3-6df7-4adc-8469-37e8db307927"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:42:00.762278 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:00.762202    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1ffdf9f3-6df7-4adc-8469-37e8db307927-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "1ffdf9f3-6df7-4adc-8469-37e8db307927" (UID: "1ffdf9f3-6df7-4adc-8469-37e8db307927"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:42:00.762441 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:00.762302    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ffdf9f3-6df7-4adc-8469-37e8db307927-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "1ffdf9f3-6df7-4adc-8469-37e8db307927" (UID: "1ffdf9f3-6df7-4adc-8469-37e8db307927"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:42:00.762441 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:00.762366    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/1ffdf9f3-6df7-4adc-8469-37e8db307927-istiod-ca-cert\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:42:00.762441 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:00.762385    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ffdf9f3-6df7-4adc-8469-37e8db307927-workload-socket\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:42:00.762441 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:00.762398    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/1ffdf9f3-6df7-4adc-8469-37e8db307927-workload-certs\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:42:00.763052 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:00.763023    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ffdf9f3-6df7-4adc-8469-37e8db307927-istio-data" (OuterVolumeSpecName: "istio-data") pod "1ffdf9f3-6df7-4adc-8469-37e8db307927" (UID: "1ffdf9f3-6df7-4adc-8469-37e8db307927"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:42:00.764375 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:00.764318    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/1ffdf9f3-6df7-4adc-8469-37e8db307927-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "1ffdf9f3-6df7-4adc-8469-37e8db307927" (UID: "1ffdf9f3-6df7-4adc-8469-37e8db307927"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 17:42:00.764503 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:00.764396    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1ffdf9f3-6df7-4adc-8469-37e8db307927-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "1ffdf9f3-6df7-4adc-8469-37e8db307927" (UID: "1ffdf9f3-6df7-4adc-8469-37e8db307927"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:42:00.764660 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:00.764635    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ffdf9f3-6df7-4adc-8469-37e8db307927-istio-token" (OuterVolumeSpecName: "istio-token") pod "1ffdf9f3-6df7-4adc-8469-37e8db307927" (UID: "1ffdf9f3-6df7-4adc-8469-37e8db307927"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:42:00.764660 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:00.764647    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1ffdf9f3-6df7-4adc-8469-37e8db307927-kube-api-access-lg2fg" (OuterVolumeSpecName: "kube-api-access-lg2fg") pod "1ffdf9f3-6df7-4adc-8469-37e8db307927" (UID: "1ffdf9f3-6df7-4adc-8469-37e8db307927"). InnerVolumeSpecName "kube-api-access-lg2fg". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:42:00.766356 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:00.766329    2562 generic.go:356] "Generic (PLEG): container finished" podID="1ffdf9f3-6df7-4adc-8469-37e8db307927" containerID="24b39257d3998d5743ef8ad079664bf97a7ea331ca12304bb398f7428c23404f" exitCode=0
Jul 07 17:42:00.766458 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:00.766406    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl"
Jul 07 17:42:00.766458 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:00.766409    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl" event={"ID":"1ffdf9f3-6df7-4adc-8469-37e8db307927","Type":"ContainerDied","Data":"24b39257d3998d5743ef8ad079664bf97a7ea331ca12304bb398f7428c23404f"}
Jul 07 17:42:00.766548 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:00.766466    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl" event={"ID":"1ffdf9f3-6df7-4adc-8469-37e8db307927","Type":"ContainerDied","Data":"4b96223fb1029679f2c54728b3286e61db1db978bca4e152cd4adbfb2f00377b"}
Jul 07 17:42:00.766548 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:00.766490    2562 scope.go:117] "RemoveContainer" containerID="24b39257d3998d5743ef8ad079664bf97a7ea331ca12304bb398f7428c23404f"
Jul 07 17:42:00.784082 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:00.784058    2562 scope.go:117] "RemoveContainer" containerID="6aa8b97c1a90e914734679e2a45654d188c9503e7c509864b270983d2f4bb879"
Jul 07 17:42:00.792908 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:00.792885    2562 scope.go:117] "RemoveContainer" containerID="24b39257d3998d5743ef8ad079664bf97a7ea331ca12304bb398f7428c23404f"
Jul 07 17:42:00.793240 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:42:00.793221    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"24b39257d3998d5743ef8ad079664bf97a7ea331ca12304bb398f7428c23404f\": container with ID starting with 24b39257d3998d5743ef8ad079664bf97a7ea331ca12304bb398f7428c23404f not found: ID does not exist" containerID="24b39257d3998d5743ef8ad079664bf97a7ea331ca12304bb398f7428c23404f"
Jul 07 17:42:00.793293 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:00.793250    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"24b39257d3998d5743ef8ad079664bf97a7ea331ca12304bb398f7428c23404f"} err="failed to get container status \"24b39257d3998d5743ef8ad079664bf97a7ea331ca12304bb398f7428c23404f\": rpc error: code = NotFound desc = could not find container \"24b39257d3998d5743ef8ad079664bf97a7ea331ca12304bb398f7428c23404f\": container with ID starting with 24b39257d3998d5743ef8ad079664bf97a7ea331ca12304bb398f7428c23404f not found: ID does not exist"
Jul 07 17:42:00.793293 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:00.793270    2562 scope.go:117] "RemoveContainer" containerID="6aa8b97c1a90e914734679e2a45654d188c9503e7c509864b270983d2f4bb879"
Jul 07 17:42:00.793560 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:42:00.793541    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6aa8b97c1a90e914734679e2a45654d188c9503e7c509864b270983d2f4bb879\": container with ID starting with 6aa8b97c1a90e914734679e2a45654d188c9503e7c509864b270983d2f4bb879 not found: ID does not exist" containerID="6aa8b97c1a90e914734679e2a45654d188c9503e7c509864b270983d2f4bb879"
Jul 07 17:42:00.793620 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:00.793569    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6aa8b97c1a90e914734679e2a45654d188c9503e7c509864b270983d2f4bb879"} err="failed to get container status \"6aa8b97c1a90e914734679e2a45654d188c9503e7c509864b270983d2f4bb879\": rpc error: code = NotFound desc = could not find container \"6aa8b97c1a90e914734679e2a45654d188c9503e7c509864b270983d2f4bb879\": container with ID starting with 6aa8b97c1a90e914734679e2a45654d188c9503e7c509864b270983d2f4bb879 not found: ID does not exist"
Jul 07 17:42:00.798016 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:00.797990    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl"]
Jul 07 17:42:00.803787 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:00.803757    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-9ecff9-openshift-default-5bf98cfd7f-9skhl"]
Jul 07 17:42:00.863597 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:00.863559    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/1ffdf9f3-6df7-4adc-8469-37e8db307927-istio-token\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:42:00.863597 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:00.863587    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/1ffdf9f3-6df7-4adc-8469-37e8db307927-istio-data\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:42:00.863597 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:00.863596    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/1ffdf9f3-6df7-4adc-8469-37e8db307927-credential-socket\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:42:00.863597 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:00.863607    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-lg2fg\" (UniqueName: \"kubernetes.io/projected/1ffdf9f3-6df7-4adc-8469-37e8db307927-kube-api-access-lg2fg\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:42:00.863863 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:00.863621    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/1ffdf9f3-6df7-4adc-8469-37e8db307927-istio-podinfo\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:42:00.863863 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:00.863630    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/1ffdf9f3-6df7-4adc-8469-37e8db307927-istio-envoy\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:42:01.848925 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:01.848891    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1ffdf9f3-6df7-4adc-8469-37e8db307927" path="/var/lib/kubelet/pods/1ffdf9f3-6df7-4adc-8469-37e8db307927/volumes"
Jul 07 17:42:02.544052 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:02.544013    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:02.645621 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:02.645588    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:02.856948 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:02.856852    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:03.133661 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:03.133620    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:03.509892 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:03.509788    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:03.909785 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:03.909752    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz"]
Jul 07 17:42:03.910198 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:03.910144    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3de3036-5fca-435a-bce9-538eeb1e6f02" containerName="maas-api"
Jul 07 17:42:03.910198 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:03.910172    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3de3036-5fca-435a-bce9-538eeb1e6f02" containerName="maas-api"
Jul 07 17:42:03.910198 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:03.910196    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ffdf9f3-6df7-4adc-8469-37e8db307927" containerName="istio-proxy"
Jul 07 17:42:03.910303 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:03.910205    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ffdf9f3-6df7-4adc-8469-37e8db307927" containerName="istio-proxy"
Jul 07 17:42:03.910303 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:03.910224    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1ffdf9f3-6df7-4adc-8469-37e8db307927" containerName="istio-proxy"
Jul 07 17:42:03.910303 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:03.910230    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="1ffdf9f3-6df7-4adc-8469-37e8db307927" containerName="istio-proxy"
Jul 07 17:42:03.910303 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:03.910239    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8e97194d-6a53-4e76-ace3-770dbca3fe5b" containerName="maas-api"
Jul 07 17:42:03.910303 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:03.910244    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="8e97194d-6a53-4e76-ace3-770dbca3fe5b" containerName="maas-api"
Jul 07 17:42:03.910303 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:03.910303    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3de3036-5fca-435a-bce9-538eeb1e6f02" containerName="maas-api"
Jul 07 17:42:03.910477 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:03.910311    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ffdf9f3-6df7-4adc-8469-37e8db307927" containerName="istio-proxy"
Jul 07 17:42:03.910477 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:03.910319    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="1ffdf9f3-6df7-4adc-8469-37e8db307927" containerName="istio-proxy"
Jul 07 17:42:03.910477 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:03.910325    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="8e97194d-6a53-4e76-ace3-770dbca3fe5b" containerName="maas-api"
Jul 07 17:42:03.915199 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:03.915174    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz"
Jul 07 17:42:03.918849 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:03.918821    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-19c9b1-openshift-default-dockercfg-s5fq2\""
Jul 07 17:42:03.962058 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:03.962011    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:03.995092 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:03.995055    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c1513f3-4907-445e-aed7-0b9f31b07f92-istio-podinfo\") pod \"e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz\" (UID: \"0c1513f3-4907-445e-aed7-0b9f31b07f92\") " pod="openshift-ingress/e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz"
Jul 07 17:42:03.995265 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:03.995113    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c1513f3-4907-445e-aed7-0b9f31b07f92-credential-socket\") pod \"e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz\" (UID: \"0c1513f3-4907-445e-aed7-0b9f31b07f92\") " pod="openshift-ingress/e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz"
Jul 07 17:42:03.995265 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:03.995199    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c1513f3-4907-445e-aed7-0b9f31b07f92-workload-certs\") pod \"e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz\" (UID: \"0c1513f3-4907-445e-aed7-0b9f31b07f92\") " pod="openshift-ingress/e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz"
Jul 07 17:42:03.995265 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:03.995247    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c1513f3-4907-445e-aed7-0b9f31b07f92-workload-socket\") pod \"e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz\" (UID: \"0c1513f3-4907-445e-aed7-0b9f31b07f92\") " pod="openshift-ingress/e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz"
Jul 07 17:42:03.995389 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:03.995266    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c1513f3-4907-445e-aed7-0b9f31b07f92-istio-token\") pod \"e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz\" (UID: \"0c1513f3-4907-445e-aed7-0b9f31b07f92\") " pod="openshift-ingress/e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz"
Jul 07 17:42:03.995389 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:03.995309    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9pns5\" (UniqueName: \"kubernetes.io/projected/0c1513f3-4907-445e-aed7-0b9f31b07f92-kube-api-access-9pns5\") pod \"e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz\" (UID: \"0c1513f3-4907-445e-aed7-0b9f31b07f92\") " pod="openshift-ingress/e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz"
Jul 07 17:42:03.995389 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:03.995383    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c1513f3-4907-445e-aed7-0b9f31b07f92-istio-envoy\") pod \"e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz\" (UID: \"0c1513f3-4907-445e-aed7-0b9f31b07f92\") " pod="openshift-ingress/e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz"
Jul 07 17:42:03.995489 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:03.995401    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c1513f3-4907-445e-aed7-0b9f31b07f92-istiod-ca-cert\") pod \"e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz\" (UID: \"0c1513f3-4907-445e-aed7-0b9f31b07f92\") " pod="openshift-ingress/e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz"
Jul 07 17:42:03.995489 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:03.995419    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c1513f3-4907-445e-aed7-0b9f31b07f92-istio-data\") pod \"e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz\" (UID: \"0c1513f3-4907-445e-aed7-0b9f31b07f92\") " pod="openshift-ingress/e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz"
Jul 07 17:42:04.057167 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:04.057108    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz"]
Jul 07 17:42:04.096459 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:04.096416    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c1513f3-4907-445e-aed7-0b9f31b07f92-istio-envoy\") pod \"e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz\" (UID: \"0c1513f3-4907-445e-aed7-0b9f31b07f92\") " pod="openshift-ingress/e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz"
Jul 07 17:42:04.096675 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:04.096496    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c1513f3-4907-445e-aed7-0b9f31b07f92-istiod-ca-cert\") pod \"e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz\" (UID: \"0c1513f3-4907-445e-aed7-0b9f31b07f92\") " pod="openshift-ingress/e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz"
Jul 07 17:42:04.096675 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:04.096529    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c1513f3-4907-445e-aed7-0b9f31b07f92-istio-data\") pod \"e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz\" (UID: \"0c1513f3-4907-445e-aed7-0b9f31b07f92\") " pod="openshift-ingress/e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz"
Jul 07 17:42:04.096803 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:04.096704    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c1513f3-4907-445e-aed7-0b9f31b07f92-istio-podinfo\") pod \"e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz\" (UID: \"0c1513f3-4907-445e-aed7-0b9f31b07f92\") " pod="openshift-ingress/e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz"
Jul 07 17:42:04.096916 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:04.096843    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c1513f3-4907-445e-aed7-0b9f31b07f92-credential-socket\") pod \"e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz\" (UID: \"0c1513f3-4907-445e-aed7-0b9f31b07f92\") " pod="openshift-ingress/e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz"
Jul 07 17:42:04.097002 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:04.096983    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c1513f3-4907-445e-aed7-0b9f31b07f92-workload-certs\") pod \"e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz\" (UID: \"0c1513f3-4907-445e-aed7-0b9f31b07f92\") " pod="openshift-ingress/e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz"
Jul 07 17:42:04.097060 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:04.097042    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c1513f3-4907-445e-aed7-0b9f31b07f92-workload-socket\") pod \"e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz\" (UID: \"0c1513f3-4907-445e-aed7-0b9f31b07f92\") " pod="openshift-ingress/e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz"
Jul 07 17:42:04.097117 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:04.097057    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c1513f3-4907-445e-aed7-0b9f31b07f92-istio-data\") pod \"e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz\" (UID: \"0c1513f3-4907-445e-aed7-0b9f31b07f92\") " pod="openshift-ingress/e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz"
Jul 07 17:42:04.097117 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:04.097070    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c1513f3-4907-445e-aed7-0b9f31b07f92-istio-token\") pod \"e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz\" (UID: \"0c1513f3-4907-445e-aed7-0b9f31b07f92\") " pod="openshift-ingress/e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz"
Jul 07 17:42:04.097287 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:04.097126    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9pns5\" (UniqueName: \"kubernetes.io/projected/0c1513f3-4907-445e-aed7-0b9f31b07f92-kube-api-access-9pns5\") pod \"e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz\" (UID: \"0c1513f3-4907-445e-aed7-0b9f31b07f92\") " pod="openshift-ingress/e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz"
Jul 07 17:42:04.097287 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:04.097212    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c1513f3-4907-445e-aed7-0b9f31b07f92-credential-socket\") pod \"e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz\" (UID: \"0c1513f3-4907-445e-aed7-0b9f31b07f92\") " pod="openshift-ingress/e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz"
Jul 07 17:42:04.097389 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:04.097335    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c1513f3-4907-445e-aed7-0b9f31b07f92-istiod-ca-cert\") pod \"e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz\" (UID: \"0c1513f3-4907-445e-aed7-0b9f31b07f92\") " pod="openshift-ingress/e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz"
Jul 07 17:42:04.097453 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:04.097422    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c1513f3-4907-445e-aed7-0b9f31b07f92-workload-certs\") pod \"e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz\" (UID: \"0c1513f3-4907-445e-aed7-0b9f31b07f92\") " pod="openshift-ingress/e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz"
Jul 07 17:42:04.097663 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:04.097644    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c1513f3-4907-445e-aed7-0b9f31b07f92-workload-socket\") pod \"e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz\" (UID: \"0c1513f3-4907-445e-aed7-0b9f31b07f92\") " pod="openshift-ingress/e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz"
Jul 07 17:42:04.098934 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:04.098914    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c1513f3-4907-445e-aed7-0b9f31b07f92-istio-envoy\") pod \"e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz\" (UID: \"0c1513f3-4907-445e-aed7-0b9f31b07f92\") " pod="openshift-ingress/e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz"
Jul 07 17:42:04.099665 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:04.099645    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c1513f3-4907-445e-aed7-0b9f31b07f92-istio-podinfo\") pod \"e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz\" (UID: \"0c1513f3-4907-445e-aed7-0b9f31b07f92\") " pod="openshift-ingress/e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz"
Jul 07 17:42:04.116868 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:04.116834    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9pns5\" (UniqueName: \"kubernetes.io/projected/0c1513f3-4907-445e-aed7-0b9f31b07f92-kube-api-access-9pns5\") pod \"e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz\" (UID: \"0c1513f3-4907-445e-aed7-0b9f31b07f92\") " pod="openshift-ingress/e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz"
Jul 07 17:42:04.117020 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:04.116833    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c1513f3-4907-445e-aed7-0b9f31b07f92-istio-token\") pod \"e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz\" (UID: \"0c1513f3-4907-445e-aed7-0b9f31b07f92\") " pod="openshift-ingress/e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz"
Jul 07 17:42:04.193884 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:04.193798    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:04.225971 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:04.225938    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz"
Jul 07 17:42:04.383868 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:04.383819    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz"]
Jul 07 17:42:04.388130 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:42:04.388096    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c1513f3_4907_445e_aed7_0b9f31b07f92.slice/crio-f73a829284fe320a32ca7dec20bc1febe30791077235fbff8d10489172ff206c WatchSource:0}: Error finding container f73a829284fe320a32ca7dec20bc1febe30791077235fbff8d10489172ff206c: Status 404 returned error can't find the container with id f73a829284fe320a32ca7dec20bc1febe30791077235fbff8d10489172ff206c
Jul 07 17:42:04.391044 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:04.390998    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 17:42:04.391208 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:04.391093    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 17:42:04.391208 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:04.391136    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 17:42:04.789660 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:04.789566    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz" event={"ID":"0c1513f3-4907-445e-aed7-0b9f31b07f92","Type":"ContainerStarted","Data":"ee67d18a54ef78dad6e7613112493470326ac7d25caae8ff1714aed1399e4010"}
Jul 07 17:42:04.789660 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:04.789618    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz" event={"ID":"0c1513f3-4907-445e-aed7-0b9f31b07f92","Type":"ContainerStarted","Data":"f73a829284fe320a32ca7dec20bc1febe30791077235fbff8d10489172ff206c"}
Jul 07 17:42:04.813729 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:04.813673    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz" podStartSLOduration=1.8136527949999999 podStartE2EDuration="1.813652795s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:42:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:42:04.81109949 +0000 UTC m=+2049.534352689" watchObservedRunningTime="2026-07-07 17:42:04.813652795 +0000 UTC m=+2049.536905988"
Jul 07 17:42:05.226950 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:05.226904    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz"
Jul 07 17:42:05.232043 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:05.232010    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz"
Jul 07 17:42:05.795683 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:05.795647    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz"
Jul 07 17:42:05.796625 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:05.796609    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz"
Jul 07 17:42:06.813659 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:06.813625    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:06.913530 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:06.913492    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:07.064429 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:07.064334    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-a-19c9b1-757f4cc774-z9x2j"]
Jul 07 17:42:07.068097 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:07.068066    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-19c9b1-757f4cc774-z9x2j"
Jul 07 17:42:07.070660 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:07.070631    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-a-19c9b1-serving-cert\""
Jul 07 17:42:07.080490 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:07.080456    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-19c9b1-757f4cc774-z9x2j"]
Jul 07 17:42:07.111400 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:07.111355    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:07.228078 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:07.228041    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e99aecb9-30b9-41f3-9fae-a83212b73f14-maas-api-tls\") pod \"maas-api-e2e-shared-a-19c9b1-757f4cc774-z9x2j\" (UID: \"e99aecb9-30b9-41f3-9fae-a83212b73f14\") " pod="opendatahub/maas-api-e2e-shared-a-19c9b1-757f4cc774-z9x2j"
Jul 07 17:42:07.228078 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:07.228087    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e99aecb9-30b9-41f3-9fae-a83212b73f14-openshift-service-ca\") pod \"maas-api-e2e-shared-a-19c9b1-757f4cc774-z9x2j\" (UID: \"e99aecb9-30b9-41f3-9fae-a83212b73f14\") " pod="opendatahub/maas-api-e2e-shared-a-19c9b1-757f4cc774-z9x2j"
Jul 07 17:42:07.228360 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:07.228124    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2vhph\" (UniqueName: \"kubernetes.io/projected/e99aecb9-30b9-41f3-9fae-a83212b73f14-kube-api-access-2vhph\") pod \"maas-api-e2e-shared-a-19c9b1-757f4cc774-z9x2j\" (UID: \"e99aecb9-30b9-41f3-9fae-a83212b73f14\") " pod="opendatahub/maas-api-e2e-shared-a-19c9b1-757f4cc774-z9x2j"
Jul 07 17:42:07.329383 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:07.329282    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e99aecb9-30b9-41f3-9fae-a83212b73f14-maas-api-tls\") pod \"maas-api-e2e-shared-a-19c9b1-757f4cc774-z9x2j\" (UID: \"e99aecb9-30b9-41f3-9fae-a83212b73f14\") " pod="opendatahub/maas-api-e2e-shared-a-19c9b1-757f4cc774-z9x2j"
Jul 07 17:42:07.329383 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:07.329332    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e99aecb9-30b9-41f3-9fae-a83212b73f14-openshift-service-ca\") pod \"maas-api-e2e-shared-a-19c9b1-757f4cc774-z9x2j\" (UID: \"e99aecb9-30b9-41f3-9fae-a83212b73f14\") " pod="opendatahub/maas-api-e2e-shared-a-19c9b1-757f4cc774-z9x2j"
Jul 07 17:42:07.329383 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:07.329370    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2vhph\" (UniqueName: \"kubernetes.io/projected/e99aecb9-30b9-41f3-9fae-a83212b73f14-kube-api-access-2vhph\") pod \"maas-api-e2e-shared-a-19c9b1-757f4cc774-z9x2j\" (UID: \"e99aecb9-30b9-41f3-9fae-a83212b73f14\") " pod="opendatahub/maas-api-e2e-shared-a-19c9b1-757f4cc774-z9x2j"
Jul 07 17:42:07.329639 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:42:07.329444    2562 secret.go:189] Couldn't get secret opendatahub/maas-api-e2e-shared-a-19c9b1-serving-cert: secret "maas-api-e2e-shared-a-19c9b1-serving-cert" not found
Jul 07 17:42:07.329639 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:42:07.329513    2562 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e99aecb9-30b9-41f3-9fae-a83212b73f14-maas-api-tls podName:e99aecb9-30b9-41f3-9fae-a83212b73f14 nodeName:}" failed. No retries permitted until 2026-07-07 17:42:07.829495921 +0000 UTC m=+2052.552749096 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/e99aecb9-30b9-41f3-9fae-a83212b73f14-maas-api-tls") pod "maas-api-e2e-shared-a-19c9b1-757f4cc774-z9x2j" (UID: "e99aecb9-30b9-41f3-9fae-a83212b73f14") : secret "maas-api-e2e-shared-a-19c9b1-serving-cert" not found
Jul 07 17:42:07.329965 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:07.329944    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e99aecb9-30b9-41f3-9fae-a83212b73f14-openshift-service-ca\") pod \"maas-api-e2e-shared-a-19c9b1-757f4cc774-z9x2j\" (UID: \"e99aecb9-30b9-41f3-9fae-a83212b73f14\") " pod="opendatahub/maas-api-e2e-shared-a-19c9b1-757f4cc774-z9x2j"
Jul 07 17:42:07.342902 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:07.342871    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2vhph\" (UniqueName: \"kubernetes.io/projected/e99aecb9-30b9-41f3-9fae-a83212b73f14-kube-api-access-2vhph\") pod \"maas-api-e2e-shared-a-19c9b1-757f4cc774-z9x2j\" (UID: \"e99aecb9-30b9-41f3-9fae-a83212b73f14\") " pod="opendatahub/maas-api-e2e-shared-a-19c9b1-757f4cc774-z9x2j"
Jul 07 17:42:07.470967 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:07.470931    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:07.571556 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:07.571518    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:07.673412 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:07.673372    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:07.833935 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:07.833901    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e99aecb9-30b9-41f3-9fae-a83212b73f14-maas-api-tls\") pod \"maas-api-e2e-shared-a-19c9b1-757f4cc774-z9x2j\" (UID: \"e99aecb9-30b9-41f3-9fae-a83212b73f14\") " pod="opendatahub/maas-api-e2e-shared-a-19c9b1-757f4cc774-z9x2j"
Jul 07 17:42:07.836517 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:07.836491    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e99aecb9-30b9-41f3-9fae-a83212b73f14-maas-api-tls\") pod \"maas-api-e2e-shared-a-19c9b1-757f4cc774-z9x2j\" (UID: \"e99aecb9-30b9-41f3-9fae-a83212b73f14\") " pod="opendatahub/maas-api-e2e-shared-a-19c9b1-757f4cc774-z9x2j"
Jul 07 17:42:07.979947 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:07.979844    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-19c9b1-757f4cc774-z9x2j"
Jul 07 17:42:08.127325 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:08.127292    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-19c9b1-757f4cc774-z9x2j"]
Jul 07 17:42:08.129021 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:42:08.128992    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode99aecb9_30b9_41f3_9fae_a83212b73f14.slice/crio-83d8e9bfd3783fc792ac77d40da901bf7780ccd7d41079c5721aeb47b3616275 WatchSource:0}: Error finding container 83d8e9bfd3783fc792ac77d40da901bf7780ccd7d41079c5721aeb47b3616275: Status 404 returned error can't find the container with id 83d8e9bfd3783fc792ac77d40da901bf7780ccd7d41079c5721aeb47b3616275
Jul 07 17:42:08.816932 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:08.816881    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-19c9b1-757f4cc774-z9x2j" event={"ID":"e99aecb9-30b9-41f3-9fae-a83212b73f14","Type":"ContainerStarted","Data":"a2e6697d4c5c88a10ec6cd9881d67ad8ac35c5eecedc1135fa24ce1123357198"}
Jul 07 17:42:08.817139 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:08.816972    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-a-19c9b1-757f4cc774-z9x2j"
Jul 07 17:42:08.817139 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:08.816997    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-19c9b1-757f4cc774-z9x2j" event={"ID":"e99aecb9-30b9-41f3-9fae-a83212b73f14","Type":"ContainerStarted","Data":"83d8e9bfd3783fc792ac77d40da901bf7780ccd7d41079c5721aeb47b3616275"}
Jul 07 17:42:08.836142 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:08.836018    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-a-19c9b1-757f4cc774-z9x2j" podStartSLOduration=1.3917396100000001 podStartE2EDuration="1.835999406s" totalImagesPullingTime="444.259796ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:42:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:42:08.834956614 +0000 UTC m=+2053.558209811" watchObservedRunningTime="2026-07-07 17:42:08.835999406 +0000 UTC m=+2053.559252603"
Jul 07 17:42:11.393296 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:11.393257    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:11.764133 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:11.764045    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:12.107644 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:12.107536    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:12.854026 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:12.853999    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:14.830668 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:14.830637    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-a-19c9b1-757f4cc774-z9x2j"
Jul 07 17:42:14.881953 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:14.881923    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:15.057331 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:15.057298    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-api-e2e-shared-b-ce87c9-69dd78c58f-2rzpr"]
Jul 07 17:42:15.061972 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:15.061952    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-ce87c9-69dd78c58f-2rzpr"
Jul 07 17:42:15.065895 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:15.065870    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-api-e2e-shared-b-ce87c9-serving-cert\""
Jul 07 17:42:15.072870 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:15.072845    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:15.134830 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:15.134790    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-ce87c9-69dd78c58f-2rzpr"]
Jul 07 17:42:15.188964 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:15.188931    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:15.201577 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:15.201546    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93341c34-1ed4-47a0-af89-23e48bfc5da6-openshift-service-ca\") pod \"maas-api-e2e-shared-b-ce87c9-69dd78c58f-2rzpr\" (UID: \"93341c34-1ed4-47a0-af89-23e48bfc5da6\") " pod="opendatahub/maas-api-e2e-shared-b-ce87c9-69dd78c58f-2rzpr"
Jul 07 17:42:15.201722 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:15.201600    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93341c34-1ed4-47a0-af89-23e48bfc5da6-maas-api-tls\") pod \"maas-api-e2e-shared-b-ce87c9-69dd78c58f-2rzpr\" (UID: \"93341c34-1ed4-47a0-af89-23e48bfc5da6\") " pod="opendatahub/maas-api-e2e-shared-b-ce87c9-69dd78c58f-2rzpr"
Jul 07 17:42:15.201722 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:15.201649    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wd7np\" (UniqueName: \"kubernetes.io/projected/93341c34-1ed4-47a0-af89-23e48bfc5da6-kube-api-access-wd7np\") pod \"maas-api-e2e-shared-b-ce87c9-69dd78c58f-2rzpr\" (UID: \"93341c34-1ed4-47a0-af89-23e48bfc5da6\") " pod="opendatahub/maas-api-e2e-shared-b-ce87c9-69dd78c58f-2rzpr"
Jul 07 17:42:15.303220 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:15.303146    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93341c34-1ed4-47a0-af89-23e48bfc5da6-openshift-service-ca\") pod \"maas-api-e2e-shared-b-ce87c9-69dd78c58f-2rzpr\" (UID: \"93341c34-1ed4-47a0-af89-23e48bfc5da6\") " pod="opendatahub/maas-api-e2e-shared-b-ce87c9-69dd78c58f-2rzpr"
Jul 07 17:42:15.303398 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:15.303258    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93341c34-1ed4-47a0-af89-23e48bfc5da6-maas-api-tls\") pod \"maas-api-e2e-shared-b-ce87c9-69dd78c58f-2rzpr\" (UID: \"93341c34-1ed4-47a0-af89-23e48bfc5da6\") " pod="opendatahub/maas-api-e2e-shared-b-ce87c9-69dd78c58f-2rzpr"
Jul 07 17:42:15.303398 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:15.303292    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wd7np\" (UniqueName: \"kubernetes.io/projected/93341c34-1ed4-47a0-af89-23e48bfc5da6-kube-api-access-wd7np\") pod \"maas-api-e2e-shared-b-ce87c9-69dd78c58f-2rzpr\" (UID: \"93341c34-1ed4-47a0-af89-23e48bfc5da6\") " pod="opendatahub/maas-api-e2e-shared-b-ce87c9-69dd78c58f-2rzpr"
Jul 07 17:42:15.304008 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:15.303975    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93341c34-1ed4-47a0-af89-23e48bfc5da6-openshift-service-ca\") pod \"maas-api-e2e-shared-b-ce87c9-69dd78c58f-2rzpr\" (UID: \"93341c34-1ed4-47a0-af89-23e48bfc5da6\") " pod="opendatahub/maas-api-e2e-shared-b-ce87c9-69dd78c58f-2rzpr"
Jul 07 17:42:15.306651 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:15.306615    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93341c34-1ed4-47a0-af89-23e48bfc5da6-maas-api-tls\") pod \"maas-api-e2e-shared-b-ce87c9-69dd78c58f-2rzpr\" (UID: \"93341c34-1ed4-47a0-af89-23e48bfc5da6\") " pod="opendatahub/maas-api-e2e-shared-b-ce87c9-69dd78c58f-2rzpr"
Jul 07 17:42:15.323001 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:15.322961    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wd7np\" (UniqueName: \"kubernetes.io/projected/93341c34-1ed4-47a0-af89-23e48bfc5da6-kube-api-access-wd7np\") pod \"maas-api-e2e-shared-b-ce87c9-69dd78c58f-2rzpr\" (UID: \"93341c34-1ed4-47a0-af89-23e48bfc5da6\") " pod="opendatahub/maas-api-e2e-shared-b-ce87c9-69dd78c58f-2rzpr"
Jul 07 17:42:15.372040 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:15.372001    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-ce87c9-69dd78c58f-2rzpr"
Jul 07 17:42:15.385077 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:15.384973    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:15.571016 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:15.570989    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-ce87c9-69dd78c58f-2rzpr"]
Jul 07 17:42:15.573935 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:42:15.573906    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod93341c34_1ed4_47a0_af89_23e48bfc5da6.slice/crio-98c871c8c77da20a1c35ab23c454c8bd149d87b2b098f5cb4f219c1dbf59b482 WatchSource:0}: Error finding container 98c871c8c77da20a1c35ab23c454c8bd149d87b2b098f5cb4f219c1dbf59b482: Status 404 returned error can't find the container with id 98c871c8c77da20a1c35ab23c454c8bd149d87b2b098f5cb4f219c1dbf59b482
Jul 07 17:42:15.855704 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:15.855623    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-ce87c9-69dd78c58f-2rzpr" event={"ID":"93341c34-1ed4-47a0-af89-23e48bfc5da6","Type":"ContainerStarted","Data":"98c871c8c77da20a1c35ab23c454c8bd149d87b2b098f5cb4f219c1dbf59b482"}
Jul 07 17:42:15.889886 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:15.889859    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:16.014646 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:16.014476    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:16.868508 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:16.868468    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-ce87c9-69dd78c58f-2rzpr" event={"ID":"93341c34-1ed4-47a0-af89-23e48bfc5da6","Type":"ContainerStarted","Data":"733fdae7567e01702f06db8f8cf3dfe841105948f40ac9f3d66d1de530958705"}
Jul 07 17:42:16.868901 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:16.868649    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-api-e2e-shared-b-ce87c9-69dd78c58f-2rzpr"
Jul 07 17:42:19.443399 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:19.443369    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:20.797355 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:20.797317    2562 patch_prober.go:28] interesting pod/e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 07 17:42:20.797773 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:20.797381    2562 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz" podUID="0c1513f3-4907-445e-aed7-0b9f31b07f92" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 07 17:42:20.894294 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:20.894263    2562 generic.go:356] "Generic (PLEG): container finished" podID="0c1513f3-4907-445e-aed7-0b9f31b07f92" containerID="ee67d18a54ef78dad6e7613112493470326ac7d25caae8ff1714aed1399e4010" exitCode=0
Jul 07 17:42:20.894485 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:20.894340    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz" event={"ID":"0c1513f3-4907-445e-aed7-0b9f31b07f92","Type":"ContainerDied","Data":"ee67d18a54ef78dad6e7613112493470326ac7d25caae8ff1714aed1399e4010"}
Jul 07 17:42:20.894749 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:20.894736    2562 scope.go:117] "RemoveContainer" containerID="ee67d18a54ef78dad6e7613112493470326ac7d25caae8ff1714aed1399e4010"
Jul 07 17:42:20.895800 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:20.895772    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 17:42:20.895865 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:20.895851    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 17:42:20.895917 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:20.895887    2562 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"}
Jul 07 17:42:20.925104 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:20.925053    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-api-e2e-shared-b-ce87c9-69dd78c58f-2rzpr" podStartSLOduration=6.631696715 podStartE2EDuration="6.925036382s" totalImagesPullingTime="293.339667ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-07 17:42:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:42:16.934485615 +0000 UTC m=+2061.657738814" watchObservedRunningTime="2026-07-07 17:42:20.925036382 +0000 UTC m=+2065.648289580"
Jul 07 17:42:21.901854 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:21.901821    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz" event={"ID":"0c1513f3-4907-445e-aed7-0b9f31b07f92","Type":"ContainerStarted","Data":"4fb74aae30a6a03f5937cf95dab270c11bab96447f4e1f30b5024fffc964213d"}
Jul 07 17:42:22.226510 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:22.226403    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz"
Jul 07 17:42:22.226700 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:22.226546    2562 patch_prober.go:28] interesting pod/e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 07 17:42:22.226700 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:22.226593    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz" podUID="0c1513f3-4907-445e-aed7-0b9f31b07f92" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 07 17:42:22.883497 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:22.883463    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-api-e2e-shared-b-ce87c9-69dd78c58f-2rzpr"
Jul 07 17:42:23.226758 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:23.226645    2562 patch_prober.go:28] interesting pod/e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 07 17:42:23.226758 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:23.226731    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz" podUID="0c1513f3-4907-445e-aed7-0b9f31b07f92" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 07 17:42:24.226928 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:24.226884    2562 patch_prober.go:28] interesting pod/e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 07 17:42:24.227600 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:24.227561    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz" podUID="0c1513f3-4907-445e-aed7-0b9f31b07f92" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 07 17:42:25.227461 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:25.227413    2562 patch_prober.go:28] interesting pod/e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 07 17:42:25.227972 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:25.227490    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz" podUID="0c1513f3-4907-445e-aed7-0b9f31b07f92" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 07 17:42:26.226854 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:26.226801    2562 patch_prober.go:28] interesting pod/e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused" start-of-body=
Jul 07 17:42:26.227047 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:26.226884    2562 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz" podUID="0c1513f3-4907-445e-aed7-0b9f31b07f92" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.133.0.59:15021/healthz/ready\": dial tcp 10.133.0.59:15021: connect: connection refused"
Jul 07 17:42:26.994526 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:26.994485    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:27.230928 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:27.230895    2562 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz"
Jul 07 17:42:27.231210 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:27.231191    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz"
Jul 07 17:42:27.231938 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:27.231917    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz"
Jul 07 17:42:29.358613 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:29.358574    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:29.460691 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:29.460660    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:33.050266 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:33.050235    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:36.921619 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:36.921583    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:37.022948 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:37.022909    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:42:59.552067 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:42:59.552032    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:43:19.974499 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:43:19.974464    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:43:21.111566 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:43:21.111531    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:44:50.952831 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:44:50.952789    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:45:00.430348 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:45:00.430312    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:45:01.365734 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:45:01.365700    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:45:10.319389 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:45:10.319355    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:45:29.473981 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:45:29.473894    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:46:20.852459 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:46:20.852423    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:46:21.888617 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:46:21.888583    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:46:33.417617 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:46:33.417580    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:46:43.212060 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:46:43.212024    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:46:43.311995 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:46:43.311961    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:46:58.151001 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:46:58.150960    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:47:30.423145 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:47:30.423095    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:47:30.527103 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:47:30.527070    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:47:37.776358 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:47:37.776315    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:47:37.864754 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:47:37.864716    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:47:44.994811 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:47:44.994774    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:47:45.829448 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:47:45.829415    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:48:05.073392 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:05.073350    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:48:05.525994 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:05.525964    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:48:05.675507 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:05.675464    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:48:05.798124 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:05.798036    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:48:06.031550 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:06.031515    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-19c9b1-757f4cc774-z9x2j"]
Jul 07 17:48:06.031782 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:06.031757    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-a-19c9b1-757f4cc774-z9x2j" podUID="e99aecb9-30b9-41f3-9fae-a83212b73f14" containerName="maas-api" containerID="cri-o://a2e6697d4c5c88a10ec6cd9881d67ad8ac35c5eecedc1135fa24ce1123357198" gracePeriod=30
Jul 07 17:48:06.115990 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:06.115906    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:48:06.292553 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:06.292523    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-19c9b1-757f4cc774-z9x2j"
Jul 07 17:48:06.448799 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:06.448754    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2vhph\" (UniqueName: \"kubernetes.io/projected/e99aecb9-30b9-41f3-9fae-a83212b73f14-kube-api-access-2vhph\") pod \"e99aecb9-30b9-41f3-9fae-a83212b73f14\" (UID: \"e99aecb9-30b9-41f3-9fae-a83212b73f14\") "
Jul 07 17:48:06.449039 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:06.448862    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e99aecb9-30b9-41f3-9fae-a83212b73f14-maas-api-tls\") pod \"e99aecb9-30b9-41f3-9fae-a83212b73f14\" (UID: \"e99aecb9-30b9-41f3-9fae-a83212b73f14\") "
Jul 07 17:48:06.449039 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:06.448903    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e99aecb9-30b9-41f3-9fae-a83212b73f14-openshift-service-ca\") pod \"e99aecb9-30b9-41f3-9fae-a83212b73f14\" (UID: \"e99aecb9-30b9-41f3-9fae-a83212b73f14\") "
Jul 07 17:48:06.449390 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:06.449363    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e99aecb9-30b9-41f3-9fae-a83212b73f14-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "e99aecb9-30b9-41f3-9fae-a83212b73f14" (UID: "e99aecb9-30b9-41f3-9fae-a83212b73f14"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:48:06.450997 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:06.450968    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e99aecb9-30b9-41f3-9fae-a83212b73f14-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "e99aecb9-30b9-41f3-9fae-a83212b73f14" (UID: "e99aecb9-30b9-41f3-9fae-a83212b73f14"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:48:06.451121 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:06.451039    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e99aecb9-30b9-41f3-9fae-a83212b73f14-kube-api-access-2vhph" (OuterVolumeSpecName: "kube-api-access-2vhph") pod "e99aecb9-30b9-41f3-9fae-a83212b73f14" (UID: "e99aecb9-30b9-41f3-9fae-a83212b73f14"). InnerVolumeSpecName "kube-api-access-2vhph". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:48:06.549957 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:06.549914    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2vhph\" (UniqueName: \"kubernetes.io/projected/e99aecb9-30b9-41f3-9fae-a83212b73f14-kube-api-access-2vhph\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:48:06.549957 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:06.549950    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/e99aecb9-30b9-41f3-9fae-a83212b73f14-maas-api-tls\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:48:06.549957 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:06.549962    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/e99aecb9-30b9-41f3-9fae-a83212b73f14-openshift-service-ca\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:48:06.684243 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:06.684203    2562 generic.go:356] "Generic (PLEG): container finished" podID="e99aecb9-30b9-41f3-9fae-a83212b73f14" containerID="a2e6697d4c5c88a10ec6cd9881d67ad8ac35c5eecedc1135fa24ce1123357198" exitCode=0
Jul 07 17:48:06.684443 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:06.684255    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-a-19c9b1-757f4cc774-z9x2j"
Jul 07 17:48:06.684443 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:06.684288    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-19c9b1-757f4cc774-z9x2j" event={"ID":"e99aecb9-30b9-41f3-9fae-a83212b73f14","Type":"ContainerDied","Data":"a2e6697d4c5c88a10ec6cd9881d67ad8ac35c5eecedc1135fa24ce1123357198"}
Jul 07 17:48:06.684443 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:06.684337    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-a-19c9b1-757f4cc774-z9x2j" event={"ID":"e99aecb9-30b9-41f3-9fae-a83212b73f14","Type":"ContainerDied","Data":"83d8e9bfd3783fc792ac77d40da901bf7780ccd7d41079c5721aeb47b3616275"}
Jul 07 17:48:06.684443 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:06.684358    2562 scope.go:117] "RemoveContainer" containerID="a2e6697d4c5c88a10ec6cd9881d67ad8ac35c5eecedc1135fa24ce1123357198"
Jul 07 17:48:06.696626 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:06.696605    2562 scope.go:117] "RemoveContainer" containerID="a2e6697d4c5c88a10ec6cd9881d67ad8ac35c5eecedc1135fa24ce1123357198"
Jul 07 17:48:06.696916 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:48:06.696897    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a2e6697d4c5c88a10ec6cd9881d67ad8ac35c5eecedc1135fa24ce1123357198\": container with ID starting with a2e6697d4c5c88a10ec6cd9881d67ad8ac35c5eecedc1135fa24ce1123357198 not found: ID does not exist" containerID="a2e6697d4c5c88a10ec6cd9881d67ad8ac35c5eecedc1135fa24ce1123357198"
Jul 07 17:48:06.696990 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:06.696924    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a2e6697d4c5c88a10ec6cd9881d67ad8ac35c5eecedc1135fa24ce1123357198"} err="failed to get container status \"a2e6697d4c5c88a10ec6cd9881d67ad8ac35c5eecedc1135fa24ce1123357198\": rpc error: code = NotFound desc = could not find container \"a2e6697d4c5c88a10ec6cd9881d67ad8ac35c5eecedc1135fa24ce1123357198\": container with ID starting with a2e6697d4c5c88a10ec6cd9881d67ad8ac35c5eecedc1135fa24ce1123357198 not found: ID does not exist"
Jul 07 17:48:06.715805 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:06.715720    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-19c9b1-757f4cc774-z9x2j"]
Jul 07 17:48:06.719946 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:06.719920    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-a-19c9b1-757f4cc774-z9x2j"]
Jul 07 17:48:07.846330 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:07.846297    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e99aecb9-30b9-41f3-9fae-a83212b73f14" path="/var/lib/kubelet/pods/e99aecb9-30b9-41f3-9fae-a83212b73f14/volumes"
Jul 07 17:48:12.624135 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:12.624101    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:48:12.731597 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:12.731567    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:48:12.921382 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:12.921349    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz"]
Jul 07 17:48:12.921586 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:12.921562    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz" podUID="0c1513f3-4907-445e-aed7-0b9f31b07f92" containerName="istio-proxy" containerID="cri-o://4fb74aae30a6a03f5937cf95dab270c11bab96447f4e1f30b5024fffc964213d" gracePeriod=30
Jul 07 17:48:12.960378 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:12.960343    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:48:13.189219 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:13.189134    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:48:13.515429 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:13.515342    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:48:13.906938 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:13.906890    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:48:14.071311 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:14.071280    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:48:14.192333 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:14.192233    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:48:14.318735 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:14.318694    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-ce87c9-69dd78c58f-2rzpr"]
Jul 07 17:48:14.319107 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:14.319071    2562 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-api-e2e-shared-b-ce87c9-69dd78c58f-2rzpr" podUID="93341c34-1ed4-47a0-af89-23e48bfc5da6" containerName="maas-api" containerID="cri-o://733fdae7567e01702f06db8f8cf3dfe841105948f40ac9f3d66d1de530958705" gracePeriod=30
Jul 07 17:48:14.381839 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:14.381812    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:48:14.570786 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:14.570764    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-ce87c9-69dd78c58f-2rzpr"
Jul 07 17:48:14.614066 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:14.614028    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wd7np\" (UniqueName: \"kubernetes.io/projected/93341c34-1ed4-47a0-af89-23e48bfc5da6-kube-api-access-wd7np\") pod \"93341c34-1ed4-47a0-af89-23e48bfc5da6\" (UID: \"93341c34-1ed4-47a0-af89-23e48bfc5da6\") "
Jul 07 17:48:14.614277 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:14.614082    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93341c34-1ed4-47a0-af89-23e48bfc5da6-maas-api-tls\") pod \"93341c34-1ed4-47a0-af89-23e48bfc5da6\" (UID: \"93341c34-1ed4-47a0-af89-23e48bfc5da6\") "
Jul 07 17:48:14.614277 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:14.614122    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93341c34-1ed4-47a0-af89-23e48bfc5da6-openshift-service-ca\") pod \"93341c34-1ed4-47a0-af89-23e48bfc5da6\" (UID: \"93341c34-1ed4-47a0-af89-23e48bfc5da6\") "
Jul 07 17:48:14.614616 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:14.614588    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/93341c34-1ed4-47a0-af89-23e48bfc5da6-openshift-service-ca" (OuterVolumeSpecName: "openshift-service-ca") pod "93341c34-1ed4-47a0-af89-23e48bfc5da6" (UID: "93341c34-1ed4-47a0-af89-23e48bfc5da6"). InnerVolumeSpecName "openshift-service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:48:14.616811 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:14.616777    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/93341c34-1ed4-47a0-af89-23e48bfc5da6-maas-api-tls" (OuterVolumeSpecName: "maas-api-tls") pod "93341c34-1ed4-47a0-af89-23e48bfc5da6" (UID: "93341c34-1ed4-47a0-af89-23e48bfc5da6"). InnerVolumeSpecName "maas-api-tls". PluginName "kubernetes.io/secret", VolumeGIDValue ""
Jul 07 17:48:14.616901 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:14.616816    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/93341c34-1ed4-47a0-af89-23e48bfc5da6-kube-api-access-wd7np" (OuterVolumeSpecName: "kube-api-access-wd7np") pod "93341c34-1ed4-47a0-af89-23e48bfc5da6" (UID: "93341c34-1ed4-47a0-af89-23e48bfc5da6"). InnerVolumeSpecName "kube-api-access-wd7np". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:48:14.715585 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:14.715548    2562 reconciler_common.go:299] "Volume detached for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/93341c34-1ed4-47a0-af89-23e48bfc5da6-maas-api-tls\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:48:14.715585 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:14.715579    2562 reconciler_common.go:299] "Volume detached for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/93341c34-1ed4-47a0-af89-23e48bfc5da6-openshift-service-ca\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:48:14.715585 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:14.715590    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wd7np\" (UniqueName: \"kubernetes.io/projected/93341c34-1ed4-47a0-af89-23e48bfc5da6-kube-api-access-wd7np\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:48:14.726645 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:14.726612    2562 generic.go:356] "Generic (PLEG): container finished" podID="93341c34-1ed4-47a0-af89-23e48bfc5da6" containerID="733fdae7567e01702f06db8f8cf3dfe841105948f40ac9f3d66d1de530958705" exitCode=0
Jul 07 17:48:14.726777 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:14.726666    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-api-e2e-shared-b-ce87c9-69dd78c58f-2rzpr"
Jul 07 17:48:14.726777 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:14.726700    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-ce87c9-69dd78c58f-2rzpr" event={"ID":"93341c34-1ed4-47a0-af89-23e48bfc5da6","Type":"ContainerDied","Data":"733fdae7567e01702f06db8f8cf3dfe841105948f40ac9f3d66d1de530958705"}
Jul 07 17:48:14.726777 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:14.726761    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-api-e2e-shared-b-ce87c9-69dd78c58f-2rzpr" event={"ID":"93341c34-1ed4-47a0-af89-23e48bfc5da6","Type":"ContainerDied","Data":"98c871c8c77da20a1c35ab23c454c8bd149d87b2b098f5cb4f219c1dbf59b482"}
Jul 07 17:48:14.726880 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:14.726785    2562 scope.go:117] "RemoveContainer" containerID="733fdae7567e01702f06db8f8cf3dfe841105948f40ac9f3d66d1de530958705"
Jul 07 17:48:14.735607 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:14.735586    2562 scope.go:117] "RemoveContainer" containerID="733fdae7567e01702f06db8f8cf3dfe841105948f40ac9f3d66d1de530958705"
Jul 07 17:48:14.735878 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:48:14.735858    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"733fdae7567e01702f06db8f8cf3dfe841105948f40ac9f3d66d1de530958705\": container with ID starting with 733fdae7567e01702f06db8f8cf3dfe841105948f40ac9f3d66d1de530958705 not found: ID does not exist" containerID="733fdae7567e01702f06db8f8cf3dfe841105948f40ac9f3d66d1de530958705"
Jul 07 17:48:14.735949 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:14.735888    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"733fdae7567e01702f06db8f8cf3dfe841105948f40ac9f3d66d1de530958705"} err="failed to get container status \"733fdae7567e01702f06db8f8cf3dfe841105948f40ac9f3d66d1de530958705\": rpc error: code = NotFound desc = could not find container \"733fdae7567e01702f06db8f8cf3dfe841105948f40ac9f3d66d1de530958705\": container with ID starting with 733fdae7567e01702f06db8f8cf3dfe841105948f40ac9f3d66d1de530958705 not found: ID does not exist"
Jul 07 17:48:14.751454 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:14.751389    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-ce87c9-69dd78c58f-2rzpr"]
Jul 07 17:48:14.757042 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:14.757016    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-api-e2e-shared-b-ce87c9-69dd78c58f-2rzpr"]
Jul 07 17:48:15.846227 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:15.846192    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="93341c34-1ed4-47a0-af89-23e48bfc5da6" path="/var/lib/kubelet/pods/93341c34-1ed4-47a0-af89-23e48bfc5da6/volumes"
Jul 07 17:48:18.173870 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:18.173844    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz"
Jul 07 17:48:18.240583 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:18.240492    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c1513f3-4907-445e-aed7-0b9f31b07f92-istio-envoy\") pod \"0c1513f3-4907-445e-aed7-0b9f31b07f92\" (UID: \"0c1513f3-4907-445e-aed7-0b9f31b07f92\") "
Jul 07 17:48:18.240583 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:18.240536    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c1513f3-4907-445e-aed7-0b9f31b07f92-istio-data\") pod \"0c1513f3-4907-445e-aed7-0b9f31b07f92\" (UID: \"0c1513f3-4907-445e-aed7-0b9f31b07f92\") "
Jul 07 17:48:18.240583 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:18.240562    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9pns5\" (UniqueName: \"kubernetes.io/projected/0c1513f3-4907-445e-aed7-0b9f31b07f92-kube-api-access-9pns5\") pod \"0c1513f3-4907-445e-aed7-0b9f31b07f92\" (UID: \"0c1513f3-4907-445e-aed7-0b9f31b07f92\") "
Jul 07 17:48:18.240861 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:18.240591    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c1513f3-4907-445e-aed7-0b9f31b07f92-istio-token\") pod \"0c1513f3-4907-445e-aed7-0b9f31b07f92\" (UID: \"0c1513f3-4907-445e-aed7-0b9f31b07f92\") "
Jul 07 17:48:18.240861 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:18.240664    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c1513f3-4907-445e-aed7-0b9f31b07f92-istio-podinfo\") pod \"0c1513f3-4907-445e-aed7-0b9f31b07f92\" (UID: \"0c1513f3-4907-445e-aed7-0b9f31b07f92\") "
Jul 07 17:48:18.240861 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:18.240688    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c1513f3-4907-445e-aed7-0b9f31b07f92-istiod-ca-cert\") pod \"0c1513f3-4907-445e-aed7-0b9f31b07f92\" (UID: \"0c1513f3-4907-445e-aed7-0b9f31b07f92\") "
Jul 07 17:48:18.240861 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:18.240716    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c1513f3-4907-445e-aed7-0b9f31b07f92-workload-certs\") pod \"0c1513f3-4907-445e-aed7-0b9f31b07f92\" (UID: \"0c1513f3-4907-445e-aed7-0b9f31b07f92\") "
Jul 07 17:48:18.241061 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:18.241005    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c1513f3-4907-445e-aed7-0b9f31b07f92-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0c1513f3-4907-445e-aed7-0b9f31b07f92" (UID: "0c1513f3-4907-445e-aed7-0b9f31b07f92"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:48:18.241115 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:18.241077    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0c1513f3-4907-445e-aed7-0b9f31b07f92-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0c1513f3-4907-445e-aed7-0b9f31b07f92" (UID: "0c1513f3-4907-445e-aed7-0b9f31b07f92"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue ""
Jul 07 17:48:18.241115 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:18.241090    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c1513f3-4907-445e-aed7-0b9f31b07f92-workload-socket\") pod \"0c1513f3-4907-445e-aed7-0b9f31b07f92\" (UID: \"0c1513f3-4907-445e-aed7-0b9f31b07f92\") "
Jul 07 17:48:18.241349 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:18.241306    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c1513f3-4907-445e-aed7-0b9f31b07f92-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0c1513f3-4907-445e-aed7-0b9f31b07f92" (UID: "0c1513f3-4907-445e-aed7-0b9f31b07f92"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:48:18.241419 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:18.241400    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c1513f3-4907-445e-aed7-0b9f31b07f92-istio-data" (OuterVolumeSpecName: "istio-data") pod "0c1513f3-4907-445e-aed7-0b9f31b07f92" (UID: "0c1513f3-4907-445e-aed7-0b9f31b07f92"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:48:18.241585 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:18.241565    2562 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0c1513f3-4907-445e-aed7-0b9f31b07f92-istio-data\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:48:18.241622 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:18.241593    2562 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0c1513f3-4907-445e-aed7-0b9f31b07f92-istiod-ca-cert\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:48:18.241622 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:18.241607    2562 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0c1513f3-4907-445e-aed7-0b9f31b07f92-workload-certs\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:48:18.241692 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:18.241621    2562 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c1513f3-4907-445e-aed7-0b9f31b07f92-workload-socket\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:48:18.242862 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:18.242837    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0c1513f3-4907-445e-aed7-0b9f31b07f92-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0c1513f3-4907-445e-aed7-0b9f31b07f92" (UID: "0c1513f3-4907-445e-aed7-0b9f31b07f92"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue ""
Jul 07 17:48:18.242959 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:18.242857    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c1513f3-4907-445e-aed7-0b9f31b07f92-kube-api-access-9pns5" (OuterVolumeSpecName: "kube-api-access-9pns5") pod "0c1513f3-4907-445e-aed7-0b9f31b07f92" (UID: "0c1513f3-4907-445e-aed7-0b9f31b07f92"). InnerVolumeSpecName "kube-api-access-9pns5". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:48:18.243121 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:18.243099    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c1513f3-4907-445e-aed7-0b9f31b07f92-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0c1513f3-4907-445e-aed7-0b9f31b07f92" (UID: "0c1513f3-4907-445e-aed7-0b9f31b07f92"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:48:18.243212 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:18.243125    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0c1513f3-4907-445e-aed7-0b9f31b07f92-istio-token" (OuterVolumeSpecName: "istio-token") pod "0c1513f3-4907-445e-aed7-0b9f31b07f92" (UID: "0c1513f3-4907-445e-aed7-0b9f31b07f92"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue ""
Jul 07 17:48:18.342450 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:18.342416    2562 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c1513f3-4907-445e-aed7-0b9f31b07f92-credential-socket\") pod \"0c1513f3-4907-445e-aed7-0b9f31b07f92\" (UID: \"0c1513f3-4907-445e-aed7-0b9f31b07f92\") "
Jul 07 17:48:18.342654 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:18.342569    2562 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0c1513f3-4907-445e-aed7-0b9f31b07f92-istio-podinfo\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:48:18.342654 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:18.342581    2562 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0c1513f3-4907-445e-aed7-0b9f31b07f92-istio-envoy\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:48:18.342654 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:18.342589    2562 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9pns5\" (UniqueName: \"kubernetes.io/projected/0c1513f3-4907-445e-aed7-0b9f31b07f92-kube-api-access-9pns5\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:48:18.342654 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:18.342600    2562 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0c1513f3-4907-445e-aed7-0b9f31b07f92-istio-token\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:48:18.342845 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:18.342750    2562 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0c1513f3-4907-445e-aed7-0b9f31b07f92-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0c1513f3-4907-445e-aed7-0b9f31b07f92" (UID: "0c1513f3-4907-445e-aed7-0b9f31b07f92"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue ""
Jul 07 17:48:18.443178 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:18.443126    2562 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0c1513f3-4907-445e-aed7-0b9f31b07f92-credential-socket\") on node \"ip-10-0-140-36.ec2.internal\" DevicePath \"\""
Jul 07 17:48:18.748231 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:18.748196    2562 generic.go:356] "Generic (PLEG): container finished" podID="0c1513f3-4907-445e-aed7-0b9f31b07f92" containerID="4fb74aae30a6a03f5937cf95dab270c11bab96447f4e1f30b5024fffc964213d" exitCode=0
Jul 07 17:48:18.748419 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:18.748243    2562 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz"
Jul 07 17:48:18.748419 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:18.748277    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz" event={"ID":"0c1513f3-4907-445e-aed7-0b9f31b07f92","Type":"ContainerDied","Data":"4fb74aae30a6a03f5937cf95dab270c11bab96447f4e1f30b5024fffc964213d"}
Jul 07 17:48:18.748419 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:18.748334    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz" event={"ID":"0c1513f3-4907-445e-aed7-0b9f31b07f92","Type":"ContainerDied","Data":"f73a829284fe320a32ca7dec20bc1febe30791077235fbff8d10489172ff206c"}
Jul 07 17:48:18.748419 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:18.748358    2562 scope.go:117] "RemoveContainer" containerID="4fb74aae30a6a03f5937cf95dab270c11bab96447f4e1f30b5024fffc964213d"
Jul 07 17:48:18.757223 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:18.757202    2562 scope.go:117] "RemoveContainer" containerID="ee67d18a54ef78dad6e7613112493470326ac7d25caae8ff1714aed1399e4010"
Jul 07 17:48:18.765557 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:18.765539    2562 scope.go:117] "RemoveContainer" containerID="4fb74aae30a6a03f5937cf95dab270c11bab96447f4e1f30b5024fffc964213d"
Jul 07 17:48:18.765827 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:48:18.765808    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4fb74aae30a6a03f5937cf95dab270c11bab96447f4e1f30b5024fffc964213d\": container with ID starting with 4fb74aae30a6a03f5937cf95dab270c11bab96447f4e1f30b5024fffc964213d not found: ID does not exist" containerID="4fb74aae30a6a03f5937cf95dab270c11bab96447f4e1f30b5024fffc964213d"
Jul 07 17:48:18.765871 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:18.765837    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4fb74aae30a6a03f5937cf95dab270c11bab96447f4e1f30b5024fffc964213d"} err="failed to get container status \"4fb74aae30a6a03f5937cf95dab270c11bab96447f4e1f30b5024fffc964213d\": rpc error: code = NotFound desc = could not find container \"4fb74aae30a6a03f5937cf95dab270c11bab96447f4e1f30b5024fffc964213d\": container with ID starting with 4fb74aae30a6a03f5937cf95dab270c11bab96447f4e1f30b5024fffc964213d not found: ID does not exist"
Jul 07 17:48:18.765871 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:18.765854    2562 scope.go:117] "RemoveContainer" containerID="ee67d18a54ef78dad6e7613112493470326ac7d25caae8ff1714aed1399e4010"
Jul 07 17:48:18.766128 ip-10-0-140-36 kubenswrapper[2562]: E0707 17:48:18.766110    2562 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ee67d18a54ef78dad6e7613112493470326ac7d25caae8ff1714aed1399e4010\": container with ID starting with ee67d18a54ef78dad6e7613112493470326ac7d25caae8ff1714aed1399e4010 not found: ID does not exist" containerID="ee67d18a54ef78dad6e7613112493470326ac7d25caae8ff1714aed1399e4010"
Jul 07 17:48:18.766308 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:18.766132    2562 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ee67d18a54ef78dad6e7613112493470326ac7d25caae8ff1714aed1399e4010"} err="failed to get container status \"ee67d18a54ef78dad6e7613112493470326ac7d25caae8ff1714aed1399e4010\": rpc error: code = NotFound desc = could not find container \"ee67d18a54ef78dad6e7613112493470326ac7d25caae8ff1714aed1399e4010\": container with ID starting with ee67d18a54ef78dad6e7613112493470326ac7d25caae8ff1714aed1399e4010 not found: ID does not exist"
Jul 07 17:48:18.775850 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:18.775825    2562 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz"]
Jul 07 17:48:18.784780 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:18.784758    2562 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-19c9b1-openshift-default-757f99db95-czftz"]
Jul 07 17:48:19.846944 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:19.846910    2562 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0c1513f3-4907-445e-aed7-0b9f31b07f92" path="/var/lib/kubelet/pods/0c1513f3-4907-445e-aed7-0b9f31b07f92/volumes"
Jul 07 17:48:21.287543 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:21.287494    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:48:22.615812 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:22.615777    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:48:27.495338 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:27.495302    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5788c58957-9tq9b_44ff424e-d29a-4229-968c-ae86f65cb19e/maas-api/0.log"
Jul 07 17:48:27.620148 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:27.620115    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29724090-cqv6v_2cf4e327-d785-4810-bd94-fff3ae50f434/cleanup/0.log"
Jul 07 17:48:27.870298 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:27.870216    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-dbcbb4f4b-xz2qg_6bab73cc-c48d-4359-809e-977f5c417d85/manager/0.log"
Jul 07 17:48:28.256611 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:28.256580    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-547959ffc4-8x76w_cae1f224-869f-4558-9b34-38184743d1d8/copy-manifests/0.log"
Jul 07 17:48:28.271483 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:28.271454    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-547959ffc4-8x76w_cae1f224-869f-4558-9b34-38184743d1d8/manager/0.log"
Jul 07 17:48:28.666409 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:28.666371    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-cft47_0613eb33-16af-40c7-a1f4-07e500ad6297/postgres/0.log"
Jul 07 17:48:30.259605 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:30.259577    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-9cwjl_a57c5767-30a4-4804-b12a-406fa1899eec/manager/0.log"
Jul 07 17:48:30.382489 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:30.382458    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-xjbxl_1c8f7d52-5743-4342-b497-b0008d71213d/manager/0.log"
Jul 07 17:48:30.631714 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:30.631691    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-8bbxd_3f6171be-c288-415e-99db-869bde16f7cd/registry-server/0.log"
Jul 07 17:48:30.760689 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:30.760655    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-r82t6_97c9de77-1237-4d8e-8744-511366b65e34/manager/0.log"
Jul 07 17:48:31.022928 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:31.022849    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-9xnxv_c4526c3c-5ede-4598-8432-69123eed54a8/manager/0.log"
Jul 07 17:48:31.531529 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:31.531499    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-hp895_3d14af82-dbb8-4b37-affd-70fe540dbc72/discovery/0.log"
Jul 07 17:48:31.916069 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:31.916042    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-r98nz_485365e1-7cb4-4143-ad07-4c33e2257b7a/istio-proxy/1.log"
Jul 07 17:48:32.041559 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:32.041529    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-rq7vq_5c736238-7320-469b-a304-c64f27e464e8/payload-pre-processing/0.log"
Jul 07 17:48:32.177040 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:32.176956    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-2d2d5_401c9525-9b61-4fbe-9692-8815029a9de2/payload-processing/0.log"
Jul 07 17:48:32.300937 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:32.300898    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-675c858bdf-2tgn6_dd7890b5-693f-4e12-a5e6-feb4ab62a25b/router/0.log"
Jul 07 17:48:32.679344 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:32.679308    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:48:32.681458 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:32.681435    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-cs99k_9ecd5589-20a1-49fe-87d7-51cdb0bfcb7f/main/0.log"
Jul 07 17:48:32.938463 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:32.938365    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-77lb5_b3c55cec-17af-481f-973f-7fb262e0e859/main/0.log"
Jul 07 17:48:33.206018 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:33.205922    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-jrz46_f16cb088-5e71-4214-946a-040fd3750cbc/main/0.log"
Jul 07 17:48:38.213120 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:38.213086    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:48:38.297046 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:38.297006    2562 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log" limit=1024
Jul 07 17:48:41.155298 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:41.155265    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-mhc8x_c1a36a2e-2dad-43d1-b604-e538cc26c66d/global-pull-secret-syncer/0.log"
Jul 07 17:48:41.266657 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:41.266628    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-28xn9_50fc3df0-8a43-48db-9b3e-80d9bd4c03eb/konnectivity-agent/0.log"
Jul 07 17:48:41.390824 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:41.390790    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-140-36.ec2.internal_49aaaf0707b9d67c20e84f9fb50f9adf/haproxy/0.log"
Jul 07 17:48:46.220557 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:46.220525    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-9cwjl_a57c5767-30a4-4804-b12a-406fa1899eec/manager/0.log"
Jul 07 17:48:46.257943 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:46.257907    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-xjbxl_1c8f7d52-5743-4342-b497-b0008d71213d/manager/0.log"
Jul 07 17:48:46.354793 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:46.354757    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-8bbxd_3f6171be-c288-415e-99db-869bde16f7cd/registry-server/0.log"
Jul 07 17:48:46.443063 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:46.443027    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-r82t6_97c9de77-1237-4d8e-8744-511366b65e34/manager/0.log"
Jul 07 17:48:46.544766 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:46.544676    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-9xnxv_c4526c3c-5ede-4598-8432-69123eed54a8/manager/0.log"
Jul 07 17:48:48.610818 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:48.610785    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-64786d9cbb-h6qjb_278dfd1c-402a-4f6f-8772-694c8c9e22b0/cluster-monitoring-operator/0.log"
Jul 07 17:48:49.030093 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:49.030063    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mcln4_0f99cba8-fd36-4a97-8177-7212383855fe/node-exporter/0.log"
Jul 07 17:48:49.054914 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:49.054880    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mcln4_0f99cba8-fd36-4a97-8177-7212383855fe/kube-rbac-proxy/0.log"
Jul 07 17:48:49.084651 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:49.084626    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-mcln4_0f99cba8-fd36-4a97-8177-7212383855fe/init-textfile/0.log"
Jul 07 17:48:51.030691 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:51.030644    2562 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-47h5d/perf-node-gather-daemonset-gff4w"]
Jul 07 17:48:51.031089 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:51.031054    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e99aecb9-30b9-41f3-9fae-a83212b73f14" containerName="maas-api"
Jul 07 17:48:51.031089 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:51.031069    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="e99aecb9-30b9-41f3-9fae-a83212b73f14" containerName="maas-api"
Jul 07 17:48:51.031089 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:51.031078    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c1513f3-4907-445e-aed7-0b9f31b07f92" containerName="istio-proxy"
Jul 07 17:48:51.031089 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:51.031084    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c1513f3-4907-445e-aed7-0b9f31b07f92" containerName="istio-proxy"
Jul 07 17:48:51.031273 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:51.031093    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="93341c34-1ed4-47a0-af89-23e48bfc5da6" containerName="maas-api"
Jul 07 17:48:51.031273 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:51.031099    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="93341c34-1ed4-47a0-af89-23e48bfc5da6" containerName="maas-api"
Jul 07 17:48:51.031273 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:51.031106    2562 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0c1513f3-4907-445e-aed7-0b9f31b07f92" containerName="istio-proxy"
Jul 07 17:48:51.031273 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:51.031112    2562 state_mem.go:107] "Deleted CPUSet assignment" podUID="0c1513f3-4907-445e-aed7-0b9f31b07f92" containerName="istio-proxy"
Jul 07 17:48:51.031273 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:51.031191    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="93341c34-1ed4-47a0-af89-23e48bfc5da6" containerName="maas-api"
Jul 07 17:48:51.031273 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:51.031199    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="e99aecb9-30b9-41f3-9fae-a83212b73f14" containerName="maas-api"
Jul 07 17:48:51.031273 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:51.031207    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c1513f3-4907-445e-aed7-0b9f31b07f92" containerName="istio-proxy"
Jul 07 17:48:51.031273 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:51.031213    2562 memory_manager.go:368] "RemoveStaleState removing state" podUID="0c1513f3-4907-445e-aed7-0b9f31b07f92" containerName="istio-proxy"
Jul 07 17:48:51.034812 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:51.034791    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-47h5d/perf-node-gather-daemonset-gff4w"
Jul 07 17:48:51.037126 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:51.037102    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-47h5d\"/\"kube-root-ca.crt\""
Jul 07 17:48:51.037834 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:51.037808    2562 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-47h5d\"/\"default-dockercfg-mt88j\""
Jul 07 17:48:51.037834 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:51.037825    2562 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-47h5d\"/\"openshift-service-ca.crt\""
Jul 07 17:48:51.047828 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:51.047801    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-47h5d/perf-node-gather-daemonset-gff4w"]
Jul 07 17:48:51.155061 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:51.155024    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d5052bba-2e77-43dd-a0e8-20b9d90a1489-podres\") pod \"perf-node-gather-daemonset-gff4w\" (UID: \"d5052bba-2e77-43dd-a0e8-20b9d90a1489\") " pod="openshift-must-gather-47h5d/perf-node-gather-daemonset-gff4w"
Jul 07 17:48:51.155317 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:51.155069    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d5052bba-2e77-43dd-a0e8-20b9d90a1489-sys\") pod \"perf-node-gather-daemonset-gff4w\" (UID: \"d5052bba-2e77-43dd-a0e8-20b9d90a1489\") " pod="openshift-must-gather-47h5d/perf-node-gather-daemonset-gff4w"
Jul 07 17:48:51.155317 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:51.155248    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d5052bba-2e77-43dd-a0e8-20b9d90a1489-proc\") pod \"perf-node-gather-daemonset-gff4w\" (UID: \"d5052bba-2e77-43dd-a0e8-20b9d90a1489\") " pod="openshift-must-gather-47h5d/perf-node-gather-daemonset-gff4w"
Jul 07 17:48:51.155317 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:51.155305    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-577zk\" (UniqueName: \"kubernetes.io/projected/d5052bba-2e77-43dd-a0e8-20b9d90a1489-kube-api-access-577zk\") pod \"perf-node-gather-daemonset-gff4w\" (UID: \"d5052bba-2e77-43dd-a0e8-20b9d90a1489\") " pod="openshift-must-gather-47h5d/perf-node-gather-daemonset-gff4w"
Jul 07 17:48:51.155477 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:51.155341    2562 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d5052bba-2e77-43dd-a0e8-20b9d90a1489-lib-modules\") pod \"perf-node-gather-daemonset-gff4w\" (UID: \"d5052bba-2e77-43dd-a0e8-20b9d90a1489\") " pod="openshift-must-gather-47h5d/perf-node-gather-daemonset-gff4w"
Jul 07 17:48:51.255791 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:51.255752    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d5052bba-2e77-43dd-a0e8-20b9d90a1489-sys\") pod \"perf-node-gather-daemonset-gff4w\" (UID: \"d5052bba-2e77-43dd-a0e8-20b9d90a1489\") " pod="openshift-must-gather-47h5d/perf-node-gather-daemonset-gff4w"
Jul 07 17:48:51.255974 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:51.255821    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d5052bba-2e77-43dd-a0e8-20b9d90a1489-proc\") pod \"perf-node-gather-daemonset-gff4w\" (UID: \"d5052bba-2e77-43dd-a0e8-20b9d90a1489\") " pod="openshift-must-gather-47h5d/perf-node-gather-daemonset-gff4w"
Jul 07 17:48:51.255974 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:51.255849    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-577zk\" (UniqueName: \"kubernetes.io/projected/d5052bba-2e77-43dd-a0e8-20b9d90a1489-kube-api-access-577zk\") pod \"perf-node-gather-daemonset-gff4w\" (UID: \"d5052bba-2e77-43dd-a0e8-20b9d90a1489\") " pod="openshift-must-gather-47h5d/perf-node-gather-daemonset-gff4w"
Jul 07 17:48:51.255974 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:51.255890    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d5052bba-2e77-43dd-a0e8-20b9d90a1489-lib-modules\") pod \"perf-node-gather-daemonset-gff4w\" (UID: \"d5052bba-2e77-43dd-a0e8-20b9d90a1489\") " pod="openshift-must-gather-47h5d/perf-node-gather-daemonset-gff4w"
Jul 07 17:48:51.255974 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:51.255911    2562 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d5052bba-2e77-43dd-a0e8-20b9d90a1489-podres\") pod \"perf-node-gather-daemonset-gff4w\" (UID: \"d5052bba-2e77-43dd-a0e8-20b9d90a1489\") " pod="openshift-must-gather-47h5d/perf-node-gather-daemonset-gff4w"
Jul 07 17:48:51.255974 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:51.255909    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/d5052bba-2e77-43dd-a0e8-20b9d90a1489-sys\") pod \"perf-node-gather-daemonset-gff4w\" (UID: \"d5052bba-2e77-43dd-a0e8-20b9d90a1489\") " pod="openshift-must-gather-47h5d/perf-node-gather-daemonset-gff4w"
Jul 07 17:48:51.255974 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:51.255909    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/d5052bba-2e77-43dd-a0e8-20b9d90a1489-proc\") pod \"perf-node-gather-daemonset-gff4w\" (UID: \"d5052bba-2e77-43dd-a0e8-20b9d90a1489\") " pod="openshift-must-gather-47h5d/perf-node-gather-daemonset-gff4w"
Jul 07 17:48:51.256208 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:51.256009    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/d5052bba-2e77-43dd-a0e8-20b9d90a1489-lib-modules\") pod \"perf-node-gather-daemonset-gff4w\" (UID: \"d5052bba-2e77-43dd-a0e8-20b9d90a1489\") " pod="openshift-must-gather-47h5d/perf-node-gather-daemonset-gff4w"
Jul 07 17:48:51.256208 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:51.256027    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/d5052bba-2e77-43dd-a0e8-20b9d90a1489-podres\") pod \"perf-node-gather-daemonset-gff4w\" (UID: \"d5052bba-2e77-43dd-a0e8-20b9d90a1489\") " pod="openshift-must-gather-47h5d/perf-node-gather-daemonset-gff4w"
Jul 07 17:48:51.265999 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:51.265966    2562 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-577zk\" (UniqueName: \"kubernetes.io/projected/d5052bba-2e77-43dd-a0e8-20b9d90a1489-kube-api-access-577zk\") pod \"perf-node-gather-daemonset-gff4w\" (UID: \"d5052bba-2e77-43dd-a0e8-20b9d90a1489\") " pod="openshift-must-gather-47h5d/perf-node-gather-daemonset-gff4w"
Jul 07 17:48:51.345447 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:51.345342    2562 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-47h5d/perf-node-gather-daemonset-gff4w"
Jul 07 17:48:51.488122 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:51.488090    2562 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-47h5d/perf-node-gather-daemonset-gff4w"]
Jul 07 17:48:51.490768 ip-10-0-140-36 kubenswrapper[2562]: W0707 17:48:51.490739    2562 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podd5052bba_2e77_43dd_a0e8_20b9d90a1489.slice/crio-76e368f85e2263fc050e80db5b4b3b52b58aa9e710a7891708d272cdc759c8ff WatchSource:0}: Error finding container 76e368f85e2263fc050e80db5b4b3b52b58aa9e710a7891708d272cdc759c8ff: Status 404 returned error can't find the container with id 76e368f85e2263fc050e80db5b4b3b52b58aa9e710a7891708d272cdc759c8ff
Jul 07 17:48:51.911164 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:51.911107    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-47h5d/perf-node-gather-daemonset-gff4w" event={"ID":"d5052bba-2e77-43dd-a0e8-20b9d90a1489","Type":"ContainerStarted","Data":"39dd4ee69265cb647e89b8a570f9673dc20d747da1c27805756c21cfe25085ae"}
Jul 07 17:48:51.911351 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:51.911191    2562 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-47h5d/perf-node-gather-daemonset-gff4w" event={"ID":"d5052bba-2e77-43dd-a0e8-20b9d90a1489","Type":"ContainerStarted","Data":"76e368f85e2263fc050e80db5b4b3b52b58aa9e710a7891708d272cdc759c8ff"}
Jul 07 17:48:51.911351 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:51.911219    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-47h5d/perf-node-gather-daemonset-gff4w"
Jul 07 17:48:51.930974 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:51.930909    2562 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-47h5d/perf-node-gather-daemonset-gff4w" podStartSLOduration=0.930888733 podStartE2EDuration="930.888733ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-07 17:48:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-07 17:48:51.929540304 +0000 UTC m=+2456.652793505" watchObservedRunningTime="2026-07-07 17:48:51.930888733 +0000 UTC m=+2456.654141929"
Jul 07 17:48:52.348868 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:52.348785    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5dbfd647dc-cpj52_c3edf7f7-2daa-4174-89c6-fa29480ac438/console/0.log"
Jul 07 17:48:54.326034 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:54.326003    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qbfqh_19218ca1-9c05-41ac-9c51-978079184615/dns/0.log"
Jul 07 17:48:54.353261 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:54.353230    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-qbfqh_19218ca1-9c05-41ac-9c51-978079184615/kube-rbac-proxy/0.log"
Jul 07 17:48:54.410650 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:54.410618    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-7xdlh_36340fd9-83c5-4baf-b02d-9fc7f5e86485/dns-node-resolver/0.log"
Jul 07 17:48:55.185082 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:55.185050    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-v72rm_79353616-7bb8-4034-b3d5-c59eff433273/node-ca/0.log"
Jul 07 17:48:56.415540 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:56.415508    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-hp895_3d14af82-dbb8-4b37-affd-70fe540dbc72/discovery/0.log"
Jul 07 17:48:56.502411 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:56.502375    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-r98nz_485365e1-7cb4-4143-ad07-4c33e2257b7a/istio-proxy/0.log"
Jul 07 17:48:56.529597 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:56.529561    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-r98nz_485365e1-7cb4-4143-ad07-4c33e2257b7a/istio-proxy/1.log"
Jul 07 17:48:56.571719 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:56.571686    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-rq7vq_5c736238-7320-469b-a304-c64f27e464e8/payload-pre-processing/0.log"
Jul 07 17:48:56.622644 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:56.622613    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-2d2d5_401c9525-9b61-4fbe-9692-8815029a9de2/payload-processing/0.log"
Jul 07 17:48:56.652595 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:56.652566    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-675c858bdf-2tgn6_dd7890b5-693f-4e12-a5e6-feb4ab62a25b/router/0.log"
Jul 07 17:48:57.387244 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:57.387212    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-9vjpm_aee49a54-f7ff-4e57-a35a-ec8e57b1fd33/serve-healthcheck-canary/0.log"
Jul 07 17:48:57.926071 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:57.926045    2562 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-47h5d/perf-node-gather-daemonset-gff4w"
Jul 07 17:48:57.980506 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:57.980470    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-qk5b2_40bee3fc-b922-45bb-ac62-2a9593b07e28/insights-operator/0.log"
Jul 07 17:48:57.981983 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:57.981965    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5c847dcfc4-qk5b2_40bee3fc-b922-45bb-ac62-2a9593b07e28/insights-operator/1.log"
Jul 07 17:48:58.176582 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:58.176502    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zpj9n_00e0f04d-964b-4a21-82cc-5dfd8ad76e8f/kube-rbac-proxy/0.log"
Jul 07 17:48:58.200442 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:58.200414    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zpj9n_00e0f04d-964b-4a21-82cc-5dfd8ad76e8f/exporter/0.log"
Jul 07 17:48:58.223832 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:48:58.223805    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-zpj9n_00e0f04d-964b-4a21-82cc-5dfd8ad76e8f/extractor/0.log"
Jul 07 17:49:00.975037 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:49:00.974953    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-5788c58957-9tq9b_44ff424e-d29a-4229-968c-ae86f65cb19e/maas-api/0.log"
Jul 07 17:49:01.008621 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:49:01.008587    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-api-key-cleanup-29724090-cqv6v_2cf4e327-d785-4810-bd94-fff3ae50f434/cleanup/0.log"
Jul 07 17:49:01.150295 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:49:01.150264    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-dbcbb4f4b-xz2qg_6bab73cc-c48d-4359-809e-977f5c417d85/manager/0.log"
Jul 07 17:49:01.342268 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:49:01.342233    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-547959ffc4-8x76w_cae1f224-869f-4558-9b34-38184743d1d8/manager/0.log"
Jul 07 17:49:01.363309 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:49:01.363285    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-547959ffc4-8x76w_cae1f224-869f-4558-9b34-38184743d1d8/copy-manifests/0.log"
Jul 07 17:49:01.533842 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:49:01.533738    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_postgres-69fb4594cf-cft47_0613eb33-16af-40c7-a1f4-07e500ad6297/postgres/0.log"
Jul 07 17:49:01.775312 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:49:01.775278    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-hp895_3d14af82-dbb8-4b37-affd-70fe540dbc72/discovery/0.log"
Jul 07 17:49:01.824849 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:49:01.824747    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-r98nz_485365e1-7cb4-4143-ad07-4c33e2257b7a/istio-proxy/0.log"
Jul 07 17:49:01.854263 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:49:01.854230    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-r98nz_485365e1-7cb4-4143-ad07-4c33e2257b7a/istio-proxy/1.log"
Jul 07 17:49:01.886277 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:49:01.886218    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-rq7vq_5c736238-7320-469b-a304-c64f27e464e8/payload-pre-processing/0.log"
Jul 07 17:49:01.924761 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:49:01.924714    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-2d2d5_401c9525-9b61-4fbe-9692-8815029a9de2/payload-processing/0.log"
Jul 07 17:49:01.938872 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:49:01.938832    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-675c858bdf-2tgn6_dd7890b5-693f-4e12-a5e6-feb4ab62a25b/router/0.log"
Jul 07 17:49:03.053889 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:49:03.053802    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-x9nsq_b49f36f5-c2a4-4904-89f6-09a675461c08/openshift-lws-operator/0.log"
Jul 07 17:49:03.312978 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:49:03.312881    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-hp895_3d14af82-dbb8-4b37-affd-70fe540dbc72/discovery/0.log"
Jul 07 17:49:03.367622 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:49:03.367592    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-r98nz_485365e1-7cb4-4143-ad07-4c33e2257b7a/istio-proxy/0.log"
Jul 07 17:49:03.393518 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:49:03.393490    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-r98nz_485365e1-7cb4-4143-ad07-4c33e2257b7a/istio-proxy/1.log"
Jul 07 17:49:03.426624 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:49:03.426572    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-7964457696-rq7vq_5c736238-7320-469b-a304-c64f27e464e8/payload-pre-processing/0.log"
Jul 07 17:49:03.466500 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:49:03.466471    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-2d2d5_401c9525-9b61-4fbe-9692-8815029a9de2/payload-processing/0.log"
Jul 07 17:49:03.484697 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:49:03.484669    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-675c858bdf-2tgn6_dd7890b5-693f-4e12-a5e6-feb4ab62a25b/router/0.log"
Jul 07 17:49:08.017338 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:49:08.017305    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-qqrth_f5579872-6ce4-4d01-8e01-0333abf2f07b/migrator/0.log"
Jul 07 17:49:08.041661 ip-10-0-140-36 kubenswrapper[2562]: I0707 17:49:08.041632    2562 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-qqrth_f5579872-6ce4-4d01-8e01-0333abf2f07b/graceful-termination/0.log"